2024-04-11T22:27:25.712063927Z ... 2024-04-11T22:27:26.107929394Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-11T22:27:27.316326396Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-11T22:27:33.286312894Z [2024-04-11T22:27:33.284+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-11T22:27:41.670276738Z 2024-04-11T22:27:42.463268094Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-11T22:27:44.311344286Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-11T22:27:49.287063229Z [2024-04-11 22:27:49 +0000] [15] [INFO] Starting gunicorn 20.1.0 2024-04-11T22:27:49.296792787Z [2024-04-11 22:27:49 +0000] [15] [INFO] Listening at: http://[::]:8793 (15) 2024-04-11T22:27:49.296812697Z [2024-04-11 22:27:49 +0000] [15] [INFO] Using worker: sync 2024-04-11T22:27:49.346585803Z [2024-04-11 22:27:49 +0000] [16] [INFO] Booting worker with pid: 16 2024-04-11T22:27:49.456620154Z [2024-04-11 22:27:49 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-11T22:27:51.528489918Z 2024-04-11T22:27:51.528506508Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-11T22:27:51.528515082Z --- ***** ----- 2024-04-11T22:27:51.528518864Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-11 22:27:51 2024-04-11T22:27:51.528522146Z - *** --- * --- 2024-04-11T22:27:51.528525758Z - ** ---------- [config] 2024-04-11T22:27:51.528529995Z - ** ---------- .> app: airflow.executors.celery_executor:0x7fb699354190 2024-04-11T22:27:51.528533255Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-11T22:27:51.528536463Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-11T22:27:51.528542618Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-11T22:27:51.528545790Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-11T22:27:51.528549153Z --- ***** ----- 2024-04-11T22:27:51.528552317Z -------------- [queues] 2024-04-11T22:27:51.528555506Z .> default exchange=default(direct) key=default 2024-04-11T22:27:51.528558710Z 2024-04-11T22:27:51.528561749Z 2024-04-11T22:27:51.528564941Z [tasks] 2024-04-11T22:27:51.528568193Z . airflow.executors.celery_executor.execute_command 2024-04-11T22:27:51.528571196Z 2024-04-11T22:27:58.014700854Z [2024-04-11 22:27:58,003: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-11T22:27:58.019437733Z [2024-04-11 22:27:58,018: INFO/MainProcess] mingle: searching for neighbors 2024-04-11T22:27:59.065945191Z [2024-04-11 22:27:59,065: INFO/MainProcess] mingle: all alone 2024-04-11T22:27:59.088905090Z [2024-04-11 22:27:59,084: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-11T22:28:56.477712714Z [2024-04-11 22:28:56,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d40d28c-20fc-4886-b993-33b14d263c08] received 2024-04-11T22:28:56.567945332Z [2024-04-11 22:28:56,567: INFO/ForkPoolWorker-15] [6d40d28c-20fc-4886-b993-33b14d263c08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:28:56.882033624Z [2024-04-11 22:28:56,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:28:57.184206708Z [2024-04-11 22:28:57,183: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:29:27.762388335Z [2024-04-11 22:29:27,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d40d28c-20fc-4886-b993-33b14d263c08] succeeded in 31.279784166000013s: None 2024-04-11T22:29:38.018757200Z [2024-04-11 22:29:38,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ce2d76b-4f48-4b50-89a0-7dc3d2cec905] received 2024-04-11T22:29:38.030574002Z [2024-04-11 22:29:38,030: INFO/ForkPoolWorker-15] [8ce2d76b-4f48-4b50-89a0-7dc3d2cec905] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:29:38.257983181Z [2024-04-11 22:29:38,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:29:38.485884157Z [2024-04-11 22:29:38,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:30:08.980905049Z [2024-04-11 22:30:08,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ce2d76b-4f48-4b50-89a0-7dc3d2cec905] succeeded in 30.95714595300001s: None 2024-04-11T22:30:09.847639768Z [2024-04-11 22:30:09,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[745bf6b2-b0c9-490a-9530-9d57876234d8] received 2024-04-11T22:30:09.855267923Z [2024-04-11 22:30:09,855: INFO/ForkPoolWorker-15] [745bf6b2-b0c9-490a-9530-9d57876234d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:30:10.142320716Z [2024-04-11 22:30:10,139: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:30:10.369682442Z [2024-04-11 22:30:10,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:30:11.093493325Z [2024-04-11 22:30:11,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[745bf6b2-b0c9-490a-9530-9d57876234d8] succeeded in 1.241621796000004s: None 2024-04-11T22:32:00.174515810Z [2024-04-11 22:32:00,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a12ef323-e5a6-433c-a33e-74048784bc35] received 2024-04-11T22:32:00.183887145Z [2024-04-11 22:32:00,183: INFO/ForkPoolWorker-15] [a12ef323-e5a6-433c-a33e-74048784bc35] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:32:00.511056175Z [2024-04-11 22:32:00,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:32:00.785731062Z [2024-04-11 22:32:00,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:32:01.251463411Z [2024-04-11 22:32:01,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a12ef323-e5a6-433c-a33e-74048784bc35] succeeded in 1.0741972580000265s: None 2024-04-11T22:34:00.441161600Z [2024-04-11 22:34:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de33b7f-87d3-460e-831d-90ba7befb0ad] received 2024-04-11T22:34:00.451000625Z [2024-04-11 22:34:00,450: INFO/ForkPoolWorker-15] [5de33b7f-87d3-460e-831d-90ba7befb0ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:34:00.751967484Z [2024-04-11 22:34:00,749: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:34:01.025626494Z [2024-04-11 22:34:01,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:34:01.555871048Z [2024-04-11 22:34:01,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5de33b7f-87d3-460e-831d-90ba7befb0ad] succeeded in 1.1118864400000348s: None 2024-04-11T22:34:56.937547800Z [2024-04-11 22:34:56,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2236a7e0-c375-453a-86d6-3a3e818a3391] received 2024-04-11T22:34:56.939881126Z [2024-04-11 22:34:56,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e4b448d-5882-4573-ad04-75abb60ba323] received 2024-04-11T22:34:56.957761595Z [2024-04-11 22:34:56,957: INFO/ForkPoolWorker-15] [2236a7e0-c375-453a-86d6-3a3e818a3391] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:34:56.993209442Z [2024-04-11 22:34:56,992: INFO/ForkPoolWorker-16] [2e4b448d-5882-4573-ad04-75abb60ba323] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:34:57.228544597Z [2024-04-11 22:34:57,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:34:57.262130511Z [2024-04-11 22:34:57,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:34:58.424640303Z [2024-04-11 22:34:58,424: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:34:58.429466988Z [2024-04-11 22:34:58,429: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:34:58.450684063Z [2024-04-11 22:34:58,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:34:58.451804520Z [2024-04-11 22:34:58,451: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:34:58.451822546Z [2024-04-11 22:34:58,451: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:34:58.451946545Z [2024-04-11 22:34:58,451: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:34:58.452200492Z [2024-04-11 22:34:58,451: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:34:58.452273111Z [2024-04-11 22:34:58,452: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:34:58.452353447Z [2024-04-11 22:34:58,452: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:34:58.497114694Z [2024-04-11 22:34:58,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:34:58.499798187Z [2024-04-11 22:34:58,499: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:34:58.519063308Z [2024-04-11 22:34:58,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:34:58.520511015Z [2024-04-11 22:34:58,520: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:34:58.520538893Z [2024-04-11 22:34:58,520: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:34:58.520756419Z [2024-04-11 22:34:58,520: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:34:58.520859455Z [2024-04-11 22:34:58,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:34:58.521239693Z [2024-04-11 22:34:58,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:34:58.521336868Z [2024-04-11 22:34:58,521: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:34:58.541353550Z [2024-04-11 22:34:58,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:34:58.607693906Z [2024-04-11 22:34:58,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:00.024995364Z [2024-04-11 22:35:00,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e4b448d-5882-4573-ad04-75abb60ba323] succeeded in 3.081750366000051s: None 2024-04-11T22:35:00.168771690Z [2024-04-11 22:35:00,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a96f2ce-12a1-4841-a9b6-3d04fa6bdfd9] received 2024-04-11T22:35:00.176085204Z [2024-04-11 22:35:00,175: INFO/ForkPoolWorker-16] [1a96f2ce-12a1-4841-a9b6-3d04fa6bdfd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:35:00.324175577Z [2024-04-11 22:35:00,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2236a7e0-c375-453a-86d6-3a3e818a3391] succeeded in 3.382760038000015s: None 2024-04-11T22:35:00.463015341Z [2024-04-11 22:35:00,460: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:35:01.412275299Z [2024-04-11 22:35:01,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9480f74-d04e-4557-b016-8845520290df] received 2024-04-11T22:35:01.424430883Z [2024-04-11 22:35:01,424: INFO/ForkPoolWorker-15] [d9480f74-d04e-4557-b016-8845520290df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:35:01.565282297Z [2024-04-11 22:35:01,564: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:35:01.568733554Z [2024-04-11 22:35:01,568: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:01.589013490Z [2024-04-11 22:35:01,588: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:35:01.590033625Z [2024-04-11 22:35:01,589: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:01.590208903Z [2024-04-11 22:35:01,589: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:01.590379075Z [2024-04-11 22:35:01,590: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:01.590492468Z [2024-04-11 22:35:01,590: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:35:01.590704819Z [2024-04-11 22:35:01,590: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:35:01.590820583Z [2024-04-11 22:35:01,590: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:01.674324325Z [2024-04-11 22:35:01,672: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:01.729371098Z [2024-04-11 22:35:01,726: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:35:02.759077551Z [2024-04-11 22:35:02,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:02.762065017Z [2024-04-11 22:35:02,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:02.780646388Z [2024-04-11 22:35:02,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:02.781958239Z [2024-04-11 22:35:02,781: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:02.782090615Z [2024-04-11 22:35:02,781: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:02.782272073Z [2024-04-11 22:35:02,782: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:02.782405080Z [2024-04-11 22:35:02,782: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:02.782662122Z [2024-04-11 22:35:02,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:35:02.782790885Z [2024-04-11 22:35:02,782: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:02.897713549Z [2024-04-11 22:35:02,897: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:03.076788993Z [2024-04-11 22:35:03,076: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a96f2ce-12a1-4841-a9b6-3d04fa6bdfd9] succeeded in 2.9053030100000115s: None 2024-04-11T22:35:04.708113849Z [2024-04-11 22:35:04,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9480f74-d04e-4557-b016-8845520290df] succeeded in 3.291355328999998s: None 2024-04-11T22:35:05.340338290Z [2024-04-11 22:35:05,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac4d69ec-e96f-4c35-a19b-e7d4011121ba] received 2024-04-11T22:35:05.347463301Z [2024-04-11 22:35:05,347: INFO/ForkPoolWorker-15] [ac4d69ec-e96f-4c35-a19b-e7d4011121ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:35:05.674594297Z [2024-04-11 22:35:05,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:35:05.822887666Z [2024-04-11 22:35:05,822: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T22:35:05.826549674Z [2024-04-11 22:35:05,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:05.849246931Z [2024-04-11 22:35:05,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:05.854134023Z [2024-04-11 22:35:05,853: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:35:05.854571126Z [2024-04-11 22:35:05,854: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:35:05.854723774Z [2024-04-11 22:35:05,854: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T22:35:05.855819185Z [2024-04-11 22:35:05,855: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:35:05.957243268Z [2024-04-11 22:35:05,957: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:06.516943356Z [2024-04-11 22:35:06,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac4d69ec-e96f-4c35-a19b-e7d4011121ba] succeeded in 1.1747919160000038s: None 2024-04-11T22:35:15.357970024Z [2024-04-11 22:35:15,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[319e618d-0583-47f0-a94a-27eec90248f2] received 2024-04-11T22:35:15.363729864Z [2024-04-11 22:35:15,363: INFO/ForkPoolWorker-15] [319e618d-0583-47f0-a94a-27eec90248f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:15.669816632Z [2024-04-11 22:35:15,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:16.713744744Z [2024-04-11 22:35:16,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:16.716916187Z [2024-04-11 22:35:16,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:16.735930593Z [2024-04-11 22:35:16,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:16.737386078Z [2024-04-11 22:35:16,737: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:16.738080576Z [2024-04-11 22:35:16,737: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:16.738288654Z [2024-04-11 22:35:16,738: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:16.738432851Z [2024-04-11 22:35:16,738: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:16.738973504Z [2024-04-11 22:35:16,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:16.739231152Z [2024-04-11 22:35:16,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:16.839911021Z [2024-04-11 22:35:16,839: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:17.256340919Z [2024-04-11 22:35:17,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a1760f7-3e76-4036-acd2-a51f1e175e17] received 2024-04-11T22:35:17.265843608Z [2024-04-11 22:35:17,265: INFO/ForkPoolWorker-16] [2a1760f7-3e76-4036-acd2-a51f1e175e17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:17.356659407Z [2024-04-11 22:35:17,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[319e618d-0583-47f0-a94a-27eec90248f2] succeeded in 1.9973062820000678s: None 2024-04-11T22:35:17.540962786Z [2024-04-11 22:35:17,538: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:18.672033969Z [2024-04-11 22:35:18,671: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:35:18.674922377Z [2024-04-11 22:35:18,674: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:18.702432010Z [2024-04-11 22:35:18,702: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:35:18.703701069Z [2024-04-11 22:35:18,703: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:18.703877432Z [2024-04-11 22:35:18,703: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:18.704100168Z [2024-04-11 22:35:18,703: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:18.704127875Z [2024-04-11 22:35:18,704: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:35:18.708095011Z [2024-04-11 22:35:18,704: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:18.708108987Z [2024-04-11 22:35:18,704: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:18.777924684Z [2024-04-11 22:35:18,777: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:19.260973038Z [2024-04-11 22:35:19,260: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a1760f7-3e76-4036-acd2-a51f1e175e17] succeeded in 2.002636341000084s: None 2024-04-11T22:35:19.579062751Z [2024-04-11 22:35:19,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56693ce9-1390-4d0c-b8a8-e00c5734261c] received 2024-04-11T22:35:19.604994166Z [2024-04-11 22:35:19,604: INFO/ForkPoolWorker-15] [56693ce9-1390-4d0c-b8a8-e00c5734261c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:35:19.842259027Z [2024-04-11 22:35:19,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:20.823913258Z [2024-04-11 22:35:20,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:20.826681894Z [2024-04-11 22:35:20,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:20.848236329Z [2024-04-11 22:35:20,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:20.849308650Z [2024-04-11 22:35:20,849: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:20.849329971Z [2024-04-11 22:35:20,849: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:20.849467061Z [2024-04-11 22:35:20,849: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:20.849489816Z [2024-04-11 22:35:20,849: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:20.850455704Z [2024-04-11 22:35:20,850: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:20.850467571Z [2024-04-11 22:35:20,850: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:20.913072861Z [2024-04-11 22:35:20,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:21.420061013Z [2024-04-11 22:35:21,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56693ce9-1390-4d0c-b8a8-e00c5734261c] succeeded in 1.838225560000069s: None 2024-04-11T22:35:21.733107141Z [2024-04-11 22:35:21,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0331859-b709-4c25-9249-9e8fe019b454] received 2024-04-11T22:35:21.747017691Z [2024-04-11 22:35:21,746: INFO/ForkPoolWorker-15] [b0331859-b709-4c25-9249-9e8fe019b454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:21.996218296Z [2024-04-11 22:35:21,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:23.057238388Z [2024-04-11 22:35:23,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:23.060021434Z [2024-04-11 22:35:23,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:23.082066196Z [2024-04-11 22:35:23,081: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:23.083161919Z [2024-04-11 22:35:23,082: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:23.083174167Z [2024-04-11 22:35:23,083: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:23.083391126Z [2024-04-11 22:35:23,083: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:35:23.083423123Z [2024-04-11 22:35:23,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:23.083790733Z [2024-04-11 22:35:23,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:23.083849108Z [2024-04-11 22:35:23,083: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:23.162330846Z [2024-04-11 22:35:23,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:23.652768476Z [2024-04-11 22:35:23,652: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0331859-b709-4c25-9249-9e8fe019b454] succeeded in 1.9176132310000185s: None 2024-04-11T22:35:47.281851705Z [2024-04-11 22:35:47,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f96461ab-399b-41f1-b236-22263be8df33] received 2024-04-11T22:35:47.298873691Z [2024-04-11 22:35:47,298: INFO/ForkPoolWorker-15] [f96461ab-399b-41f1-b236-22263be8df33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:47.534623702Z [2024-04-11 22:35:47,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:48.668284247Z [2024-04-11 22:35:48,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:48.671280955Z [2024-04-11 22:35:48,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:48.689515107Z [2024-04-11 22:35:48,689: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:48.690660638Z [2024-04-11 22:35:48,690: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:48.690714896Z [2024-04-11 22:35:48,690: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:48.690740419Z [2024-04-11 22:35:48,690: INFO/ForkPoolWorker-15] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:35:48.690931720Z [2024-04-11 22:35:48,690: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:35:48.690995777Z [2024-04-11 22:35:48,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:48.691184368Z [2024-04-11 22:35:48,691: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:48.691337179Z [2024-04-11 22:35:48,691: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:48.696082627Z [2024-04-11 22:35:48,695: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:35:48.773617432Z [2024-04-11 22:35:48,773: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:49.344174874Z [2024-04-11 22:35:49,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f96461ab-399b-41f1-b236-22263be8df33] succeeded in 2.0585225489999175s: None 2024-04-11T22:35:49.694460067Z [2024-04-11 22:35:49,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70da27c8-c6dc-408c-848e-5467e486247c] received 2024-04-11T22:35:49.700474976Z [2024-04-11 22:35:49,700: INFO/ForkPoolWorker-15] [70da27c8-c6dc-408c-848e-5467e486247c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:49.945512923Z [2024-04-11 22:35:49,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:50.989183528Z [2024-04-11 22:35:50,988: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:50.992299321Z [2024-04-11 22:35:50,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:51.013266722Z [2024-04-11 22:35:51,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:51.014352680Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:51.014423020Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:51.014491754Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:35:51.014627088Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:35:51.014676520Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:51.014911425Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:51.015097817Z [2024-04-11 22:35:51,014: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:51.019866716Z [2024-04-11 22:35:51,019: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:35:51.114677088Z [2024-04-11 22:35:51,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:51.700766310Z [2024-04-11 22:35:51,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70da27c8-c6dc-408c-848e-5467e486247c] succeeded in 2.00470516900009s: None 2024-04-11T22:35:52.383491206Z [2024-04-11 22:35:52,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a67f22a-2fd0-48a4-a1d9-ee4d8ce65c96] received 2024-04-11T22:35:52.391701333Z [2024-04-11 22:35:52,391: INFO/ForkPoolWorker-15] [5a67f22a-2fd0-48a4-a1d9-ee4d8ce65c96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:35:52.643290436Z [2024-04-11 22:35:52,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:53.697910367Z [2024-04-11 22:35:53,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:53.701021260Z [2024-04-11 22:35:53,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:53.714768930Z [2024-04-11 22:35:53,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:53.715830814Z [2024-04-11 22:35:53,715: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:53.715908646Z [2024-04-11 22:35:53,715: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:53.716127795Z [2024-04-11 22:35:53,715: INFO/ForkPoolWorker-15] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:35:53.716349334Z [2024-04-11 22:35:53,716: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:35:53.716533265Z [2024-04-11 22:35:53,716: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:53.716793901Z [2024-04-11 22:35:53,716: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:53.716900190Z [2024-04-11 22:35:53,716: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:53.722036205Z [2024-04-11 22:35:53,721: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:35:53.823168923Z [2024-04-11 22:35:53,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:54.306619318Z [2024-04-11 22:35:54,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a67f22a-2fd0-48a4-a1d9-ee4d8ce65c96] succeeded in 1.920705906999956s: None 2024-04-11T22:35:54.650337201Z [2024-04-11 22:35:54,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd1f2afd-1d0d-47c7-8cc1-fceb6365b6d3] received 2024-04-11T22:35:54.658794020Z [2024-04-11 22:35:54,658: INFO/ForkPoolWorker-15] [cd1f2afd-1d0d-47c7-8cc1-fceb6365b6d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:54.936760956Z [2024-04-11 22:35:54,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:35:55.951252901Z [2024-04-11 22:35:55,950: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:35:55.954109641Z [2024-04-11 22:35:55,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:35:55.977949982Z [2024-04-11 22:35:55,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:35:55.979101691Z [2024-04-11 22:35:55,978: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:35:55.979195030Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:35:55.979245998Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:35:55.979450481Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:35:55.979468719Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:35:55.979740476Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:35:55.979772717Z [2024-04-11 22:35:55,979: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:35:55.985440509Z [2024-04-11 22:35:55,985: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:35:56.048529925Z [2024-04-11 22:35:56,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:35:56.674029113Z [2024-04-11 22:35:56,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd1f2afd-1d0d-47c7-8cc1-fceb6365b6d3] succeeded in 2.0206102269999064s: None 2024-04-11T22:36:00.940132299Z [2024-04-11 22:36:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42627854-b1bf-429d-998c-e0c351da9e55] received 2024-04-11T22:36:00.941818898Z [2024-04-11 22:36:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a113969-3ffc-42fa-b8fa-ee43b9e809ee] received 2024-04-11T22:36:00.946757492Z [2024-04-11 22:36:00,946: INFO/ForkPoolWorker-15] [42627854-b1bf-429d-998c-e0c351da9e55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:00.950942791Z [2024-04-11 22:36:00,950: INFO/ForkPoolWorker-16] [5a113969-3ffc-42fa-b8fa-ee43b9e809ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:00.957143888Z [2024-04-11 22:36:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88eb843d-a651-4944-80ee-68a2bc906818] received 2024-04-11T22:36:00.972215217Z [2024-04-11 22:36:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a593ee69-3a42-4044-96fe-ff993c731943] received 2024-04-11T22:36:00.998785831Z [2024-04-11 22:36:00,998: INFO/ForkPoolWorker-1] [88eb843d-a651-4944-80ee-68a2bc906818] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:36:01.106498571Z [2024-04-11 22:36:01,106: INFO/ForkPoolWorker-2] [a593ee69-3a42-4044-96fe-ff993c731943] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:36:01.307420660Z [2024-04-11 22:36:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:36:01.581166040Z [2024-04-11 22:36:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:36:01.788514934Z [2024-04-11 22:36:01,785: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:36:01.919377592Z [2024-04-11 22:36:01,902: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:36:02.062691581Z [2024-04-11 22:36:02,062: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T22:36:02.068014835Z [2024-04-11 22:36:02,067: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:02.127167835Z [2024-04-11 22:36:02,126: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:36:02.131755236Z [2024-04-11 22:36:02,131: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:36:02.131804190Z [2024-04-11 22:36:02,131: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:36:02.131956197Z [2024-04-11 22:36:02,131: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T22:36:02.132643362Z [2024-04-11 22:36:02,132: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:36:02.300956967Z [2024-04-11 22:36:02,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:02.702075004Z [2024-04-11 22:36:02,701: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:02.875432659Z [2024-04-11 22:36:02,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eb5504c-d2e4-4cb6-8d56-71fc9e43d4ee] received 2024-04-11T22:36:02.886267956Z [2024-04-11 22:36:02,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bf27811-b8a3-4342-bbbf-71f13501ef0b] received 2024-04-11T22:36:02.933776633Z [2024-04-11 22:36:02,933: INFO/ForkPoolWorker-3] [5eb5504c-d2e4-4cb6-8d56-71fc9e43d4ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:02.976870073Z [2024-04-11 22:36:02,976: INFO/ForkPoolWorker-4] [3bf27811-b8a3-4342-bbbf-71f13501ef0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:02.990876927Z [2024-04-11 22:36:02,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:36:03.006432331Z [2024-04-11 22:36:03,004: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:03.071062705Z [2024-04-11 22:36:03,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:36:03.077645693Z [2024-04-11 22:36:03,077: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:03.077852959Z [2024-04-11 22:36:03,077: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:03.077968044Z [2024-04-11 22:36:03,077: INFO/ForkPoolWorker-16] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:36:03.078272988Z [2024-04-11 22:36:03,077: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:36:03.078467006Z [2024-04-11 22:36:03,078: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:36:03.078851276Z [2024-04-11 22:36:03,078: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:36:03.079372212Z [2024-04-11 22:36:03,078: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:03.084807513Z [2024-04-11 22:36:03,084: INFO/ForkPoolWorker-16] Creating DAG vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:36:03.303243470Z [2024-04-11 22:36:03,299: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:36:03.362393599Z [2024-04-11 22:36:03,362: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:03.363234560Z [2024-04-11 22:36:03,362: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a593ee69-3a42-4044-96fe-ff993c731943] succeeded in 2.387337898999931s: None 2024-04-11T22:36:03.585867438Z [2024-04-11 22:36:03,580: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:36:03.686150084Z [2024-04-11 22:36:03,685: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88eb843d-a651-4944-80ee-68a2bc906818] succeeded in 2.7266798039997866s: None 2024-04-11T22:36:04.002533253Z [2024-04-11 22:36:04,002: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:36:04.007541967Z [2024-04-11 22:36:04,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:04.053567014Z [2024-04-11 22:36:04,051: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:36:04.058574422Z [2024-04-11 22:36:04,058: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:04.058866771Z [2024-04-11 22:36:04,058: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:04.059154845Z [2024-04-11 22:36:04,058: INFO/ForkPoolWorker-15] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:36:04.059652946Z [2024-04-11 22:36:04,059: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:36:04.059953033Z [2024-04-11 22:36:04,059: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:36:04.060555762Z [2024-04-11 22:36:04,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:36:04.060795820Z [2024-04-11 22:36:04,060: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:04.068044396Z [2024-04-11 22:36:04,067: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:36:04.167774339Z [2024-04-11 22:36:04,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:04.994951543Z [2024-04-11 22:36:04,994: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:36:04.999604562Z [2024-04-11 22:36:04,998: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:05.011591157Z [2024-04-11 22:36:05,011: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a113969-3ffc-42fa-b8fa-ee43b9e809ee] succeeded in 4.068432183000141s: None 2024-04-11T22:36:05.047649855Z [2024-04-11 22:36:05,047: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:36:05.048989596Z [2024-04-11 22:36:05,048: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:05.049299930Z [2024-04-11 22:36:05,049: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:05.049417345Z [2024-04-11 22:36:05,049: INFO/ForkPoolWorker-3] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:36:05.049640658Z [2024-04-11 22:36:05,049: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:36:05.049769056Z [2024-04-11 22:36:05,049: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:36:05.050055864Z [2024-04-11 22:36:05,049: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:36:05.050193403Z [2024-04-11 22:36:05,050: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:05.054909462Z [2024-04-11 22:36:05,054: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:36:05.131740724Z [2024-04-11 22:36:05,131: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:05.149094674Z [2024-04-11 22:36:05,148: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:36:05.151987600Z [2024-04-11 22:36:05,151: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:05.166662262Z [2024-04-11 22:36:05,166: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:36:05.168203071Z [2024-04-11 22:36:05,168: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:05.168363732Z [2024-04-11 22:36:05,168: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:05.168554842Z [2024-04-11 22:36:05,168: INFO/ForkPoolWorker-4] Read VIM 6953bf4f-1694-49e4-a9db-472be6cb9d00 (basic01_483777) 2024-04-11T22:36:05.168765897Z [2024-04-11 22:36:05,168: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6953bf4f-1694-49e4-a9db-472be6cb9d00', 'name': 'basic01_483777', 'vim_type': 'openstack'}] 2024-04-11T22:36:05.168901015Z [2024-04-11 22:36:05,168: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:36:05.169195960Z [2024-04-11 22:36:05,169: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:36:05.169389391Z [2024-04-11 22:36:05,169: INFO/ForkPoolWorker-4] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:05.173818032Z [2024-04-11 22:36:05,173: INFO/ForkPoolWorker-4] Creating DAG vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 2024-04-11T22:36:05.242862197Z [2024-04-11 22:36:05,242: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:06.327115479Z [2024-04-11 22:36:06,326: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42627854-b1bf-429d-998c-e0c351da9e55] succeeded in 5.3843771780000225s: None 2024-04-11T22:36:06.623303427Z [2024-04-11 22:36:06,622: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[3bf27811-b8a3-4342-bbbf-71f13501ef0b] succeeded in 3.7347606230000565s: None 2024-04-11T22:36:06.873092077Z [2024-04-11 22:36:06,872: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5eb5504c-d2e4-4cb6-8d56-71fc9e43d4ee] succeeded in 3.9930764519999684s: None 2024-04-11T22:36:34.121786873Z [2024-04-11 22:36:34,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[488d3694-77a7-4525-aff2-2de18a86cb84] received 2024-04-11T22:36:34.134487786Z [2024-04-11 22:36:34,134: INFO/ForkPoolWorker-15] [488d3694-77a7-4525-aff2-2de18a86cb84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:34.429342320Z [2024-04-11 22:36:34,426: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:36:35.409011420Z [2024-04-11 22:36:35,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63a0928e-d642-4a4b-9b1b-ce79efa28e33] received 2024-04-11T22:36:35.418569496Z [2024-04-11 22:36:35,418: INFO/ForkPoolWorker-16] [63a0928e-d642-4a4b-9b1b-ce79efa28e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:35.568266114Z [2024-04-11 22:36:35,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:36:35.571794912Z [2024-04-11 22:36:35,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:35.602324809Z [2024-04-11 22:36:35,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:36:35.604830699Z [2024-04-11 22:36:35,604: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:35.605052419Z [2024-04-11 22:36:35,604: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:35.605267080Z [2024-04-11 22:36:35,605: INFO/ForkPoolWorker-15] Read VIM cc4d4a77-e4a1-4899-811c-0385594a6a43 (basic01_845463) 2024-04-11T22:36:35.605641436Z [2024-04-11 22:36:35,605: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'cc4d4a77-e4a1-4899-811c-0385594a6a43', 'name': 'basic01_845463', 'vim_type': 'openstack'}] 2024-04-11T22:36:35.605879772Z [2024-04-11 22:36:35,605: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:36:35.607128850Z [2024-04-11 22:36:35,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:36:35.607416534Z [2024-04-11 22:36:35,607: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:35.616420305Z [2024-04-11 22:36:35,616: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 2024-04-11T22:36:35.684207510Z [2024-04-11 22:36:35,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:36:35.692017332Z [2024-04-11 22:36:35,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:36.717875048Z [2024-04-11 22:36:36,717: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:36:36.720944414Z [2024-04-11 22:36:36,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:36.741356729Z [2024-04-11 22:36:36,741: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:36:36.742555023Z [2024-04-11 22:36:36,742: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:36.742565977Z [2024-04-11 22:36:36,742: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:36.742569711Z [2024-04-11 22:36:36,742: INFO/ForkPoolWorker-16] Read VIM cc4d4a77-e4a1-4899-811c-0385594a6a43 (basic01_845463) 2024-04-11T22:36:36.742738692Z [2024-04-11 22:36:36,742: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'cc4d4a77-e4a1-4899-811c-0385594a6a43', 'name': 'basic01_845463', 'vim_type': 'openstack'}] 2024-04-11T22:36:36.742755863Z [2024-04-11 22:36:36,742: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:36:36.743460747Z [2024-04-11 22:36:36,743: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:36:36.743467737Z [2024-04-11 22:36:36,743: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:36.747635926Z [2024-04-11 22:36:36,747: INFO/ForkPoolWorker-16] Creating DAG vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 2024-04-11T22:36:36.898499661Z [2024-04-11 22:36:36,898: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:37.472457818Z [2024-04-11 22:36:37,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[488d3694-77a7-4525-aff2-2de18a86cb84] succeeded in 3.3488186110000697s: None 2024-04-11T22:36:38.363430428Z [2024-04-11 22:36:38,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63a0928e-d642-4a4b-9b1b-ce79efa28e33] succeeded in 2.9531685219999417s: None 2024-04-11T22:36:50.232829035Z [2024-04-11 22:36:50,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a878d04-5660-48d4-82d5-1892f60c3ff9] received 2024-04-11T22:36:50.246912882Z [2024-04-11 22:36:50,246: INFO/ForkPoolWorker-15] [1a878d04-5660-48d4-82d5-1892f60c3ff9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:50.490757550Z [2024-04-11 22:36:50,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:51.505579122Z [2024-04-11 22:36:51,505: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:36:51.508541114Z [2024-04-11 22:36:51,508: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:51.525134877Z [2024-04-11 22:36:51,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:36:51.526023020Z [2024-04-11 22:36:51,525: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:51.526114056Z [2024-04-11 22:36:51,525: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:51.526299860Z [2024-04-11 22:36:51,526: INFO/ForkPoolWorker-15] Read VIM cc4d4a77-e4a1-4899-811c-0385594a6a43 (basic01_845463) 2024-04-11T22:36:51.526454924Z [2024-04-11 22:36:51,526: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'cc4d4a77-e4a1-4899-811c-0385594a6a43', 'name': 'basic01_845463', 'vim_type': 'openstack'}] 2024-04-11T22:36:51.526555596Z [2024-04-11 22:36:51,526: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:36:51.526874800Z [2024-04-11 22:36:51,526: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:36:51.526953732Z [2024-04-11 22:36:51,526: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:51.532172847Z [2024-04-11 22:36:51,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 2024-04-11T22:36:51.610236192Z [2024-04-11 22:36:51,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:52.156170989Z [2024-04-11 22:36:52,155: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a878d04-5660-48d4-82d5-1892f60c3ff9] succeeded in 1.9176523589999306s: None 2024-04-11T22:36:52.324132539Z [2024-04-11 22:36:52,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f63b8c6c-d955-4039-873b-2a81321253b8] received 2024-04-11T22:36:52.332141468Z [2024-04-11 22:36:52,331: INFO/ForkPoolWorker-15] [f63b8c6c-d955-4039-873b-2a81321253b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:52.572802174Z [2024-04-11 22:36:52,570: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:53.541501121Z [2024-04-11 22:36:53,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:36:53.548430693Z [2024-04-11 22:36:53,544: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:53.563015184Z [2024-04-11 22:36:53,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:36:53.564010376Z [2024-04-11 22:36:53,563: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:53.564168683Z [2024-04-11 22:36:53,563: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:53.564296761Z [2024-04-11 22:36:53,564: INFO/ForkPoolWorker-15] Read VIM cc4d4a77-e4a1-4899-811c-0385594a6a43 (basic01_845463) 2024-04-11T22:36:53.564517190Z [2024-04-11 22:36:53,564: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'cc4d4a77-e4a1-4899-811c-0385594a6a43', 'name': 'basic01_845463', 'vim_type': 'openstack'}] 2024-04-11T22:36:53.564627313Z [2024-04-11 22:36:53,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:36:53.564863878Z [2024-04-11 22:36:53,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:36:53.565003188Z [2024-04-11 22:36:53,564: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:53.570235690Z [2024-04-11 22:36:53,570: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 2024-04-11T22:36:53.659519525Z [2024-04-11 22:36:53,659: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:54.262224385Z [2024-04-11 22:36:54,261: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f63b8c6c-d955-4039-873b-2a81321253b8] succeeded in 1.934430128000031s: None 2024-04-11T22:36:54.609972496Z [2024-04-11 22:36:54,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3121c720-a529-4ca1-a3ec-5600aa456b24] received 2024-04-11T22:36:54.627088925Z [2024-04-11 22:36:54,626: INFO/ForkPoolWorker-15] [3121c720-a529-4ca1-a3ec-5600aa456b24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:36:54.863301216Z [2024-04-11 22:36:54,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:55.932003037Z [2024-04-11 22:36:55,931: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:36:55.936321478Z [2024-04-11 22:36:55,935: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:55.956755503Z [2024-04-11 22:36:55,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:36:55.959305864Z [2024-04-11 22:36:55,959: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:55.961457794Z [2024-04-11 22:36:55,961: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:55.961665314Z [2024-04-11 22:36:55,961: INFO/ForkPoolWorker-15] Read VIM cc4d4a77-e4a1-4899-811c-0385594a6a43 (basic01_845463) 2024-04-11T22:36:55.961928162Z [2024-04-11 22:36:55,961: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'cc4d4a77-e4a1-4899-811c-0385594a6a43', 'name': 'basic01_845463', 'vim_type': 'openstack'}] 2024-04-11T22:36:55.962118265Z [2024-04-11 22:36:55,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:36:55.962899109Z [2024-04-11 22:36:55,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:36:55.963155638Z [2024-04-11 22:36:55,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:55.972336307Z [2024-04-11 22:36:55,971: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 2024-04-11T22:36:56.055300661Z [2024-04-11 22:36:56,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:36:56.577317978Z [2024-04-11 22:36:56,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bad73343-4056-43ac-b8f0-e0667807a3f0] received 2024-04-11T22:36:56.581814392Z [2024-04-11 22:36:56,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3121c720-a529-4ca1-a3ec-5600aa456b24] succeeded in 1.9700322429998778s: None 2024-04-11T22:36:56.592172623Z [2024-04-11 22:36:56,591: INFO/ForkPoolWorker-16] [bad73343-4056-43ac-b8f0-e0667807a3f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:56.876440232Z [2024-04-11 22:36:56,873: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:57.986993086Z [2024-04-11 22:36:57,986: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:36:57.989837854Z [2024-04-11 22:36:57,989: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:58.008858793Z [2024-04-11 22:36:58,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:36:58.010129430Z [2024-04-11 22:36:58,009: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:58.010163025Z [2024-04-11 22:36:58,010: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:58.010316857Z [2024-04-11 22:36:58,010: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:36:58.010322756Z [2024-04-11 22:36:58,010: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:36:58.010513361Z [2024-04-11 22:36:58,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:36:58.010518402Z [2024-04-11 22:36:58,010: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:58.017114036Z [2024-04-11 22:36:58,016: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:58.017611132Z [2024-04-11 22:36:58,017: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:36:58.019255525Z [2024-04-11 22:36:58,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:36:58.020774942Z [2024-04-11 22:36:58,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:36:58.031631793Z [2024-04-11 22:36:58,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:36:58.032643709Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:36:58.032700949Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:36:58.032725362Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:36:58.032778518Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:36:58.033045680Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:36:58.033055228Z [2024-04-11 22:36:58,032: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:36:58.036495325Z [2024-04-11 22:36:58,035: ERROR/ForkPoolWorker-16] [bad73343-4056-43ac-b8f0-e0667807a3f0] Failed to execute task Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:36:58.036524255Z Traceback (most recent call last): 2024-04-11T22:36:58.036533545Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:36:58.036551777Z args.func(args) 2024-04-11T22:36:58.036577941Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:36:58.036587103Z return func(*args, **kwargs) 2024-04-11T22:36:58.036602305Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:36:58.036617250Z return f(*args, **kwargs) 2024-04-11T22:36:58.036624743Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:36:58.036631956Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:36:58.036639127Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:36:58.036646409Z raise AirflowException( 2024-04-11T22:36:58.036657733Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:36:58.085363197Z [2024-04-11 22:36:58,084: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bad73343-4056-43ac-b8f0-e0667807a3f0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bad73343-4056-43ac-b8f0-e0667807a3f0') 2024-04-11T22:36:58.085396509Z Traceback (most recent call last): 2024-04-11T22:36:58.085407229Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:36:58.085416281Z R = retval = fun(*args, **kwargs) 2024-04-11T22:36:58.085425237Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:36:58.085434538Z return self.run(*args, **kwargs) 2024-04-11T22:36:58.085443793Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:36:58.085455116Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:36:58.085463954Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:36:58.085473451Z raise AirflowException(msg) 2024-04-11T22:36:58.085482820Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bad73343-4056-43ac-b8f0-e0667807a3f0 2024-04-11T22:37:00.602396463Z [2024-04-11 22:37:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23c90fa5-78ad-48e1-b1dd-159f9af5ca99] received 2024-04-11T22:37:00.604457913Z [2024-04-11 22:37:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7229fe67-d63d-4aa9-a25e-d1fab293828e] received 2024-04-11T22:37:00.606712036Z [2024-04-11 22:37:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[396be169-e749-4b2f-972e-e8c0be997e4b] received 2024-04-11T22:37:00.608912873Z [2024-04-11 22:37:00,608: INFO/ForkPoolWorker-15] [23c90fa5-78ad-48e1-b1dd-159f9af5ca99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.615048383Z [2024-04-11 22:37:00,614: INFO/ForkPoolWorker-1] [396be169-e749-4b2f-972e-e8c0be997e4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:00.617756929Z [2024-04-11 22:37:00,617: INFO/ForkPoolWorker-16] [7229fe67-d63d-4aa9-a25e-d1fab293828e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:37:00.620061101Z [2024-04-11 22:37:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39735726-1ef2-4f7e-b13b-0f81b7610dd9] received 2024-04-11T22:37:00.625816184Z [2024-04-11 22:37:00,625: INFO/ForkPoolWorker-2] [39735726-1ef2-4f7e-b13b-0f81b7610dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:00.628870051Z [2024-04-11 22:37:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f14bd26-9cae-40d0-8a87-9b46bbbe1442] received 2024-04-11T22:37:00.635131749Z [2024-04-11 22:37:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a992589-6f88-48e0-b455-ffd58d54b275] received 2024-04-11T22:37:00.639098078Z [2024-04-11 22:37:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edadfbbb-df33-4a79-a858-ecda7088b0b5] received 2024-04-11T22:37:00.641356028Z [2024-04-11 22:37:00,641: INFO/ForkPoolWorker-4] [7a992589-6f88-48e0-b455-ffd58d54b275] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.648598713Z [2024-04-11 22:37:00,648: INFO/ForkPoolWorker-3] [1f14bd26-9cae-40d0-8a87-9b46bbbe1442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:00.700479644Z [2024-04-11 22:37:00,700: INFO/ForkPoolWorker-5] [edadfbbb-df33-4a79-a858-ecda7088b0b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.938751182Z [2024-04-11 22:37:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:01.009240546Z [2024-04-11 22:37:01,006: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:01.063497955Z [2024-04-11 22:37:01,060: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:01.252489076Z [2024-04-11 22:37:01,228: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:01.394270571Z [2024-04-11 22:37:01,386: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:01.402579032Z [2024-04-11 22:37:01,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:37:01.475968044Z [2024-04-11 22:37:01,472: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:01.668085634Z [2024-04-11 22:37:01,667: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:37:01.704534247Z [2024-04-11 22:37:01,701: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:01.772761057Z [2024-04-11 22:37:01,772: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:37:01.781764258Z [2024-04-11 22:37:01,775: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:37:01.781783682Z [2024-04-11 22:37:01,775: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:37:01.781794150Z [2024-04-11 22:37:01,775: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:37:01.784023249Z [2024-04-11 22:37:01,775: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:37:01.900899657Z [2024-04-11 22:37:01,900: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:37:02.652925007Z [2024-04-11 22:37:02,652: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:02.657950667Z [2024-04-11 22:37:02,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:02.744291599Z [2024-04-11 22:37:02,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:02.751559644Z [2024-04-11 22:37:02,751: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:37:02.752435053Z [2024-04-11 22:37:02,752: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:02.754354099Z [2024-04-11 22:37:02,754: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:02.755696784Z [2024-04-11 22:37:02,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:02.756277370Z [2024-04-11 22:37:02,756: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:02.760551953Z [2024-04-11 22:37:02,760: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:02.760993330Z [2024-04-11 22:37:02,760: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:02.764634365Z [2024-04-11 22:37:02,764: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:02.773997140Z [2024-04-11 22:37:02,773: WARNING/ForkPoolWorker-15] Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:02.774729866Z [2024-04-11 22:37:02,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:02.775466617Z [2024-04-11 22:37:02,775: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:02.788718531Z [2024-04-11 22:37:02,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:02.827233402Z [2024-04-11 22:37:02,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:37:02.830219980Z [2024-04-11 22:37:02,830: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:02.830959688Z [2024-04-11 22:37:02,830: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:02.831112798Z [2024-04-11 22:37:02,830: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:02.831199178Z [2024-04-11 22:37:02,831: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:37:02.831483844Z [2024-04-11 22:37:02,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:02.831966799Z [2024-04-11 22:37:02,831: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:02.838452610Z [2024-04-11 22:37:02,838: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:02.839095843Z [2024-04-11 22:37:02,838: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:02.839844176Z [2024-04-11 22:37:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:37:02.842163253Z [2024-04-11 22:37:02,841: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:02.850390127Z [2024-04-11 22:37:02,850: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:02.854830103Z [2024-04-11 22:37:02,854: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:02.856114643Z [2024-04-11 22:37:02,855: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:02.857562540Z [2024-04-11 22:37:02,856: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:02.858291260Z [2024-04-11 22:37:02,858: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:02.858704320Z [2024-04-11 22:37:02,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:02.860817076Z [2024-04-11 22:37:02,860: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:02.866556390Z [2024-04-11 22:37:02,864: ERROR/ForkPoolWorker-15] [23c90fa5-78ad-48e1-b1dd-159f9af5ca99] Failed to execute task Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:02.866575536Z Traceback (most recent call last): 2024-04-11T22:37:02.866579800Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:02.866595535Z args.func(args) 2024-04-11T22:37:02.866598964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:02.866627379Z return func(*args, **kwargs) 2024-04-11T22:37:02.866630711Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:02.866633635Z return f(*args, **kwargs) 2024-04-11T22:37:02.866636273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:02.866638895Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:02.866641467Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:02.866644049Z raise AirflowException( 2024-04-11T22:37:02.866647334Z airflow.exceptions.AirflowException: Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:02.904598245Z [2024-04-11 22:37:02,904: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7229fe67-d63d-4aa9-a25e-d1fab293828e] succeeded in 2.2979551280000123s: None 2024-04-11T22:37:02.906384537Z [2024-04-11 22:37:02,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:37:02.908541969Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:02.908583488Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:02.908709577Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:02.908755679Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:37:02.908961733Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:02.909019619Z [2024-04-11 22:37:02,908: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:02.912917978Z [2024-04-11 22:37:02,912: ERROR/ForkPoolWorker-1] [396be169-e749-4b2f-972e-e8c0be997e4b] Failed to execute task Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:02.912930363Z Traceback (most recent call last): 2024-04-11T22:37:02.912934097Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:02.912937923Z args.func(args) 2024-04-11T22:37:02.912941180Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:02.912944845Z return func(*args, **kwargs) 2024-04-11T22:37:02.912947734Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:02.912950682Z return f(*args, **kwargs) 2024-04-11T22:37:02.912953732Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:02.912956578Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:02.912959369Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:02.912962268Z raise AirflowException( 2024-04-11T22:37:02.912965624Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:02.942150987Z [2024-04-11 22:37:02,941: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23c90fa5-78ad-48e1-b1dd-159f9af5ca99] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23c90fa5-78ad-48e1-b1dd-159f9af5ca99') 2024-04-11T22:37:02.942168748Z Traceback (most recent call last): 2024-04-11T22:37:02.942172404Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:02.942175611Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:02.942178306Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:02.942181120Z return self.run(*args, **kwargs) 2024-04-11T22:37:02.942184551Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:02.942187765Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:02.942190385Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:02.942193492Z raise AirflowException(msg) 2024-04-11T22:37:02.942196746Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23c90fa5-78ad-48e1-b1dd-159f9af5ca99 2024-04-11T22:37:02.969494640Z [2024-04-11 22:37:02,969: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[396be169-e749-4b2f-972e-e8c0be997e4b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 396be169-e749-4b2f-972e-e8c0be997e4b') 2024-04-11T22:37:02.969504268Z Traceback (most recent call last): 2024-04-11T22:37:02.969507969Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:02.969510616Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:02.969513426Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:02.969516470Z return self.run(*args, **kwargs) 2024-04-11T22:37:02.969519668Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:02.969523109Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:02.969525725Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:02.969528730Z raise AirflowException(msg) 2024-04-11T22:37:02.969532395Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 396be169-e749-4b2f-972e-e8c0be997e4b 2024-04-11T22:37:03.226454769Z [2024-04-11 22:37:03,226: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:37:03.229310695Z [2024-04-11 22:37:03,228: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.254328165Z [2024-04-11 22:37:03,254: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:37:03.255631546Z [2024-04-11 22:37:03,255: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.255647391Z [2024-04-11 22:37:03,255: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.255838701Z [2024-04-11 22:37:03,255: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.255849260Z [2024-04-11 22:37:03,255: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:37:03.256117380Z [2024-04-11 22:37:03,255: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:03.256161918Z [2024-04-11 22:37:03,256: INFO/ForkPoolWorker-4] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.262311398Z [2024-04-11 22:37:03,261: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:37:03.262917228Z [2024-04-11 22:37:03,262: WARNING/ForkPoolWorker-4] Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:03.263629358Z [2024-04-11 22:37:03,263: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:03.264430892Z [2024-04-11 22:37:03,264: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:37:03.265454184Z [2024-04-11 22:37:03,265: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.266926887Z [2024-04-11 22:37:03,266: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.283772670Z [2024-04-11 22:37:03,283: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:37:03.284885301Z [2024-04-11 22:37:03,284: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:37:03.285690770Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.285730948Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.285877235Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.285983134Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:37:03.285990215Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.286082204Z [2024-04-11 22:37:03,285: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.286154666Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:03.286160339Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.286189450Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:37:03.286206290Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-4] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.286379354Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:03.286387008Z [2024-04-11 22:37:03,286: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.289101423Z [2024-04-11 22:37:03,288: ERROR/ForkPoolWorker-4] [7a992589-6f88-48e0-b455-ffd58d54b275] Failed to execute task Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:03.289117278Z Traceback (most recent call last): 2024-04-11T22:37:03.289121191Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:03.289124822Z args.func(args) 2024-04-11T22:37:03.289128345Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:03.289131809Z return func(*args, **kwargs) 2024-04-11T22:37:03.289134716Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:03.289137570Z return f(*args, **kwargs) 2024-04-11T22:37:03.289140558Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:03.289143437Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:03.289146292Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:03.289149513Z raise AirflowException( 2024-04-11T22:37:03.289153064Z airflow.exceptions.AirflowException: Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:03.305601509Z [2024-04-11 22:37:03,305: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-11T22:37:03.308570760Z [2024-04-11 22:37:03,308: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.321939878Z [2024-04-11 22:37:03,321: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[7a992589-6f88-48e0-b455-ffd58d54b275] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7a992589-6f88-48e0-b455-ffd58d54b275') 2024-04-11T22:37:03.321956074Z Traceback (most recent call last): 2024-04-11T22:37:03.321961651Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:03.321965811Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:03.321970333Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:03.321974824Z return self.run(*args, **kwargs) 2024-04-11T22:37:03.321979729Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:03.321984210Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:03.321988029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:03.322007597Z raise AirflowException(msg) 2024-04-11T22:37:03.322011210Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7a992589-6f88-48e0-b455-ffd58d54b275 2024-04-11T22:37:03.338027021Z [2024-04-11 22:37:03,337: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-11T22:37:03.339687167Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.339696706Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.339812863Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.339818747Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-11T22:37:03.340008139Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:03.340065025Z [2024-04-11 22:37:03,339: INFO/ForkPoolWorker-5] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.351573129Z [2024-04-11 22:37:03,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:37:03.363850901Z [2024-04-11 22:37:03,363: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:37:03.366613217Z [2024-04-11 22:37:03,366: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.386696227Z [2024-04-11 22:37:03,386: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:37:03.387564508Z [2024-04-11 22:37:03,387: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.387615989Z [2024-04-11 22:37:03,387: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.387732675Z [2024-04-11 22:37:03,387: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.387780017Z [2024-04-11 22:37:03,387: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:37:03.388080053Z [2024-04-11 22:37:03,387: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:03.388171872Z [2024-04-11 22:37:03,388: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.393341860Z [2024-04-11 22:37:03,393: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:03.393982617Z [2024-04-11 22:37:03,393: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:03.394721211Z [2024-04-11 22:37:03,394: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:37:03.397024430Z [2024-04-11 22:37:03,396: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:03.403859316Z [2024-04-11 22:37:03,403: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:37:03.405774848Z [2024-04-11 22:37:03,405: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:37:03.406691426Z [2024-04-11 22:37:03,406: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:03.406733878Z [2024-04-11 22:37:03,406: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:03.406848250Z [2024-04-11 22:37:03,406: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:03.406890136Z [2024-04-11 22:37:03,406: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:37:03.407104263Z [2024-04-11 22:37:03,406: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:03.407153323Z [2024-04-11 22:37:03,407: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:03.409835270Z [2024-04-11 22:37:03,409: ERROR/ForkPoolWorker-3] [1f14bd26-9cae-40d0-8a87-9b46bbbe1442] Failed to execute task Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:03.409846555Z Traceback (most recent call last): 2024-04-11T22:37:03.409851070Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:03.409855195Z args.func(args) 2024-04-11T22:37:03.409860554Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:03.409864669Z return func(*args, **kwargs) 2024-04-11T22:37:03.409868211Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:03.409871937Z return f(*args, **kwargs) 2024-04-11T22:37:03.409879368Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:03.409883058Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:03.409886604Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:03.409893217Z raise AirflowException( 2024-04-11T22:37:03.409897671Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:03.440178958Z [2024-04-11 22:37:03,439: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1f14bd26-9cae-40d0-8a87-9b46bbbe1442] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f14bd26-9cae-40d0-8a87-9b46bbbe1442') 2024-04-11T22:37:03.440193278Z Traceback (most recent call last): 2024-04-11T22:37:03.440197279Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:03.440200481Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:03.440203650Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:03.440206799Z return self.run(*args, **kwargs) 2024-04-11T22:37:03.440210569Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:03.440214660Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:03.440227936Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:03.440231788Z raise AirflowException(msg) 2024-04-11T22:37:03.440235226Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f14bd26-9cae-40d0-8a87-9b46bbbe1442 2024-04-11T22:37:05.249433448Z [2024-04-11 22:37:05,249: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[edadfbbb-df33-4a79-a858-ecda7088b0b5] succeeded in 4.6063508530000945s: None 2024-04-11T22:37:05.264245038Z [2024-04-11 22:37:05,263: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39735726-1ef2-4f7e-b13b-0f81b7610dd9] succeeded in 4.642930390000174s: None 2024-04-11T22:37:08.412134063Z [2024-04-11 22:37:08,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df531f39-6c26-499d-a285-c184632d519e] received 2024-04-11T22:37:08.423438385Z [2024-04-11 22:37:08,423: INFO/ForkPoolWorker-15] [df531f39-6c26-499d-a285-c184632d519e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:37:08.655921485Z [2024-04-11 22:37:08,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:37:09.584406278Z [2024-04-11 22:37:09,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:09.586985375Z [2024-04-11 22:37:09,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:09.606874238Z [2024-04-11 22:37:09,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:09.608182925Z [2024-04-11 22:37:09,607: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:09.608293806Z [2024-04-11 22:37:09,608: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:09.608535975Z [2024-04-11 22:37:09,608: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:09.608573571Z [2024-04-11 22:37:09,608: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:09.608991916Z [2024-04-11 22:37:09,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:37:09.609005961Z [2024-04-11 22:37:09,608: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:09.615817780Z [2024-04-11 22:37:09,615: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:37:09.616544708Z [2024-04-11 22:37:09,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:37:09.617450178Z [2024-04-11 22:37:09,617: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:09.620516732Z [2024-04-11 22:37:09,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:09.635364473Z [2024-04-11 22:37:09,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:09.636730175Z [2024-04-11 22:37:09,636: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:09.636787089Z [2024-04-11 22:37:09,636: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:09.636993174Z [2024-04-11 22:37:09,636: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:09.637035914Z [2024-04-11 22:37:09,636: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:09.637354127Z [2024-04-11 22:37:09,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:37:09.637379380Z [2024-04-11 22:37:09,637: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:09.640750038Z [2024-04-11 22:37:09,640: ERROR/ForkPoolWorker-15] [df531f39-6c26-499d-a285-c184632d519e] Failed to execute task Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:09.640777427Z Traceback (most recent call last): 2024-04-11T22:37:09.640786688Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:09.640795539Z args.func(args) 2024-04-11T22:37:09.640804924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:09.640813505Z return func(*args, **kwargs) 2024-04-11T22:37:09.640821307Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:09.640830160Z return f(*args, **kwargs) 2024-04-11T22:37:09.640838400Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:09.640846343Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:09.640854417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:09.640862567Z raise AirflowException( 2024-04-11T22:37:09.640871567Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:09.678280684Z [2024-04-11 22:37:09,677: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df531f39-6c26-499d-a285-c184632d519e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id df531f39-6c26-499d-a285-c184632d519e') 2024-04-11T22:37:09.678292693Z Traceback (most recent call last): 2024-04-11T22:37:09.678296244Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:09.678299013Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:09.678301686Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:09.678304370Z return self.run(*args, **kwargs) 2024-04-11T22:37:09.678307800Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:09.678311148Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:09.678323130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:09.678326313Z raise AirflowException(msg) 2024-04-11T22:37:09.678329390Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id df531f39-6c26-499d-a285-c184632d519e 2024-04-11T22:37:14.276664129Z [2024-04-11 22:37:14,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2027196-4950-4650-929f-63956d218146] received 2024-04-11T22:37:14.279379599Z [2024-04-11 22:37:14,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26573084-6fcf-4b9f-82a2-85c8f38f3983] received 2024-04-11T22:37:14.281856925Z [2024-04-11 22:37:14,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64436d25-4260-4c77-b9fe-99dae5e05549] received 2024-04-11T22:37:14.282098380Z [2024-04-11 22:37:14,281: INFO/ForkPoolWorker-15] [d2027196-4950-4650-929f-63956d218146] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:14.288832263Z [2024-04-11 22:37:14,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[075ef931-b9e7-4efe-8881-e82fc6183ae0] received 2024-04-11T22:37:14.291495298Z [2024-04-11 22:37:14,291: INFO/ForkPoolWorker-1] [64436d25-4260-4c77-b9fe-99dae5e05549] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:14.294743145Z [2024-04-11 22:37:14,294: INFO/ForkPoolWorker-16] [26573084-6fcf-4b9f-82a2-85c8f38f3983] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:14.296168251Z [2024-04-11 22:37:14,295: INFO/ForkPoolWorker-2] [075ef931-b9e7-4efe-8881-e82fc6183ae0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:14.574349275Z [2024-04-11 22:37:14,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:14.580649723Z [2024-04-11 22:37:14,577: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:14.611075129Z [2024-04-11 22:37:14,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:14.632814299Z [2024-04-11 22:37:14,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:15.647588178Z [2024-04-11 22:37:15,647: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:37:15.651401620Z [2024-04-11 22:37:15,651: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.670326264Z [2024-04-11 22:37:15,670: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:37:15.673944105Z [2024-04-11 22:37:15,673: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.675124487Z [2024-04-11 22:37:15,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:37:15.676451336Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.676544499Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.676714208Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.676725824Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:37:15.676947536Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:15.676973845Z [2024-04-11 22:37:15,676: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.683129754Z [2024-04-11 22:37:15,683: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:15.685523015Z [2024-04-11 22:37:15,684: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:15.686247070Z [2024-04-11 22:37:15,686: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:37:15.690371700Z [2024-04-11 22:37:15,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.691878927Z [2024-04-11 22:37:15,691: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:37:15.693747027Z [2024-04-11 22:37:15,693: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.694233984Z [2024-04-11 22:37:15,693: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.694487530Z [2024-04-11 22:37:15,694: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.694724496Z [2024-04-11 22:37:15,694: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:37:15.694957489Z [2024-04-11 22:37:15,694: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:15.695394731Z [2024-04-11 22:37:15,695: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.701083351Z [2024-04-11 22:37:15,700: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:15.701813402Z [2024-04-11 22:37:15,701: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:37:15.702604068Z [2024-04-11 22:37:15,702: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:37:15.703510502Z [2024-04-11 22:37:15,703: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:15.706759782Z [2024-04-11 22:37:15,706: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.707370557Z [2024-04-11 22:37:15,706: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.714354733Z [2024-04-11 22:37:15,714: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:37:15.715983910Z [2024-04-11 22:37:15,715: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.716040871Z [2024-04-11 22:37:15,715: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.716196736Z [2024-04-11 22:37:15,716: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.716260774Z [2024-04-11 22:37:15,716: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:37:15.716502541Z [2024-04-11 22:37:15,716: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:15.716567246Z [2024-04-11 22:37:15,716: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.719689088Z [2024-04-11 22:37:15,719: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:37:15.720811973Z [2024-04-11 22:37:15,719: ERROR/ForkPoolWorker-1] [64436d25-4260-4c77-b9fe-99dae5e05549] Failed to execute task Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:15.720827891Z Traceback (most recent call last): 2024-04-11T22:37:15.720833846Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:15.720837848Z args.func(args) 2024-04-11T22:37:15.720841408Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:15.720844756Z return func(*args, **kwargs) 2024-04-11T22:37:15.720847751Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:15.720850684Z return f(*args, **kwargs) 2024-04-11T22:37:15.720853509Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:15.720856421Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:15.720859381Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:15.720862146Z raise AirflowException( 2024-04-11T22:37:15.720865756Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:15.722495101Z [2024-04-11 22:37:15,722: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.722950839Z [2024-04-11 22:37:15,722: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.723257302Z [2024-04-11 22:37:15,723: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.724006346Z [2024-04-11 22:37:15,723: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:37:15.725556173Z [2024-04-11 22:37:15,725: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:37:15.725718167Z [2024-04-11 22:37:15,725: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.729662423Z [2024-04-11 22:37:15,728: ERROR/ForkPoolWorker-2] [075ef931-b9e7-4efe-8881-e82fc6183ae0] Failed to execute task Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:15.729673263Z Traceback (most recent call last): 2024-04-11T22:37:15.729676840Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:15.729680132Z args.func(args) 2024-04-11T22:37:15.729683459Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:15.729686803Z return func(*args, **kwargs) 2024-04-11T22:37:15.729689441Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:15.729692190Z return f(*args, **kwargs) 2024-04-11T22:37:15.729694937Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:15.729697573Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:15.729700142Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:15.729702832Z raise AirflowException( 2024-04-11T22:37:15.729706183Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:15.750269000Z [2024-04-11 22:37:15,749: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64436d25-4260-4c77-b9fe-99dae5e05549] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 64436d25-4260-4c77-b9fe-99dae5e05549') 2024-04-11T22:37:15.750279019Z Traceback (most recent call last): 2024-04-11T22:37:15.750282713Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:15.750285522Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:15.750288293Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:15.750291023Z return self.run(*args, **kwargs) 2024-04-11T22:37:15.750294162Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:15.750298099Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:15.750300734Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:15.750303815Z raise AirflowException(msg) 2024-04-11T22:37:15.750307582Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 64436d25-4260-4c77-b9fe-99dae5e05549 2024-04-11T22:37:15.765350032Z [2024-04-11 22:37:15,765: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:15.767668031Z [2024-04-11 22:37:15,767: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.767843765Z [2024-04-11 22:37:15,767: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.768041759Z [2024-04-11 22:37:15,767: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.768062743Z [2024-04-11 22:37:15,767: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:15.768338838Z [2024-04-11 22:37:15,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:15.768443448Z [2024-04-11 22:37:15,768: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.776502667Z [2024-04-11 22:37:15,774: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[075ef931-b9e7-4efe-8881-e82fc6183ae0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 075ef931-b9e7-4efe-8881-e82fc6183ae0') 2024-04-11T22:37:15.776517126Z Traceback (most recent call last): 2024-04-11T22:37:15.776521726Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:15.776525594Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:15.776529242Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:15.776532986Z return self.run(*args, **kwargs) 2024-04-11T22:37:15.776536941Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:15.776546187Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:15.776549989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:15.776554105Z raise AirflowException(msg) 2024-04-11T22:37:15.776559244Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 075ef931-b9e7-4efe-8881-e82fc6183ae0 2024-04-11T22:37:15.776563813Z [2024-04-11 22:37:15,775: WARNING/ForkPoolWorker-15] Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:15.776611285Z [2024-04-11 22:37:15,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:15.777535708Z [2024-04-11 22:37:15,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:37:15.780442623Z [2024-04-11 22:37:15,780: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.795272227Z [2024-04-11 22:37:15,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:37:15.796993092Z [2024-04-11 22:37:15,796: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.797024057Z [2024-04-11 22:37:15,796: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.797187842Z [2024-04-11 22:37:15,797: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.797248103Z [2024-04-11 22:37:15,797: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:37:15.797542043Z [2024-04-11 22:37:15,797: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:15.797597551Z [2024-04-11 22:37:15,797: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.802867599Z [2024-04-11 22:37:15,802: ERROR/ForkPoolWorker-15] [d2027196-4950-4650-929f-63956d218146] Failed to execute task Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:15.802875315Z Traceback (most recent call last): 2024-04-11T22:37:15.802878790Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:15.802882312Z args.func(args) 2024-04-11T22:37:15.802885656Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:15.802889601Z return func(*args, **kwargs) 2024-04-11T22:37:15.802892860Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:15.802896355Z return f(*args, **kwargs) 2024-04-11T22:37:15.802899224Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:15.802902083Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:15.802905274Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:15.802908105Z raise AirflowException( 2024-04-11T22:37:15.802911509Z airflow.exceptions.AirflowException: Dag 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:15.845028039Z [2024-04-11 22:37:15,844: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2027196-4950-4650-929f-63956d218146] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d2027196-4950-4650-929f-63956d218146') 2024-04-11T22:37:15.845042137Z Traceback (most recent call last): 2024-04-11T22:37:15.845046321Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:15.845049703Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:15.845052846Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:15.845055949Z return self.run(*args, **kwargs) 2024-04-11T22:37:15.845060067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:15.845063846Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:15.845066811Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:15.845071103Z raise AirflowException(msg) 2024-04-11T22:37:15.845074983Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d2027196-4950-4650-929f-63956d218146 2024-04-11T22:37:15.854833606Z [2024-04-11 22:37:15,854: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:37:15.858353665Z [2024-04-11 22:37:15,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.874191023Z [2024-04-11 22:37:15,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:37:15.875189574Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.875266867Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.875426385Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.875485199Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:37:15.875791886Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:15.875888778Z [2024-04-11 22:37:15,875: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.882990884Z [2024-04-11 22:37:15,882: WARNING/ForkPoolWorker-16] Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:15.883689289Z [2024-04-11 22:37:15,883: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:37:15.884574189Z [2024-04-11 22:37:15,884: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:37:15.887573155Z [2024-04-11 22:37:15,887: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:37:15.902904291Z [2024-04-11 22:37:15,902: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:37:15.903854511Z [2024-04-11 22:37:15,903: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:37:15.903926165Z [2024-04-11 22:37:15,903: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:37:15.904197683Z [2024-04-11 22:37:15,903: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:37:15.904268387Z [2024-04-11 22:37:15,904: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:37:15.904543527Z [2024-04-11 22:37:15,904: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:37:15.904596187Z [2024-04-11 22:37:15,904: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:37:15.907392149Z [2024-04-11 22:37:15,906: ERROR/ForkPoolWorker-16] [26573084-6fcf-4b9f-82a2-85c8f38f3983] Failed to execute task Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:37:15.907416807Z Traceback (most recent call last): 2024-04-11T22:37:15.907424655Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:37:15.907453147Z args.func(args) 2024-04-11T22:37:15.907460358Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:37:15.907467928Z return func(*args, **kwargs) 2024-04-11T22:37:15.907473789Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:37:15.907479576Z return f(*args, **kwargs) 2024-04-11T22:37:15.907485349Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:37:15.907503896Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:37:15.907509703Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:37:15.907515511Z raise AirflowException( 2024-04-11T22:37:15.907522794Z airflow.exceptions.AirflowException: Dag 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:37:15.954836076Z [2024-04-11 22:37:15,953: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26573084-6fcf-4b9f-82a2-85c8f38f3983] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 26573084-6fcf-4b9f-82a2-85c8f38f3983') 2024-04-11T22:37:15.954877816Z Traceback (most recent call last): 2024-04-11T22:37:15.954889138Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:37:15.954898028Z R = retval = fun(*args, **kwargs) 2024-04-11T22:37:15.954907032Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:37:15.954915585Z return self.run(*args, **kwargs) 2024-04-11T22:37:15.954925427Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:37:15.954935949Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:37:15.954944937Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:37:15.954954670Z raise AirflowException(msg) 2024-04-11T22:37:15.954964926Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 26573084-6fcf-4b9f-82a2-85c8f38f3983 2024-04-11T22:38:01.038275567Z [2024-04-11 22:38:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f332a2f2-ca77-459e-be01-939dbbd49d7f] received 2024-04-11T22:38:01.041813409Z [2024-04-11 22:38:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad4abd3a-625d-4390-914a-8baf499a967c] received 2024-04-11T22:38:01.045333483Z [2024-04-11 22:38:01,045: INFO/ForkPoolWorker-15] [f332a2f2-ca77-459e-be01-939dbbd49d7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:38:01.045554245Z [2024-04-11 22:38:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b26d366a-b1e3-47e7-83dc-9b74b5b331d6] received 2024-04-11T22:38:01.055791519Z [2024-04-11 22:38:01,055: INFO/ForkPoolWorker-16] [ad4abd3a-625d-4390-914a-8baf499a967c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:38:01.057342249Z [2024-04-11 22:38:01,056: INFO/ForkPoolWorker-1] [b26d366a-b1e3-47e7-83dc-9b74b5b331d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:38:01.061506529Z [2024-04-11 22:38:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07098e0b-135b-4bdd-9717-0cb89ad0e919] received 2024-04-11T22:38:01.088405415Z [2024-04-11 22:38:01,088: INFO/ForkPoolWorker-2] [07098e0b-135b-4bdd-9717-0cb89ad0e919] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:38:01.329133464Z [2024-04-11 22:38:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:38:01.332249641Z [2024-04-11 22:38:01,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:38:01.348460364Z [2024-04-11 22:38:01,345: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:38:01.361687424Z [2024-04-11 22:38:01,358: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:38:01.482407607Z [2024-04-11 22:38:01,481: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:38:01.486168598Z [2024-04-11 22:38:01,485: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:38:01.509350192Z [2024-04-11 22:38:01,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:38:01.510333096Z [2024-04-11 22:38:01,510: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:38:01.510561180Z [2024-04-11 22:38:01,510: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:38:01.510728650Z [2024-04-11 22:38:01,510: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:38:01.511036251Z [2024-04-11 22:38:01,510: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:38:01.572734139Z [2024-04-11 22:38:01,572: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:38:01.624656895Z [2024-04-11 22:38:01,624: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:38:02.089286561Z [2024-04-11 22:38:02,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f332a2f2-ca77-459e-be01-939dbbd49d7f] succeeded in 1.049411864999911s: None 2024-04-11T22:38:02.208126964Z [2024-04-11 22:38:02,207: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad4abd3a-625d-4390-914a-8baf499a967c] succeeded in 1.161169960000052s: None 2024-04-11T22:38:02.464161985Z [2024-04-11 22:38:02,463: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:38:02.467098601Z [2024-04-11 22:38:02,466: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:38:02.485463508Z [2024-04-11 22:38:02,485: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:38:02.486553393Z [2024-04-11 22:38:02,486: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:38:02.486667631Z [2024-04-11 22:38:02,486: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:38:02.486840157Z [2024-04-11 22:38:02,486: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:38:02.486911967Z [2024-04-11 22:38:02,486: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:38:02.487134440Z [2024-04-11 22:38:02,487: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:38:02.487203600Z [2024-04-11 22:38:02,487: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:38:02.544423965Z [2024-04-11 22:38:02,544: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:38:02.547243119Z [2024-04-11 22:38:02,546: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:38:02.552613081Z [2024-04-11 22:38:02,552: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:38:02.568888132Z [2024-04-11 22:38:02,568: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:38:02.570741499Z [2024-04-11 22:38:02,570: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:38:02.570765670Z [2024-04-11 22:38:02,570: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:38:02.570896860Z [2024-04-11 22:38:02,570: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:38:02.571074764Z [2024-04-11 22:38:02,570: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:38:02.571509867Z [2024-04-11 22:38:02,571: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:38:02.571654614Z [2024-04-11 22:38:02,571: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:38:02.644421045Z [2024-04-11 22:38:02,644: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:38:04.019436252Z [2024-04-11 22:38:04,018: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[07098e0b-135b-4bdd-9717-0cb89ad0e919] succeeded in 2.9554394940000748s: None 2024-04-11T22:38:04.344546985Z [2024-04-11 22:38:04,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b26d366a-b1e3-47e7-83dc-9b74b5b331d6] succeeded in 3.294193729999961s: None 2024-04-11T22:39:00.805461063Z [2024-04-11 22:39:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fed9e27-011f-4181-a521-8122e416935d] received 2024-04-11T22:39:00.809046522Z [2024-04-11 22:39:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87fa2cac-e01d-4341-bfb8-47565742e68b] received 2024-04-11T22:39:00.814449407Z [2024-04-11 22:39:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86845a0e-5586-4740-9ccf-b1e703d0a182] received 2024-04-11T22:39:00.815471915Z [2024-04-11 22:39:00,815: INFO/ForkPoolWorker-16] [87fa2cac-e01d-4341-bfb8-47565742e68b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:39:00.816190912Z [2024-04-11 22:39:00,815: INFO/ForkPoolWorker-15] [5fed9e27-011f-4181-a521-8122e416935d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:39:00.823966896Z [2024-04-11 22:39:00,823: INFO/ForkPoolWorker-1] [86845a0e-5586-4740-9ccf-b1e703d0a182] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:39:01.061386833Z [2024-04-11 22:39:01,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:39:01.061942982Z [2024-04-11 22:39:01,058: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:39:01.078118784Z [2024-04-11 22:39:01,075: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:39:01.196003101Z [2024-04-11 22:39:01,195: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:39:01.199869870Z [2024-04-11 22:39:01,199: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:39:01.226248717Z [2024-04-11 22:39:01,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:39:01.233091976Z [2024-04-11 22:39:01,232: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:39:01.233249689Z [2024-04-11 22:39:01,233: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:39:01.233483013Z [2024-04-11 22:39:01,233: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:39:01.233782885Z [2024-04-11 22:39:01,233: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:39:01.315390524Z [2024-04-11 22:39:01,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:39:01.861483739Z [2024-04-11 22:39:01,861: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87fa2cac-e01d-4341-bfb8-47565742e68b] succeeded in 1.0507866610000747s: None 2024-04-11T22:39:02.060293516Z [2024-04-11 22:39:02,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:39:02.063137899Z [2024-04-11 22:39:02,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:39:02.077302771Z [2024-04-11 22:39:02,077: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:39:02.078514811Z [2024-04-11 22:39:02,078: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:39:02.078584640Z [2024-04-11 22:39:02,078: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:39:02.078765482Z [2024-04-11 22:39:02,078: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:39:02.078836770Z [2024-04-11 22:39:02,078: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:39:02.079086154Z [2024-04-11 22:39:02,078: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:39:02.079160438Z [2024-04-11 22:39:02,079: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:39:02.107116476Z [2024-04-11 22:39:02,106: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:39:02.110495083Z [2024-04-11 22:39:02,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:39:02.133233611Z [2024-04-11 22:39:02,133: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:39:02.134454862Z [2024-04-11 22:39:02,134: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:39:02.134559972Z [2024-04-11 22:39:02,134: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:39:02.134750441Z [2024-04-11 22:39:02,134: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:39:02.134873125Z [2024-04-11 22:39:02,134: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:39:02.135139512Z [2024-04-11 22:39:02,135: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:39:02.135264959Z [2024-04-11 22:39:02,135: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:39:02.165471293Z [2024-04-11 22:39:02,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:39:02.211323471Z [2024-04-11 22:39:02,211: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:39:03.825049044Z [2024-04-11 22:39:03,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fed9e27-011f-4181-a521-8122e416935d] succeeded in 3.01782650999985s: None 2024-04-11T22:39:04.363339730Z [2024-04-11 22:39:04,362: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86845a0e-5586-4740-9ccf-b1e703d0a182] succeeded in 3.546500235999929s: None 2024-04-11T22:40:00.609192011Z [2024-04-11 22:40:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58f31355-1906-4de6-a9f6-9bcd18815956] received 2024-04-11T22:40:00.613408537Z [2024-04-11 22:40:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4519a64-1835-45df-8ed4-eec6065298fa] received 2024-04-11T22:40:00.623211115Z [2024-04-11 22:40:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e19eccf-ba52-4dd3-bed1-bb5f4cfea507] received 2024-04-11T22:40:00.625573181Z [2024-04-11 22:40:00,625: INFO/ForkPoolWorker-16] [a4519a64-1835-45df-8ed4-eec6065298fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:40:00.636899921Z [2024-04-11 22:40:00,636: INFO/ForkPoolWorker-1] [1e19eccf-ba52-4dd3-bed1-bb5f4cfea507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:00.642938677Z [2024-04-11 22:40:00,642: INFO/ForkPoolWorker-15] [58f31355-1906-4de6-a9f6-9bcd18815956] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:40:00.649465206Z [2024-04-11 22:40:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87d19c2e-9ac9-42b9-9114-321a94b77ffb] received 2024-04-11T22:40:00.654863764Z [2024-04-11 22:40:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63e8b901-05be-465e-8d78-4a5cd6a4ecdd] received 2024-04-11T22:40:00.662015351Z [2024-04-11 22:40:00,661: INFO/ForkPoolWorker-2] [87d19c2e-9ac9-42b9-9114-321a94b77ffb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:40:00.703478172Z [2024-04-11 22:40:00,703: INFO/ForkPoolWorker-3] [63e8b901-05be-465e-8d78-4a5cd6a4ecdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:40:01.063782880Z [2024-04-11 22:40:01,048: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:40:01.358989481Z [2024-04-11 22:40:01,358: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-11T22:40:01.363181861Z [2024-04-11 22:40:01,362: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:01.446865112Z [2024-04-11 22:40:01,442: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:40:01.463997402Z [2024-04-11 22:40:01,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:40:01.541616190Z [2024-04-11 22:40:01,509: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:40:01.544231398Z [2024-04-11 22:40:01,543: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:40:01.545887526Z [2024-04-11 22:40:01,545: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:40:01.546127641Z [2024-04-11 22:40:01,545: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:40:01.546358186Z [2024-04-11 22:40:01,546: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-11T22:40:01.546976475Z [2024-04-11 22:40:01,546: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:40:01.731795811Z [2024-04-11 22:40:01,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:40:01.735430414Z [2024-04-11 22:40:01,735: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:02.098726948Z [2024-04-11 22:40:02,098: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:02.848269495Z [2024-04-11 22:40:02,847: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[63e8b901-05be-465e-8d78-4a5cd6a4ecdd] succeeded in 2.1662309189998723s: None 2024-04-11T22:40:03.188057194Z [2024-04-11 22:40:03,187: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87d19c2e-9ac9-42b9-9114-321a94b77ffb] succeeded in 2.53158635900013s: None 2024-04-11T22:40:03.763589311Z [2024-04-11 22:40:03,763: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:40:03.767189748Z [2024-04-11 22:40:03,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:03.799560059Z [2024-04-11 22:40:03,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:40:03.800522343Z [2024-04-11 22:40:03,800: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:03.800534725Z [2024-04-11 22:40:03,800: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:03.800816223Z [2024-04-11 22:40:03,800: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:03.801127023Z [2024-04-11 22:40:03,800: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:40:03.801662395Z [2024-04-11 22:40:03,801: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:40:03.801799136Z [2024-04-11 22:40:03,801: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:03.934246647Z [2024-04-11 22:40:03,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:04.315041748Z [2024-04-11 22:40:04,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:40:04.318546240Z [2024-04-11 22:40:04,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:04.362459662Z [2024-04-11 22:40:04,362: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:40:04.364054538Z [2024-04-11 22:40:04,363: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:04.364252294Z [2024-04-11 22:40:04,363: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:04.364574682Z [2024-04-11 22:40:04,364: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:04.364777260Z [2024-04-11 22:40:04,364: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:40:04.365181992Z [2024-04-11 22:40:04,365: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:40:04.365677642Z [2024-04-11 22:40:04,365: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:04.514672719Z [2024-04-11 22:40:04,514: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:40:04.530539070Z [2024-04-11 22:40:04,530: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:04.547830347Z [2024-04-11 22:40:04,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:04.558834248Z [2024-04-11 22:40:04,558: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:40:04.559989562Z [2024-04-11 22:40:04,559: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:04.560006562Z [2024-04-11 22:40:04,559: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:04.560155993Z [2024-04-11 22:40:04,559: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:04.560243843Z [2024-04-11 22:40:04,560: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:40:04.560463873Z [2024-04-11 22:40:04,560: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:40:04.560520343Z [2024-04-11 22:40:04,560: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:04.647691969Z [2024-04-11 22:40:04,647: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:05.250331074Z [2024-04-11 22:40:05,249: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e19eccf-ba52-4dd3-bed1-bb5f4cfea507] succeeded in 4.6255229570001575s: None 2024-04-11T22:40:05.741137947Z [2024-04-11 22:40:05,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[512dced0-159e-4ee0-a780-4607ed25b120] received 2024-04-11T22:40:05.751168638Z [2024-04-11 22:40:05,750: INFO/ForkPoolWorker-1] [512dced0-159e-4ee0-a780-4607ed25b120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:05.800722313Z [2024-04-11 22:40:05,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58f31355-1906-4de6-a9f6-9bcd18815956] succeeded in 5.179517444999874s: None 2024-04-11T22:40:06.097088092Z [2024-04-11 22:40:06,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:40:06.431278150Z [2024-04-11 22:40:06,430: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4519a64-1835-45df-8ed4-eec6065298fa] succeeded in 5.816661279000073s: None 2024-04-11T22:40:07.318945326Z [2024-04-11 22:40:07,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:40:07.321942814Z [2024-04-11 22:40:07,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:07.341186039Z [2024-04-11 22:40:07,340: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:40:07.342232330Z [2024-04-11 22:40:07,342: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:07.342324638Z [2024-04-11 22:40:07,342: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:07.342521017Z [2024-04-11 22:40:07,342: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:07.342862681Z [2024-04-11 22:40:07,342: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:40:07.343549324Z [2024-04-11 22:40:07,343: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:40:07.343684145Z [2024-04-11 22:40:07,343: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:07.437573620Z [2024-04-11 22:40:07,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:08.307139770Z [2024-04-11 22:40:08,306: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[512dced0-159e-4ee0-a780-4607ed25b120] succeeded in 2.563713018000044s: None 2024-04-11T22:40:09.042859268Z [2024-04-11 22:40:09,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be853b02-e2d1-447f-8c39-d3723dcea414] received 2024-04-11T22:40:09.052090886Z [2024-04-11 22:40:09,051: INFO/ForkPoolWorker-15] [be853b02-e2d1-447f-8c39-d3723dcea414] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:40:09.355983654Z [2024-04-11 22:40:09,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:40:10.571136140Z [2024-04-11 22:40:10,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:40:10.577950056Z [2024-04-11 22:40:10,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:10.602520505Z [2024-04-11 22:40:10,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:40:10.603941148Z [2024-04-11 22:40:10,603: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:10.604160575Z [2024-04-11 22:40:10,604: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:10.604447779Z [2024-04-11 22:40:10,604: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:10.604629784Z [2024-04-11 22:40:10,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:40:10.605090269Z [2024-04-11 22:40:10,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:40:10.605274948Z [2024-04-11 22:40:10,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:10.674415333Z [2024-04-11 22:40:10,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:11.202258599Z [2024-04-11 22:40:11,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be853b02-e2d1-447f-8c39-d3723dcea414] succeeded in 2.1568041079999603s: None 2024-04-11T22:40:11.800966557Z [2024-04-11 22:40:11,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[444630a1-5f94-4c23-a3de-446e141ce52c] received 2024-04-11T22:40:11.813687512Z [2024-04-11 22:40:11,813: INFO/ForkPoolWorker-15] [444630a1-5f94-4c23-a3de-446e141ce52c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:12.076422019Z [2024-04-11 22:40:12,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:40:13.498537616Z [2024-04-11 22:40:13,498: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:40:13.501617676Z [2024-04-11 22:40:13,501: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:40:13.521399506Z [2024-04-11 22:40:13,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:40:13.522443343Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:40:13.522457077Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:40:13.522616560Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:40:13.522661668Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:40:13.522872735Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:40:13.522917079Z [2024-04-11 22:40:13,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:40:13.635804409Z [2024-04-11 22:40:13,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:40:14.203774699Z [2024-04-11 22:40:14,203: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[444630a1-5f94-4c23-a3de-446e141ce52c] succeeded in 2.3979593950000435s: None 2024-04-11T22:41:01.228549277Z [2024-04-11 22:41:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9334bb8f-cef9-4259-97ed-1355f9ba659c] received 2024-04-11T22:41:01.233593112Z [2024-04-11 22:41:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e9c574a-a7e4-4258-b1d4-ac56e70e6521] received 2024-04-11T22:41:01.236002799Z [2024-04-11 22:41:01,235: INFO/ForkPoolWorker-15] [9334bb8f-cef9-4259-97ed-1355f9ba659c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:41:01.244282744Z [2024-04-11 22:41:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f19f60c-b3f7-4245-bb89-9a175c9c1f63] received 2024-04-11T22:41:01.246878345Z [2024-04-11 22:41:01,246: INFO/ForkPoolWorker-16] [5e9c574a-a7e4-4258-b1d4-ac56e70e6521] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:41:01.252295776Z [2024-04-11 22:41:01,252: INFO/ForkPoolWorker-1] [7f19f60c-b3f7-4245-bb89-9a175c9c1f63] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:41:01.494384825Z [2024-04-11 22:41:01,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:41:01.495685651Z [2024-04-11 22:41:01,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:41:01.530239312Z [2024-04-11 22:41:01,526: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:41:01.685801607Z [2024-04-11 22:41:01,684: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:41:01.693921186Z [2024-04-11 22:41:01,693: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:41:01.736901922Z [2024-04-11 22:41:01,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:41:01.737630742Z [2024-04-11 22:41:01,737: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:41:01.737701106Z [2024-04-11 22:41:01,737: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:41:01.737791536Z [2024-04-11 22:41:01,737: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:41:01.737979352Z [2024-04-11 22:41:01,737: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:41:01.813885296Z [2024-04-11 22:41:01,813: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:41:02.368341525Z [2024-04-11 22:41:02,367: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f19f60c-b3f7-4245-bb89-9a175c9c1f63] succeeded in 1.121923188999972s: None 2024-04-11T22:41:02.534447359Z [2024-04-11 22:41:02,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:41:02.537353838Z [2024-04-11 22:41:02,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:41:02.558201780Z [2024-04-11 22:41:02,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:41:02.559290112Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:41:02.559305881Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:41:02.559418928Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:41:02.559428415Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:41:02.559606984Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:41:02.559641099Z [2024-04-11 22:41:02,559: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:41:02.624868096Z [2024-04-11 22:41:02,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:41:02.692633501Z [2024-04-11 22:41:02,692: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:41:02.696027695Z [2024-04-11 22:41:02,695: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:41:02.722675863Z [2024-04-11 22:41:02,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:41:02.724073536Z [2024-04-11 22:41:02,723: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:41:02.724211739Z [2024-04-11 22:41:02,724: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:41:02.724577976Z [2024-04-11 22:41:02,724: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:41:02.724706246Z [2024-04-11 22:41:02,724: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:41:02.724994638Z [2024-04-11 22:41:02,724: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:41:02.725127252Z [2024-04-11 22:41:02,725: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:41:02.797848658Z [2024-04-11 22:41:02,797: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:41:04.281583016Z [2024-04-11 22:41:04,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e9c574a-a7e4-4258-b1d4-ac56e70e6521] succeeded in 3.0447859210000843s: None 2024-04-11T22:41:04.467709717Z [2024-04-11 22:41:04,467: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9334bb8f-cef9-4259-97ed-1355f9ba659c] succeeded in 3.2376779140001872s: None 2024-04-11T22:42:00.610713082Z [2024-04-11 22:42:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdf81154-18f0-4c17-8527-e10007ca24e1] received 2024-04-11T22:42:00.613388896Z [2024-04-11 22:42:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ee7b78-8707-4181-987d-ef5535bb161d] received 2024-04-11T22:42:00.624161983Z [2024-04-11 22:42:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3302b470-bbba-44cb-b525-e3c210be09ac] received 2024-04-11T22:42:00.626604239Z [2024-04-11 22:42:00,626: INFO/ForkPoolWorker-16] [23ee7b78-8707-4181-987d-ef5535bb161d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:42:00.627914637Z [2024-04-11 22:42:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20664490-abbf-4e8a-ade4-0aac374ef709] received 2024-04-11T22:42:00.633756522Z [2024-04-11 22:42:00,633: INFO/ForkPoolWorker-15] [cdf81154-18f0-4c17-8527-e10007ca24e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:42:00.640113728Z [2024-04-11 22:42:00,639: INFO/ForkPoolWorker-2] [20664490-abbf-4e8a-ade4-0aac374ef709] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:42:00.642511763Z [2024-04-11 22:42:00,642: INFO/ForkPoolWorker-1] [3302b470-bbba-44cb-b525-e3c210be09ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:42:00.907416636Z [2024-04-11 22:42:00,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:42:00.936009578Z [2024-04-11 22:42:00,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:42:00.939538043Z [2024-04-11 22:42:00,936: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:42:00.991298893Z [2024-04-11 22:42:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:42:01.075394923Z [2024-04-11 22:42:01,075: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T22:42:01.078978216Z [2024-04-11 22:42:01,078: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:42:01.106939219Z [2024-04-11 22:42:01,106: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:42:01.107939302Z [2024-04-11 22:42:01,107: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:42:01.108171632Z [2024-04-11 22:42:01,108: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:42:01.108315013Z [2024-04-11 22:42:01,108: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T22:42:01.108618074Z [2024-04-11 22:42:01,108: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:42:01.176711171Z [2024-04-11 22:42:01,176: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:42:01.211558451Z [2024-04-11 22:42:01,211: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:42:01.717375920Z [2024-04-11 22:42:01,717: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20664490-abbf-4e8a-ade4-0aac374ef709] succeeded in 1.0872144110001045s: None 2024-04-11T22:42:01.745282630Z [2024-04-11 22:42:01,744: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3302b470-bbba-44cb-b525-e3c210be09ac] succeeded in 1.117324950000011s: None 2024-04-11T22:42:02.092209374Z [2024-04-11 22:42:02,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:42:02.095145223Z [2024-04-11 22:42:02,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:42:02.128459530Z [2024-04-11 22:42:02,128: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:42:02.130115862Z [2024-04-11 22:42:02,129: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:42:02.130213365Z [2024-04-11 22:42:02,130: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:42:02.130354131Z [2024-04-11 22:42:02,130: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:42:02.130446712Z [2024-04-11 22:42:02,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:42:02.130834601Z [2024-04-11 22:42:02,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:42:02.130920593Z [2024-04-11 22:42:02,130: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:42:02.193169263Z [2024-04-11 22:42:02,192: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:42:02.196324966Z [2024-04-11 22:42:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:42:02.215072076Z [2024-04-11 22:42:02,214: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:42:02.216203889Z [2024-04-11 22:42:02,215: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:42:02.216481292Z [2024-04-11 22:42:02,216: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:42:02.216585580Z [2024-04-11 22:42:02,216: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:42:02.216700492Z [2024-04-11 22:42:02,216: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:42:02.216725215Z [2024-04-11 22:42:02,216: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:42:02.216935595Z [2024-04-11 22:42:02,216: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:42:02.220984192Z [2024-04-11 22:42:02,220: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:42:02.290646167Z [2024-04-11 22:42:02,290: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:42:03.697583534Z [2024-04-11 22:42:03,697: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23ee7b78-8707-4181-987d-ef5535bb161d] succeeded in 3.0827287349998187s: None 2024-04-11T22:42:04.050518566Z [2024-04-11 22:42:04,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdf81154-18f0-4c17-8527-e10007ca24e1] succeeded in 3.435531405999882s: None 2024-04-11T22:43:00.554685924Z [2024-04-11 22:43:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60d3605c-9b70-41ec-8d4d-1b87cfddd6f4] received 2024-04-11T22:43:00.558121990Z [2024-04-11 22:43:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11d5158e-4bed-4aa5-8983-f873062d81e6] received 2024-04-11T22:43:00.560726377Z [2024-04-11 22:43:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d379145c-2a5c-4bf5-acea-e60cdf203c6b] received 2024-04-11T22:43:00.569408473Z [2024-04-11 22:43:00,569: INFO/ForkPoolWorker-15] [60d3605c-9b70-41ec-8d4d-1b87cfddd6f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:43:00.572726344Z [2024-04-11 22:43:00,572: INFO/ForkPoolWorker-1] [d379145c-2a5c-4bf5-acea-e60cdf203c6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:43:00.573303763Z [2024-04-11 22:43:00,573: INFO/ForkPoolWorker-16] [11d5158e-4bed-4aa5-8983-f873062d81e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:43:00.832600064Z [2024-04-11 22:43:00,828: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:43:00.859596510Z [2024-04-11 22:43:00,856: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:43:00.859951950Z [2024-04-11 22:43:00,856: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:43:01.006115011Z [2024-04-11 22:43:01,005: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:43:01.015815887Z [2024-04-11 22:43:01,015: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:43:01.040732550Z [2024-04-11 22:43:01,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:43:01.041806970Z [2024-04-11 22:43:01,041: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:43:01.042022881Z [2024-04-11 22:43:01,041: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:43:01.042089886Z [2024-04-11 22:43:01,041: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:43:01.042352264Z [2024-04-11 22:43:01,042: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:43:01.121610993Z [2024-04-11 22:43:01,121: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:43:01.753829021Z [2024-04-11 22:43:01,753: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d379145c-2a5c-4bf5-acea-e60cdf203c6b] succeeded in 1.1911903529999108s: None 2024-04-11T22:43:01.912644691Z [2024-04-11 22:43:01,912: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:43:01.915482290Z [2024-04-11 22:43:01,915: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:43:01.935937346Z [2024-04-11 22:43:01,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:43:01.937243736Z [2024-04-11 22:43:01,937: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:43:01.937389380Z [2024-04-11 22:43:01,937: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:43:01.937560072Z [2024-04-11 22:43:01,937: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:43:01.937730183Z [2024-04-11 22:43:01,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:43:01.937967065Z [2024-04-11 22:43:01,937: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:43:01.938194406Z [2024-04-11 22:43:01,938: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:43:01.946659596Z [2024-04-11 22:43:01,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:43:01.949713754Z [2024-04-11 22:43:01,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:43:01.982056354Z [2024-04-11 22:43:01,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:43:01.983718769Z [2024-04-11 22:43:01,983: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:43:01.983761971Z [2024-04-11 22:43:01,983: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:43:01.983853991Z [2024-04-11 22:43:01,983: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:43:01.983906049Z [2024-04-11 22:43:01,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:43:01.984087402Z [2024-04-11 22:43:01,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:43:01.984117697Z [2024-04-11 22:43:01,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:43:02.015800608Z [2024-04-11 22:43:02,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:43:02.070868491Z [2024-04-11 22:43:02,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:43:03.492726255Z [2024-04-11 22:43:03,492: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11d5158e-4bed-4aa5-8983-f873062d81e6] succeeded in 2.931419098000106s: None 2024-04-11T22:43:03.817551713Z [2024-04-11 22:43:03,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60d3605c-9b70-41ec-8d4d-1b87cfddd6f4] succeeded in 3.259864039000149s: None 2024-04-11T22:44:00.683258630Z [2024-04-11 22:44:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25fe152c-c3ec-42fe-b3f8-169d1b917dac] received 2024-04-11T22:44:00.692491154Z [2024-04-11 22:44:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6627d5f-2870-4442-8db4-a83b7a6c4b70] received 2024-04-11T22:44:00.695793515Z [2024-04-11 22:44:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db3f8538-76a4-475b-91aa-24e710ac6c7b] received 2024-04-11T22:44:00.698206383Z [2024-04-11 22:44:00,697: INFO/ForkPoolWorker-15] [25fe152c-c3ec-42fe-b3f8-169d1b917dac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:44:00.703416156Z [2024-04-11 22:44:00,703: INFO/ForkPoolWorker-16] [a6627d5f-2870-4442-8db4-a83b7a6c4b70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:44:00.703691311Z [2024-04-11 22:44:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2734fa75-721d-45e4-9445-255db89812c5] received 2024-04-11T22:44:00.707128608Z [2024-04-11 22:44:00,706: INFO/ForkPoolWorker-1] [db3f8538-76a4-475b-91aa-24e710ac6c7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:44:00.713099633Z [2024-04-11 22:44:00,712: INFO/ForkPoolWorker-2] [2734fa75-721d-45e4-9445-255db89812c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:44:00.994036712Z [2024-04-11 22:44:00,989: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:44:01.090594481Z [2024-04-11 22:44:01,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:44:01.179229008Z [2024-04-11 22:44:01,178: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:44:01.183609098Z [2024-04-11 22:44:01,183: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:44:01.189360091Z [2024-04-11 22:44:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:44:01.255122753Z [2024-04-11 22:44:01,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:44:01.256543512Z [2024-04-11 22:44:01,256: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:44:01.256706356Z [2024-04-11 22:44:01,256: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:44:01.256810746Z [2024-04-11 22:44:01,256: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:44:01.257042036Z [2024-04-11 22:44:01,256: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:44:01.278904029Z [2024-04-11 22:44:01,266: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:44:01.343564947Z [2024-04-11 22:44:01,343: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:44:01.398621463Z [2024-04-11 22:44:01,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:44:02.072600402Z [2024-04-11 22:44:02,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db3f8538-76a4-475b-91aa-24e710ac6c7b] succeeded in 1.37535640100009s: None 2024-04-11T22:44:02.117488290Z [2024-04-11 22:44:02,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25fe152c-c3ec-42fe-b3f8-169d1b917dac] succeeded in 1.4302478219999557s: None 2024-04-11T22:44:02.555028776Z [2024-04-11 22:44:02,554: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:44:02.558050843Z [2024-04-11 22:44:02,557: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:44:02.585343992Z [2024-04-11 22:44:02,585: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:44:02.586859041Z [2024-04-11 22:44:02,586: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:44:02.587032746Z [2024-04-11 22:44:02,586: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:44:02.587256340Z [2024-04-11 22:44:02,587: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:44:02.587376419Z [2024-04-11 22:44:02,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:44:02.587976612Z [2024-04-11 22:44:02,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:44:02.588157863Z [2024-04-11 22:44:02,587: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:44:02.642584783Z [2024-04-11 22:44:02,642: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:44:02.645916210Z [2024-04-11 22:44:02,645: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:44:02.671571758Z [2024-04-11 22:44:02,671: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:44:02.689306483Z [2024-04-11 22:44:02,689: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:44:02.691063058Z [2024-04-11 22:44:02,690: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:44:02.691606544Z [2024-04-11 22:44:02,691: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:44:02.696818168Z [2024-04-11 22:44:02,696: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:44:02.697504629Z [2024-04-11 22:44:02,697: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:44:02.698133737Z [2024-04-11 22:44:02,697: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:44:02.704615456Z [2024-04-11 22:44:02,704: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:44:02.795160383Z [2024-04-11 22:44:02,794: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:44:04.209781263Z [2024-04-11 22:44:04,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6627d5f-2870-4442-8db4-a83b7a6c4b70] succeeded in 3.5155757929999254s: None 2024-04-11T22:44:04.641189776Z [2024-04-11 22:44:04,640: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2734fa75-721d-45e4-9445-255db89812c5] succeeded in 3.934571883999979s: None 2024-04-11T22:45:00.920863917Z [2024-04-11 22:45:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aeb27a9-84e0-4469-8f45-27b8a5dc3288] received 2024-04-11T22:45:00.926292284Z [2024-04-11 22:45:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b8a3184-7f7e-421d-9ff2-83ab083ea99d] received 2024-04-11T22:45:00.929888255Z [2024-04-11 22:45:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[035062be-c83d-4f4c-ab1b-a71bef20a30b] received 2024-04-11T22:45:00.932831864Z [2024-04-11 22:45:00,932: INFO/ForkPoolWorker-15] [5aeb27a9-84e0-4469-8f45-27b8a5dc3288] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:00.939870008Z [2024-04-11 22:45:00,939: INFO/ForkPoolWorker-16] [8b8a3184-7f7e-421d-9ff2-83ab083ea99d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:45:00.944088405Z [2024-04-11 22:45:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0878a8e-3347-4617-8acc-454fa92d66c9] received 2024-04-11T22:45:00.949354233Z [2024-04-11 22:45:00,948: INFO/ForkPoolWorker-1] [035062be-c83d-4f4c-ab1b-a71bef20a30b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:45:00.951198692Z [2024-04-11 22:45:00,951: INFO/ForkPoolWorker-2] [e0878a8e-3347-4617-8acc-454fa92d66c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:45:01.203679733Z [2024-04-11 22:45:01,200: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:45:01.268821907Z [2024-04-11 22:45:01,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:45:01.280520940Z [2024-04-11 22:45:01,277: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:45:01.344620158Z [2024-04-11 22:45:01,344: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:45:01.348128963Z [2024-04-11 22:45:01,347: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:01.372555008Z [2024-04-11 22:45:01,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:45:01.374038514Z [2024-04-11 22:45:01,373: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:45:01.374281213Z [2024-04-11 22:45:01,374: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:45:01.374492012Z [2024-04-11 22:45:01,374: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:45:01.375037131Z [2024-04-11 22:45:01,374: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:45:01.390911004Z [2024-04-11 22:45:01,388: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:45:01.460895771Z [2024-04-11 22:45:01,460: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:02.045156370Z [2024-04-11 22:45:02,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b8a3184-7f7e-421d-9ff2-83ab083ea99d] succeeded in 1.1132782530000895s: None 2024-04-11T22:45:02.464272387Z [2024-04-11 22:45:02,463: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:45:02.467503711Z [2024-04-11 22:45:02,467: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:02.488575321Z [2024-04-11 22:45:02,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:45:02.489790376Z [2024-04-11 22:45:02,489: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:02.489987659Z [2024-04-11 22:45:02,489: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:02.490194119Z [2024-04-11 22:45:02,490: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:02.490317251Z [2024-04-11 22:45:02,490: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:45:02.490649750Z [2024-04-11 22:45:02,490: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:45:02.490798279Z [2024-04-11 22:45:02,490: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:02.503552793Z [2024-04-11 22:45:02,503: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:45:02.506511798Z [2024-04-11 22:45:02,506: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:02.534318297Z [2024-04-11 22:45:02,534: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:45:02.535783352Z [2024-04-11 22:45:02,535: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:02.535980754Z [2024-04-11 22:45:02,535: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:02.536216637Z [2024-04-11 22:45:02,536: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:02.536360200Z [2024-04-11 22:45:02,536: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:45:02.536709514Z [2024-04-11 22:45:02,536: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:45:02.536801316Z [2024-04-11 22:45:02,536: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:02.570140551Z [2024-04-11 22:45:02,569: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:02.586255288Z [2024-04-11 22:45:02,585: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:45:02.589571916Z [2024-04-11 22:45:02,589: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:02.606376768Z [2024-04-11 22:45:02,606: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:45:02.607462192Z [2024-04-11 22:45:02,607: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:02.607663376Z [2024-04-11 22:45:02,607: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:02.607877383Z [2024-04-11 22:45:02,607: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:02.607996644Z [2024-04-11 22:45:02,607: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:45:02.608255419Z [2024-04-11 22:45:02,608: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:45:02.608366720Z [2024-04-11 22:45:02,608: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:02.613300912Z [2024-04-11 22:45:02,613: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:02.693914265Z [2024-04-11 22:45:02,693: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:03.031174164Z [2024-04-11 22:45:03,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5aeb27a9-84e0-4469-8f45-27b8a5dc3288] succeeded in 2.107990243999893s: None 2024-04-11T22:45:03.327225465Z [2024-04-11 22:45:03,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07984b6b-808f-4611-b1af-580b6ff46c15] received 2024-04-11T22:45:03.335889651Z [2024-04-11 22:45:03,335: INFO/ForkPoolWorker-15] [07984b6b-808f-4611-b1af-580b6ff46c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:03.582775440Z [2024-04-11 22:45:03,579: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:45:04.128757590Z [2024-04-11 22:45:04,128: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e0878a8e-3347-4617-8acc-454fa92d66c9] succeeded in 3.182293033000178s: None 2024-04-11T22:45:04.479032222Z [2024-04-11 22:45:04,478: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[035062be-c83d-4f4c-ab1b-a71bef20a30b] succeeded in 3.542635367999992s: None 2024-04-11T22:45:04.604711705Z [2024-04-11 22:45:04,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:45:04.607781050Z [2024-04-11 22:45:04,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:04.626114966Z [2024-04-11 22:45:04,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:45:04.627251756Z [2024-04-11 22:45:04,627: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:04.627322422Z [2024-04-11 22:45:04,627: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:04.627521392Z [2024-04-11 22:45:04,627: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:04.627621932Z [2024-04-11 22:45:04,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:45:04.628519936Z [2024-04-11 22:45:04,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:45:04.628606345Z [2024-04-11 22:45:04,628: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:04.712066008Z [2024-04-11 22:45:04,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:05.415687166Z [2024-04-11 22:45:05,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07984b6b-808f-4611-b1af-580b6ff46c15] succeeded in 2.0855728139999883s: None 2024-04-11T22:45:05.708307122Z [2024-04-11 22:45:05,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[481bd006-f8dc-46e7-ae2c-8e2b31db6877] received 2024-04-11T22:45:05.719187376Z [2024-04-11 22:45:05,718: INFO/ForkPoolWorker-15] [481bd006-f8dc-46e7-ae2c-8e2b31db6877] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:45:06.009540524Z [2024-04-11 22:45:06,006: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:45:06.952386794Z [2024-04-11 22:45:06,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:45:06.955395457Z [2024-04-11 22:45:06,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:06.980043226Z [2024-04-11 22:45:06,979: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:45:06.981574142Z [2024-04-11 22:45:06,981: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:06.981622646Z [2024-04-11 22:45:06,981: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:06.981867382Z [2024-04-11 22:45:06,981: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:06.981904437Z [2024-04-11 22:45:06,981: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:45:06.982246787Z [2024-04-11 22:45:06,982: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:45:06.982260703Z [2024-04-11 22:45:06,982: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:07.079661804Z [2024-04-11 22:45:07,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:07.720541583Z [2024-04-11 22:45:07,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[481bd006-f8dc-46e7-ae2c-8e2b31db6877] succeeded in 2.0085732469999584s: None 2024-04-11T22:45:08.073643128Z [2024-04-11 22:45:08,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b034ee7d-2ffe-4353-a4df-44841d25f65e] received 2024-04-11T22:45:08.084185579Z [2024-04-11 22:45:08,083: INFO/ForkPoolWorker-15] [b034ee7d-2ffe-4353-a4df-44841d25f65e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:08.332568569Z [2024-04-11 22:45:08,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:45:09.267089549Z [2024-04-11 22:45:09,266: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:45:09.269924274Z [2024-04-11 22:45:09,269: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:45:09.294481775Z [2024-04-11 22:45:09,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:45:09.296722691Z [2024-04-11 22:45:09,296: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:45:09.296890344Z [2024-04-11 22:45:09,296: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:45:09.302879288Z [2024-04-11 22:45:09,300: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:45:09.302898212Z [2024-04-11 22:45:09,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:45:09.302903383Z [2024-04-11 22:45:09,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:45:09.302907709Z [2024-04-11 22:45:09,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:45:09.378423249Z [2024-04-11 22:45:09,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:45:09.984890682Z [2024-04-11 22:45:09,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b034ee7d-2ffe-4353-a4df-44841d25f65e] succeeded in 1.909084636999978s: None 2024-04-11T22:46:01.008591420Z [2024-04-11 22:46:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb62dd6a-842a-4e87-9d80-dcb92e103d62] received 2024-04-11T22:46:01.014276792Z [2024-04-11 22:46:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da6ee307-39a7-463a-84f4-6c6927dfc03f] received 2024-04-11T22:46:01.020504572Z [2024-04-11 22:46:01,019: INFO/ForkPoolWorker-15] [eb62dd6a-842a-4e87-9d80-dcb92e103d62] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:46:01.021219373Z [2024-04-11 22:46:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a9db721-13ac-43d3-832c-642c25a4db36] received 2024-04-11T22:46:01.023112877Z [2024-04-11 22:46:01,022: INFO/ForkPoolWorker-16] [da6ee307-39a7-463a-84f4-6c6927dfc03f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:46:01.026637133Z [2024-04-11 22:46:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbc5a6c-abe2-4158-848d-a94e7cc512ba] received 2024-04-11T22:46:01.042264199Z [2024-04-11 22:46:01,041: INFO/ForkPoolWorker-1] [2a9db721-13ac-43d3-832c-642c25a4db36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:46:01.045696710Z [2024-04-11 22:46:01,045: INFO/ForkPoolWorker-2] [2bbc5a6c-abe2-4158-848d-a94e7cc512ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:46:01.354617562Z [2024-04-11 22:46:01,351: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:46:01.359718263Z [2024-04-11 22:46:01,356: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:46:01.374887523Z [2024-04-11 22:46:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:46:01.526643420Z [2024-04-11 22:46:01,523: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:46:01.752961437Z [2024-04-11 22:46:01,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:46:01.790327161Z [2024-04-11 22:46:01,789: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T22:46:01.793772067Z [2024-04-11 22:46:01,793: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:46:01.813937720Z [2024-04-11 22:46:01,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:46:01.815148608Z [2024-04-11 22:46:01,814: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:46:01.815296761Z [2024-04-11 22:46:01,815: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:46:01.815395895Z [2024-04-11 22:46:01,815: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T22:46:01.815601887Z [2024-04-11 22:46:01,815: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:46:01.916148344Z [2024-04-11 22:46:01,915: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:46:02.730437233Z [2024-04-11 22:46:02,730: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2bbc5a6c-abe2-4158-848d-a94e7cc512ba] succeeded in 1.7014103740000337s: None 2024-04-11T22:46:02.939719826Z [2024-04-11 22:46:02,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb62dd6a-842a-4e87-9d80-dcb92e103d62] succeeded in 1.9291287650000868s: None 2024-04-11T22:46:03.490900106Z [2024-04-11 22:46:03,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:46:03.494500102Z [2024-04-11 22:46:03,493: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:46:03.530175445Z [2024-04-11 22:46:03,529: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:46:03.531773889Z [2024-04-11 22:46:03,531: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:46:03.531928761Z [2024-04-11 22:46:03,531: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:46:03.532179077Z [2024-04-11 22:46:03,531: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:46:03.532242250Z [2024-04-11 22:46:03,532: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:46:03.532871953Z [2024-04-11 22:46:03,532: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:46:03.532930225Z [2024-04-11 22:46:03,532: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:46:03.638979916Z [2024-04-11 22:46:03,638: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:46:03.743251531Z [2024-04-11 22:46:03,742: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:46:03.747511694Z [2024-04-11 22:46:03,746: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:46:03.812347490Z [2024-04-11 22:46:03,812: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:46:03.821616155Z [2024-04-11 22:46:03,821: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:46:03.823382190Z [2024-04-11 22:46:03,823: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:46:03.824128434Z [2024-04-11 22:46:03,823: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:46:03.824154516Z [2024-04-11 22:46:03,823: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:46:03.824473296Z [2024-04-11 22:46:03,824: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:46:03.824537846Z [2024-04-11 22:46:03,824: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:46:03.979152954Z [2024-04-11 22:46:03,976: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:46:05.491252006Z [2024-04-11 22:46:05,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a9db721-13ac-43d3-832c-642c25a4db36] succeeded in 4.4672350840000945s: None 2024-04-11T22:46:05.606959976Z [2024-04-11 22:46:05,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da6ee307-39a7-463a-84f4-6c6927dfc03f] succeeded in 4.590581520000114s: None 2024-04-11T22:47:00.183438609Z [2024-04-11 22:47:00,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bc2b8ba-8fd0-4dfb-b8b7-924897d16477] received 2024-04-11T22:47:00.193447283Z [2024-04-11 22:47:00,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bfdbf32-471a-479a-b132-43c2c4acf647] received 2024-04-11T22:47:00.202283393Z [2024-04-11 22:47:00,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b6c733c-d93b-4bff-b12c-d0064be28f67] received 2024-04-11T22:47:00.204790333Z [2024-04-11 22:47:00,203: INFO/ForkPoolWorker-15] [0bc2b8ba-8fd0-4dfb-b8b7-924897d16477] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:47:00.208279486Z [2024-04-11 22:47:00,207: INFO/ForkPoolWorker-16] [2bfdbf32-471a-479a-b132-43c2c4acf647] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:47:00.212826389Z [2024-04-11 22:47:00,212: INFO/ForkPoolWorker-1] [2b6c733c-d93b-4bff-b12c-d0064be28f67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:47:00.461745248Z [2024-04-11 22:47:00,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:47:00.571623423Z [2024-04-11 22:47:00,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:47:00.608494779Z [2024-04-11 22:47:00,602: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:47:00.803259298Z [2024-04-11 22:47:00,802: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:47:00.807416807Z [2024-04-11 22:47:00,806: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:47:00.831177039Z [2024-04-11 22:47:00,830: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:47:00.832071036Z [2024-04-11 22:47:00,831: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:47:00.832154375Z [2024-04-11 22:47:00,832: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:47:00.832191625Z [2024-04-11 22:47:00,832: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:47:00.832510444Z [2024-04-11 22:47:00,832: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:47:00.922680662Z [2024-04-11 22:47:00,922: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:47:01.450808206Z [2024-04-11 22:47:01,450: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b6c733c-d93b-4bff-b12c-d0064be28f67] succeeded in 1.2452187579999645s: None 2024-04-11T22:47:01.486106203Z [2024-04-11 22:47:01,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:47:01.489177124Z [2024-04-11 22:47:01,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:47:01.510043231Z [2024-04-11 22:47:01,509: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:47:01.511260995Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:47:01.511312150Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:47:01.511488701Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:47:01.511548727Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:47:01.511874016Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:47:01.511948932Z [2024-04-11 22:47:01,511: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:47:01.576024832Z [2024-04-11 22:47:01,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:47:01.642604833Z [2024-04-11 22:47:01,642: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:47:01.645974783Z [2024-04-11 22:47:01,645: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:47:01.688633458Z [2024-04-11 22:47:01,683: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:47:01.688650226Z [2024-04-11 22:47:01,684: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:47:01.688653891Z [2024-04-11 22:47:01,684: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:47:01.688660560Z [2024-04-11 22:47:01,684: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:47:01.688664627Z [2024-04-11 22:47:01,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:47:01.688667694Z [2024-04-11 22:47:01,685: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:47:01.688670666Z [2024-04-11 22:47:01,685: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:47:01.800106986Z [2024-04-11 22:47:01,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:47:02.986851651Z [2024-04-11 22:47:02,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0bc2b8ba-8fd0-4dfb-b8b7-924897d16477] succeeded in 2.7969082280001203s: None 2024-04-11T22:47:03.606249207Z [2024-04-11 22:47:03,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bfdbf32-471a-479a-b132-43c2c4acf647] succeeded in 3.4103430489999482s: None 2024-04-11T22:48:01.151698472Z [2024-04-11 22:48:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33f5d6c1-4cea-4056-a1bf-43142c1a5093] received 2024-04-11T22:48:01.156420487Z [2024-04-11 22:48:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[190f4fc0-54fb-4c3a-ad2d-04359711e1b6] received 2024-04-11T22:48:01.163029823Z [2024-04-11 22:48:01,162: INFO/ForkPoolWorker-15] [33f5d6c1-4cea-4056-a1bf-43142c1a5093] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:48:01.163918741Z [2024-04-11 22:48:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f4385b1-94f8-44e9-904a-b21533620a3d] received 2024-04-11T22:48:01.165257587Z [2024-04-11 22:48:01,165: INFO/ForkPoolWorker-16] [190f4fc0-54fb-4c3a-ad2d-04359711e1b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:48:01.166085051Z [2024-04-11 22:48:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b867b06c-d7e1-4311-9cfd-d463c51bb552] received 2024-04-11T22:48:01.169531144Z [2024-04-11 22:48:01,169: INFO/ForkPoolWorker-1] [8f4385b1-94f8-44e9-904a-b21533620a3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:48:01.180953577Z [2024-04-11 22:48:01,180: INFO/ForkPoolWorker-2] [b867b06c-d7e1-4311-9cfd-d463c51bb552] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:48:01.471564560Z [2024-04-11 22:48:01,468: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:48:01.475747702Z [2024-04-11 22:48:01,471: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:48:01.527705633Z [2024-04-11 22:48:01,525: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:48:01.588214360Z [2024-04-11 22:48:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:48:01.616026206Z [2024-04-11 22:48:01,615: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T22:48:01.619330633Z [2024-04-11 22:48:01,619: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:01.642218980Z [2024-04-11 22:48:01,642: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:48:01.643060342Z [2024-04-11 22:48:01,642: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:48:01.643136652Z [2024-04-11 22:48:01,643: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:48:01.643190162Z [2024-04-11 22:48:01,643: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T22:48:01.643354062Z [2024-04-11 22:48:01,643: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:48:01.749446008Z [2024-04-11 22:48:01,749: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:01.923945436Z [2024-04-11 22:48:01,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:02.284802297Z [2024-04-11 22:48:02,284: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b867b06c-d7e1-4311-9cfd-d463c51bb552] succeeded in 1.115451450999899s: None 2024-04-11T22:48:02.370596752Z [2024-04-11 22:48:02,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33f5d6c1-4cea-4056-a1bf-43142c1a5093] succeeded in 1.212383521999982s: None 2024-04-11T22:48:02.668063257Z [2024-04-11 22:48:02,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:48:02.671177829Z [2024-04-11 22:48:02,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:02.696436861Z [2024-04-11 22:48:02,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:48:02.698163327Z [2024-04-11 22:48:02,697: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:02.698698162Z [2024-04-11 22:48:02,698: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:02.698959501Z [2024-04-11 22:48:02,698: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:48:02.699136062Z [2024-04-11 22:48:02,698: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:48:02.699599015Z [2024-04-11 22:48:02,699: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:48:02.699890571Z [2024-04-11 22:48:02,699: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:02.789062698Z [2024-04-11 22:48:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:02.840199611Z [2024-04-11 22:48:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:48:02.843297004Z [2024-04-11 22:48:02,842: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:02.864123800Z [2024-04-11 22:48:02,863: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:48:02.867404697Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:02.867428081Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:02.867562965Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:48:02.867606392Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:48:02.867814803Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:48:02.867927818Z [2024-04-11 22:48:02,867: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:02.947431442Z [2024-04-11 22:48:02,947: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:04.803174781Z [2024-04-11 22:48:04,802: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[190f4fc0-54fb-4c3a-ad2d-04359711e1b6] succeeded in 3.645381321999821s: None 2024-04-11T22:48:05.506210395Z [2024-04-11 22:48:05,505: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f4385b1-94f8-44e9-904a-b21533620a3d] succeeded in 4.340280926000105s: None 2024-04-11T22:48:25.411512194Z [2024-04-11 22:48:25,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5d353f0-b713-4319-b05e-e1f33db4dcc7] received 2024-04-11T22:48:25.425540942Z [2024-04-11 22:48:25,425: INFO/ForkPoolWorker-15] [e5d353f0-b713-4319-b05e-e1f33db4dcc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:25.664462741Z [2024-04-11 22:48:25,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:48:26.608207614Z [2024-04-11 22:48:26,607: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:48:26.611678077Z [2024-04-11 22:48:26,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:26.635303981Z [2024-04-11 22:48:26,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:48:26.637107030Z [2024-04-11 22:48:26,636: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:26.637317096Z [2024-04-11 22:48:26,637: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:26.637426485Z [2024-04-11 22:48:26,637: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:26.637667261Z [2024-04-11 22:48:26,637: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:26.637760845Z [2024-04-11 22:48:26,637: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:48:26.638110389Z [2024-04-11 22:48:26,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:48:26.638212639Z [2024-04-11 22:48:26,638: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:26.644332473Z [2024-04-11 22:48:26,644: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:26.726147604Z [2024-04-11 22:48:26,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:27.344462849Z [2024-04-11 22:48:27,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5d353f0-b713-4319-b05e-e1f33db4dcc7] succeeded in 1.9271893750001254s: None 2024-04-11T22:48:27.765298257Z [2024-04-11 22:48:27,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce54ef55-8096-4add-9a74-eb190cafc4e2] received 2024-04-11T22:48:27.788502676Z [2024-04-11 22:48:27,788: INFO/ForkPoolWorker-15] [ce54ef55-8096-4add-9a74-eb190cafc4e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'split_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:28.186895490Z [2024-04-11 22:48:28,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:48:29.196119065Z [2024-04-11 22:48:29,195: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:48:29.199360839Z [2024-04-11 22:48:29,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:29.224841583Z [2024-04-11 22:48:29,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:48:29.226575966Z [2024-04-11 22:48:29,226: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:29.226676161Z [2024-04-11 22:48:29,226: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:29.226688149Z [2024-04-11 22:48:29,226: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:29.226872831Z [2024-04-11 22:48:29,226: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:29.227031475Z [2024-04-11 22:48:29,226: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:48:29.227352155Z [2024-04-11 22:48:29,227: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:48:29.227604958Z [2024-04-11 22:48:29,227: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:29.234293215Z [2024-04-11 22:48:29,234: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:29.310968423Z [2024-04-11 22:48:29,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:29.962621808Z [2024-04-11 22:48:29,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce54ef55-8096-4add-9a74-eb190cafc4e2] succeeded in 2.195708677000084s: None 2024-04-11T22:48:30.521481408Z [2024-04-11 22:48:30,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54666b4f-a8de-48f1-ba53-47d3b8137e76] received 2024-04-11T22:48:30.537694541Z [2024-04-11 22:48:30,537: INFO/ForkPoolWorker-15] [54666b4f-a8de-48f1-ba53-47d3b8137e76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'collect_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:48:30.779276506Z [2024-04-11 22:48:30,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:48:31.782035261Z [2024-04-11 22:48:31,781: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:48:31.785081729Z [2024-04-11 22:48:31,784: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:31.801858324Z [2024-04-11 22:48:31,801: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:48:31.803705207Z [2024-04-11 22:48:31,803: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:31.803985485Z [2024-04-11 22:48:31,803: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:31.804202798Z [2024-04-11 22:48:31,804: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:31.804665897Z [2024-04-11 22:48:31,804: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:31.804749638Z [2024-04-11 22:48:31,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:48:31.805081088Z [2024-04-11 22:48:31,804: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:48:31.805087429Z [2024-04-11 22:48:31,804: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:31.810417879Z [2024-04-11 22:48:31,810: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:31.886849645Z [2024-04-11 22:48:31,886: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:32.423331477Z [2024-04-11 22:48:32,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54666b4f-a8de-48f1-ba53-47d3b8137e76] succeeded in 1.8972028240000327s: None 2024-04-11T22:48:32.841189767Z [2024-04-11 22:48:32,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[068c4093-e2ad-40ea-b4d6-77c52fd4eccb] received 2024-04-11T22:48:32.851213520Z [2024-04-11 22:48:32,850: INFO/ForkPoolWorker-15] [068c4093-e2ad-40ea-b4d6-77c52fd4eccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'send_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:33.108317619Z [2024-04-11 22:48:33,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:48:34.152271089Z [2024-04-11 22:48:34,151: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:48:34.155387156Z [2024-04-11 22:48:34,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:34.175581068Z [2024-04-11 22:48:34,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:48:34.176938103Z [2024-04-11 22:48:34,176: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:34.177216876Z [2024-04-11 22:48:34,177: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:34.177627121Z [2024-04-11 22:48:34,177: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:34.177788335Z [2024-04-11 22:48:34,177: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:34.177876296Z [2024-04-11 22:48:34,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:48:34.178158857Z [2024-04-11 22:48:34,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:48:34.178512650Z [2024-04-11 22:48:34,178: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:34.184984267Z [2024-04-11 22:48:34,184: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:34.267941826Z [2024-04-11 22:48:34,267: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:34.804556756Z [2024-04-11 22:48:34,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[068c4093-e2ad-40ea-b4d6-77c52fd4eccb] succeeded in 1.961352338999859s: None 2024-04-11T22:48:41.877914906Z [2024-04-11 22:48:41,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be1897a-5f19-41c0-8544-f3910573f1da] received 2024-04-11T22:48:41.881093519Z [2024-04-11 22:48:41,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d877ccc7-a35f-4823-8c1a-74e3216a10bd] received 2024-04-11T22:48:41.886963253Z [2024-04-11 22:48:41,886: INFO/ForkPoolWorker-15] [2be1897a-5f19-41c0-8544-f3910573f1da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:48:41.888603821Z [2024-04-11 22:48:41,888: INFO/ForkPoolWorker-16] [d877ccc7-a35f-4823-8c1a-74e3216a10bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:48:42.136579611Z [2024-04-11 22:48:42,133: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:48:42.206717931Z [2024-04-11 22:48:42,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:48:43.112877750Z [2024-04-11 22:48:43,112: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:48:43.116069033Z [2024-04-11 22:48:43,115: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:43.129350408Z [2024-04-11 22:48:43,129: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:48:43.130411106Z [2024-04-11 22:48:43,130: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:43.130642131Z [2024-04-11 22:48:43,130: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:43.130691721Z [2024-04-11 22:48:43,130: INFO/ForkPoolWorker-16] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:43.130840462Z [2024-04-11 22:48:43,130: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:43.131007511Z [2024-04-11 22:48:43,130: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:48:43.131251269Z [2024-04-11 22:48:43,131: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:48:43.131375044Z [2024-04-11 22:48:43,131: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:43.135325100Z [2024-04-11 22:48:43,135: INFO/ForkPoolWorker-16] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:43.204685301Z [2024-04-11 22:48:43,204: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:43.247416629Z [2024-04-11 22:48:43,247: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:48:43.250398434Z [2024-04-11 22:48:43,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:48:43.273797787Z [2024-04-11 22:48:43,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:48:43.275715191Z [2024-04-11 22:48:43,275: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:48:43.276106058Z [2024-04-11 22:48:43,275: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:48:43.276297809Z [2024-04-11 22:48:43,276: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:48:43.276656544Z [2024-04-11 22:48:43,276: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:48:43.276959528Z [2024-04-11 22:48:43,276: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:48:43.277341964Z [2024-04-11 22:48:43,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:48:43.277960021Z [2024-04-11 22:48:43,277: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:48:43.283794905Z [2024-04-11 22:48:43,283: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:48:43.361766378Z [2024-04-11 22:48:43,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:48:44.644843462Z [2024-04-11 22:48:44,644: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d877ccc7-a35f-4823-8c1a-74e3216a10bd] succeeded in 2.7623151590000816s: None 2024-04-11T22:48:45.098512187Z [2024-04-11 22:48:45,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2be1897a-5f19-41c0-8544-f3910573f1da] succeeded in 3.218029526999999s: None 2024-04-11T22:49:00.832222449Z [2024-04-11 22:49:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b56820-7d7d-46c2-81a5-579c030c54a2] received 2024-04-11T22:49:00.834855181Z [2024-04-11 22:49:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db48d606-2ce8-4738-a270-6170ab6fe723] received 2024-04-11T22:49:00.844913736Z [2024-04-11 22:49:00,844: INFO/ForkPoolWorker-16] [db48d606-2ce8-4738-a270-6170ab6fe723] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:49:00.848422009Z [2024-04-11 22:49:00,848: INFO/ForkPoolWorker-15] [34b56820-7d7d-46c2-81a5-579c030c54a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:49:00.850364626Z [2024-04-11 22:49:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[729b91c4-0782-43b3-b78c-7e347652fd11] received 2024-04-11T22:49:00.852977813Z [2024-04-11 22:49:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dab61c3d-204e-4e68-b2c5-9551b10a7eae] received 2024-04-11T22:49:00.859832236Z [2024-04-11 22:49:00,858: INFO/ForkPoolWorker-1] [729b91c4-0782-43b3-b78c-7e347652fd11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:49:00.862595392Z [2024-04-11 22:49:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbd2db3e-5fa1-47a4-8c47-e19859f41710] received 2024-04-11T22:49:00.886153882Z [2024-04-11 22:49:00,885: INFO/ForkPoolWorker-2] [dab61c3d-204e-4e68-b2c5-9551b10a7eae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:49:00.902260428Z [2024-04-11 22:49:00,901: INFO/ForkPoolWorker-3] [cbd2db3e-5fa1-47a4-8c47-e19859f41710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:49:01.248741048Z [2024-04-11 22:49:01,245: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:49:01.336827843Z [2024-04-11 22:49:01,331: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:49:01.415040942Z [2024-04-11 22:49:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:49:01.463630300Z [2024-04-11 22:49:01,460: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:49:01.558076046Z [2024-04-11 22:49:01,535: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:49:01.639525429Z [2024-04-11 22:49:01,639: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T22:49:01.642949843Z [2024-04-11 22:49:01,642: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:49:01.715393290Z [2024-04-11 22:49:01,715: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:49:01.720462296Z [2024-04-11 22:49:01,720: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:49:01.720758028Z [2024-04-11 22:49:01,720: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:49:01.720861800Z [2024-04-11 22:49:01,720: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T22:49:01.721096608Z [2024-04-11 22:49:01,720: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:49:01.858808369Z [2024-04-11 22:49:01,858: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:49:02.453295872Z [2024-04-11 22:49:02,452: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dab61c3d-204e-4e68-b2c5-9551b10a7eae] succeeded in 1.5979387250001764s: None 2024-04-11T22:49:02.755369654Z [2024-04-11 22:49:02,755: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:49:02.762896650Z [2024-04-11 22:49:02,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:49:02.809143953Z [2024-04-11 22:49:02,808: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:49:02.813286964Z [2024-04-11 22:49:02,813: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:49:02.815070843Z [2024-04-11 22:49:02,814: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:49:02.815204277Z [2024-04-11 22:49:02,815: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:49:02.816097354Z [2024-04-11 22:49:02,815: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:49:02.816248955Z [2024-04-11 22:49:02,816: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:49:02.816615796Z [2024-04-11 22:49:02,816: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:49:02.817494555Z [2024-04-11 22:49:02,817: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:49:02.822409173Z [2024-04-11 22:49:02,822: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:49:02.942659363Z [2024-04-11 22:49:02,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:49:02.946215616Z [2024-04-11 22:49:02,945: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:49:02.958272668Z [2024-04-11 22:49:02,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:49:02.975345544Z [2024-04-11 22:49:02,975: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:49:02.976594422Z [2024-04-11 22:49:02,976: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:49:02.976773725Z [2024-04-11 22:49:02,976: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:49:02.976900570Z [2024-04-11 22:49:02,976: INFO/ForkPoolWorker-16] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:49:02.977084480Z [2024-04-11 22:49:02,976: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:49:02.977142762Z [2024-04-11 22:49:02,977: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:49:02.977380262Z [2024-04-11 22:49:02,977: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:49:02.977497806Z [2024-04-11 22:49:02,977: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:49:02.981533736Z [2024-04-11 22:49:02,981: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:49:03.005705262Z [2024-04-11 22:49:03,005: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:49:03.009086481Z [2024-04-11 22:49:03,008: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:49:03.030214861Z [2024-04-11 22:49:03,030: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:49:03.031293600Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:49:03.031303522Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:49:03.031388002Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:49:03.031585169Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:49:03.031659245Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:49:03.032043872Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:49:03.032099715Z [2024-04-11 22:49:03,031: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:49:03.036793074Z [2024-04-11 22:49:03,036: INFO/ForkPoolWorker-3] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:49:03.109563669Z [2024-04-11 22:49:03,109: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:49:03.129700580Z [2024-04-11 22:49:03,129: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:49:03.178004559Z [2024-04-11 22:49:03,177: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:49:03.181141960Z [2024-04-11 22:49:03,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:49:03.205953064Z [2024-04-11 22:49:03,205: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:49:03.207213513Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:49:03.207258190Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:49:03.207295006Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:49:03.207409607Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:49:03.207441388Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:49:03.207663770Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:49:03.207697086Z [2024-04-11 22:49:03,207: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:49:03.212826487Z [2024-04-11 22:49:03,212: INFO/ForkPoolWorker-1] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:49:03.305008602Z [2024-04-11 22:49:03,304: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:49:05.521775780Z [2024-04-11 22:49:05,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[729b91c4-0782-43b3-b78c-7e347652fd11] succeeded in 4.669642496000051s: None 2024-04-11T22:49:05.523842997Z [2024-04-11 22:49:05,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34b56820-7d7d-46c2-81a5-579c030c54a2] succeeded in 4.6866538669999045s: None 2024-04-11T22:49:05.579065441Z [2024-04-11 22:49:05,578: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cbd2db3e-5fa1-47a4-8c47-e19859f41710] succeeded in 4.713557574000106s: None 2024-04-11T22:49:05.625803337Z [2024-04-11 22:49:05,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db48d606-2ce8-4738-a270-6170ab6fe723] succeeded in 4.789794798999992s: None 2024-04-11T22:50:01.177318287Z [2024-04-11 22:50:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0324aef0-785e-40d7-a1e6-cf892d8b7ba6] received 2024-04-11T22:50:01.180512430Z [2024-04-11 22:50:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f0bbad1-3674-46dd-9171-163cf6f72df7] received 2024-04-11T22:50:01.184051207Z [2024-04-11 22:50:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c21c33-faba-435a-b9f6-3e8d6e149309] received 2024-04-11T22:50:01.189018538Z [2024-04-11 22:50:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deff5b58-b1bb-4373-afb1-0e3a73e6804b] received 2024-04-11T22:50:01.194649293Z [2024-04-11 22:50:01,194: INFO/ForkPoolWorker-1] [62c21c33-faba-435a-b9f6-3e8d6e149309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:50:01.195652445Z [2024-04-11 22:50:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27d3dd25-0e7f-4f72-b45c-74e2c1dcfc6a] received 2024-04-11T22:50:01.199877124Z [2024-04-11 22:50:01,199: INFO/ForkPoolWorker-15] [0324aef0-785e-40d7-a1e6-cf892d8b7ba6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:50:01.202200578Z [2024-04-11 22:50:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f156f422-293e-4b11-b00e-fc40d84dce43] received 2024-04-11T22:50:01.206472370Z [2024-04-11 22:50:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6591eec0-5598-49d2-aa93-d475e51472ac] received 2024-04-11T22:50:01.207163789Z [2024-04-11 22:50:01,205: INFO/ForkPoolWorker-16] [1f0bbad1-3674-46dd-9171-163cf6f72df7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:50:01.214261725Z [2024-04-11 22:50:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92486afa-c489-4d96-b4b2-3c952f178f89] received 2024-04-11T22:50:01.230530075Z [2024-04-11 22:50:01,230: INFO/ForkPoolWorker-4] [f156f422-293e-4b11-b00e-fc40d84dce43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:01.240076898Z [2024-04-11 22:50:01,239: INFO/ForkPoolWorker-3] [27d3dd25-0e7f-4f72-b45c-74e2c1dcfc6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:50:01.244595353Z [2024-04-11 22:50:01,244: INFO/ForkPoolWorker-2] [deff5b58-b1bb-4373-afb1-0e3a73e6804b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:50:01.260793862Z [2024-04-11 22:50:01,260: INFO/ForkPoolWorker-5] [6591eec0-5598-49d2-aa93-d475e51472ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:01.304643263Z [2024-04-11 22:50:01,304: INFO/ForkPoolWorker-6] [92486afa-c489-4d96-b4b2-3c952f178f89] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:50:01.626972610Z [2024-04-11 22:50:01,624: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:50:01.684292943Z [2024-04-11 22:50:01,672: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:50:01.844588893Z [2024-04-11 22:50:01,840: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:02.075484081Z [2024-04-11 22:50:02,071: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:02.274732329Z [2024-04-11 22:50:02,274: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:02.275214018Z [2024-04-11 22:50:02,272: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:50:02.303135553Z [2024-04-11 22:50:02,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:50:02.331620160Z [2024-04-11 22:50:02,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:50:02.344668742Z [2024-04-11 22:50:02,336: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:50:02.864316628Z [2024-04-11 22:50:02,863: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T22:50:02.869395510Z [2024-04-11 22:50:02,868: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:02.893628863Z [2024-04-11 22:50:02,893: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:50:02.894970546Z [2024-04-11 22:50:02,894: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:50:02.895035738Z [2024-04-11 22:50:02,894: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:50:02.895083700Z [2024-04-11 22:50:02,895: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T22:50:02.895261135Z [2024-04-11 22:50:02,895: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:50:03.012886908Z [2024-04-11 22:50:03,012: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:03.240677401Z [2024-04-11 22:50:03,240: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[92486afa-c489-4d96-b4b2-3c952f178f89] succeeded in 2.010473705999857s: None 2024-04-11T22:50:03.920716775Z [2024-04-11 22:50:03,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0324aef0-785e-40d7-a1e6-cf892d8b7ba6] succeeded in 2.7387686790000316s: None 2024-04-11T22:50:03.993847707Z [2024-04-11 22:50:03,993: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:50:04.007410919Z [2024-04-11 22:50:03,999: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.081259361Z [2024-04-11 22:50:04,081: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:50:04.089572113Z [2024-04-11 22:50:04,089: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.089695518Z [2024-04-11 22:50:04,089: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.089973234Z [2024-04-11 22:50:04,089: INFO/ForkPoolWorker-4] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.090106802Z [2024-04-11 22:50:04,089: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.090161453Z [2024-04-11 22:50:04,090: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:50:04.090424729Z [2024-04-11 22:50:04,090: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:04.090514185Z [2024-04-11 22:50:04,090: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.096026444Z [2024-04-11 22:50:04,095: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.137333081Z [2024-04-11 22:50:04,136: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:50:04.140250580Z [2024-04-11 22:50:04,139: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.171051872Z [2024-04-11 22:50:04,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:50:04.172746247Z [2024-04-11 22:50:04,172: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.172873881Z [2024-04-11 22:50:04,172: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.173002706Z [2024-04-11 22:50:04,172: INFO/ForkPoolWorker-16] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.173280493Z [2024-04-11 22:50:04,172: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.173459871Z [2024-04-11 22:50:04,173: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:50:04.173805481Z [2024-04-11 22:50:04,173: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:50:04.174268822Z [2024-04-11 22:50:04,174: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.182099734Z [2024-04-11 22:50:04,181: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.264095258Z [2024-04-11 22:50:04,263: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:04.298425907Z [2024-04-11 22:50:04,298: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:04.615933147Z [2024-04-11 22:50:04,615: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:50:04.635379294Z [2024-04-11 22:50:04,635: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:50:04.638429935Z [2024-04-11 22:50:04,638: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.639235400Z [2024-04-11 22:50:04,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.664931619Z [2024-04-11 22:50:04,664: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:50:04.670248156Z [2024-04-11 22:50:04,669: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.682240810Z [2024-04-11 22:50:04,682: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:50:04.687013587Z [2024-04-11 22:50:04,686: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:50:04.688463513Z [2024-04-11 22:50:04,688: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.688596766Z [2024-04-11 22:50:04,688: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.688624741Z [2024-04-11 22:50:04,688: INFO/ForkPoolWorker-1] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.688810361Z [2024-04-11 22:50:04,688: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.688862439Z [2024-04-11 22:50:04,688: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:50:04.689471508Z [2024-04-11 22:50:04,689: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.689865737Z [2024-04-11 22:50:04,689: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.690110398Z [2024-04-11 22:50:04,689: INFO/ForkPoolWorker-2] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.690265123Z [2024-04-11 22:50:04,690: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.690310755Z [2024-04-11 22:50:04,690: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:50:04.690594867Z [2024-04-11 22:50:04,690: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:50:04.690702662Z [2024-04-11 22:50:04,690: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.694954974Z [2024-04-11 22:50:04,694: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.695206613Z [2024-04-11 22:50:04,695: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:50:04.695273300Z [2024-04-11 22:50:04,695: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.699506721Z [2024-04-11 22:50:04,699: INFO/ForkPoolWorker-1] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.708674918Z [2024-04-11 22:50:04,708: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:50:04.713692881Z [2024-04-11 22:50:04,713: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.713961736Z [2024-04-11 22:50:04,713: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.714165546Z [2024-04-11 22:50:04,713: INFO/ForkPoolWorker-3] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.714453543Z [2024-04-11 22:50:04,714: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.714644710Z [2024-04-11 22:50:04,714: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:50:04.715452344Z [2024-04-11 22:50:04,715: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:50:04.715964174Z [2024-04-11 22:50:04,715: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.722694805Z [2024-04-11 22:50:04,722: INFO/ForkPoolWorker-3] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.794351826Z [2024-04-11 22:50:04,794: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-11T22:50:04.797840187Z [2024-04-11 22:50:04,797: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:04.814456529Z [2024-04-11 22:50:04,814: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:04.847011004Z [2024-04-11 22:50:04,846: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:04.854875901Z [2024-04-11 22:50:04,854: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:04.865632490Z [2024-04-11 22:50:04,865: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-11T22:50:04.868587576Z [2024-04-11 22:50:04,868: INFO/ForkPoolWorker-5] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:04.868673727Z [2024-04-11 22:50:04,868: INFO/ForkPoolWorker-5] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:04.868723604Z [2024-04-11 22:50:04,868: INFO/ForkPoolWorker-5] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:04.868884205Z [2024-04-11 22:50:04,868: INFO/ForkPoolWorker-5] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:04.872791375Z [2024-04-11 22:50:04,872: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-11T22:50:04.873097857Z [2024-04-11 22:50:04,872: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:04.873142213Z [2024-04-11 22:50:04,873: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:04.878444747Z [2024-04-11 22:50:04,878: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:04.975004114Z [2024-04-11 22:50:04,974: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:05.250775649Z [2024-04-11 22:50:05,250: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[f156f422-293e-4b11-b00e-fc40d84dce43] succeeded in 4.041288297999927s: None 2024-04-11T22:50:05.667983410Z [2024-04-11 22:50:05,667: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[6591eec0-5598-49d2-aa93-d475e51472ac] succeeded in 4.455389325999931s: None 2024-04-11T22:50:05.978603984Z [2024-04-11 22:50:05,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3ae4f0c-4043-4d09-b381-7af1ae0a800f] received 2024-04-11T22:50:05.983561516Z [2024-04-11 22:50:05,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d4ee05a-e6fd-4fa3-982f-3b4dea7171ea] received 2024-04-11T22:50:05.988687123Z [2024-04-11 22:50:05,988: INFO/ForkPoolWorker-15] [a3ae4f0c-4043-4d09-b381-7af1ae0a800f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'split_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:05.991018199Z [2024-04-11 22:50:05,990: INFO/ForkPoolWorker-4] [3d4ee05a-e6fd-4fa3-982f-3b4dea7171ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:06.286622502Z [2024-04-11 22:50:06,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:06.309364814Z [2024-04-11 22:50:06,306: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:06.409264147Z [2024-04-11 22:50:06,408: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f0bbad1-3674-46dd-9171-163cf6f72df7] succeeded in 5.225295051000103s: None 2024-04-11T22:50:06.415897301Z [2024-04-11 22:50:06,415: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[27d3dd25-0e7f-4f72-b45c-74e2c1dcfc6a] succeeded in 5.214955521999855s: None 2024-04-11T22:50:06.589259187Z [2024-04-11 22:50:06,588: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62c21c33-faba-435a-b9f6-3e8d6e149309] succeeded in 5.402819260999877s: None 2024-04-11T22:50:06.735325578Z [2024-04-11 22:50:06,734: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[deff5b58-b1bb-4373-afb1-0e3a73e6804b] succeeded in 5.544145350000008s: None 2024-04-11T22:50:07.322245401Z [2024-04-11 22:50:07,321: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:50:07.325060685Z [2024-04-11 22:50:07,324: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:07.369484927Z [2024-04-11 22:50:07,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:50:07.371484806Z [2024-04-11 22:50:07,371: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:07.371613174Z [2024-04-11 22:50:07,371: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:07.371846688Z [2024-04-11 22:50:07,371: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:07.372275824Z [2024-04-11 22:50:07,371: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:07.372578938Z [2024-04-11 22:50:07,372: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:50:07.373166609Z [2024-04-11 22:50:07,372: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:07.373381111Z [2024-04-11 22:50:07,373: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:07.384127316Z [2024-04-11 22:50:07,383: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:07.449710742Z [2024-04-11 22:50:07,449: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:07.453660459Z [2024-04-11 22:50:07,453: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:50:07.456513693Z [2024-04-11 22:50:07,456: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:07.485388818Z [2024-04-11 22:50:07,485: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:50:07.486683364Z [2024-04-11 22:50:07,486: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:07.486739445Z [2024-04-11 22:50:07,486: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:07.486831917Z [2024-04-11 22:50:07,486: INFO/ForkPoolWorker-4] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:07.486997238Z [2024-04-11 22:50:07,486: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:07.487070582Z [2024-04-11 22:50:07,486: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:50:07.487457423Z [2024-04-11 22:50:07,487: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:07.487472355Z [2024-04-11 22:50:07,487: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:07.492963212Z [2024-04-11 22:50:07,492: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:07.591490057Z [2024-04-11 22:50:07,591: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:07.997272170Z [2024-04-11 22:50:07,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3ae4f0c-4043-4d09-b381-7af1ae0a800f] succeeded in 2.016312923000214s: None 2024-04-11T22:50:08.374111215Z [2024-04-11 22:50:08,373: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[3d4ee05a-e6fd-4fa3-982f-3b4dea7171ea] succeeded in 2.3885887700000694s: None 2024-04-11T22:50:08.787972560Z [2024-04-11 22:50:08,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff1c16cc-ddd3-4c35-927d-6c73b394beed] received 2024-04-11T22:50:08.793375948Z [2024-04-11 22:50:08,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d22f7f1-af8b-4594-b78f-8e02c8c07fc0] received 2024-04-11T22:50:08.803921251Z [2024-04-11 22:50:08,803: INFO/ForkPoolWorker-15] [ff1c16cc-ddd3-4c35-927d-6c73b394beed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'collect_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:50:08.808178011Z [2024-04-11 22:50:08,807: INFO/ForkPoolWorker-16] [1d22f7f1-af8b-4594-b78f-8e02c8c07fc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:50:09.038322188Z [2024-04-11 22:50:09,035: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:09.058444095Z [2024-04-11 22:50:09,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:10.020626425Z [2024-04-11 22:50:10,016: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:50:10.020676685Z [2024-04-11 22:50:10,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:10.041525994Z [2024-04-11 22:50:10,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:50:10.042368272Z [2024-04-11 22:50:10,042: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:10.042378831Z [2024-04-11 22:50:10,042: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:10.042389147Z [2024-04-11 22:50:10,042: INFO/ForkPoolWorker-16] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:10.042678566Z [2024-04-11 22:50:10,042: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:10.042684358Z [2024-04-11 22:50:10,042: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:50:10.045132884Z [2024-04-11 22:50:10,043: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:10.045149390Z [2024-04-11 22:50:10,044: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:10.057168756Z [2024-04-11 22:50:10,055: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:10.111295660Z [2024-04-11 22:50:10,110: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:50:10.116553519Z [2024-04-11 22:50:10,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:10.162080584Z [2024-04-11 22:50:10,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:50:10.163522701Z [2024-04-11 22:50:10,163: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:10.164535512Z [2024-04-11 22:50:10,163: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:10.164645553Z [2024-04-11 22:50:10,164: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:10.164805087Z [2024-04-11 22:50:10,164: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:10.164906512Z [2024-04-11 22:50:10,164: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:50:10.165141744Z [2024-04-11 22:50:10,165: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:10.165434388Z [2024-04-11 22:50:10,165: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:10.176132141Z [2024-04-11 22:50:10,175: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:10.184451096Z [2024-04-11 22:50:10,184: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:10.263420331Z [2024-04-11 22:50:10,263: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:10.745759329Z [2024-04-11 22:50:10,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff1c16cc-ddd3-4c35-927d-6c73b394beed] succeeded in 1.9505146819999482s: None 2024-04-11T22:50:10.753783084Z [2024-04-11 22:50:10,753: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d22f7f1-af8b-4594-b78f-8e02c8c07fc0] succeeded in 1.955140184000129s: None 2024-04-11T22:50:11.300186129Z [2024-04-11 22:50:11,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9caab77f-7591-4288-bba7-cb50e6e23d4d] received 2024-04-11T22:50:11.302054599Z [2024-04-11 22:50:11,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[470ab3f6-497a-4ab4-a2a8-854d593a3451] received 2024-04-11T22:50:11.309246192Z [2024-04-11 22:50:11,309: INFO/ForkPoolWorker-15] [9caab77f-7591-4288-bba7-cb50e6e23d4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'send_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:11.310941599Z [2024-04-11 22:50:11,310: INFO/ForkPoolWorker-16] [470ab3f6-497a-4ab4-a2a8-854d593a3451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:11.549096536Z [2024-04-11 22:50:11,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:11.590822545Z [2024-04-11 22:50:11,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:50:12.543872855Z [2024-04-11 22:50:12,543: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:50:12.546980559Z [2024-04-11 22:50:12,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:12.573765997Z [2024-04-11 22:50:12,573: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:50:12.576257264Z [2024-04-11 22:50:12,575: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:12.576392594Z [2024-04-11 22:50:12,576: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:12.576576230Z [2024-04-11 22:50:12,576: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:12.576843823Z [2024-04-11 22:50:12,576: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:12.576960700Z [2024-04-11 22:50:12,576: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:50:12.577389716Z [2024-04-11 22:50:12,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:12.577514712Z [2024-04-11 22:50:12,577: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:12.587524676Z [2024-04-11 22:50:12,587: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:12.669166127Z [2024-04-11 22:50:12,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:12.722083805Z [2024-04-11 22:50:12,721: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:50:12.725609407Z [2024-04-11 22:50:12,725: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:50:12.758465031Z [2024-04-11 22:50:12,758: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:50:12.760282482Z [2024-04-11 22:50:12,760: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:50:12.760515711Z [2024-04-11 22:50:12,760: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:50:12.760630076Z [2024-04-11 22:50:12,760: INFO/ForkPoolWorker-16] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:50:12.760864960Z [2024-04-11 22:50:12,760: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:50:12.760987892Z [2024-04-11 22:50:12,760: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:50:12.761307222Z [2024-04-11 22:50:12,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:50:12.761422008Z [2024-04-11 22:50:12,761: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:50:12.767698157Z [2024-04-11 22:50:12,767: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:50:12.834771700Z [2024-04-11 22:50:12,834: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:50:13.289832543Z [2024-04-11 22:50:13,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9caab77f-7591-4288-bba7-cb50e6e23d4d] succeeded in 1.9857947529999365s: None 2024-04-11T22:50:13.381217155Z [2024-04-11 22:50:13,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[470ab3f6-497a-4ab4-a2a8-854d593a3451] succeeded in 2.0769426659999226s: None 2024-04-11T22:51:00.230756864Z [2024-04-11 22:51:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53dc6e38-fe41-499f-906c-613c4ba639a2] received 2024-04-11T22:51:00.233870949Z [2024-04-11 22:51:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15c76c5f-ee8c-4924-884d-356566ea0208] received 2024-04-11T22:51:00.238311257Z [2024-04-11 22:51:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c779e0b3-0f60-408f-864f-ca12daa0a4d6] received 2024-04-11T22:51:00.238453114Z [2024-04-11 22:51:00,238: INFO/ForkPoolWorker-15] [53dc6e38-fe41-499f-906c-613c4ba639a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:51:00.240895854Z [2024-04-11 22:51:00,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9aac2b3-2c8c-4678-a2c8-de2b03600c32] received 2024-04-11T22:51:00.244576748Z [2024-04-11 22:51:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab53fc87-de27-42fc-8a81-e30675b12b13] received 2024-04-11T22:51:00.247860168Z [2024-04-11 22:51:00,247: INFO/ForkPoolWorker-16] [15c76c5f-ee8c-4924-884d-356566ea0208] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:51:00.248789930Z [2024-04-11 22:51:00,248: INFO/ForkPoolWorker-1] [c779e0b3-0f60-408f-864f-ca12daa0a4d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:51:00.259387711Z [2024-04-11 22:51:00,259: INFO/ForkPoolWorker-2] [d9aac2b3-2c8c-4678-a2c8-de2b03600c32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:51:00.259718067Z [2024-04-11 22:51:00,259: INFO/ForkPoolWorker-3] [ab53fc87-de27-42fc-8a81-e30675b12b13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:51:00.552302847Z [2024-04-11 22:51:00,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:51:00.599270968Z [2024-04-11 22:51:00,596: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:51:00.631526079Z [2024-04-11 22:51:00,625: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:51:00.646175276Z [2024-04-11 22:51:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:51:00.803686837Z [2024-04-11 22:51:00,803: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:51:00.807015972Z [2024-04-11 22:51:00,806: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:51:00.807525833Z [2024-04-11 22:51:00,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:51:00.852209246Z [2024-04-11 22:51:00,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:51:00.855328861Z [2024-04-11 22:51:00,855: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:51:00.855585001Z [2024-04-11 22:51:00,855: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:51:00.856803753Z [2024-04-11 22:51:00,856: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:51:00.857811688Z [2024-04-11 22:51:00,857: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:51:00.957597130Z [2024-04-11 22:51:00,957: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:51:01.533396329Z [2024-04-11 22:51:01,533: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15c76c5f-ee8c-4924-884d-356566ea0208] succeeded in 1.296737832999952s: None 2024-04-11T22:51:01.883496002Z [2024-04-11 22:51:01,883: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:51:01.886123478Z [2024-04-11 22:51:01,885: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:51:01.919991172Z [2024-04-11 22:51:01,919: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:51:01.922041172Z [2024-04-11 22:51:01,921: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:51:01.922100700Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:51:01.922188535Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:51:01.922375707Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:51:01.922440475Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:51:01.922733521Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:51:01.922809382Z [2024-04-11 22:51:01,922: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:51:01.929632094Z [2024-04-11 22:51:01,929: INFO/ForkPoolWorker-3] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:51:01.999987382Z [2024-04-11 22:51:01,999: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:51:02.153810806Z [2024-04-11 22:51:02,153: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:51:02.158388137Z [2024-04-11 22:51:02,158: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:51:02.188191301Z [2024-04-11 22:51:02,187: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:51:02.191822930Z [2024-04-11 22:51:02,191: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:51:02.198114189Z [2024-04-11 22:51:02,197: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:51:02.199642874Z [2024-04-11 22:51:02,199: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:51:02.199992857Z [2024-04-11 22:51:02,199: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:51:02.200243113Z [2024-04-11 22:51:02,200: INFO/ForkPoolWorker-1] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:51:02.200566234Z [2024-04-11 22:51:02,200: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:51:02.200801466Z [2024-04-11 22:51:02,200: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:51:02.201108783Z [2024-04-11 22:51:02,200: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:51:02.201233895Z [2024-04-11 22:51:02,201: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:51:02.205707717Z [2024-04-11 22:51:02,205: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:51:02.237302944Z [2024-04-11 22:51:02,237: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:51:02.238283101Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:51:02.238321546Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:51:02.238359649Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:51:02.238471857Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:51:02.238503573Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:51:02.238705765Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:51:02.238750959Z [2024-04-11 22:51:02,238: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:51:02.242774339Z [2024-04-11 22:51:02,242: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:51:02.268216479Z [2024-04-11 22:51:02,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:51:02.274476515Z [2024-04-11 22:51:02,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:51:02.305879813Z [2024-04-11 22:51:02,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:51:02.306814319Z [2024-04-11 22:51:02,306: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:51:02.306830200Z [2024-04-11 22:51:02,306: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:51:02.306895725Z [2024-04-11 22:51:02,306: INFO/ForkPoolWorker-15] Read VIM 39a0752b-13a5-45da-ac07-7c66abcecb6d (basic_08_vim_test) 2024-04-11T22:51:02.306952882Z [2024-04-11 22:51:02,306: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '39a0752b-13a5-45da-ac07-7c66abcecb6d', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-11T22:51:02.306960678Z [2024-04-11 22:51:02,306: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:51:02.307159280Z [2024-04-11 22:51:02,307: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:51:02.307166888Z [2024-04-11 22:51:02,307: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:51:02.315284504Z [2024-04-11 22:51:02,315: INFO/ForkPoolWorker-15] Creating DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d 2024-04-11T22:51:02.321517411Z [2024-04-11 22:51:02,321: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:51:02.366722832Z [2024-04-11 22:51:02,366: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:51:02.408497669Z [2024-04-11 22:51:02,408: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:51:03.509469359Z [2024-04-11 22:51:03,509: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ab53fc87-de27-42fc-8a81-e30675b12b13] succeeded in 3.2610925139999836s: None 2024-04-11T22:51:04.255091914Z [2024-04-11 22:51:04,254: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d9aac2b3-2c8c-4678-a2c8-de2b03600c32] succeeded in 4.012146752000035s: None 2024-04-11T22:51:04.296951493Z [2024-04-11 22:51:04,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53dc6e38-fe41-499f-906c-613c4ba639a2] succeeded in 4.064571607000062s: None 2024-04-11T22:51:04.627802768Z [2024-04-11 22:51:04,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c779e0b3-0f60-408f-864f-ca12daa0a4d6] succeeded in 4.386521057999971s: None 2024-04-11T22:52:00.629028304Z [2024-04-11 22:52:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df96d02d-8dc7-45d2-8b78-a60e16619ffa] received 2024-04-11T22:52:00.633458477Z [2024-04-11 22:52:00,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b630a020-b06a-4007-8606-ecc788f0fef4] received 2024-04-11T22:52:00.635078773Z [2024-04-11 22:52:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c82d953-7f42-4eee-ac2f-e49e368e85db] received 2024-04-11T22:52:00.639760741Z [2024-04-11 22:52:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4919734b-7c1c-4fd1-b86e-edff26b51e55] received 2024-04-11T22:52:00.640346098Z [2024-04-11 22:52:00,640: INFO/ForkPoolWorker-1] [8c82d953-7f42-4eee-ac2f-e49e368e85db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:00.642632232Z [2024-04-11 22:52:00,642: INFO/ForkPoolWorker-16] [b630a020-b06a-4007-8606-ecc788f0fef4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:52:00.643578396Z [2024-04-11 22:52:00,643: INFO/ForkPoolWorker-15] [df96d02d-8dc7-45d2-8b78-a60e16619ffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:52:00.654768467Z [2024-04-11 22:52:00,654: INFO/ForkPoolWorker-2] [4919734b-7c1c-4fd1-b86e-edff26b51e55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:00.664663915Z [2024-04-11 22:52:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25a1271c-a4ca-4b69-b61e-d9421b8f54b3] received 2024-04-11T22:52:00.670284665Z [2024-04-11 22:52:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cda38a48-dad9-4796-99c8-5310e6328b9e] received 2024-04-11T22:52:00.670538085Z [2024-04-11 22:52:00,670: INFO/ForkPoolWorker-3] [25a1271c-a4ca-4b69-b61e-d9421b8f54b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:00.684991408Z [2024-04-11 22:52:00,684: INFO/ForkPoolWorker-4] [cda38a48-dad9-4796-99c8-5310e6328b9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:00.958732257Z [2024-04-11 22:52:00,954: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:01.034842509Z [2024-04-11 22:52:01,026: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:01.100562183Z [2024-04-11 22:52:01,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:52:01.103922314Z [2024-04-11 22:52:01,101: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:01.151059016Z [2024-04-11 22:52:01,140: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:01.234973838Z [2024-04-11 22:52:01,223: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:52:01.551381576Z [2024-04-11 22:52:01,551: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:52:01.556071413Z [2024-04-11 22:52:01,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:52:01.563384903Z [2024-04-11 22:52:01,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:01.606774001Z [2024-04-11 22:52:01,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:52:01.609027334Z [2024-04-11 22:52:01,608: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:52:01.609080667Z [2024-04-11 22:52:01,608: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:52:01.609129052Z [2024-04-11 22:52:01,609: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:52:01.609398748Z [2024-04-11 22:52:01,609: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:52:01.860663064Z [2024-04-11 22:52:01,857: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:52:02.270414944Z [2024-04-11 22:52:02,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df96d02d-8dc7-45d2-8b78-a60e16619ffa] succeeded in 1.6385144480000235s: None 2024-04-11T22:52:02.345734451Z [2024-04-11 22:52:02,345: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:52:02.348432921Z [2024-04-11 22:52:02,348: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.386127223Z [2024-04-11 22:52:02,385: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:52:02.388212257Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.388340342Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.388510187Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.388578735Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:52:02.388855212Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:52:02.388986249Z [2024-04-11 22:52:02,388: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.395102728Z [2024-04-11 22:52:02,394: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:02.396354933Z [2024-04-11 22:52:02,395: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:02.397355106Z [2024-04-11 22:52:02,397: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:52:02.402176012Z [2024-04-11 22:52:02,401: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.425109534Z [2024-04-11 22:52:02,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b630a020-b06a-4007-8606-ecc788f0fef4] succeeded in 1.7894219029999476s: None 2024-04-11T22:52:02.426984815Z [2024-04-11 22:52:02,426: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:52:02.430672865Z [2024-04-11 22:52:02,430: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.430691084Z [2024-04-11 22:52:02,430: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.430802928Z [2024-04-11 22:52:02,430: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.430869387Z [2024-04-11 22:52:02,430: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:52:02.431106674Z [2024-04-11 22:52:02,430: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:52:02.431151728Z [2024-04-11 22:52:02,431: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.434844847Z [2024-04-11 22:52:02,434: ERROR/ForkPoolWorker-3] [25a1271c-a4ca-4b69-b61e-d9421b8f54b3] Failed to execute task Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:52:02.434857353Z Traceback (most recent call last): 2024-04-11T22:52:02.434861283Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:52:02.434865338Z args.func(args) 2024-04-11T22:52:02.434868869Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:52:02.434872436Z return func(*args, **kwargs) 2024-04-11T22:52:02.434875301Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:52:02.434878600Z return f(*args, **kwargs) 2024-04-11T22:52:02.434881556Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:52:02.434884680Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:52:02.434898964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:52:02.434902403Z raise AirflowException( 2024-04-11T22:52:02.434906225Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:52:02.460603135Z [2024-04-11 22:52:02,459: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[25a1271c-a4ca-4b69-b61e-d9421b8f54b3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25a1271c-a4ca-4b69-b61e-d9421b8f54b3') 2024-04-11T22:52:02.460627390Z Traceback (most recent call last): 2024-04-11T22:52:02.460631452Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:52:02.460635104Z R = retval = fun(*args, **kwargs) 2024-04-11T22:52:02.460639072Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:52:02.460642116Z return self.run(*args, **kwargs) 2024-04-11T22:52:02.460645757Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:52:02.460649230Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:52:02.460652375Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:52:02.460655914Z raise AirflowException(msg) 2024-04-11T22:52:02.460659392Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25a1271c-a4ca-4b69-b61e-d9421b8f54b3 2024-04-11T22:52:02.492109959Z [2024-04-11 22:52:02,491: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:52:02.494916718Z [2024-04-11 22:52:02,494: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.515099377Z [2024-04-11 22:52:02,514: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:52:02.516344259Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.516365168Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.516628206Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.516732250Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:52:02.516986072Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:52:02.517040809Z [2024-04-11 22:52:02,516: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.581139227Z [2024-04-11 22:52:02,580: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:52:02.746321896Z [2024-04-11 22:52:02,746: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:52:02.748991813Z [2024-04-11 22:52:02,748: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.774897975Z [2024-04-11 22:52:02,774: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:52:02.775873070Z [2024-04-11 22:52:02,775: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.775890465Z [2024-04-11 22:52:02,775: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.776030277Z [2024-04-11 22:52:02,775: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.776146202Z [2024-04-11 22:52:02,776: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:52:02.776499531Z [2024-04-11 22:52:02,776: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:52:02.776576617Z [2024-04-11 22:52:02,776: INFO/ForkPoolWorker-4] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.783502201Z [2024-04-11 22:52:02,783: WARNING/ForkPoolWorker-4] Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:02.784460572Z [2024-04-11 22:52:02,783: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:02.785352534Z [2024-04-11 22:52:02,785: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-11T22:52:02.787894449Z [2024-04-11 22:52:02,787: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.801791323Z [2024-04-11 22:52:02,801: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:52:02.804808012Z [2024-04-11 22:52:02,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:02.816357050Z [2024-04-11 22:52:02,816: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-11T22:52:02.817750779Z [2024-04-11 22:52:02,817: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.817807530Z [2024-04-11 22:52:02,817: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.817895010Z [2024-04-11 22:52:02,817: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.817979030Z [2024-04-11 22:52:02,817: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-11T22:52:02.818156508Z [2024-04-11 22:52:02,818: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:52:02.818169329Z [2024-04-11 22:52:02,818: INFO/ForkPoolWorker-4] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.821274414Z [2024-04-11 22:52:02,820: ERROR/ForkPoolWorker-4] [cda38a48-dad9-4796-99c8-5310e6328b9e] Failed to execute task Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:52:02.821289171Z Traceback (most recent call last): 2024-04-11T22:52:02.821293851Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:52:02.821297963Z args.func(args) 2024-04-11T22:52:02.821302208Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:52:02.821317511Z return func(*args, **kwargs) 2024-04-11T22:52:02.821321258Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:52:02.821324732Z return f(*args, **kwargs) 2024-04-11T22:52:02.821328228Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:52:02.821331749Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:52:02.821335431Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:52:02.821338895Z raise AirflowException( 2024-04-11T22:52:02.821342983Z airflow.exceptions.AirflowException: Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:52:02.828946715Z [2024-04-11 22:52:02,828: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:52:02.831029465Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:02.831038935Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:02.831044696Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:02.831050167Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:52:02.831055006Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:52:02.831059899Z [2024-04-11 22:52:02,830: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:02.858750972Z [2024-04-11 22:52:02,858: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[cda38a48-dad9-4796-99c8-5310e6328b9e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cda38a48-dad9-4796-99c8-5310e6328b9e') 2024-04-11T22:52:02.858765406Z Traceback (most recent call last): 2024-04-11T22:52:02.858769351Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:52:02.858772353Z R = retval = fun(*args, **kwargs) 2024-04-11T22:52:02.858775305Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:52:02.858778482Z return self.run(*args, **kwargs) 2024-04-11T22:52:02.858782088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:52:02.858785931Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:52:02.858788789Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:52:02.858792338Z raise AirflowException(msg) 2024-04-11T22:52:02.858795853Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cda38a48-dad9-4796-99c8-5310e6328b9e 2024-04-11T22:52:02.911262881Z [2024-04-11 22:52:02,910: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:52:04.376873282Z [2024-04-11 22:52:04,376: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4919734b-7c1c-4fd1-b86e-edff26b51e55] succeeded in 3.726710798999875s: None 2024-04-11T22:52:04.669804625Z [2024-04-11 22:52:04,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c82d953-7f42-4eee-ac2f-e49e368e85db] succeeded in 4.033433228999911s: None 2024-04-11T22:52:12.882561617Z [2024-04-11 22:52:12,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65bcbb26-c564-4032-9eaf-4a2e8ab2aebb] received 2024-04-11T22:52:12.897677041Z [2024-04-11 22:52:12,897: INFO/ForkPoolWorker-15] [65bcbb26-c564-4032-9eaf-4a2e8ab2aebb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:13.171847128Z [2024-04-11 22:52:13,168: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:14.150018747Z [2024-04-11 22:52:14,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b448811f-bf57-493f-b69e-2116841206ba] received 2024-04-11T22:52:14.161197121Z [2024-04-11 22:52:14,160: INFO/ForkPoolWorker-16] [b448811f-bf57-493f-b69e-2116841206ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:14.175563694Z [2024-04-11 22:52:14,175: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:52:14.178665633Z [2024-04-11 22:52:14,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:14.211159406Z [2024-04-11 22:52:14,210: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:52:14.212984574Z [2024-04-11 22:52:14,212: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:14.213153936Z [2024-04-11 22:52:14,212: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:14.213428496Z [2024-04-11 22:52:14,213: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:14.213598862Z [2024-04-11 22:52:14,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:52:14.213984804Z [2024-04-11 22:52:14,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:52:14.214520451Z [2024-04-11 22:52:14,214: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:14.221385429Z [2024-04-11 22:52:14,221: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:14.222301368Z [2024-04-11 22:52:14,221: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:52:14.223194607Z [2024-04-11 22:52:14,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:52:14.226148847Z [2024-04-11 22:52:14,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:14.248596702Z [2024-04-11 22:52:14,248: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:52:14.253103369Z [2024-04-11 22:52:14,252: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:14.255017050Z [2024-04-11 22:52:14,254: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:14.255171525Z [2024-04-11 22:52:14,254: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:14.255240952Z [2024-04-11 22:52:14,255: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:52:14.255539227Z [2024-04-11 22:52:14,255: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:52:14.255631356Z [2024-04-11 22:52:14,255: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:14.259632696Z [2024-04-11 22:52:14,259: ERROR/ForkPoolWorker-15] [65bcbb26-c564-4032-9eaf-4a2e8ab2aebb] Failed to execute task Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:52:14.259648321Z Traceback (most recent call last): 2024-04-11T22:52:14.259653751Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:52:14.259659426Z args.func(args) 2024-04-11T22:52:14.259664928Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:52:14.259689307Z return func(*args, **kwargs) 2024-04-11T22:52:14.259694255Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:52:14.259698790Z return f(*args, **kwargs) 2024-04-11T22:52:14.259703683Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:52:14.259708253Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:52:14.259712835Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:52:14.259717492Z raise AirflowException( 2024-04-11T22:52:14.259722792Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:52:14.304270177Z [2024-04-11 22:52:14,303: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65bcbb26-c564-4032-9eaf-4a2e8ab2aebb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 65bcbb26-c564-4032-9eaf-4a2e8ab2aebb') 2024-04-11T22:52:14.304289604Z Traceback (most recent call last): 2024-04-11T22:52:14.304295273Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:52:14.304300098Z R = retval = fun(*args, **kwargs) 2024-04-11T22:52:14.304304516Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:52:14.304309192Z return self.run(*args, **kwargs) 2024-04-11T22:52:14.304314154Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:52:14.304319472Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:52:14.304337623Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:52:14.304343039Z raise AirflowException(msg) 2024-04-11T22:52:14.304348387Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 65bcbb26-c564-4032-9eaf-4a2e8ab2aebb 2024-04-11T22:52:14.422507710Z [2024-04-11 22:52:14,418: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:15.422928056Z [2024-04-11 22:52:15,422: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:52:15.427090007Z [2024-04-11 22:52:15,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:15.453334374Z [2024-04-11 22:52:15,453: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:52:15.454900830Z [2024-04-11 22:52:15,454: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:15.455040446Z [2024-04-11 22:52:15,454: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:15.455284426Z [2024-04-11 22:52:15,454: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:15.455446890Z [2024-04-11 22:52:15,455: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:52:15.456021920Z [2024-04-11 22:52:15,455: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:52:15.456140328Z [2024-04-11 22:52:15,455: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:15.464366276Z [2024-04-11 22:52:15,464: WARNING/ForkPoolWorker-16] Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:15.465296248Z [2024-04-11 22:52:15,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:52:15.466153388Z [2024-04-11 22:52:15,465: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:52:15.469336091Z [2024-04-11 22:52:15,469: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:52:15.487800193Z [2024-04-11 22:52:15,487: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:52:15.489351982Z [2024-04-11 22:52:15,489: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:52:15.489377597Z [2024-04-11 22:52:15,489: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:52:15.489554186Z [2024-04-11 22:52:15,489: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:52:15.489726634Z [2024-04-11 22:52:15,489: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:52:15.490138230Z [2024-04-11 22:52:15,489: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:52:15.490176440Z [2024-04-11 22:52:15,490: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:52:15.494166899Z [2024-04-11 22:52:15,493: ERROR/ForkPoolWorker-16] [b448811f-bf57-493f-b69e-2116841206ba] Failed to execute task Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:52:15.494229139Z Traceback (most recent call last): 2024-04-11T22:52:15.494239793Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:52:15.494248589Z args.func(args) 2024-04-11T22:52:15.494258041Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:52:15.494314035Z return func(*args, **kwargs) 2024-04-11T22:52:15.494323631Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:52:15.494331604Z return f(*args, **kwargs) 2024-04-11T22:52:15.494340110Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:52:15.494348071Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:52:15.494355898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:52:15.494363685Z raise AirflowException( 2024-04-11T22:52:15.494413278Z airflow.exceptions.AirflowException: Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:52:15.536119876Z [2024-04-11 22:52:15,535: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b448811f-bf57-493f-b69e-2116841206ba] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b448811f-bf57-493f-b69e-2116841206ba') 2024-04-11T22:52:15.536150025Z Traceback (most recent call last): 2024-04-11T22:52:15.536159832Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:52:15.536167887Z R = retval = fun(*args, **kwargs) 2024-04-11T22:52:15.536175772Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:52:15.536183663Z return self.run(*args, **kwargs) 2024-04-11T22:52:15.536192413Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:52:15.536201146Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:52:15.536209655Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:52:15.536218450Z raise AirflowException(msg) 2024-04-11T22:52:15.536227955Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b448811f-bf57-493f-b69e-2116841206ba 2024-04-11T22:53:00.522868973Z [2024-04-11 22:53:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f4b5f31-60bb-49b2-a933-6b8435303229] received 2024-04-11T22:53:00.526097605Z [2024-04-11 22:53:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb038087-18fa-4614-a4a1-45ca43676cbe] received 2024-04-11T22:53:00.528912854Z [2024-04-11 22:53:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b25d5ea-f980-408f-b073-e6edba0b307d] received 2024-04-11T22:53:00.531187685Z [2024-04-11 22:53:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af0becc7-3bd8-4d1e-817f-dc490b046ba9] received 2024-04-11T22:53:00.534336419Z [2024-04-11 22:53:00,534: INFO/ForkPoolWorker-15] [9f4b5f31-60bb-49b2-a933-6b8435303229] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:53:00.535010520Z [2024-04-11 22:53:00,534: INFO/ForkPoolWorker-16] [cb038087-18fa-4614-a4a1-45ca43676cbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:53:00.537272994Z [2024-04-11 22:53:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[270d3dd5-2546-4cd1-89c8-b1eaa0b15429] received 2024-04-11T22:53:00.538186883Z [2024-04-11 22:53:00,537: INFO/ForkPoolWorker-2] [af0becc7-3bd8-4d1e-817f-dc490b046ba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:53:00.539142339Z [2024-04-11 22:53:00,538: INFO/ForkPoolWorker-1] [6b25d5ea-f980-408f-b073-e6edba0b307d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:53:00.548723186Z [2024-04-11 22:53:00,548: INFO/ForkPoolWorker-3] [270d3dd5-2546-4cd1-89c8-b1eaa0b15429] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:53:00.839108566Z [2024-04-11 22:53:00,835: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:53:00.859412828Z [2024-04-11 22:53:00,856: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:53:00.875538598Z [2024-04-11 22:53:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:53:00.987724601Z [2024-04-11 22:53:00,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:53:01.015496678Z [2024-04-11 22:53:01,015: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:53:01.018967615Z [2024-04-11 22:53:01,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:01.052793705Z [2024-04-11 22:53:01,048: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:53:01.056431377Z [2024-04-11 22:53:01,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:53:01.058292882Z [2024-04-11 22:53:01,058: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:53:01.058358420Z [2024-04-11 22:53:01,058: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:53:01.058388379Z [2024-04-11 22:53:01,058: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:53:01.058539681Z [2024-04-11 22:53:01,058: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:53:01.150049300Z [2024-04-11 22:53:01,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:53:01.890117881Z [2024-04-11 22:53:01,889: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb038087-18fa-4614-a4a1-45ca43676cbe] succeeded in 1.3607772039999873s: None 2024-04-11T22:53:02.053521069Z [2024-04-11 22:53:02,053: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:53:02.056876604Z [2024-04-11 22:53:02,056: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.083376483Z [2024-04-11 22:53:02,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:53:02.084652409Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.084669142Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.084771616Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.084797908Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:53:02.084989176Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:53:02.085021205Z [2024-04-11 22:53:02,084: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.090362922Z [2024-04-11 22:53:02,090: WARNING/ForkPoolWorker-2] Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:53:02.091055412Z [2024-04-11 22:53:02,090: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:53:02.092298270Z [2024-04-11 22:53:02,092: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:53:02.094530562Z [2024-04-11 22:53:02,094: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.107878789Z [2024-04-11 22:53:02,107: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:53:02.109109310Z [2024-04-11 22:53:02,108: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.109122143Z [2024-04-11 22:53:02,109: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.109216701Z [2024-04-11 22:53:02,109: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.109240636Z [2024-04-11 22:53:02,109: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:53:02.109656839Z [2024-04-11 22:53:02,109: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:53:02.109663180Z [2024-04-11 22:53:02,109: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.112671010Z [2024-04-11 22:53:02,111: ERROR/ForkPoolWorker-2] [af0becc7-3bd8-4d1e-817f-dc490b046ba9] Failed to execute task Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:53:02.112684989Z Traceback (most recent call last): 2024-04-11T22:53:02.112689391Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:53:02.112693293Z args.func(args) 2024-04-11T22:53:02.112696923Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:53:02.112700457Z return func(*args, **kwargs) 2024-04-11T22:53:02.112703674Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:53:02.112707249Z return f(*args, **kwargs) 2024-04-11T22:53:02.112710799Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:53:02.112714070Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:53:02.112717348Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:53:02.112751447Z raise AirflowException( 2024-04-11T22:53:02.112757426Z airflow.exceptions.AirflowException: Dag 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:53:02.139641193Z [2024-04-11 22:53:02,139: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[af0becc7-3bd8-4d1e-817f-dc490b046ba9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id af0becc7-3bd8-4d1e-817f-dc490b046ba9') 2024-04-11T22:53:02.139657522Z Traceback (most recent call last): 2024-04-11T22:53:02.139661640Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:53:02.139664630Z R = retval = fun(*args, **kwargs) 2024-04-11T22:53:02.139667871Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:53:02.139670878Z return self.run(*args, **kwargs) 2024-04-11T22:53:02.139674531Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:53:02.139677695Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:53:02.139680531Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:53:02.139717245Z raise AirflowException(msg) 2024-04-11T22:53:02.139722193Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id af0becc7-3bd8-4d1e-817f-dc490b046ba9 2024-04-11T22:53:02.214240381Z [2024-04-11 22:53:02,213: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:53:02.216997459Z [2024-04-11 22:53:02,216: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.249572214Z [2024-04-11 22:53:02,249: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:53:02.251867635Z [2024-04-11 22:53:02,251: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.251877919Z [2024-04-11 22:53:02,251: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.251990342Z [2024-04-11 22:53:02,251: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.252000413Z [2024-04-11 22:53:02,251: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:53:02.252214197Z [2024-04-11 22:53:02,252: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:53:02.252329461Z [2024-04-11 22:53:02,252: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.259272367Z [2024-04-11 22:53:02,257: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:53:02.259298617Z [2024-04-11 22:53:02,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:53:02.259342434Z [2024-04-11 22:53:02,259: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:53:02.262107636Z [2024-04-11 22:53:02,261: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.281186196Z [2024-04-11 22:53:02,280: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:53:02.282519820Z [2024-04-11 22:53:02,282: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.282532713Z [2024-04-11 22:53:02,282: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.282774276Z [2024-04-11 22:53:02,282: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.282944760Z [2024-04-11 22:53:02,282: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:53:02.283222008Z [2024-04-11 22:53:02,283: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:53:02.283231634Z [2024-04-11 22:53:02,283: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.286966108Z [2024-04-11 22:53:02,286: ERROR/ForkPoolWorker-1] [6b25d5ea-f980-408f-b073-e6edba0b307d] Failed to execute task Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse.. 2024-04-11T22:53:02.286980324Z Traceback (most recent call last): 2024-04-11T22:53:02.286985805Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-11T22:53:02.286990312Z args.func(args) 2024-04-11T22:53:02.286994930Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-11T22:53:02.287012009Z return func(*args, **kwargs) 2024-04-11T22:53:02.287077863Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-11T22:53:02.287082382Z return f(*args, **kwargs) 2024-04-11T22:53:02.287086366Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-11T22:53:02.287090357Z dag = get_dag(args.subdir, args.dag_id) 2024-04-11T22:53:02.287112011Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-11T22:53:02.287116711Z raise AirflowException( 2024-04-11T22:53:02.287121227Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d' could not be found; either it does not exist or it failed to parse. 2024-04-11T22:53:02.317741335Z [2024-04-11 22:53:02,317: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b25d5ea-f980-408f-b073-e6edba0b307d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6b25d5ea-f980-408f-b073-e6edba0b307d') 2024-04-11T22:53:02.317753810Z Traceback (most recent call last): 2024-04-11T22:53:02.317757294Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-11T22:53:02.317760244Z R = retval = fun(*args, **kwargs) 2024-04-11T22:53:02.317762904Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-11T22:53:02.317765620Z return self.run(*args, **kwargs) 2024-04-11T22:53:02.317768999Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-11T22:53:02.317772016Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-11T22:53:02.317775257Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-11T22:53:02.317778596Z raise AirflowException(msg) 2024-04-11T22:53:02.317781659Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6b25d5ea-f980-408f-b073-e6edba0b307d 2024-04-11T22:53:02.412261251Z [2024-04-11 22:53:02,411: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T22:53:02.414482657Z [2024-04-11 22:53:02,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:53:02.414902555Z [2024-04-11 22:53:02,414: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.417174814Z [2024-04-11 22:53:02,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:53:02.430664666Z [2024-04-11 22:53:02,430: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T22:53:02.431646642Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.431662240Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.431800266Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.431818693Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T22:53:02.431959322Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:53:02.431962943Z [2024-04-11 22:53:02,431: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.440776411Z [2024-04-11 22:53:02,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:53:02.442019211Z [2024-04-11 22:53:02,441: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:53:02.442151756Z [2024-04-11 22:53:02,441: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:53:02.442340297Z [2024-04-11 22:53:02,442: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:53:02.442474521Z [2024-04-11 22:53:02,442: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:53:02.442742180Z [2024-04-11 22:53:02,442: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:53:02.442881079Z [2024-04-11 22:53:02,442: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:53:02.521098080Z [2024-04-11 22:53:02,520: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:53:02.522734186Z [2024-04-11 22:53:02,522: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:53:04.223871187Z [2024-04-11 22:53:04,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f4b5f31-60bb-49b2-a933-6b8435303229] succeeded in 3.6943046510000386s: None 2024-04-11T22:53:04.766239696Z [2024-04-11 22:53:04,765: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[270d3dd5-2546-4cd1-89c8-b1eaa0b15429] succeeded in 4.222790632999931s: None 2024-04-11T22:54:01.233090393Z [2024-04-11 22:54:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8f9bbd0-1211-4320-b123-897c0db0df22] received 2024-04-11T22:54:01.247332433Z [2024-04-11 22:54:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2aae4cb-a293-42b0-87d0-67d19f2036a1] received 2024-04-11T22:54:01.248131566Z [2024-04-11 22:54:01,247: INFO/ForkPoolWorker-15] [c8f9bbd0-1211-4320-b123-897c0db0df22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:54:01.253477084Z [2024-04-11 22:54:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f349422-760f-4a18-886e-8df9e080f551] received 2024-04-11T22:54:01.257494543Z [2024-04-11 22:54:01,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46ca8b71-45d3-4d96-bea0-95553523e733] received 2024-04-11T22:54:01.259588503Z [2024-04-11 22:54:01,259: INFO/ForkPoolWorker-16] [c2aae4cb-a293-42b0-87d0-67d19f2036a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:54:01.267237213Z [2024-04-11 22:54:01,266: INFO/ForkPoolWorker-1] [9f349422-760f-4a18-886e-8df9e080f551] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:54:01.284953342Z [2024-04-11 22:54:01,284: INFO/ForkPoolWorker-2] [46ca8b71-45d3-4d96-bea0-95553523e733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:54:01.590862868Z [2024-04-11 22:54:01,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:54:01.694193378Z [2024-04-11 22:54:01,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:54:01.782341278Z [2024-04-11 22:54:01,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:54:01.796142534Z [2024-04-11 22:54:01,793: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:54:01.872144065Z [2024-04-11 22:54:01,871: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:54:01.876806769Z [2024-04-11 22:54:01,876: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T22:54:01.880404025Z [2024-04-11 22:54:01,879: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:54:01.910576366Z [2024-04-11 22:54:01,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:54:01.911407065Z [2024-04-11 22:54:01,911: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:54:01.911493644Z [2024-04-11 22:54:01,911: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:54:01.911549416Z [2024-04-11 22:54:01,911: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T22:54:01.911709059Z [2024-04-11 22:54:01,911: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:54:02.013209436Z [2024-04-11 22:54:02,012: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:54:02.357641058Z [2024-04-11 22:54:02,357: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f349422-760f-4a18-886e-8df9e080f551] succeeded in 1.1023669320002227s: None 2024-04-11T22:54:02.504015897Z [2024-04-11 22:54:02,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8f9bbd0-1211-4320-b123-897c0db0df22] succeeded in 1.2693058740001106s: None 2024-04-11T22:54:02.936744471Z [2024-04-11 22:54:02,936: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:54:02.944812625Z [2024-04-11 22:54:02,944: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:54:02.955920541Z [2024-04-11 22:54:02,955: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:54:02.959864016Z [2024-04-11 22:54:02,959: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:54:02.971940355Z [2024-04-11 22:54:02,971: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:54:02.973339476Z [2024-04-11 22:54:02,973: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:54:02.973488036Z [2024-04-11 22:54:02,973: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:54:02.973689954Z [2024-04-11 22:54:02,973: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:54:02.973877072Z [2024-04-11 22:54:02,973: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:54:02.974174273Z [2024-04-11 22:54:02,974: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:54:02.974314501Z [2024-04-11 22:54:02,974: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:54:02.983221052Z [2024-04-11 22:54:02,983: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:54:02.984282597Z [2024-04-11 22:54:02,984: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:54:02.984428136Z [2024-04-11 22:54:02,984: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:54:02.984546623Z [2024-04-11 22:54:02,984: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:54:02.984620172Z [2024-04-11 22:54:02,984: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:54:02.984858050Z [2024-04-11 22:54:02,984: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:54:02.985177419Z [2024-04-11 22:54:02,985: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:54:03.051340742Z [2024-04-11 22:54:03,051: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:54:03.051378410Z [2024-04-11 22:54:03,051: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:54:04.753044770Z [2024-04-11 22:54:04,752: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[46ca8b71-45d3-4d96-bea0-95553523e733] succeeded in 3.493352911999864s: None 2024-04-11T22:54:05.053674670Z [2024-04-11 22:54:05,053: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2aae4cb-a293-42b0-87d0-67d19f2036a1] succeeded in 3.800306886999806s: None 2024-04-11T22:55:01.153179023Z [2024-04-11 22:55:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[487ae22e-0223-41ac-8cb1-01bafc483f01] received 2024-04-11T22:55:01.155108050Z [2024-04-11 22:55:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[300e99b7-dc26-4bfc-8c22-2473379de8e3] received 2024-04-11T22:55:01.162250348Z [2024-04-11 22:55:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4de4bc6-1f8a-4284-826a-5b9a7ebbed8a] received 2024-04-11T22:55:01.162961936Z [2024-04-11 22:55:01,162: INFO/ForkPoolWorker-15] [487ae22e-0223-41ac-8cb1-01bafc483f01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:55:01.169123759Z [2024-04-11 22:55:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9db4affc-3693-400b-ac27-871eaf24e5ce] received 2024-04-11T22:55:01.175647390Z [2024-04-11 22:55:01,175: INFO/ForkPoolWorker-16] [300e99b7-dc26-4bfc-8c22-2473379de8e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:01.176020353Z [2024-04-11 22:55:01,175: INFO/ForkPoolWorker-2] [9db4affc-3693-400b-ac27-871eaf24e5ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:55:01.197616532Z [2024-04-11 22:55:01,197: INFO/ForkPoolWorker-1] [e4de4bc6-1f8a-4284-826a-5b9a7ebbed8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:55:01.510906528Z [2024-04-11 22:55:01,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:55:01.756259851Z [2024-04-11 22:55:01,753: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:55:01.875498823Z [2024-04-11 22:55:01,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:55:01.899030452Z [2024-04-11 22:55:01,898: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T22:55:01.902808060Z [2024-04-11 22:55:01,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:01.909711039Z [2024-04-11 22:55:01,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:55:01.926588882Z [2024-04-11 22:55:01,926: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:55:01.928148448Z [2024-04-11 22:55:01,927: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:55:01.928359306Z [2024-04-11 22:55:01,928: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:55:01.928573840Z [2024-04-11 22:55:01,928: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T22:55:01.928805835Z [2024-04-11 22:55:01,928: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:55:02.086756404Z [2024-04-11 22:55:02,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:03.224343403Z [2024-04-11 22:55:03,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[487ae22e-0223-41ac-8cb1-01bafc483f01] succeeded in 2.068034866000289s: None 2024-04-11T22:55:03.351707285Z [2024-04-11 22:55:03,351: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:55:03.354637124Z [2024-04-11 22:55:03,354: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:03.368428601Z [2024-04-11 22:55:03,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:55:03.371366178Z [2024-04-11 22:55:03,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:03.384234566Z [2024-04-11 22:55:03,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:55:03.385758303Z [2024-04-11 22:55:03,385: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:03.385938789Z [2024-04-11 22:55:03,385: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:03.386149037Z [2024-04-11 22:55:03,385: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:03.386297098Z [2024-04-11 22:55:03,386: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:55:03.386688710Z [2024-04-11 22:55:03,386: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:55:03.386821939Z [2024-04-11 22:55:03,386: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:03.409228422Z [2024-04-11 22:55:03,408: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:55:03.410477829Z [2024-04-11 22:55:03,410: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:03.410640750Z [2024-04-11 22:55:03,410: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:03.410789916Z [2024-04-11 22:55:03,410: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:03.410865588Z [2024-04-11 22:55:03,410: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:55:03.411094294Z [2024-04-11 22:55:03,410: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:55:03.411171937Z [2024-04-11 22:55:03,411: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:03.464887466Z [2024-04-11 22:55:03,464: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:03.473510930Z [2024-04-11 22:55:03,473: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:03.586202309Z [2024-04-11 22:55:03,585: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:55:03.589113237Z [2024-04-11 22:55:03,588: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:03.617227076Z [2024-04-11 22:55:03,617: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:55:03.619135068Z [2024-04-11 22:55:03,618: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:03.619234623Z [2024-04-11 22:55:03,619: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:03.619395241Z [2024-04-11 22:55:03,619: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:03.619493119Z [2024-04-11 22:55:03,619: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:55:03.619791693Z [2024-04-11 22:55:03,619: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:55:03.619984173Z [2024-04-11 22:55:03,619: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:03.710256348Z [2024-04-11 22:55:03,710: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:04.065398979Z [2024-04-11 22:55:04,065: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[300e99b7-dc26-4bfc-8c22-2473379de8e3] succeeded in 2.9090827319996606s: None 2024-04-11T22:55:04.129592962Z [2024-04-11 22:55:04,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16f13af6-d6c3-4789-afe1-3d743925d61d] received 2024-04-11T22:55:04.149094049Z [2024-04-11 22:55:04,148: INFO/ForkPoolWorker-15] [16f13af6-d6c3-4789-afe1-3d743925d61d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:04.469666268Z [2024-04-11 22:55:04,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:55:05.418381837Z [2024-04-11 22:55:05,418: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9db4affc-3693-400b-ac27-871eaf24e5ce] succeeded in 4.247975780000161s: None 2024-04-11T22:55:05.485417650Z [2024-04-11 22:55:05,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:55:05.488512532Z [2024-04-11 22:55:05,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:05.512192210Z [2024-04-11 22:55:05,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:55:05.513440169Z [2024-04-11 22:55:05,513: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:05.513569597Z [2024-04-11 22:55:05,513: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:05.513763867Z [2024-04-11 22:55:05,513: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:05.513877475Z [2024-04-11 22:55:05,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:55:05.514183026Z [2024-04-11 22:55:05,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:55:05.514323503Z [2024-04-11 22:55:05,514: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:05.605459180Z [2024-04-11 22:55:05,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:05.887359500Z [2024-04-11 22:55:05,886: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4de4bc6-1f8a-4284-826a-5b9a7ebbed8a] succeeded in 4.712847697000143s: None 2024-04-11T22:55:06.179014417Z [2024-04-11 22:55:06,178: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16f13af6-d6c3-4789-afe1-3d743925d61d] succeeded in 2.0450473999999303s: None 2024-04-11T22:55:06.579205586Z [2024-04-11 22:55:06,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab82ffc4-9ccc-4b23-972d-c063739f359e] received 2024-04-11T22:55:06.591731740Z [2024-04-11 22:55:06,591: INFO/ForkPoolWorker-15] [ab82ffc4-9ccc-4b23-972d-c063739f359e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:55:06.877871726Z [2024-04-11 22:55:06,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:55:07.953899072Z [2024-04-11 22:55:07,953: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:55:07.956967292Z [2024-04-11 22:55:07,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:07.977687275Z [2024-04-11 22:55:07,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:55:07.979153580Z [2024-04-11 22:55:07,978: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:07.979300605Z [2024-04-11 22:55:07,979: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:07.979534165Z [2024-04-11 22:55:07,979: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:07.979582724Z [2024-04-11 22:55:07,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:55:07.980209207Z [2024-04-11 22:55:07,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:55:07.980242975Z [2024-04-11 22:55:07,980: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:08.072641640Z [2024-04-11 22:55:08,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:08.681391025Z [2024-04-11 22:55:08,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab82ffc4-9ccc-4b23-972d-c063739f359e] succeeded in 2.098874237000018s: None 2024-04-11T22:55:09.187921377Z [2024-04-11 22:55:09,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f56d442e-ef6a-4b6a-b194-9233162c2c1a] received 2024-04-11T22:55:09.193955376Z [2024-04-11 22:55:09,193: INFO/ForkPoolWorker-15] [f56d442e-ef6a-4b6a-b194-9233162c2c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:09.448028724Z [2024-04-11 22:55:09,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T22:55:10.407777850Z [2024-04-11 22:55:10,405: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:55:10.411335233Z [2024-04-11 22:55:10,411: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:55:10.435816907Z [2024-04-11 22:55:10,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:55:10.437058587Z [2024-04-11 22:55:10,436: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:55:10.437345803Z [2024-04-11 22:55:10,437: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:55:10.437549579Z [2024-04-11 22:55:10,437: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:55:10.437694510Z [2024-04-11 22:55:10,437: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:55:10.437979148Z [2024-04-11 22:55:10,437: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T22:55:10.438092326Z [2024-04-11 22:55:10,437: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:55:10.518762519Z [2024-04-11 22:55:10,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:55:11.090334678Z [2024-04-11 22:55:11,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f56d442e-ef6a-4b6a-b194-9233162c2c1a] succeeded in 1.9001565479998135s: None 2024-04-11T22:56:01.166024429Z [2024-04-11 22:56:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c84c5c63-3868-493a-a28c-b16136447ceb] received 2024-04-11T22:56:01.168230465Z [2024-04-11 22:56:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f2582f7-0c97-4e10-ae16-39eede8b7cb4] received 2024-04-11T22:56:01.174166901Z [2024-04-11 22:56:01,173: INFO/ForkPoolWorker-16] [7f2582f7-0c97-4e10-ae16-39eede8b7cb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:56:01.177937913Z [2024-04-11 22:56:01,177: INFO/ForkPoolWorker-15] [c84c5c63-3868-493a-a28c-b16136447ceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:56:01.181323177Z [2024-04-11 22:56:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e07f9805-4f38-471b-b551-ae0e10de923a] received 2024-04-11T22:56:01.184566561Z [2024-04-11 22:56:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95627374-b95c-421a-83ae-7f279b0b4eba] received 2024-04-11T22:56:01.199332984Z [2024-04-11 22:56:01,199: INFO/ForkPoolWorker-1] [e07f9805-4f38-471b-b551-ae0e10de923a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:56:01.201228375Z [2024-04-11 22:56:01,200: INFO/ForkPoolWorker-2] [95627374-b95c-421a-83ae-7f279b0b4eba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:56:01.461108308Z [2024-04-11 22:56:01,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:56:01.489062439Z [2024-04-11 22:56:01,485: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:56:01.517559079Z [2024-04-11 22:56:01,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:56:01.532578558Z [2024-04-11 22:56:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:56:01.721271070Z [2024-04-11 22:56:01,720: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:56:01.724952107Z [2024-04-11 22:56:01,724: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:56:01.731948775Z [2024-04-11 22:56:01,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:56:01.776767407Z [2024-04-11 22:56:01,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:56:01.779609768Z [2024-04-11 22:56:01,779: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:56:01.779724920Z [2024-04-11 22:56:01,779: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:56:01.779964813Z [2024-04-11 22:56:01,779: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:56:01.780965890Z [2024-04-11 22:56:01,780: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:56:01.887429693Z [2024-04-11 22:56:01,887: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:56:02.273508624Z [2024-04-11 22:56:02,273: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c84c5c63-3868-493a-a28c-b16136447ceb] succeeded in 1.1059056359999886s: None 2024-04-11T22:56:02.361811815Z [2024-04-11 22:56:02,361: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f2582f7-0c97-4e10-ae16-39eede8b7cb4] succeeded in 1.192009508999945s: None 2024-04-11T22:56:02.650346778Z [2024-04-11 22:56:02,649: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:56:02.653211148Z [2024-04-11 22:56:02,652: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:56:02.671118297Z [2024-04-11 22:56:02,670: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:56:02.672166023Z [2024-04-11 22:56:02,671: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:56:02.672177563Z [2024-04-11 22:56:02,672: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:56:02.672437803Z [2024-04-11 22:56:02,672: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:56:02.672451915Z [2024-04-11 22:56:02,672: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:56:02.672734247Z [2024-04-11 22:56:02,672: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:56:02.672744526Z [2024-04-11 22:56:02,672: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:56:02.694545045Z [2024-04-11 22:56:02,694: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:56:02.697292534Z [2024-04-11 22:56:02,696: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:56:02.730067617Z [2024-04-11 22:56:02,729: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:56:02.733198283Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:56:02.733209252Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:56:02.733312852Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:56:02.733336013Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:56:02.733517782Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:56:02.733541065Z [2024-04-11 22:56:02,733: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:56:02.750768346Z [2024-04-11 22:56:02,750: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:56:02.810139013Z [2024-04-11 22:56:02,809: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:56:04.221064430Z [2024-04-11 22:56:04,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95627374-b95c-421a-83ae-7f279b0b4eba] succeeded in 3.0330665520000366s: None 2024-04-11T22:56:04.555784881Z [2024-04-11 22:56:04,555: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e07f9805-4f38-471b-b551-ae0e10de923a] succeeded in 3.3694219500002873s: None 2024-04-11T22:57:00.980888887Z [2024-04-11 22:57:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fff0081f-8ff2-4389-98da-cf6a609e87cd] received 2024-04-11T22:57:00.986902662Z [2024-04-11 22:57:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68151d6c-ae6a-4054-8a1a-faf8a68ba7d2] received 2024-04-11T22:57:00.989114969Z [2024-04-11 22:57:00,988: INFO/ForkPoolWorker-15] [fff0081f-8ff2-4389-98da-cf6a609e87cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:57:00.994907848Z [2024-04-11 22:57:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e889385-1cfe-4eb3-b185-a72ade9516df] received 2024-04-11T22:57:00.995950084Z [2024-04-11 22:57:00,995: INFO/ForkPoolWorker-16] [68151d6c-ae6a-4054-8a1a-faf8a68ba7d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:57:01.005560326Z [2024-04-11 22:57:01,005: INFO/ForkPoolWorker-1] [1e889385-1cfe-4eb3-b185-a72ade9516df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:57:01.272316801Z [2024-04-11 22:57:01,269: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:57:01.286197631Z [2024-04-11 22:57:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:57:01.303141121Z [2024-04-11 22:57:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:57:01.444694216Z [2024-04-11 22:57:01,444: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T22:57:01.448766596Z [2024-04-11 22:57:01,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:57:01.473760564Z [2024-04-11 22:57:01,473: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:57:01.474973999Z [2024-04-11 22:57:01,474: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:57:01.475182480Z [2024-04-11 22:57:01,474: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:57:01.475353217Z [2024-04-11 22:57:01,475: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T22:57:01.475708620Z [2024-04-11 22:57:01,475: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:57:01.576465781Z [2024-04-11 22:57:01,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:57:02.149753599Z [2024-04-11 22:57:02,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68151d6c-ae6a-4054-8a1a-faf8a68ba7d2] succeeded in 1.1617031949999728s: None 2024-04-11T22:57:02.337090733Z [2024-04-11 22:57:02,336: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T22:57:02.339758258Z [2024-04-11 22:57:02,339: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:57:02.355451907Z [2024-04-11 22:57:02,355: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:57:02.356485730Z [2024-04-11 22:57:02,356: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:57:02.356497202Z [2024-04-11 22:57:02,356: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:57:02.356607616Z [2024-04-11 22:57:02,356: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:57:02.356639293Z [2024-04-11 22:57:02,356: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T22:57:02.357084518Z [2024-04-11 22:57:02,356: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:57:02.357093853Z [2024-04-11 22:57:02,357: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:57:02.376963828Z [2024-04-11 22:57:02,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:57:02.379973518Z [2024-04-11 22:57:02,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:57:02.402556770Z [2024-04-11 22:57:02,402: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:57:02.405194045Z [2024-04-11 22:57:02,404: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:57:02.405222649Z [2024-04-11 22:57:02,404: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:57:02.405236807Z [2024-04-11 22:57:02,404: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:57:02.409620633Z [2024-04-11 22:57:02,405: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:57:02.409644404Z [2024-04-11 22:57:02,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:57:02.409649745Z [2024-04-11 22:57:02,409: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:57:02.434568624Z [2024-04-11 22:57:02,434: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:57:02.480623765Z [2024-04-11 22:57:02,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:57:03.847367791Z [2024-04-11 22:57:03,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e889385-1cfe-4eb3-b185-a72ade9516df] succeeded in 2.8504357950000667s: None 2024-04-11T22:57:04.225282993Z [2024-04-11 22:57:04,224: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fff0081f-8ff2-4389-98da-cf6a609e87cd] succeeded in 3.242095592000169s: None 2024-04-11T22:58:00.563298162Z [2024-04-11 22:58:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[865a693a-a9d3-4a90-95e5-4c0cab396350] received 2024-04-11T22:58:00.565372862Z [2024-04-11 22:58:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ad98d04-de8a-4753-855d-9b4aa1629f44] received 2024-04-11T22:58:00.574675852Z [2024-04-11 22:58:00,574: INFO/ForkPoolWorker-16] [8ad98d04-de8a-4753-855d-9b4aa1629f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:58:00.574980184Z [2024-04-11 22:58:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[301f89c5-b52f-4954-bb35-1dee90bb737c] received 2024-04-11T22:58:00.575187058Z [2024-04-11 22:58:00,574: INFO/ForkPoolWorker-15] [865a693a-a9d3-4a90-95e5-4c0cab396350] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:58:00.576743635Z [2024-04-11 22:58:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e299954-1739-4231-b62d-ffaca526a7f4] received 2024-04-11T22:58:00.581243935Z [2024-04-11 22:58:00,581: INFO/ForkPoolWorker-1] [301f89c5-b52f-4954-bb35-1dee90bb737c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:58:00.585060772Z [2024-04-11 22:58:00,584: INFO/ForkPoolWorker-2] [3e299954-1739-4231-b62d-ffaca526a7f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:58:00.836473193Z [2024-04-11 22:58:00,833: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:58:00.849649631Z [2024-04-11 22:58:00,845: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:58:00.980504999Z [2024-04-11 22:58:00,977: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:58:00.997097616Z [2024-04-11 22:58:00,996: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:58:01.000776607Z [2024-04-11 22:58:01,000: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:58:01.015226209Z [2024-04-11 22:58:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T22:58:01.032749875Z [2024-04-11 22:58:01,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:58:01.034001181Z [2024-04-11 22:58:01,033: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:58:01.034135811Z [2024-04-11 22:58:01,033: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:58:01.034192811Z [2024-04-11 22:58:01,034: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:58:01.034431249Z [2024-04-11 22:58:01,034: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:58:01.113180762Z [2024-04-11 22:58:01,112: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:58:01.248361447Z [2024-04-11 22:58:01,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:58:01.637587269Z [2024-04-11 22:58:01,637: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[301f89c5-b52f-4954-bb35-1dee90bb737c] succeeded in 1.0610296240001844s: None 2024-04-11T22:58:01.867060239Z [2024-04-11 22:58:01,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[865a693a-a9d3-4a90-95e5-4c0cab396350] succeeded in 1.300223509999796s: None 2024-04-11T22:58:01.980218652Z [2024-04-11 22:58:01,979: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T22:58:01.983042377Z [2024-04-11 22:58:01,982: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:58:02.002049586Z [2024-04-11 22:58:02,001: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T22:58:02.003146865Z [2024-04-11 22:58:02,002: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:58:02.003264436Z [2024-04-11 22:58:02,003: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:58:02.003471567Z [2024-04-11 22:58:02,003: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:58:02.003505999Z [2024-04-11 22:58:02,003: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T22:58:02.003734931Z [2024-04-11 22:58:02,003: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:58:02.003774106Z [2024-04-11 22:58:02,003: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:58:02.081351270Z [2024-04-11 22:58:02,080: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:58:02.093056506Z [2024-04-11 22:58:02,092: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:58:02.095938165Z [2024-04-11 22:58:02,095: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:58:02.121105522Z [2024-04-11 22:58:02,120: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:58:02.122096099Z [2024-04-11 22:58:02,121: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:58:02.122112534Z [2024-04-11 22:58:02,122: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:58:02.122227865Z [2024-04-11 22:58:02,122: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:58:02.122238289Z [2024-04-11 22:58:02,122: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:58:02.122495501Z [2024-04-11 22:58:02,122: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:58:02.122500333Z [2024-04-11 22:58:02,122: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:58:02.211231154Z [2024-04-11 22:58:02,210: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:58:03.778535949Z [2024-04-11 22:58:03,778: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ad98d04-de8a-4753-855d-9b4aa1629f44] succeeded in 3.211716446999617s: None 2024-04-11T22:58:03.869729238Z [2024-04-11 22:58:03,869: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3e299954-1739-4231-b62d-ffaca526a7f4] succeeded in 3.291204353000012s: None 2024-04-11T22:59:00.895619870Z [2024-04-11 22:59:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c5001b1-a472-47b1-9a9e-072fd4fae79c] received 2024-04-11T22:59:00.897968726Z [2024-04-11 22:59:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f85cf64c-607a-4764-8cfd-2105606539bd] received 2024-04-11T22:59:00.906623139Z [2024-04-11 22:59:00,906: INFO/ForkPoolWorker-15] [1c5001b1-a472-47b1-9a9e-072fd4fae79c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:59:00.908991695Z [2024-04-11 22:59:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb32aa9b-7158-4fcf-95e4-34f70ed0b3da] received 2024-04-11T22:59:00.915352949Z [2024-04-11 22:59:00,915: INFO/ForkPoolWorker-16] [f85cf64c-607a-4764-8cfd-2105606539bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:59:00.923692114Z [2024-04-11 22:59:00,923: INFO/ForkPoolWorker-1] [bb32aa9b-7158-4fcf-95e4-34f70ed0b3da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:59:01.165402275Z [2024-04-11 22:59:01,162: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T22:59:01.194818099Z [2024-04-11 22:59:01,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T22:59:01.222297827Z [2024-04-11 22:59:01,216: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T22:59:01.369088717Z [2024-04-11 22:59:01,368: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T22:59:01.372824792Z [2024-04-11 22:59:01,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:59:01.396767345Z [2024-04-11 22:59:01,396: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T22:59:01.398055224Z [2024-04-11 22:59:01,397: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T22:59:01.398295630Z [2024-04-11 22:59:01,397: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T22:59:01.398311938Z [2024-04-11 22:59:01,398: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T22:59:01.398561527Z [2024-04-11 22:59:01,398: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T22:59:01.504871953Z [2024-04-11 22:59:01,504: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:59:02.053030758Z [2024-04-11 22:59:02,052: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb32aa9b-7158-4fcf-95e4-34f70ed0b3da] succeeded in 1.1426849219997166s: None 2024-04-11T22:59:02.198200859Z [2024-04-11 22:59:02,197: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T22:59:02.201066395Z [2024-04-11 22:59:02,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:59:02.219196030Z [2024-04-11 22:59:02,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T22:59:02.220408826Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:59:02.220464933Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:59:02.220555452Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:59:02.220589636Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T22:59:02.220848417Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T22:59:02.220985172Z [2024-04-11 22:59:02,220: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:59:02.314792780Z [2024-04-11 22:59:02,314: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:59:02.347052319Z [2024-04-11 22:59:02,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T22:59:02.350025840Z [2024-04-11 22:59:02,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T22:59:02.370179576Z [2024-04-11 22:59:02,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T22:59:02.371714874Z [2024-04-11 22:59:02,371: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T22:59:02.371899038Z [2024-04-11 22:59:02,371: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T22:59:02.372104899Z [2024-04-11 22:59:02,371: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T22:59:02.372267962Z [2024-04-11 22:59:02,372: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T22:59:02.372650926Z [2024-04-11 22:59:02,372: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T22:59:02.372802007Z [2024-04-11 22:59:02,372: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T22:59:02.439435963Z [2024-04-11 22:59:02,439: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T22:59:03.926411927Z [2024-04-11 22:59:03,926: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c5001b1-a472-47b1-9a9e-072fd4fae79c] succeeded in 3.0285615200000393s: None 2024-04-11T22:59:04.050298234Z [2024-04-11 22:59:04,049: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f85cf64c-607a-4764-8cfd-2105606539bd] succeeded in 3.1495008130000315s: None 2024-04-11T23:00:01.156644361Z [2024-04-11 23:00:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[013fd5a3-7377-4603-8739-0f96cb269d95] received 2024-04-11T23:00:01.169462428Z [2024-04-11 23:00:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ed54214-d8cb-42d7-9009-bffdf1335fcf] received 2024-04-11T23:00:01.185045968Z [2024-04-11 23:00:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f46740a1-88ff-45ce-9825-451d3f5a2fbe] received 2024-04-11T23:00:01.186505587Z [2024-04-11 23:00:01,186: INFO/ForkPoolWorker-16] [9ed54214-d8cb-42d7-9009-bffdf1335fcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:00:01.187835816Z [2024-04-11 23:00:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[107f340f-73a7-4772-a2ac-9474a091542e] received 2024-04-11T23:00:01.197140318Z [2024-04-11 23:00:01,196: INFO/ForkPoolWorker-1] [f46740a1-88ff-45ce-9825-451d3f5a2fbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:00:01.197889674Z [2024-04-11 23:00:01,197: INFO/ForkPoolWorker-2] [107f340f-73a7-4772-a2ac-9474a091542e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:00:01.300813331Z [2024-04-11 23:00:01,272: INFO/ForkPoolWorker-15] [013fd5a3-7377-4603-8739-0f96cb269d95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:01.311612970Z [2024-04-11 23:00:01,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5fe5812-5d14-4f97-adc5-42add5dd33ac] received 2024-04-11T23:00:01.354442610Z [2024-04-11 23:00:01,354: INFO/ForkPoolWorker-3] [b5fe5812-5d14-4f97-adc5-42add5dd33ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:00:02.152100872Z [2024-04-11 23:00:02,141: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:00:02.393215127Z [2024-04-11 23:00:02,383: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:00:02.837435842Z [2024-04-11 23:00:02,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:00:03.011330714Z [2024-04-11 23:00:02,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:00:03.776914053Z [2024-04-11 23:00:03,757: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:00:04.593785368Z [2024-04-11 23:00:04,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:04.836020928Z [2024-04-11 23:00:04,835: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-11T23:00:04.844854532Z [2024-04-11 23:00:04,842: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:04.950334851Z [2024-04-11 23:00:04,949: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:00:04.959044838Z [2024-04-11 23:00:04,958: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:00:04.959256866Z [2024-04-11 23:00:04,958: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:00:04.960543299Z [2024-04-11 23:00:04,959: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-11T23:00:04.960556630Z [2024-04-11 23:00:04,959: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:00:05.175161893Z [2024-04-11 23:00:05,174: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:05.907679737Z [2024-04-11 23:00:05,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ed54214-d8cb-42d7-9009-bffdf1335fcf] succeeded in 4.730138287000045s: None 2024-04-11T23:00:06.301456276Z [2024-04-11 23:00:06,301: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b5fe5812-5d14-4f97-adc5-42add5dd33ac] succeeded in 4.973284990000138s: None 2024-04-11T23:00:06.941123109Z [2024-04-11 23:00:06,940: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:00:06.944074095Z [2024-04-11 23:00:06,943: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:06.974097475Z [2024-04-11 23:00:06,973: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:00:06.988276494Z [2024-04-11 23:00:06,982: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:06.988307079Z [2024-04-11 23:00:06,983: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:06.988311565Z [2024-04-11 23:00:06,983: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:06.988315439Z [2024-04-11 23:00:06,983: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:00:06.988318278Z [2024-04-11 23:00:06,983: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:00:06.988321080Z [2024-04-11 23:00:06,983: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:07.093156720Z [2024-04-11 23:00:07,092: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:07.150095876Z [2024-04-11 23:00:07,149: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:00:07.154420750Z [2024-04-11 23:00:07,154: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:07.160850775Z [2024-04-11 23:00:07,160: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:00:07.164337245Z [2024-04-11 23:00:07,163: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:07.201541401Z [2024-04-11 23:00:07,201: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:00:07.221154081Z [2024-04-11 23:00:07,220: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:07.221169971Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:07.221264809Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:07.221304181Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:00:07.221498666Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:00:07.221522754Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:07.222102630Z [2024-04-11 23:00:07,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:00:07.223142096Z [2024-04-11 23:00:07,222: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:07.223265652Z [2024-04-11 23:00:07,223: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:07.223419885Z [2024-04-11 23:00:07,223: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:07.223520473Z [2024-04-11 23:00:07,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:00:07.223868969Z [2024-04-11 23:00:07,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:00:07.223991510Z [2024-04-11 23:00:07,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:07.355694188Z [2024-04-11 23:00:07,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:07.406347494Z [2024-04-11 23:00:07,406: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:08.501495186Z [2024-04-11 23:00:08,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[013fd5a3-7377-4603-8739-0f96cb269d95] succeeded in 7.336189333999755s: None 2024-04-11T23:00:08.587292764Z [2024-04-11 23:00:08,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ae3c406-e947-4c11-9935-735e8ce19566] received 2024-04-11T23:00:08.606161651Z [2024-04-11 23:00:08,604: INFO/ForkPoolWorker-15] [5ae3c406-e947-4c11-9935-735e8ce19566] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:08.940387183Z [2024-04-11 23:00:08,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:00:09.147285802Z [2024-04-11 23:00:09,146: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[107f340f-73a7-4772-a2ac-9474a091542e] succeeded in 7.957149827000194s: None 2024-04-11T23:00:10.496414459Z [2024-04-11 23:00:10,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f46740a1-88ff-45ce-9825-451d3f5a2fbe] succeeded in 9.309545247999722s: None 2024-04-11T23:00:10.632794886Z [2024-04-11 23:00:10,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:00:10.635862670Z [2024-04-11 23:00:10,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:10.683101589Z [2024-04-11 23:00:10,682: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:00:10.684764857Z [2024-04-11 23:00:10,684: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:10.684910612Z [2024-04-11 23:00:10,684: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:10.685064259Z [2024-04-11 23:00:10,684: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:10.685129333Z [2024-04-11 23:00:10,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:00:10.685364769Z [2024-04-11 23:00:10,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:00:10.685717029Z [2024-04-11 23:00:10,685: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:10.763605795Z [2024-04-11 23:00:10,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:11.401379385Z [2024-04-11 23:00:11,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ae3c406-e947-4c11-9935-735e8ce19566] succeeded in 2.812409163999746s: None 2024-04-11T23:00:11.412429935Z [2024-04-11 23:00:11,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cee5fa22-5c0f-4dbf-ad87-751635b93535] received 2024-04-11T23:00:11.418702392Z [2024-04-11 23:00:11,418: INFO/ForkPoolWorker-15] [cee5fa22-5c0f-4dbf-ad87-751635b93535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:00:11.707748227Z [2024-04-11 23:00:11,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:00:12.898104124Z [2024-04-11 23:00:12,897: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:00:12.901388558Z [2024-04-11 23:00:12,900: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:12.922046422Z [2024-04-11 23:00:12,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:00:12.922330300Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:12.922370803Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:12.922654689Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:12.922662561Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:00:12.922765064Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:00:12.922823404Z [2024-04-11 23:00:12,922: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:13.019734952Z [2024-04-11 23:00:13,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:13.652285812Z [2024-04-11 23:00:13,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cee5fa22-5c0f-4dbf-ad87-751635b93535] succeeded in 2.2383527500001037s: None 2024-04-11T23:00:13.740550123Z [2024-04-11 23:00:13,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c48eb24-cf3f-49a3-976b-accb5b39413f] received 2024-04-11T23:00:13.776651795Z [2024-04-11 23:00:13,773: INFO/ForkPoolWorker-15] [2c48eb24-cf3f-49a3-976b-accb5b39413f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:14.083614443Z [2024-04-11 23:00:14,080: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:00:15.106525191Z [2024-04-11 23:00:15,105: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:00:15.109459098Z [2024-04-11 23:00:15,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:00:15.133176991Z [2024-04-11 23:00:15,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:00:15.134773272Z [2024-04-11 23:00:15,134: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:00:15.134861558Z [2024-04-11 23:00:15,134: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:00:15.135105958Z [2024-04-11 23:00:15,134: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:00:15.135226521Z [2024-04-11 23:00:15,135: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:00:15.135459137Z [2024-04-11 23:00:15,135: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:00:15.135507266Z [2024-04-11 23:00:15,135: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:00:15.215166557Z [2024-04-11 23:00:15,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:00:15.887077127Z [2024-04-11 23:00:15,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c48eb24-cf3f-49a3-976b-accb5b39413f] succeeded in 2.143350308999743s: None 2024-04-11T23:01:00.690541201Z [2024-04-11 23:01:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12e2466b-0b3d-4826-ad43-c7aa8ed46f1d] received 2024-04-11T23:01:00.698961708Z [2024-04-11 23:01:00,698: INFO/ForkPoolWorker-15] [12e2466b-0b3d-4826-ad43-c7aa8ed46f1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:01:00.715479239Z [2024-04-11 23:01:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a074567-0310-47c7-a449-947730d88c13] received 2024-04-11T23:01:00.716691225Z [2024-04-11 23:01:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f917165a-5a3e-42ef-8018-3e25b986480d] received 2024-04-11T23:01:00.731083670Z [2024-04-11 23:01:00,730: INFO/ForkPoolWorker-1] [f917165a-5a3e-42ef-8018-3e25b986480d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:01:00.731977077Z [2024-04-11 23:01:00,731: INFO/ForkPoolWorker-16] [4a074567-0310-47c7-a449-947730d88c13] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:01:01.037474207Z [2024-04-11 23:01:01,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:01:01.109412507Z [2024-04-11 23:01:01,106: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:01:01.135577477Z [2024-04-11 23:01:01,132: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:01:01.294447293Z [2024-04-11 23:01:01,294: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:01:01.298345461Z [2024-04-11 23:01:01,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:01:01.328612147Z [2024-04-11 23:01:01,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:01:01.329428725Z [2024-04-11 23:01:01,329: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:01:01.329526560Z [2024-04-11 23:01:01,329: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:01:01.329615699Z [2024-04-11 23:01:01,329: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:01:01.329795312Z [2024-04-11 23:01:01,329: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:01:01.420108424Z [2024-04-11 23:01:01,419: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:01:02.175732977Z [2024-04-11 23:01:02,175: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a074567-0310-47c7-a449-947730d88c13] succeeded in 1.4577634329998546s: None 2024-04-11T23:01:02.214409191Z [2024-04-11 23:01:02,214: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:01:02.217539023Z [2024-04-11 23:01:02,217: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:01:02.253238464Z [2024-04-11 23:01:02,252: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:01:02.256532291Z [2024-04-11 23:01:02,253: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:01:02.256548361Z [2024-04-11 23:01:02,253: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:01:02.256552093Z [2024-04-11 23:01:02,253: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:01:02.256555927Z [2024-04-11 23:01:02,254: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:01:02.256558583Z [2024-04-11 23:01:02,254: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:01:02.256561417Z [2024-04-11 23:01:02,254: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:01:02.290893817Z [2024-04-11 23:01:02,290: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:01:02.294471437Z [2024-04-11 23:01:02,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:01:02.310597732Z [2024-04-11 23:01:02,310: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:01:02.313165753Z [2024-04-11 23:01:02,312: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:01:02.313227848Z [2024-04-11 23:01:02,313: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:01:02.313406391Z [2024-04-11 23:01:02,313: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:01:02.313444383Z [2024-04-11 23:01:02,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:01:02.313664146Z [2024-04-11 23:01:02,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:01:02.313695686Z [2024-04-11 23:01:02,313: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:01:02.325249087Z [2024-04-11 23:01:02,325: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:01:02.393629535Z [2024-04-11 23:01:02,393: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:01:03.701736691Z [2024-04-11 23:01:03,700: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f917165a-5a3e-42ef-8018-3e25b986480d] succeeded in 2.982019528999899s: None 2024-04-11T23:01:04.373049049Z [2024-04-11 23:01:04,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12e2466b-0b3d-4826-ad43-c7aa8ed46f1d] succeeded in 3.680728722999902s: None 2024-04-11T23:02:00.509293159Z [2024-04-11 23:02:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f7ad16-afe0-4ec2-b36a-4b43c8d7dcf6] received 2024-04-11T23:02:00.514049033Z [2024-04-11 23:02:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b9f4c36-3b4b-4a01-9391-f928aae549ae] received 2024-04-11T23:02:00.515343869Z [2024-04-11 23:02:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13084d51-02ec-47f7-ae05-716160f6c628] received 2024-04-11T23:02:00.518801840Z [2024-04-11 23:02:00,518: INFO/ForkPoolWorker-15] [47f7ad16-afe0-4ec2-b36a-4b43c8d7dcf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:02:00.526897968Z [2024-04-11 23:02:00,526: INFO/ForkPoolWorker-16] [4b9f4c36-3b4b-4a01-9391-f928aae549ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:02:00.530453322Z [2024-04-11 23:02:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32a8455b-5e05-4422-9016-ce515c9abfa5] received 2024-04-11T23:02:00.541337092Z [2024-04-11 23:02:00,540: INFO/ForkPoolWorker-1] [13084d51-02ec-47f7-ae05-716160f6c628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:02:00.542651317Z [2024-04-11 23:02:00,542: INFO/ForkPoolWorker-2] [32a8455b-5e05-4422-9016-ce515c9abfa5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:02:00.823004861Z [2024-04-11 23:02:00,818: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:02:00.857247792Z [2024-04-11 23:02:00,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:02:00.898156810Z [2024-04-11 23:02:00,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:02:00.946191975Z [2024-04-11 23:02:00,943: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:02:01.012811818Z [2024-04-11 23:02:01,012: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:02:01.016423243Z [2024-04-11 23:02:01,015: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:02:01.049213954Z [2024-04-11 23:02:01,048: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:02:01.050541863Z [2024-04-11 23:02:01,050: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:02:01.050601482Z [2024-04-11 23:02:01,050: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:02:01.050658916Z [2024-04-11 23:02:01,050: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:02:01.050820210Z [2024-04-11 23:02:01,050: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:02:01.155036159Z [2024-04-11 23:02:01,154: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:02:01.168642952Z [2024-04-11 23:02:01,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:02:01.657011131Z [2024-04-11 23:02:01,656: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47f7ad16-afe0-4ec2-b36a-4b43c8d7dcf6] succeeded in 1.145159620999948s: None 2024-04-11T23:02:01.698239796Z [2024-04-11 23:02:01,696: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32a8455b-5e05-4422-9016-ce515c9abfa5] succeeded in 1.1636363650000021s: None 2024-04-11T23:02:02.062416013Z [2024-04-11 23:02:02,062: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:02:02.065589093Z [2024-04-11 23:02:02,065: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:02:02.085437409Z [2024-04-11 23:02:02,085: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:02:02.086633952Z [2024-04-11 23:02:02,086: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:02:02.086737460Z [2024-04-11 23:02:02,086: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:02:02.086887257Z [2024-04-11 23:02:02,086: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:02:02.086959406Z [2024-04-11 23:02:02,086: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:02:02.087222178Z [2024-04-11 23:02:02,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:02:02.087332367Z [2024-04-11 23:02:02,087: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:02:02.153538441Z [2024-04-11 23:02:02,153: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:02:02.156534219Z [2024-04-11 23:02:02,156: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:02:02.177700285Z [2024-04-11 23:02:02,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:02:02.179134875Z [2024-04-11 23:02:02,178: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:02:02.179360020Z [2024-04-11 23:02:02,179: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:02:02.179624682Z [2024-04-11 23:02:02,179: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:02:02.179726463Z [2024-04-11 23:02:02,179: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:02:02.179918046Z [2024-04-11 23:02:02,179: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:02:02.180366583Z [2024-04-11 23:02:02,180: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:02:02.180594844Z [2024-04-11 23:02:02,180: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:02:02.268984726Z [2024-04-11 23:02:02,268: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:02:03.789089213Z [2024-04-11 23:02:03,788: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b9f4c36-3b4b-4a01-9391-f928aae549ae] succeeded in 3.2713352800001303s: None 2024-04-11T23:02:04.358235033Z [2024-04-11 23:02:04,357: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13084d51-02ec-47f7-ae05-716160f6c628] succeeded in 3.8391586870002357s: None 2024-04-11T23:03:00.268757735Z [2024-04-11 23:03:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3c59e7e-850d-4538-abce-0a8cf0aa1338] received 2024-04-11T23:03:00.279777485Z [2024-04-11 23:03:00,279: INFO/ForkPoolWorker-15] [c3c59e7e-850d-4538-abce-0a8cf0aa1338] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:03:00.283852847Z [2024-04-11 23:03:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dacc0f75-c469-4daa-b5a5-3e3490a44863] received 2024-04-11T23:03:00.290198737Z [2024-04-11 23:03:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[595b23e1-3ced-4e07-a50d-affaae6d89da] received 2024-04-11T23:03:00.294341884Z [2024-04-11 23:03:00,294: INFO/ForkPoolWorker-16] [dacc0f75-c469-4daa-b5a5-3e3490a44863] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:03:00.301979495Z [2024-04-11 23:03:00,301: INFO/ForkPoolWorker-1] [595b23e1-3ced-4e07-a50d-affaae6d89da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:03:00.587832425Z [2024-04-11 23:03:00,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:03:00.631545626Z [2024-04-11 23:03:00,628: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:03:00.646089885Z [2024-04-11 23:03:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:03:00.786909214Z [2024-04-11 23:03:00,786: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:03:00.790468697Z [2024-04-11 23:03:00,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:03:00.828902676Z [2024-04-11 23:03:00,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:03:00.829877502Z [2024-04-11 23:03:00,829: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:03:00.830015870Z [2024-04-11 23:03:00,829: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:03:00.830074762Z [2024-04-11 23:03:00,830: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:03:00.830282625Z [2024-04-11 23:03:00,830: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:03:00.908310507Z [2024-04-11 23:03:00,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:03:01.515864377Z [2024-04-11 23:03:01,515: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dacc0f75-c469-4daa-b5a5-3e3490a44863] succeeded in 1.229159706000246s: None 2024-04-11T23:03:01.810218801Z [2024-04-11 23:03:01,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:03:01.813203797Z [2024-04-11 23:03:01,812: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:03:01.829265294Z [2024-04-11 23:03:01,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:03:01.830421421Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:03:01.830488192Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:03:01.830624084Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:03:01.830679658Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:03:01.830899577Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:03:01.830949457Z [2024-04-11 23:03:01,830: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:03:01.839530815Z [2024-04-11 23:03:01,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:03:01.842361041Z [2024-04-11 23:03:01,842: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:03:01.869549543Z [2024-04-11 23:03:01,869: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:03:01.871072598Z [2024-04-11 23:03:01,870: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:03:01.871194038Z [2024-04-11 23:03:01,871: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:03:01.871349408Z [2024-04-11 23:03:01,871: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:03:01.871454644Z [2024-04-11 23:03:01,871: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:03:01.871708523Z [2024-04-11 23:03:01,871: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:03:01.871824098Z [2024-04-11 23:03:01,871: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:03:01.920888357Z [2024-04-11 23:03:01,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:03:01.985780582Z [2024-04-11 23:03:01,985: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:03:03.358236873Z [2024-04-11 23:03:03,357: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[595b23e1-3ced-4e07-a50d-affaae6d89da] succeeded in 3.0643113549999725s: None 2024-04-11T23:03:03.637057760Z [2024-04-11 23:03:03,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3c59e7e-850d-4538-abce-0a8cf0aa1338] succeeded in 3.3652436849997684s: None 2024-04-11T23:04:01.010971938Z [2024-04-11 23:04:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2273ba7e-a40c-41a7-9c22-b69d5f2677a4] received 2024-04-11T23:04:01.013800352Z [2024-04-11 23:04:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb4e1bc2-fa2d-4c0f-9134-344decacb6fb] received 2024-04-11T23:04:01.018629116Z [2024-04-11 23:04:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be1a91d7-69ed-408c-8d85-43c7b6e106b7] received 2024-04-11T23:04:01.020751782Z [2024-04-11 23:04:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74fb5cac-2c7c-4353-af7f-6398541265e0] received 2024-04-11T23:04:01.028804448Z [2024-04-11 23:04:01,028: INFO/ForkPoolWorker-1] [be1a91d7-69ed-408c-8d85-43c7b6e106b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:04:01.029606202Z [2024-04-11 23:04:01,029: INFO/ForkPoolWorker-16] [cb4e1bc2-fa2d-4c0f-9134-344decacb6fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:04:01.031364081Z [2024-04-11 23:04:01,031: INFO/ForkPoolWorker-2] [74fb5cac-2c7c-4353-af7f-6398541265e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:04:01.037091610Z [2024-04-11 23:04:01,036: INFO/ForkPoolWorker-15] [2273ba7e-a40c-41a7-9c22-b69d5f2677a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:04:01.319767027Z [2024-04-11 23:04:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:04:01.355420410Z [2024-04-11 23:04:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:04:01.392327302Z [2024-04-11 23:04:01,388: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:04:01.442837634Z [2024-04-11 23:04:01,439: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:04:01.555342535Z [2024-04-11 23:04:01,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:04:01.611271955Z [2024-04-11 23:04:01,610: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:04:01.617016524Z [2024-04-11 23:04:01,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:04:01.651474726Z [2024-04-11 23:04:01,651: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:04:01.654328355Z [2024-04-11 23:04:01,652: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:04:01.654339412Z [2024-04-11 23:04:01,652: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:04:01.654349907Z [2024-04-11 23:04:01,653: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:04:01.654353161Z [2024-04-11 23:04:01,653: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:04:01.772748468Z [2024-04-11 23:04:01,772: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:04:02.166882408Z [2024-04-11 23:04:02,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2273ba7e-a40c-41a7-9c22-b69d5f2677a4] succeeded in 1.1521290010000484s: None 2024-04-11T23:04:02.338709725Z [2024-04-11 23:04:02,338: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb4e1bc2-fa2d-4c0f-9134-344decacb6fb] succeeded in 1.3230283760003658s: None 2024-04-11T23:04:02.586670511Z [2024-04-11 23:04:02,586: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:04:02.589513989Z [2024-04-11 23:04:02,589: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:04:02.613641532Z [2024-04-11 23:04:02,613: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:04:02.615259872Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:04:02.615293786Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:04:02.615456449Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:04:02.615477904Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:04:02.615718955Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:04:02.615731398Z [2024-04-11 23:04:02,615: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:04:02.653389381Z [2024-04-11 23:04:02,653: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:04:02.656550446Z [2024-04-11 23:04:02,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:04:02.682768420Z [2024-04-11 23:04:02,682: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:04:02.684521625Z [2024-04-11 23:04:02,684: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:04:02.684645197Z [2024-04-11 23:04:02,684: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:04:02.684829563Z [2024-04-11 23:04:02,684: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:04:02.684935542Z [2024-04-11 23:04:02,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:04:02.685217624Z [2024-04-11 23:04:02,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:04:02.685336032Z [2024-04-11 23:04:02,685: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:04:02.693556821Z [2024-04-11 23:04:02,693: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:04:02.754499437Z [2024-04-11 23:04:02,754: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:04:04.164525818Z [2024-04-11 23:04:04,164: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74fb5cac-2c7c-4353-af7f-6398541265e0] succeeded in 3.1413927490002607s: None 2024-04-11T23:04:05.329679119Z [2024-04-11 23:04:05,328: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be1a91d7-69ed-408c-8d85-43c7b6e106b7] succeeded in 4.308634332999645s: None 2024-04-11T23:05:00.845203661Z [2024-04-11 23:05:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c90270fd-db31-492c-bb5e-f6e9329c4fc3] received 2024-04-11T23:05:00.846701876Z [2024-04-11 23:05:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3b8bd4c-3c58-43af-b4fd-5cf3b626b563] received 2024-04-11T23:05:00.853216708Z [2024-04-11 23:05:00,853: INFO/ForkPoolWorker-16] [b3b8bd4c-3c58-43af-b4fd-5cf3b626b563] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:05:00.855047634Z [2024-04-11 23:05:00,854: INFO/ForkPoolWorker-15] [c90270fd-db31-492c-bb5e-f6e9329c4fc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:00.858823968Z [2024-04-11 23:05:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[523fdd7d-089d-4833-8c61-9f4693e1d542] received 2024-04-11T23:05:00.861203715Z [2024-04-11 23:05:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[955d965d-77a2-43b7-91c7-e3497ea34365] received 2024-04-11T23:05:00.879948566Z [2024-04-11 23:05:00,879: INFO/ForkPoolWorker-1] [523fdd7d-089d-4833-8c61-9f4693e1d542] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:05:00.880231169Z [2024-04-11 23:05:00,880: INFO/ForkPoolWorker-2] [955d965d-77a2-43b7-91c7-e3497ea34365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:05:01.128633362Z [2024-04-11 23:05:01,125: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:05:01.156233004Z [2024-04-11 23:05:01,153: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:05:01.157573917Z [2024-04-11 23:05:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:05:01.233106952Z [2024-04-11 23:05:01,230: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:05:01.368716281Z [2024-04-11 23:05:01,368: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:05:01.372068298Z [2024-04-11 23:05:01,371: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:01.408982152Z [2024-04-11 23:05:01,408: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:05:01.410870146Z [2024-04-11 23:05:01,410: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:05:01.410913914Z [2024-04-11 23:05:01,410: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:05:01.410958667Z [2024-04-11 23:05:01,410: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:05:01.411118964Z [2024-04-11 23:05:01,411: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:05:01.486331656Z [2024-04-11 23:05:01,486: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:02.138769805Z [2024-04-11 23:05:02,138: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[523fdd7d-089d-4833-8c61-9f4693e1d542] succeeded in 1.2765777119998347s: None 2024-04-11T23:05:02.287942689Z [2024-04-11 23:05:02,287: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:05:02.290874751Z [2024-04-11 23:05:02,290: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:02.303222649Z [2024-04-11 23:05:02,302: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:05:02.306318738Z [2024-04-11 23:05:02,305: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:02.315743595Z [2024-04-11 23:05:02,315: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:05:02.317483774Z [2024-04-11 23:05:02,317: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:02.317691985Z [2024-04-11 23:05:02,317: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:02.317913635Z [2024-04-11 23:05:02,317: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:02.318047596Z [2024-04-11 23:05:02,317: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:05:02.318640197Z [2024-04-11 23:05:02,318: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:05:02.318787943Z [2024-04-11 23:05:02,318: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:02.333895039Z [2024-04-11 23:05:02,333: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:05:02.335474707Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:02.335485125Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:02.335613446Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:02.335619825Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:05:02.335828608Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:05:02.335850240Z [2024-04-11 23:05:02,335: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:02.396344140Z [2024-04-11 23:05:02,396: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:02.422602823Z [2024-04-11 23:05:02,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:02.425390075Z [2024-04-11 23:05:02,425: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:05:02.429778928Z [2024-04-11 23:05:02,429: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:02.444961922Z [2024-04-11 23:05:02,444: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:05:02.446081812Z [2024-04-11 23:05:02,445: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:02.446264044Z [2024-04-11 23:05:02,446: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:02.446475435Z [2024-04-11 23:05:02,446: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:02.446629270Z [2024-04-11 23:05:02,446: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:05:02.446909547Z [2024-04-11 23:05:02,446: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:05:02.447075284Z [2024-04-11 23:05:02,446: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:02.517110054Z [2024-04-11 23:05:02,516: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:02.970068012Z [2024-04-11 23:05:02,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3265063b-159d-474e-b19f-ba15feeb964f] received 2024-04-11T23:05:02.984781615Z [2024-04-11 23:05:02,984: INFO/ForkPoolWorker-1] [3265063b-159d-474e-b19f-ba15feeb964f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:02.995655292Z [2024-04-11 23:05:02,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c90270fd-db31-492c-bb5e-f6e9329c4fc3] succeeded in 2.1486299479997797s: None 2024-04-11T23:05:03.246606502Z [2024-04-11 23:05:03,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:05:03.962987635Z [2024-04-11 23:05:03,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[955d965d-77a2-43b7-91c7-e3497ea34365] succeeded in 3.0933152040001914s: None 2024-04-11T23:05:04.117937669Z [2024-04-11 23:05:04,117: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3b8bd4c-3c58-43af-b4fd-5cf3b626b563] succeeded in 3.269509181000103s: None 2024-04-11T23:05:04.353401743Z [2024-04-11 23:05:04,353: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:05:04.356133822Z [2024-04-11 23:05:04,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:04.374588377Z [2024-04-11 23:05:04,374: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:05:04.376420608Z [2024-04-11 23:05:04,376: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:04.376598076Z [2024-04-11 23:05:04,376: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:04.377320240Z [2024-04-11 23:05:04,376: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:04.377541168Z [2024-04-11 23:05:04,377: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:05:04.377935108Z [2024-04-11 23:05:04,377: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:05:04.378087121Z [2024-04-11 23:05:04,377: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:04.456014531Z [2024-04-11 23:05:04,455: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:05.171809213Z [2024-04-11 23:05:05,171: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3265063b-159d-474e-b19f-ba15feeb964f] succeeded in 2.2002001999999266s: None 2024-04-11T23:05:05.432660784Z [2024-04-11 23:05:05,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ad199f9-3bc1-48ae-882d-016320119dae] received 2024-04-11T23:05:05.439024212Z [2024-04-11 23:05:05,438: INFO/ForkPoolWorker-15] [4ad199f9-3bc1-48ae-882d-016320119dae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:05:05.681654788Z [2024-04-11 23:05:05,678: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:05:06.674373107Z [2024-04-11 23:05:06,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:05:06.678081710Z [2024-04-11 23:05:06,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:06.700216941Z [2024-04-11 23:05:06,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:05:06.701663622Z [2024-04-11 23:05:06,701: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:06.701731756Z [2024-04-11 23:05:06,701: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:06.701898172Z [2024-04-11 23:05:06,701: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:06.701959538Z [2024-04-11 23:05:06,701: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:05:06.702285605Z [2024-04-11 23:05:06,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:05:06.702368305Z [2024-04-11 23:05:06,702: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:06.790395071Z [2024-04-11 23:05:06,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:07.323234299Z [2024-04-11 23:05:07,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ad199f9-3bc1-48ae-882d-016320119dae] succeeded in 1.8923192199999903s: None 2024-04-11T23:05:07.759399913Z [2024-04-11 23:05:07,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4de0d48a-a79d-4a0a-bac7-f856c0560342] received 2024-04-11T23:05:07.767282422Z [2024-04-11 23:05:07,765: INFO/ForkPoolWorker-15] [4de0d48a-a79d-4a0a-bac7-f856c0560342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:08.107316527Z [2024-04-11 23:05:08,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:05:09.059814041Z [2024-04-11 23:05:09,058: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:05:09.062045628Z [2024-04-11 23:05:09,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:05:09.085327945Z [2024-04-11 23:05:09,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:05:09.086598894Z [2024-04-11 23:05:09,086: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:05:09.086667132Z [2024-04-11 23:05:09,086: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:05:09.086818678Z [2024-04-11 23:05:09,086: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:05:09.086840387Z [2024-04-11 23:05:09,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:05:09.087048360Z [2024-04-11 23:05:09,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:05:09.087155113Z [2024-04-11 23:05:09,087: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:05:09.159729773Z [2024-04-11 23:05:09,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:05:09.691927247Z [2024-04-11 23:05:09,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4de0d48a-a79d-4a0a-bac7-f856c0560342] succeeded in 1.9314431870002409s: None 2024-04-11T23:06:00.720324580Z [2024-04-11 23:06:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f8ed78a-d8c3-40e8-88b0-323ccacd729b] received 2024-04-11T23:06:00.727574653Z [2024-04-11 23:06:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67b0b038-eb34-4dda-b232-8e8ef7a8371a] received 2024-04-11T23:06:00.730390486Z [2024-04-11 23:06:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbf741b6-3c44-4b39-b32b-2f398c3eca9c] received 2024-04-11T23:06:00.731053228Z [2024-04-11 23:06:00,730: INFO/ForkPoolWorker-15] [2f8ed78a-d8c3-40e8-88b0-323ccacd729b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:06:00.736403197Z [2024-04-11 23:06:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e09bc40-6070-45a4-ae06-371a1ff0efd2] received 2024-04-11T23:06:00.741216709Z [2024-04-11 23:06:00,740: INFO/ForkPoolWorker-1] [cbf741b6-3c44-4b39-b32b-2f398c3eca9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:06:00.742023408Z [2024-04-11 23:06:00,741: INFO/ForkPoolWorker-16] [67b0b038-eb34-4dda-b232-8e8ef7a8371a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:06:00.745399029Z [2024-04-11 23:06:00,745: INFO/ForkPoolWorker-2] [9e09bc40-6070-45a4-ae06-371a1ff0efd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:06:01.036710116Z [2024-04-11 23:06:01,031: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:06:01.050580577Z [2024-04-11 23:06:01,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:06:01.076455414Z [2024-04-11 23:06:01,071: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:06:01.115863332Z [2024-04-11 23:06:01,111: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:06:01.248772729Z [2024-04-11 23:06:01,248: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:06:01.252549834Z [2024-04-11 23:06:01,252: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:06:01.289388128Z [2024-04-11 23:06:01,289: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:06:01.290235910Z [2024-04-11 23:06:01,290: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:06:01.290320468Z [2024-04-11 23:06:01,290: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:06:01.290398963Z [2024-04-11 23:06:01,290: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:06:01.290616114Z [2024-04-11 23:06:01,290: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:06:01.487422410Z [2024-04-11 23:06:01,487: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:06:01.612696449Z [2024-04-11 23:06:01,612: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:06:02.161678194Z [2024-04-11 23:06:02,161: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbf741b6-3c44-4b39-b32b-2f398c3eca9c] succeeded in 1.4276647419997062s: None 2024-04-11T23:06:02.289861022Z [2024-04-11 23:06:02,289: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e09bc40-6070-45a4-ae06-371a1ff0efd2] succeeded in 1.551405844999863s: None 2024-04-11T23:06:02.397692140Z [2024-04-11 23:06:02,397: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:06:02.400893352Z [2024-04-11 23:06:02,400: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:06:02.418605337Z [2024-04-11 23:06:02,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:06:02.419613343Z [2024-04-11 23:06:02,419: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:06:02.419633571Z [2024-04-11 23:06:02,419: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:06:02.419806661Z [2024-04-11 23:06:02,419: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:06:02.419821031Z [2024-04-11 23:06:02,419: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:06:02.420340687Z [2024-04-11 23:06:02,420: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:06:02.420356931Z [2024-04-11 23:06:02,420: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:06:02.492256946Z [2024-04-11 23:06:02,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:06:02.495478517Z [2024-04-11 23:06:02,495: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:06:02.498073087Z [2024-04-11 23:06:02,497: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:06:02.515113667Z [2024-04-11 23:06:02,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:06:02.517190779Z [2024-04-11 23:06:02,516: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:06:02.517405824Z [2024-04-11 23:06:02,517: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:06:02.518005393Z [2024-04-11 23:06:02,517: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:06:02.518249772Z [2024-04-11 23:06:02,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:06:02.518519243Z [2024-04-11 23:06:02,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:06:02.519124561Z [2024-04-11 23:06:02,518: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:06:02.600043984Z [2024-04-11 23:06:02,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:06:03.909416999Z [2024-04-11 23:06:03,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67b0b038-eb34-4dda-b232-8e8ef7a8371a] succeeded in 3.177742103000128s: None 2024-04-11T23:06:05.957614065Z [2024-04-11 23:06:05,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f8ed78a-d8c3-40e8-88b0-323ccacd729b] succeeded in 5.234818933000042s: None 2024-04-11T23:07:00.641065911Z [2024-04-11 23:07:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[366b42ce-bb19-4c18-9999-88511e9bc0bf] received 2024-04-11T23:07:00.648520822Z [2024-04-11 23:07:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[388e2a6d-ea62-4742-baaa-c31081d5ccf2] received 2024-04-11T23:07:00.653113731Z [2024-04-11 23:07:00,651: INFO/ForkPoolWorker-15] [366b42ce-bb19-4c18-9999-88511e9bc0bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:07:00.659229827Z [2024-04-11 23:07:00,659: INFO/ForkPoolWorker-16] [388e2a6d-ea62-4742-baaa-c31081d5ccf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:07:00.664711231Z [2024-04-11 23:07:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00751b7-0424-4e97-8933-d54a8695aa83] received 2024-04-11T23:07:00.678481907Z [2024-04-11 23:07:00,678: INFO/ForkPoolWorker-1] [b00751b7-0424-4e97-8933-d54a8695aa83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:07:00.910686921Z [2024-04-11 23:07:00,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:07:00.919437930Z [2024-04-11 23:07:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:07:00.945421062Z [2024-04-11 23:07:00,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:07:01.043192923Z [2024-04-11 23:07:01,042: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:07:01.046554303Z [2024-04-11 23:07:01,046: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:07:01.067800327Z [2024-04-11 23:07:01,067: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:07:01.070653542Z [2024-04-11 23:07:01,070: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:07:01.070728184Z [2024-04-11 23:07:01,070: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:07:01.070782665Z [2024-04-11 23:07:01,070: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:07:01.072349750Z [2024-04-11 23:07:01,070: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:07:01.159220891Z [2024-04-11 23:07:01,158: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:07:01.646851256Z [2024-04-11 23:07:01,646: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[388e2a6d-ea62-4742-baaa-c31081d5ccf2] succeeded in 0.9961427839998578s: None 2024-04-11T23:07:02.017992052Z [2024-04-11 23:07:02,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:07:02.020824001Z [2024-04-11 23:07:02,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:07:02.040028955Z [2024-04-11 23:07:02,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:07:02.041295688Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:07:02.041358494Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:07:02.041616064Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:07:02.041646161Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:07:02.041905237Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:07:02.041918761Z [2024-04-11 23:07:02,041: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:07:02.094347540Z [2024-04-11 23:07:02,093: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:07:02.097194850Z [2024-04-11 23:07:02,096: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:07:02.118252181Z [2024-04-11 23:07:02,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:07:02.119592376Z [2024-04-11 23:07:02,119: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:07:02.119729010Z [2024-04-11 23:07:02,119: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:07:02.119892737Z [2024-04-11 23:07:02,119: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:07:02.120029322Z [2024-04-11 23:07:02,119: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:07:02.120404305Z [2024-04-11 23:07:02,120: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:07:02.120522318Z [2024-04-11 23:07:02,120: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:07:02.125901832Z [2024-04-11 23:07:02,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:07:02.220095925Z [2024-04-11 23:07:02,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:07:03.610248945Z [2024-04-11 23:07:03,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[366b42ce-bb19-4c18-9999-88511e9bc0bf] succeeded in 2.967184460000226s: None 2024-04-11T23:07:04.094765482Z [2024-04-11 23:07:04,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b00751b7-0424-4e97-8933-d54a8695aa83] succeeded in 3.4275929529999303s: None 2024-04-11T23:08:01.181124285Z [2024-04-11 23:08:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1470b87b-84c7-4707-ac74-dfc5f931fe5d] received 2024-04-11T23:08:01.183808041Z [2024-04-11 23:08:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[015b4643-f83c-43a5-8561-7d27b4358611] received 2024-04-11T23:08:01.190268533Z [2024-04-11 23:08:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f7ad725-2ff9-49b4-b9bd-af66cd65649c] received 2024-04-11T23:08:01.191440408Z [2024-04-11 23:08:01,191: INFO/ForkPoolWorker-15] [1470b87b-84c7-4707-ac74-dfc5f931fe5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:08:01.198604258Z [2024-04-11 23:08:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faf272f1-b88f-4bfd-8694-c0b76cc416c8] received 2024-04-11T23:08:01.199729091Z [2024-04-11 23:08:01,199: INFO/ForkPoolWorker-1] [6f7ad725-2ff9-49b4-b9bd-af66cd65649c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:08:01.202169647Z [2024-04-11 23:08:01,201: INFO/ForkPoolWorker-16] [015b4643-f83c-43a5-8561-7d27b4358611] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:08:01.215510908Z [2024-04-11 23:08:01,215: INFO/ForkPoolWorker-2] [faf272f1-b88f-4bfd-8694-c0b76cc416c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:08:01.486633101Z [2024-04-11 23:08:01,482: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:08:01.520108624Z [2024-04-11 23:08:01,512: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:08:01.560291837Z [2024-04-11 23:08:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:08:01.564252665Z [2024-04-11 23:08:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:08:01.739188271Z [2024-04-11 23:08:01,738: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:08:01.743751609Z [2024-04-11 23:08:01,743: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:08:01.751708329Z [2024-04-11 23:08:01,751: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:08:01.793201816Z [2024-04-11 23:08:01,793: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:08:01.794077849Z [2024-04-11 23:08:01,793: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:08:01.794123768Z [2024-04-11 23:08:01,794: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:08:01.794152283Z [2024-04-11 23:08:01,794: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:08:01.794348548Z [2024-04-11 23:08:01,794: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:08:01.920070231Z [2024-04-11 23:08:01,919: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:08:02.244112747Z [2024-04-11 23:08:02,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[015b4643-f83c-43a5-8561-7d27b4358611] succeeded in 1.0576377289999073s: None 2024-04-11T23:08:02.487211654Z [2024-04-11 23:08:02,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[faf272f1-b88f-4bfd-8694-c0b76cc416c8] succeeded in 1.277965573000074s: None 2024-04-11T23:08:02.699101193Z [2024-04-11 23:08:02,698: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:08:02.701874151Z [2024-04-11 23:08:02,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:08:02.720733022Z [2024-04-11 23:08:02,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:08:02.722272495Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:08:02.722285511Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:08:02.722399533Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:08:02.722435713Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:08:02.722917657Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:08:02.722929977Z [2024-04-11 23:08:02,722: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:08:02.778511258Z [2024-04-11 23:08:02,778: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:08:02.781530238Z [2024-04-11 23:08:02,781: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:08:02.800874922Z [2024-04-11 23:08:02,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:08:02.807266867Z [2024-04-11 23:08:02,807: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:08:02.809281079Z [2024-04-11 23:08:02,809: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:08:02.809416648Z [2024-04-11 23:08:02,809: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:08:02.809583039Z [2024-04-11 23:08:02,809: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:08:02.809682435Z [2024-04-11 23:08:02,809: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:08:02.809966785Z [2024-04-11 23:08:02,809: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:08:02.810333741Z [2024-04-11 23:08:02,810: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:08:02.891550214Z [2024-04-11 23:08:02,891: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:08:04.756195916Z [2024-04-11 23:08:04,755: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1470b87b-84c7-4707-ac74-dfc5f931fe5d] succeeded in 3.5702924739998707s: None 2024-04-11T23:08:05.153356300Z [2024-04-11 23:08:05,152: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f7ad725-2ff9-49b4-b9bd-af66cd65649c] succeeded in 3.961090515000251s: None 2024-04-11T23:09:00.763876022Z [2024-04-11 23:09:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da18fa25-cd80-4406-97e2-f01e1098d9e0] received 2024-04-11T23:09:00.769947309Z [2024-04-11 23:09:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bdfcc55-604f-48d6-9b6c-70b3113f462a] received 2024-04-11T23:09:00.770763144Z [2024-04-11 23:09:00,770: INFO/ForkPoolWorker-15] [da18fa25-cd80-4406-97e2-f01e1098d9e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:09:00.780942305Z [2024-04-11 23:09:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[064ff3da-eb8d-4ffe-ac87-d8cf9ebdc2b6] received 2024-04-11T23:09:00.787493747Z [2024-04-11 23:09:00,787: INFO/ForkPoolWorker-16] [6bdfcc55-604f-48d6-9b6c-70b3113f462a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:09:00.793618421Z [2024-04-11 23:09:00,793: INFO/ForkPoolWorker-1] [064ff3da-eb8d-4ffe-ac87-d8cf9ebdc2b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:09:01.063758636Z [2024-04-11 23:09:01,060: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:09:01.079547143Z [2024-04-11 23:09:01,076: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:09:01.130790226Z [2024-04-11 23:09:01,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:09:01.343727063Z [2024-04-11 23:09:01,343: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:09:01.347193800Z [2024-04-11 23:09:01,346: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:09:01.393813531Z [2024-04-11 23:09:01,393: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:09:01.394776025Z [2024-04-11 23:09:01,394: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:09:01.394913019Z [2024-04-11 23:09:01,394: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:09:01.395046630Z [2024-04-11 23:09:01,394: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:09:01.395293943Z [2024-04-11 23:09:01,395: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:09:01.475841390Z [2024-04-11 23:09:01,475: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:09:02.076092027Z [2024-04-11 23:09:02,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bdfcc55-604f-48d6-9b6c-70b3113f462a] succeeded in 1.2954151849999107s: None 2024-04-11T23:09:02.160982711Z [2024-04-11 23:09:02,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:09:02.164292883Z [2024-04-11 23:09:02,163: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:09:02.184518740Z [2024-04-11 23:09:02,184: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:09:02.185693782Z [2024-04-11 23:09:02,185: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:09:02.185764361Z [2024-04-11 23:09:02,185: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:09:02.185865437Z [2024-04-11 23:09:02,185: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:09:02.185917108Z [2024-04-11 23:09:02,185: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:09:02.186395341Z [2024-04-11 23:09:02,186: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:09:02.186436365Z [2024-04-11 23:09:02,186: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:09:02.201528238Z [2024-04-11 23:09:02,201: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:09:02.204920134Z [2024-04-11 23:09:02,204: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:09:02.224994165Z [2024-04-11 23:09:02,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:09:02.226204942Z [2024-04-11 23:09:02,226: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:09:02.226374271Z [2024-04-11 23:09:02,226: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:09:02.226560224Z [2024-04-11 23:09:02,226: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:09:02.226709134Z [2024-04-11 23:09:02,226: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:09:02.227061600Z [2024-04-11 23:09:02,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:09:02.227216968Z [2024-04-11 23:09:02,227: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:09:02.282809361Z [2024-04-11 23:09:02,282: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:09:02.313874248Z [2024-04-11 23:09:02,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:09:03.796266312Z [2024-04-11 23:09:03,795: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[064ff3da-eb8d-4ffe-ac87-d8cf9ebdc2b6] succeeded in 3.013324553000075s: None 2024-04-11T23:09:04.152856366Z [2024-04-11 23:09:04,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da18fa25-cd80-4406-97e2-f01e1098d9e0] succeeded in 3.3869109389997902s: None 2024-04-11T23:10:00.709127951Z [2024-04-11 23:10:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85bfcac4-bac1-4488-a082-465fb537e99b] received 2024-04-11T23:10:00.710720635Z [2024-04-11 23:10:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59743341-a293-4a86-ab16-554f3d80e98d] received 2024-04-11T23:10:00.712066579Z [2024-04-11 23:10:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eef8c3d-9893-4477-a88e-d5c39fbcfead] received 2024-04-11T23:10:00.713957288Z [2024-04-11 23:10:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5748fe33-63d3-4413-92ff-32666eaef977] received 2024-04-11T23:10:00.719622479Z [2024-04-11 23:10:00,719: INFO/ForkPoolWorker-15] [85bfcac4-bac1-4488-a082-465fb537e99b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:00.719884185Z [2024-04-11 23:10:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e30ca93-30a0-4caa-8253-d0295384d161] received 2024-04-11T23:10:00.722004959Z [2024-04-11 23:10:00,721: INFO/ForkPoolWorker-1] [6eef8c3d-9893-4477-a88e-d5c39fbcfead] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:10:00.723399621Z [2024-04-11 23:10:00,723: INFO/ForkPoolWorker-2] [5748fe33-63d3-4413-92ff-32666eaef977] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:10:00.725298281Z [2024-04-11 23:10:00,724: INFO/ForkPoolWorker-16] [59743341-a293-4a86-ab16-554f3d80e98d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:10:00.734076060Z [2024-04-11 23:10:00,733: INFO/ForkPoolWorker-3] [3e30ca93-30a0-4caa-8253-d0295384d161] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:10:01.037762956Z [2024-04-11 23:10:01,033: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:10:01.090785435Z [2024-04-11 23:10:01,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:10:01.101071596Z [2024-04-11 23:10:01,093: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:10:01.127498320Z [2024-04-11 23:10:01,124: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:10:01.187239888Z [2024-04-11 23:10:01,183: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:10:01.272899242Z [2024-04-11 23:10:01,272: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:10:01.276716834Z [2024-04-11 23:10:01,276: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:01.305902837Z [2024-04-11 23:10:01,305: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:10:01.307351037Z [2024-04-11 23:10:01,307: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:10:01.307518007Z [2024-04-11 23:10:01,307: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:10:01.307619669Z [2024-04-11 23:10:01,307: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:10:01.308597193Z [2024-04-11 23:10:01,308: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:10:01.399514755Z [2024-04-11 23:10:01,399: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:01.560985230Z [2024-04-11 23:10:01,560: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:02.180954829Z [2024-04-11 23:10:02,180: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5748fe33-63d3-4413-92ff-32666eaef977] succeeded in 1.464801684000122s: None 2024-04-11T23:10:02.198839912Z [2024-04-11 23:10:02,198: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59743341-a293-4a86-ab16-554f3d80e98d] succeeded in 1.4842091209998216s: None 2024-04-11T23:10:02.526050865Z [2024-04-11 23:10:02,525: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T23:10:02.529075015Z [2024-04-11 23:10:02,528: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:02.565370604Z [2024-04-11 23:10:02,565: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:10:02.568582854Z [2024-04-11 23:10:02,568: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:02.568668510Z [2024-04-11 23:10:02,568: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:02.568869929Z [2024-04-11 23:10:02,568: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:02.568952644Z [2024-04-11 23:10:02,568: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T23:10:02.569299455Z [2024-04-11 23:10:02,569: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:10:02.569383034Z [2024-04-11 23:10:02,569: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:02.701033238Z [2024-04-11 23:10:02,700: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:02.793973792Z [2024-04-11 23:10:02,793: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:10:02.797329932Z [2024-04-11 23:10:02,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:02.810445645Z [2024-04-11 23:10:02,810: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:10:02.813465668Z [2024-04-11 23:10:02,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:02.826808585Z [2024-04-11 23:10:02,826: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:10:02.830604844Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:02.830626398Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:02.830675356Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:02.830702520Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:10:02.830896904Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:10:02.830919180Z [2024-04-11 23:10:02,830: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:02.836217861Z [2024-04-11 23:10:02,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:10:02.837255776Z [2024-04-11 23:10:02,837: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:02.837280758Z [2024-04-11 23:10:02,837: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:02.837364048Z [2024-04-11 23:10:02,837: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:02.837409484Z [2024-04-11 23:10:02,837: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:10:02.840685764Z [2024-04-11 23:10:02,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:10:02.840771260Z [2024-04-11 23:10:02,840: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:02.924324227Z [2024-04-11 23:10:02,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:02.940339389Z [2024-04-11 23:10:02,940: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:03.433393895Z [2024-04-11 23:10:03,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06675bc4-f802-4e20-9a93-f98466f71e86] received 2024-04-11T23:10:03.440714569Z [2024-04-11 23:10:03,440: INFO/ForkPoolWorker-16] [06675bc4-f802-4e20-9a93-f98466f71e86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:03.522253381Z [2024-04-11 23:10:03,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85bfcac4-bac1-4488-a082-465fb537e99b] succeeded in 2.8111276519998682s: None 2024-04-11T23:10:03.705110427Z [2024-04-11 23:10:03,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:10:04.197482668Z [2024-04-11 23:10:04,196: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3e30ca93-30a0-4caa-8253-d0295384d161] succeeded in 3.4743175529997643s: None 2024-04-11T23:10:04.587619371Z [2024-04-11 23:10:04,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6eef8c3d-9893-4477-a88e-d5c39fbcfead] succeeded in 3.874186885999734s: None 2024-04-11T23:10:04.825951887Z [2024-04-11 23:10:04,825: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:10:04.828506947Z [2024-04-11 23:10:04,828: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:04.848757411Z [2024-04-11 23:10:04,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:10:04.849900106Z [2024-04-11 23:10:04,849: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:04.849953758Z [2024-04-11 23:10:04,849: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:04.850079100Z [2024-04-11 23:10:04,849: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:04.850137062Z [2024-04-11 23:10:04,849: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:10:04.850332668Z [2024-04-11 23:10:04,850: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:10:04.850351733Z [2024-04-11 23:10:04,850: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:04.932131070Z [2024-04-11 23:10:04,931: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:05.581208334Z [2024-04-11 23:10:05,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[06675bc4-f802-4e20-9a93-f98466f71e86] succeeded in 2.1456915649996517s: None 2024-04-11T23:10:06.413957646Z [2024-04-11 23:10:06,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1479cac7-02f0-4f4c-986b-dc455ab38cc1] received 2024-04-11T23:10:06.427926374Z [2024-04-11 23:10:06,427: INFO/ForkPoolWorker-15] [1479cac7-02f0-4f4c-986b-dc455ab38cc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:10:06.663784519Z [2024-04-11 23:10:06,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:10:07.613940380Z [2024-04-11 23:10:07,613: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:10:07.616752069Z [2024-04-11 23:10:07,616: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:07.640421054Z [2024-04-11 23:10:07,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:10:07.642063411Z [2024-04-11 23:10:07,641: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:07.642084093Z [2024-04-11 23:10:07,641: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:07.642245873Z [2024-04-11 23:10:07,642: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:07.642258105Z [2024-04-11 23:10:07,642: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:10:07.642655977Z [2024-04-11 23:10:07,642: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:10:07.642664513Z [2024-04-11 23:10:07,642: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:07.746077729Z [2024-04-11 23:10:07,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:08.347792603Z [2024-04-11 23:10:08,347: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1479cac7-02f0-4f4c-986b-dc455ab38cc1] succeeded in 1.9315577309998844s: None 2024-04-11T23:10:08.621470000Z [2024-04-11 23:10:08,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2c15c50-434e-4369-89ad-3c657ef937f5] received 2024-04-11T23:10:08.633268270Z [2024-04-11 23:10:08,632: INFO/ForkPoolWorker-15] [f2c15c50-434e-4369-89ad-3c657ef937f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:08.912616870Z [2024-04-11 23:10:08,908: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:10:10.131458940Z [2024-04-11 23:10:10,131: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:10:10.134870132Z [2024-04-11 23:10:10,134: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:10:10.157826827Z [2024-04-11 23:10:10,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:10:10.160129877Z [2024-04-11 23:10:10,159: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:10:10.160301596Z [2024-04-11 23:10:10,160: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:10:10.160555265Z [2024-04-11 23:10:10,160: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:10:10.160723830Z [2024-04-11 23:10:10,160: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:10:10.161128699Z [2024-04-11 23:10:10,160: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:10:10.161264431Z [2024-04-11 23:10:10,161: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:10:10.253946848Z [2024-04-11 23:10:10,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:10:10.919746306Z [2024-04-11 23:10:10,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2c15c50-434e-4369-89ad-3c657ef937f5] succeeded in 2.295687643999827s: None 2024-04-11T23:11:00.703777911Z [2024-04-11 23:11:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8caf2cf-5f2f-48d4-9e29-a76de20a656f] received 2024-04-11T23:11:00.705094795Z [2024-04-11 23:11:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77b3185e-de5e-4b34-a921-15b0eae925c2] received 2024-04-11T23:11:00.707613439Z [2024-04-11 23:11:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[413e7753-9c0a-4629-8fb2-724868607bb4] received 2024-04-11T23:11:00.712326790Z [2024-04-11 23:11:00,712: INFO/ForkPoolWorker-16] [77b3185e-de5e-4b34-a921-15b0eae925c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:11:00.716169791Z [2024-04-11 23:11:00,715: INFO/ForkPoolWorker-15] [b8caf2cf-5f2f-48d4-9e29-a76de20a656f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:11:00.717167830Z [2024-04-11 23:11:00,716: INFO/ForkPoolWorker-1] [413e7753-9c0a-4629-8fb2-724868607bb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:11:00.970463631Z [2024-04-11 23:11:00,967: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:11:00.976415036Z [2024-04-11 23:11:00,973: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:11:00.977802361Z [2024-04-11 23:11:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:11:01.102632160Z [2024-04-11 23:11:01,102: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:11:01.106322428Z [2024-04-11 23:11:01,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:11:01.134929064Z [2024-04-11 23:11:01,134: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:11:01.141197452Z [2024-04-11 23:11:01,140: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:11:01.141417698Z [2024-04-11 23:11:01,141: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:11:01.141579528Z [2024-04-11 23:11:01,141: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:11:01.141881859Z [2024-04-11 23:11:01,141: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:11:01.222462230Z [2024-04-11 23:11:01,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:11:01.790247531Z [2024-04-11 23:11:01,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8caf2cf-5f2f-48d4-9e29-a76de20a656f] succeeded in 1.0830767639999976s: None 2024-04-11T23:11:01.978079136Z [2024-04-11 23:11:01,977: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:11:01.981260632Z [2024-04-11 23:11:01,980: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:11:02.020232613Z [2024-04-11 23:11:02,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:11:02.020926770Z [2024-04-11 23:11:02,020: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:11:02.022143618Z [2024-04-11 23:11:02,021: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:11:02.022371061Z [2024-04-11 23:11:02,022: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:11:02.022667887Z [2024-04-11 23:11:02,022: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:11:02.022867545Z [2024-04-11 23:11:02,022: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:11:02.023308716Z [2024-04-11 23:11:02,023: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:11:02.023574888Z [2024-04-11 23:11:02,023: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:11:02.023600608Z [2024-04-11 23:11:02,023: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:11:02.042619808Z [2024-04-11 23:11:02,042: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:11:02.044689150Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:11:02.044705054Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:11:02.044782863Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:11:02.044817442Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:11:02.044977783Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:11:02.045008788Z [2024-04-11 23:11:02,044: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:11:02.118434055Z [2024-04-11 23:11:02,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:11:02.130316251Z [2024-04-11 23:11:02,130: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:11:03.517734273Z [2024-04-11 23:11:03,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77b3185e-de5e-4b34-a921-15b0eae925c2] succeeded in 2.81142457299984s: None 2024-04-11T23:11:03.873763488Z [2024-04-11 23:11:03,872: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[413e7753-9c0a-4629-8fb2-724868607bb4] succeeded in 3.1626693749999504s: None 2024-04-11T23:12:00.382665938Z [2024-04-11 23:12:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[118ae469-69cf-44e7-95e3-09560b63217d] received 2024-04-11T23:12:00.384296552Z [2024-04-11 23:12:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12d6b2eb-5ecb-477d-b01c-e214f01f114d] received 2024-04-11T23:12:00.385922310Z [2024-04-11 23:12:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb93cf03-225d-4327-ae0b-0f0e99efa7f8] received 2024-04-11T23:12:00.387173188Z [2024-04-11 23:12:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fe5d655-0224-4534-b3ea-98f193acb781] received 2024-04-11T23:12:00.394060479Z [2024-04-11 23:12:00,393: INFO/ForkPoolWorker-15] [118ae469-69cf-44e7-95e3-09560b63217d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:12:00.394995090Z [2024-04-11 23:12:00,394: INFO/ForkPoolWorker-1] [eb93cf03-225d-4327-ae0b-0f0e99efa7f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:12:00.397877939Z [2024-04-11 23:12:00,397: INFO/ForkPoolWorker-16] [12d6b2eb-5ecb-477d-b01c-e214f01f114d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:12:00.420160479Z [2024-04-11 23:12:00,417: INFO/ForkPoolWorker-2] [0fe5d655-0224-4534-b3ea-98f193acb781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:12:00.762807392Z [2024-04-11 23:12:00,759: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:12:00.826312009Z [2024-04-11 23:12:00,823: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:12:01.018165343Z [2024-04-11 23:12:01,014: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:12:01.145865302Z [2024-04-11 23:12:01,143: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:12:01.256308266Z [2024-04-11 23:12:01,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:12:01.493342165Z [2024-04-11 23:12:01,492: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:12:01.504109431Z [2024-04-11 23:12:01,503: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:12:01.554364785Z [2024-04-11 23:12:01,551: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:12:01.554380275Z [2024-04-11 23:12:01,553: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:12:01.554384200Z [2024-04-11 23:12:01,554: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:12:01.554709067Z [2024-04-11 23:12:01,554: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:12:01.555021060Z [2024-04-11 23:12:01,554: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:12:01.795670520Z [2024-04-11 23:12:01,795: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:12:02.008283590Z [2024-04-11 23:12:02,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[118ae469-69cf-44e7-95e3-09560b63217d] succeeded in 1.6235314430000471s: None 2024-04-11T23:12:02.363490746Z [2024-04-11 23:12:02,363: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:12:02.366834092Z [2024-04-11 23:12:02,366: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:12:02.367179651Z [2024-04-11 23:12:02,366: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:12:02.372045925Z [2024-04-11 23:12:02,371: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:12:02.388697225Z [2024-04-11 23:12:02,388: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:12:02.390464980Z [2024-04-11 23:12:02,390: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:12:02.390939125Z [2024-04-11 23:12:02,390: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:12:02.391373953Z [2024-04-11 23:12:02,391: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:12:02.391469740Z [2024-04-11 23:12:02,391: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:12:02.391608509Z [2024-04-11 23:12:02,391: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:12:02.391764296Z [2024-04-11 23:12:02,391: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:12:02.391883453Z [2024-04-11 23:12:02,391: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:12:02.392750182Z [2024-04-11 23:12:02,392: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:12:02.392766821Z [2024-04-11 23:12:02,392: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:12:02.392883740Z [2024-04-11 23:12:02,392: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:12:02.392894346Z [2024-04-11 23:12:02,392: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:12:02.393075087Z [2024-04-11 23:12:02,392: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:12:02.393114509Z [2024-04-11 23:12:02,393: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:12:02.493314742Z [2024-04-11 23:12:02,493: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:12:02.504721666Z [2024-04-11 23:12:02,504: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:12:02.740098046Z [2024-04-11 23:12:02,739: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb93cf03-225d-4327-ae0b-0f0e99efa7f8] succeeded in 2.351630322999881s: None 2024-04-11T23:12:04.066245497Z [2024-04-11 23:12:04,065: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0fe5d655-0224-4534-b3ea-98f193acb781] succeeded in 3.675334190000285s: None 2024-04-11T23:12:04.482806116Z [2024-04-11 23:12:04,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12d6b2eb-5ecb-477d-b01c-e214f01f114d] succeeded in 4.0958748600000945s: None 2024-04-11T23:13:00.425194527Z [2024-04-11 23:13:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[374b9f42-042d-4374-a34d-1d114ba6fc44] received 2024-04-11T23:13:00.427311173Z [2024-04-11 23:13:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc6dd0ee-66b6-4feb-ad81-adacfcd67380] received 2024-04-11T23:13:00.429775723Z [2024-04-11 23:13:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68984217-de1c-4cde-b006-48388ff08759] received 2024-04-11T23:13:00.439942268Z [2024-04-11 23:13:00,439: INFO/ForkPoolWorker-15] [374b9f42-042d-4374-a34d-1d114ba6fc44] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:13:00.441319591Z [2024-04-11 23:13:00,441: INFO/ForkPoolWorker-16] [cc6dd0ee-66b6-4feb-ad81-adacfcd67380] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:13:00.442293328Z [2024-04-11 23:13:00,441: INFO/ForkPoolWorker-1] [68984217-de1c-4cde-b006-48388ff08759] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:13:00.710339743Z [2024-04-11 23:13:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:13:00.747666727Z [2024-04-11 23:13:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:13:00.752254255Z [2024-04-11 23:13:00,748: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:13:00.895051538Z [2024-04-11 23:13:00,894: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:13:00.898990508Z [2024-04-11 23:13:00,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:13:00.922004756Z [2024-04-11 23:13:00,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:13:00.923220311Z [2024-04-11 23:13:00,923: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:13:00.923308546Z [2024-04-11 23:13:00,923: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:13:00.923359166Z [2024-04-11 23:13:00,923: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:13:00.923448831Z [2024-04-11 23:13:00,923: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:13:01.030605681Z [2024-04-11 23:13:01,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:13:01.565238335Z [2024-04-11 23:13:01,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[374b9f42-042d-4374-a34d-1d114ba6fc44] succeeded in 1.1378651649997664s: None 2024-04-11T23:13:01.899050905Z [2024-04-11 23:13:01,898: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:13:01.902317211Z [2024-04-11 23:13:01,901: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:13:01.930942781Z [2024-04-11 23:13:01,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:13:01.932632299Z [2024-04-11 23:13:01,932: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:13:01.932805170Z [2024-04-11 23:13:01,932: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:13:01.933147111Z [2024-04-11 23:13:01,932: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:13:01.933241223Z [2024-04-11 23:13:01,933: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:13:01.933684580Z [2024-04-11 23:13:01,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:13:01.933846434Z [2024-04-11 23:13:01,933: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:13:01.978274028Z [2024-04-11 23:13:01,977: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:13:01.981817313Z [2024-04-11 23:13:01,981: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:13:02.015858031Z [2024-04-11 23:13:02,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:13:02.017211757Z [2024-04-11 23:13:02,016: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:13:02.017402779Z [2024-04-11 23:13:02,017: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:13:02.018254191Z [2024-04-11 23:13:02,017: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:13:02.018265914Z [2024-04-11 23:13:02,017: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:13:02.018270099Z [2024-04-11 23:13:02,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:13:02.018273400Z [2024-04-11 23:13:02,017: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:13:02.040411862Z [2024-04-11 23:13:02,040: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:13:02.091830498Z [2024-04-11 23:13:02,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:13:03.630109356Z [2024-04-11 23:13:03,629: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc6dd0ee-66b6-4feb-ad81-adacfcd67380] succeeded in 3.1997451300003377s: None 2024-04-11T23:13:03.913687120Z [2024-04-11 23:13:03,912: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68984217-de1c-4cde-b006-48388ff08759] succeeded in 3.481360755999958s: None 2024-04-11T23:14:01.004710172Z [2024-04-11 23:14:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5059f19-6b21-4841-9d54-873a5379b420] received 2024-04-11T23:14:01.008751010Z [2024-04-11 23:14:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c1647e8-6176-4df0-9cab-f8e7a6e6c774] received 2024-04-11T23:14:01.010179383Z [2024-04-11 23:14:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e23cd343-1800-4c77-b6bd-47e0771dec78] received 2024-04-11T23:14:01.011757396Z [2024-04-11 23:14:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0566de24-1faf-4928-aa1b-4cbd30ea13f9] received 2024-04-11T23:14:01.020939775Z [2024-04-11 23:14:01,018: INFO/ForkPoolWorker-15] [f5059f19-6b21-4841-9d54-873a5379b420] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:14:01.021422315Z [2024-04-11 23:14:01,021: INFO/ForkPoolWorker-2] [0566de24-1faf-4928-aa1b-4cbd30ea13f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:14:01.021559279Z [2024-04-11 23:14:01,021: INFO/ForkPoolWorker-16] [7c1647e8-6176-4df0-9cab-f8e7a6e6c774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:14:01.021669695Z [2024-04-11 23:14:01,021: INFO/ForkPoolWorker-1] [e23cd343-1800-4c77-b6bd-47e0771dec78] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:14:01.298137383Z [2024-04-11 23:14:01,295: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:14:01.303995546Z [2024-04-11 23:14:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:14:01.315128385Z [2024-04-11 23:14:01,312: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:14:01.335160379Z [2024-04-11 23:14:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:14:01.467653422Z [2024-04-11 23:14:01,467: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:14:01.472622543Z [2024-04-11 23:14:01,472: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:14:01.519285283Z [2024-04-11 23:14:01,519: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:14:01.520954236Z [2024-04-11 23:14:01,520: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:14:01.521425286Z [2024-04-11 23:14:01,521: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:14:01.521800648Z [2024-04-11 23:14:01,521: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:14:01.522605108Z [2024-04-11 23:14:01,522: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:14:01.659065785Z [2024-04-11 23:14:01,651: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:14:01.670123572Z [2024-04-11 23:14:01,663: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:14:02.229394743Z [2024-04-11 23:14:02,228: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e23cd343-1800-4c77-b6bd-47e0771dec78] succeeded in 1.216649390999919s: None 2024-04-11T23:14:02.250433917Z [2024-04-11 23:14:02,250: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0566de24-1faf-4928-aa1b-4cbd30ea13f9] succeeded in 1.2364008009999452s: None 2024-04-11T23:14:02.574650295Z [2024-04-11 23:14:02,574: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:14:02.577699621Z [2024-04-11 23:14:02,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:14:02.599183746Z [2024-04-11 23:14:02,598: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:14:02.599999834Z [2024-04-11 23:14:02,599: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:14:02.601364422Z [2024-04-11 23:14:02,601: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:14:02.601478078Z [2024-04-11 23:14:02,601: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:14:02.601663191Z [2024-04-11 23:14:02,601: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:14:02.601765378Z [2024-04-11 23:14:02,601: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:14:02.602037987Z [2024-04-11 23:14:02,601: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:14:02.602140152Z [2024-04-11 23:14:02,602: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:14:02.602573590Z [2024-04-11 23:14:02,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:14:02.625114042Z [2024-04-11 23:14:02,624: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:14:02.626077069Z [2024-04-11 23:14:02,625: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:14:02.626166486Z [2024-04-11 23:14:02,626: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:14:02.626279189Z [2024-04-11 23:14:02,626: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:14:02.626338007Z [2024-04-11 23:14:02,626: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:14:02.626589515Z [2024-04-11 23:14:02,626: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:14:02.626695657Z [2024-04-11 23:14:02,626: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:14:02.677151461Z [2024-04-11 23:14:02,676: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:14:02.710139657Z [2024-04-11 23:14:02,709: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:14:04.322811337Z [2024-04-11 23:14:04,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5059f19-6b21-4841-9d54-873a5379b420] succeeded in 3.315188527999908s: None 2024-04-11T23:14:04.783184768Z [2024-04-11 23:14:04,782: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c1647e8-6176-4df0-9cab-f8e7a6e6c774] succeeded in 3.7729332740000245s: None 2024-04-11T23:15:00.919284973Z [2024-04-11 23:15:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc41c085-c1f0-431d-914b-53e9502fdc5e] received 2024-04-11T23:15:00.921821917Z [2024-04-11 23:15:00,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1eb1ab96-5b49-448e-afbb-31e6174b4258] received 2024-04-11T23:15:00.924208053Z [2024-04-11 23:15:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8537b578-27d3-4102-a54f-0d3b20b257df] received 2024-04-11T23:15:00.926712458Z [2024-04-11 23:15:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0d45a19-38b9-431a-a5e3-46e9436ecc60] received 2024-04-11T23:15:00.932877332Z [2024-04-11 23:15:00,932: INFO/ForkPoolWorker-15] [cc41c085-c1f0-431d-914b-53e9502fdc5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:00.937298855Z [2024-04-11 23:15:00,937: INFO/ForkPoolWorker-16] [1eb1ab96-5b49-448e-afbb-31e6174b4258] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:15:00.943451502Z [2024-04-11 23:15:00,943: INFO/ForkPoolWorker-2] [d0d45a19-38b9-431a-a5e3-46e9436ecc60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:15:00.945639470Z [2024-04-11 23:15:00,945: INFO/ForkPoolWorker-1] [8537b578-27d3-4102-a54f-0d3b20b257df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:15:01.234984058Z [2024-04-11 23:15:01,231: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:15:01.255500009Z [2024-04-11 23:15:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:15:01.276155404Z [2024-04-11 23:15:01,273: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:15:01.346688770Z [2024-04-11 23:15:01,342: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:15:01.503128560Z [2024-04-11 23:15:01,502: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:15:01.507791172Z [2024-04-11 23:15:01,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:01.543687676Z [2024-04-11 23:15:01,543: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:15:01.545159334Z [2024-04-11 23:15:01,544: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:15:01.545347012Z [2024-04-11 23:15:01,545: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:15:01.545478219Z [2024-04-11 23:15:01,545: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:15:01.545787355Z [2024-04-11 23:15:01,545: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:15:01.659812747Z [2024-04-11 23:15:01,658: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:02.242708474Z [2024-04-11 23:15:02,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8537b578-27d3-4102-a54f-0d3b20b257df] succeeded in 1.3080520670000624s: None 2024-04-11T23:15:02.442245519Z [2024-04-11 23:15:02,441: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:15:02.445449884Z [2024-04-11 23:15:02,445: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:02.450484694Z [2024-04-11 23:15:02,450: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:15:02.455196940Z [2024-04-11 23:15:02,453: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:02.477608356Z [2024-04-11 23:15:02,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:15:02.480153955Z [2024-04-11 23:15:02,479: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:02.480165729Z [2024-04-11 23:15:02,480: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:02.480286124Z [2024-04-11 23:15:02,480: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:02.480310018Z [2024-04-11 23:15:02,480: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:15:02.480721709Z [2024-04-11 23:15:02,480: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:15:02.480749367Z [2024-04-11 23:15:02,480: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:02.485110594Z [2024-04-11 23:15:02,484: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:15:02.488644248Z [2024-04-11 23:15:02,488: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:02.488729554Z [2024-04-11 23:15:02,488: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:02.488858451Z [2024-04-11 23:15:02,488: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:02.488944789Z [2024-04-11 23:15:02,488: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:15:02.489218691Z [2024-04-11 23:15:02,489: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:15:02.489330859Z [2024-04-11 23:15:02,489: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:02.553322595Z [2024-04-11 23:15:02,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:02.578532724Z [2024-04-11 23:15:02,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:15:02.581814844Z [2024-04-11 23:15:02,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:02.583437814Z [2024-04-11 23:15:02,583: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:02.602866797Z [2024-04-11 23:15:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:15:02.609385410Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:02.609429703Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:02.609589223Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:02.609747398Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:15:02.610027139Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:15:02.610068673Z [2024-04-11 23:15:02,609: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:02.683174797Z [2024-04-11 23:15:02,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:03.346236967Z [2024-04-11 23:15:03,345: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc41c085-c1f0-431d-914b-53e9502fdc5e] succeeded in 2.4246081839996805s: None 2024-04-11T23:15:03.586854914Z [2024-04-11 23:15:03,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d4da658-47af-4c74-a553-36320de4e847] received 2024-04-11T23:15:03.591100385Z [2024-04-11 23:15:03,590: INFO/ForkPoolWorker-15] [2d4da658-47af-4c74-a553-36320de4e847] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:03.899914997Z [2024-04-11 23:15:03,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:15:03.999998009Z [2024-04-11 23:15:03,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1eb1ab96-5b49-448e-afbb-31e6174b4258] succeeded in 3.0751857230002315s: None 2024-04-11T23:15:04.341751881Z [2024-04-11 23:15:04,341: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d0d45a19-38b9-431a-a5e3-46e9436ecc60] succeeded in 3.4127218029998403s: None 2024-04-11T23:15:04.935243379Z [2024-04-11 23:15:04,934: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:15:04.938248005Z [2024-04-11 23:15:04,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:04.958369457Z [2024-04-11 23:15:04,958: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:15:04.959876411Z [2024-04-11 23:15:04,959: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:04.959899485Z [2024-04-11 23:15:04,959: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:04.960082494Z [2024-04-11 23:15:04,959: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:04.960097119Z [2024-04-11 23:15:04,959: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:15:04.960262722Z [2024-04-11 23:15:04,960: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:15:04.960783652Z [2024-04-11 23:15:04,960: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:05.045393952Z [2024-04-11 23:15:05,045: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:05.677462285Z [2024-04-11 23:15:05,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d4da658-47af-4c74-a553-36320de4e847] succeeded in 2.0909662549997847s: None 2024-04-11T23:15:06.018944197Z [2024-04-11 23:15:06,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac98b92b-6771-460d-b01e-2e80194ad9d7] received 2024-04-11T23:15:06.030671429Z [2024-04-11 23:15:06,030: INFO/ForkPoolWorker-15] [ac98b92b-6771-460d-b01e-2e80194ad9d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:15:06.267436203Z [2024-04-11 23:15:06,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:15:07.234745390Z [2024-04-11 23:15:07,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:15:07.237406424Z [2024-04-11 23:15:07,236: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:07.267374605Z [2024-04-11 23:15:07,267: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:15:07.268898214Z [2024-04-11 23:15:07,268: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:07.268930830Z [2024-04-11 23:15:07,268: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:07.269213915Z [2024-04-11 23:15:07,268: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:07.269240488Z [2024-04-11 23:15:07,269: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:15:07.269534559Z [2024-04-11 23:15:07,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:15:07.269551019Z [2024-04-11 23:15:07,269: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:07.353204805Z [2024-04-11 23:15:07,352: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:09.705355306Z [2024-04-11 23:15:09,704: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac98b92b-6771-460d-b01e-2e80194ad9d7] succeeded in 3.682954154000072s: None 2024-04-11T23:15:09.890362884Z [2024-04-11 23:15:09,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba67b3b0-9bf0-4a65-9dba-f8eef52f2a2a] received 2024-04-11T23:15:09.898800842Z [2024-04-11 23:15:09,898: INFO/ForkPoolWorker-15] [ba67b3b0-9bf0-4a65-9dba-f8eef52f2a2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:10.171711025Z [2024-04-11 23:15:10,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:15:11.113818637Z [2024-04-11 23:15:11,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:15:11.116706845Z [2024-04-11 23:15:11,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:15:11.145202222Z [2024-04-11 23:15:11,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:15:11.147859994Z [2024-04-11 23:15:11,147: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:15:11.148154882Z [2024-04-11 23:15:11,148: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:15:11.148391285Z [2024-04-11 23:15:11,148: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:15:11.148544346Z [2024-04-11 23:15:11,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:15:11.148854763Z [2024-04-11 23:15:11,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:15:11.149009599Z [2024-04-11 23:15:11,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:15:11.234232314Z [2024-04-11 23:15:11,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:15:11.692913127Z [2024-04-11 23:15:11,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba67b3b0-9bf0-4a65-9dba-f8eef52f2a2a] succeeded in 1.7996990100000403s: None 2024-04-11T23:16:00.790064423Z [2024-04-11 23:16:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c698a9f9-2988-489f-8a2c-968e33316ab5] received 2024-04-11T23:16:00.792941031Z [2024-04-11 23:16:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3f8d73c-d226-4c8e-a6ae-3edacd0462ac] received 2024-04-11T23:16:00.799354504Z [2024-04-11 23:16:00,799: INFO/ForkPoolWorker-16] [a3f8d73c-d226-4c8e-a6ae-3edacd0462ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:16:00.801439530Z [2024-04-11 23:16:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[039022f5-ebcf-4a16-987c-8d1b965c1b40] received 2024-04-11T23:16:00.805433397Z [2024-04-11 23:16:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14c7ae92-a8a1-472a-bb76-df4c02e2b19b] received 2024-04-11T23:16:00.808212608Z [2024-04-11 23:16:00,807: INFO/ForkPoolWorker-15] [c698a9f9-2988-489f-8a2c-968e33316ab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:16:00.814192001Z [2024-04-11 23:16:00,813: INFO/ForkPoolWorker-2] [14c7ae92-a8a1-472a-bb76-df4c02e2b19b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:16:00.826056455Z [2024-04-11 23:16:00,825: INFO/ForkPoolWorker-1] [039022f5-ebcf-4a16-987c-8d1b965c1b40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:16:01.083470092Z [2024-04-11 23:16:01,076: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:16:01.155182674Z [2024-04-11 23:16:01,145: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:16:01.170240379Z [2024-04-11 23:16:01,167: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:16:01.180608450Z [2024-04-11 23:16:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:16:01.391204839Z [2024-04-11 23:16:01,388: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:16:01.396921359Z [2024-04-11 23:16:01,396: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:16:01.419740857Z [2024-04-11 23:16:01,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:16:01.421854751Z [2024-04-11 23:16:01,421: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:16:01.421953305Z [2024-04-11 23:16:01,421: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:16:01.421996815Z [2024-04-11 23:16:01,421: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:16:01.422123338Z [2024-04-11 23:16:01,422: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:16:01.424132760Z [2024-04-11 23:16:01,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:16:01.529196051Z [2024-04-11 23:16:01,528: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:16:01.954686375Z [2024-04-11 23:16:01,954: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c698a9f9-2988-489f-8a2c-968e33316ab5] succeeded in 1.162124746000245s: None 2024-04-11T23:16:02.186418359Z [2024-04-11 23:16:02,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3f8d73c-d226-4c8e-a6ae-3edacd0462ac] succeeded in 1.3922940129996277s: None 2024-04-11T23:16:02.277530539Z [2024-04-11 23:16:02,276: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:16:02.279928426Z [2024-04-11 23:16:02,279: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:16:02.307112880Z [2024-04-11 23:16:02,306: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:16:02.308683775Z [2024-04-11 23:16:02,308: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:16:02.308931477Z [2024-04-11 23:16:02,308: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:16:02.309216099Z [2024-04-11 23:16:02,308: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:16:02.309378477Z [2024-04-11 23:16:02,309: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:16:02.309942805Z [2024-04-11 23:16:02,309: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:16:02.310165899Z [2024-04-11 23:16:02,309: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:16:02.387279713Z [2024-04-11 23:16:02,387: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:16:02.467390711Z [2024-04-11 23:16:02,467: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:16:02.470303080Z [2024-04-11 23:16:02,469: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:16:02.488209269Z [2024-04-11 23:16:02,488: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:16:02.493205683Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:16:02.493219588Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:16:02.493309477Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:16:02.493334473Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:16:02.493544949Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:16:02.493575118Z [2024-04-11 23:16:02,493: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:16:02.586302601Z [2024-04-11 23:16:02,585: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:16:03.978437788Z [2024-04-11 23:16:03,977: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[14c7ae92-a8a1-472a-bb76-df4c02e2b19b] succeeded in 3.170787931999712s: None 2024-04-11T23:16:04.811849608Z [2024-04-11 23:16:04,811: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[039022f5-ebcf-4a16-987c-8d1b965c1b40] succeeded in 4.0073143710001204s: None 2024-04-11T23:17:00.737179515Z [2024-04-11 23:17:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9004b7e3-22d6-4d8a-b177-02219e34a41b] received 2024-04-11T23:17:00.744715044Z [2024-04-11 23:17:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[733dfd57-54ed-4460-95eb-3dcd94f2ee2a] received 2024-04-11T23:17:00.745227587Z [2024-04-11 23:17:00,744: INFO/ForkPoolWorker-15] [9004b7e3-22d6-4d8a-b177-02219e34a41b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:17:00.750536038Z [2024-04-11 23:17:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[070c5e47-e713-4ff4-9bef-3dc0f9476e33] received 2024-04-11T23:17:00.755888986Z [2024-04-11 23:17:00,755: INFO/ForkPoolWorker-16] [733dfd57-54ed-4460-95eb-3dcd94f2ee2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:17:00.756247319Z [2024-04-11 23:17:00,756: INFO/ForkPoolWorker-1] [070c5e47-e713-4ff4-9bef-3dc0f9476e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:17:01.027856548Z [2024-04-11 23:17:01,024: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:17:01.034223364Z [2024-04-11 23:17:01,030: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:17:01.051173759Z [2024-04-11 23:17:01,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:17:01.174033977Z [2024-04-11 23:17:01,173: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:17:01.180685123Z [2024-04-11 23:17:01,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:17:01.206751004Z [2024-04-11 23:17:01,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:17:01.207826379Z [2024-04-11 23:17:01,207: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:17:01.208058968Z [2024-04-11 23:17:01,207: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:17:01.208211975Z [2024-04-11 23:17:01,208: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:17:01.208824889Z [2024-04-11 23:17:01,208: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:17:01.310314054Z [2024-04-11 23:17:01,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:17:01.906097589Z [2024-04-11 23:17:01,905: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[070c5e47-e713-4ff4-9bef-3dc0f9476e33] succeeded in 1.1538319659998706s: None 2024-04-11T23:17:02.196076826Z [2024-04-11 23:17:02,195: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:17:02.199128208Z [2024-04-11 23:17:02,198: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:17:02.221168422Z [2024-04-11 23:17:02,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:17:02.222225430Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:17:02.222335732Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:17:02.222488752Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:17:02.222499368Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:17:02.222754647Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:17:02.222811815Z [2024-04-11 23:17:02,222: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:17:02.231782210Z [2024-04-11 23:17:02,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:17:02.234660707Z [2024-04-11 23:17:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:17:02.261969138Z [2024-04-11 23:17:02,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:17:02.263544340Z [2024-04-11 23:17:02,263: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:17:02.263608267Z [2024-04-11 23:17:02,263: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:17:02.263816317Z [2024-04-11 23:17:02,263: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:17:02.263998754Z [2024-04-11 23:17:02,263: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:17:02.264487903Z [2024-04-11 23:17:02,264: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:17:02.264620023Z [2024-04-11 23:17:02,264: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:17:02.294818832Z [2024-04-11 23:17:02,294: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:17:02.332043946Z [2024-04-11 23:17:02,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:17:03.707521688Z [2024-04-11 23:17:03,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[733dfd57-54ed-4460-95eb-3dcd94f2ee2a] succeeded in 2.958746117999908s: None 2024-04-11T23:17:04.028303846Z [2024-04-11 23:17:04,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9004b7e3-22d6-4d8a-b177-02219e34a41b] succeeded in 3.28907733799997s: None 2024-04-11T23:18:00.932920972Z [2024-04-11 23:18:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b53b88a-9858-42e9-88cf-0697a1d312e2] received 2024-04-11T23:18:00.938489241Z [2024-04-11 23:18:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667d4665-cb74-4563-bf67-1ff99b78796e] received 2024-04-11T23:18:00.941935463Z [2024-04-11 23:18:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53fbf854-40a4-4dce-bcad-aa2df414a4da] received 2024-04-11T23:18:00.943856518Z [2024-04-11 23:18:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1a8e97a-4f15-4398-8981-0e365afcad38] received 2024-04-11T23:18:00.952832705Z [2024-04-11 23:18:00,952: INFO/ForkPoolWorker-2] [d1a8e97a-4f15-4398-8981-0e365afcad38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:18:00.953036143Z [2024-04-11 23:18:00,952: INFO/ForkPoolWorker-16] [667d4665-cb74-4563-bf67-1ff99b78796e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:18:00.953868800Z [2024-04-11 23:18:00,953: INFO/ForkPoolWorker-15] [4b53b88a-9858-42e9-88cf-0697a1d312e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:18:00.956454122Z [2024-04-11 23:18:00,956: INFO/ForkPoolWorker-1] [53fbf854-40a4-4dce-bcad-aa2df414a4da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:18:01.201727877Z [2024-04-11 23:18:01,198: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:18:01.253205594Z [2024-04-11 23:18:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:18:01.286364666Z [2024-04-11 23:18:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:18:01.291442816Z [2024-04-11 23:18:01,285: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:18:01.432969942Z [2024-04-11 23:18:01,432: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:18:01.437703241Z [2024-04-11 23:18:01,436: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:18:01.469834026Z [2024-04-11 23:18:01,469: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:18:01.473167317Z [2024-04-11 23:18:01,472: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:18:01.473245887Z [2024-04-11 23:18:01,473: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:18:01.473305064Z [2024-04-11 23:18:01,473: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:18:01.473545847Z [2024-04-11 23:18:01,473: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:18:01.611123614Z [2024-04-11 23:18:01,610: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:18:01.635792176Z [2024-04-11 23:18:01,635: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:18:02.294146104Z [2024-04-11 23:18:02,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b53b88a-9858-42e9-88cf-0697a1d312e2] succeeded in 1.3585441599998376s: None 2024-04-11T23:18:02.327814758Z [2024-04-11 23:18:02,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[667d4665-cb74-4563-bf67-1ff99b78796e] succeeded in 1.3836087039999256s: None 2024-04-11T23:18:02.364168810Z [2024-04-11 23:18:02,363: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:18:02.367348021Z [2024-04-11 23:18:02,366: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:18:02.390137483Z [2024-04-11 23:18:02,389: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:18:02.391975451Z [2024-04-11 23:18:02,391: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:18:02.392212944Z [2024-04-11 23:18:02,392: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:18:02.392500782Z [2024-04-11 23:18:02,392: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:18:02.392661679Z [2024-04-11 23:18:02,392: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:18:02.393009395Z [2024-04-11 23:18:02,392: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:18:02.393534279Z [2024-04-11 23:18:02,393: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:18:02.471706635Z [2024-04-11 23:18:02,471: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:18:02.698733162Z [2024-04-11 23:18:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:18:02.702019892Z [2024-04-11 23:18:02,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:18:02.733625003Z [2024-04-11 23:18:02,733: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:18:02.736476654Z [2024-04-11 23:18:02,736: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:18:02.736789321Z [2024-04-11 23:18:02,736: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:18:02.736989212Z [2024-04-11 23:18:02,736: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:18:02.737070963Z [2024-04-11 23:18:02,736: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:18:02.737429242Z [2024-04-11 23:18:02,737: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:18:02.737586925Z [2024-04-11 23:18:02,737: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:18:02.836262896Z [2024-04-11 23:18:02,835: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:18:04.342929448Z [2024-04-11 23:18:04,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d1a8e97a-4f15-4398-8981-0e365afcad38] succeeded in 3.397303037999791s: None 2024-04-11T23:18:04.480848734Z [2024-04-11 23:18:04,479: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53fbf854-40a4-4dce-bcad-aa2df414a4da] succeeded in 3.5346808139997847s: None 2024-04-11T23:19:01.242564582Z [2024-04-11 23:19:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[992c7d08-a1a4-4b7a-93e8-7c74780bce2b] received 2024-04-11T23:19:01.249478331Z [2024-04-11 23:19:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5abf61b2-b61c-41da-a254-6379147d94ea] received 2024-04-11T23:19:01.251609522Z [2024-04-11 23:19:01,251: INFO/ForkPoolWorker-15] [992c7d08-a1a4-4b7a-93e8-7c74780bce2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:19:01.254011126Z [2024-04-11 23:19:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7754eb20-9ad8-423c-b3ad-7b9809569b22] received 2024-04-11T23:19:01.266708019Z [2024-04-11 23:19:01,266: INFO/ForkPoolWorker-16] [5abf61b2-b61c-41da-a254-6379147d94ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:19:01.267482520Z [2024-04-11 23:19:01,267: INFO/ForkPoolWorker-1] [7754eb20-9ad8-423c-b3ad-7b9809569b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:19:01.560433138Z [2024-04-11 23:19:01,557: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:19:01.571642106Z [2024-04-11 23:19:01,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:19:01.630030159Z [2024-04-11 23:19:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:19:01.722663481Z [2024-04-11 23:19:01,720: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:19:01.725295123Z [2024-04-11 23:19:01,724: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:19:01.806977554Z [2024-04-11 23:19:01,805: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:19:01.806990882Z [2024-04-11 23:19:01,806: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:19:01.806994234Z [2024-04-11 23:19:01,806: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:19:01.806997568Z [2024-04-11 23:19:01,806: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:19:01.807000306Z [2024-04-11 23:19:01,806: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:19:01.881698313Z [2024-04-11 23:19:01,881: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:19:02.389099858Z [2024-04-11 23:19:02,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7754eb20-9ad8-423c-b3ad-7b9809569b22] succeeded in 1.1338616789998923s: None 2024-04-11T23:19:02.769648880Z [2024-04-11 23:19:02,769: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:19:02.773312070Z [2024-04-11 23:19:02,772: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:19:02.793592121Z [2024-04-11 23:19:02,793: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:19:02.795014373Z [2024-04-11 23:19:02,794: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:19:02.795131708Z [2024-04-11 23:19:02,795: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:19:02.795303177Z [2024-04-11 23:19:02,795: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:19:02.795416885Z [2024-04-11 23:19:02,795: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:19:02.795699904Z [2024-04-11 23:19:02,795: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:19:02.796097972Z [2024-04-11 23:19:02,795: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:19:02.825487083Z [2024-04-11 23:19:02,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:19:02.828440399Z [2024-04-11 23:19:02,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:19:02.847293592Z [2024-04-11 23:19:02,847: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:19:02.848714260Z [2024-04-11 23:19:02,848: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:19:02.848810317Z [2024-04-11 23:19:02,848: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:19:02.848983775Z [2024-04-11 23:19:02,848: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:19:02.849081756Z [2024-04-11 23:19:02,848: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:19:02.849460037Z [2024-04-11 23:19:02,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:19:02.849567367Z [2024-04-11 23:19:02,849: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:19:02.872035423Z [2024-04-11 23:19:02,871: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:19:02.921137535Z [2024-04-11 23:19:02,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:19:04.709759003Z [2024-04-11 23:19:04,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[992c7d08-a1a4-4b7a-93e8-7c74780bce2b] succeeded in 3.465026111000043s: None 2024-04-11T23:19:05.291669571Z [2024-04-11 23:19:05,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5abf61b2-b61c-41da-a254-6379147d94ea] succeeded in 4.03922214000022s: None 2024-04-11T23:20:00.995948894Z [2024-04-11 23:20:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e179c2c-3b30-4b48-b850-65eb5e12be24] received 2024-04-11T23:20:00.997716623Z [2024-04-11 23:20:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7c2559c-d5bf-4257-80f6-8ba20c6eafd9] received 2024-04-11T23:20:01.004840579Z [2024-04-11 23:20:01,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa6f2346-1cae-445b-a538-b7049ed72444] received 2024-04-11T23:20:01.006844525Z [2024-04-11 23:20:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49f0c89f-7dd3-48cd-ab53-302c57d0fc10] received 2024-04-11T23:20:01.007514799Z [2024-04-11 23:20:01,007: INFO/ForkPoolWorker-16] [a7c2559c-d5bf-4257-80f6-8ba20c6eafd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:20:01.010098512Z [2024-04-11 23:20:01,009: INFO/ForkPoolWorker-15] [2e179c2c-3b30-4b48-b850-65eb5e12be24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:01.013650579Z [2024-04-11 23:20:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e43c191-5346-43bd-843a-bd7f8d528e01] received 2024-04-11T23:20:01.019926208Z [2024-04-11 23:20:01,019: INFO/ForkPoolWorker-1] [fa6f2346-1cae-445b-a538-b7049ed72444] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:20:01.029457572Z [2024-04-11 23:20:01,029: INFO/ForkPoolWorker-2] [49f0c89f-7dd3-48cd-ab53-302c57d0fc10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:20:01.034043625Z [2024-04-11 23:20:01,033: INFO/ForkPoolWorker-3] [3e43c191-5346-43bd-843a-bd7f8d528e01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:20:01.273304110Z [2024-04-11 23:20:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:20:01.299347094Z [2024-04-11 23:20:01,295: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:20:01.448420178Z [2024-04-11 23:20:01,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:20:01.507356430Z [2024-04-11 23:20:01,503: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:20:01.510683174Z [2024-04-11 23:20:01,505: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:20:01.598198224Z [2024-04-11 23:20:01,597: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:01.696489170Z [2024-04-11 23:20:01,693: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:20:01.700566317Z [2024-04-11 23:20:01,699: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:01.737397470Z [2024-04-11 23:20:01,737: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:20:01.741262411Z [2024-04-11 23:20:01,741: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:20:01.741451951Z [2024-04-11 23:20:01,741: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:20:01.741561559Z [2024-04-11 23:20:01,741: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:20:01.741835611Z [2024-04-11 23:20:01,741: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:20:01.829131170Z [2024-04-11 23:20:01,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:02.241643123Z [2024-04-11 23:20:02,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7c2559c-d5bf-4257-80f6-8ba20c6eafd9] succeeded in 1.2425164219998805s: None 2024-04-11T23:20:02.450051606Z [2024-04-11 23:20:02,449: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa6f2346-1cae-445b-a538-b7049ed72444] succeeded in 1.4427410660000533s: None 2024-04-11T23:20:02.700198820Z [2024-04-11 23:20:02,699: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:20:02.703144488Z [2024-04-11 23:20:02,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:02.730160581Z [2024-04-11 23:20:02,729: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:20:02.731555156Z [2024-04-11 23:20:02,731: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:02.731669249Z [2024-04-11 23:20:02,731: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:02.731860431Z [2024-04-11 23:20:02,731: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:02.731984751Z [2024-04-11 23:20:02,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:20:02.732301160Z [2024-04-11 23:20:02,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:20:02.732449942Z [2024-04-11 23:20:02,732: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:02.758444726Z [2024-04-11 23:20:02,758: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T23:20:02.761371208Z [2024-04-11 23:20:02,761: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:02.789425206Z [2024-04-11 23:20:02,789: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:20:02.792638045Z [2024-04-11 23:20:02,792: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:02.796793827Z [2024-04-11 23:20:02,796: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:02.797356938Z [2024-04-11 23:20:02,796: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:02.797511735Z [2024-04-11 23:20:02,797: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T23:20:02.797886362Z [2024-04-11 23:20:02,797: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:20:02.798196857Z [2024-04-11 23:20:02,798: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:02.802322662Z [2024-04-11 23:20:02,802: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:20:02.805268478Z [2024-04-11 23:20:02,804: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:02.813418894Z [2024-04-11 23:20:02,813: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:02.821978777Z [2024-04-11 23:20:02,821: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:20:02.822961942Z [2024-04-11 23:20:02,822: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:02.822975531Z [2024-04-11 23:20:02,822: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:02.823074260Z [2024-04-11 23:20:02,822: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:02.823104476Z [2024-04-11 23:20:02,823: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:20:02.823267775Z [2024-04-11 23:20:02,823: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:20:02.823289596Z [2024-04-11 23:20:02,823: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:02.880162445Z [2024-04-11 23:20:02,879: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:02.902484711Z [2024-04-11 23:20:02,902: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:03.286659779Z [2024-04-11 23:20:03,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e179c2c-3b30-4b48-b850-65eb5e12be24] succeeded in 2.2873236870000255s: None 2024-04-11T23:20:03.619173244Z [2024-04-11 23:20:03,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2416db8-b23b-4e35-9cc1-a09153c2c2f5] received 2024-04-11T23:20:03.634212568Z [2024-04-11 23:20:03,633: INFO/ForkPoolWorker-15] [c2416db8-b23b-4e35-9cc1-a09153c2c2f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:03.907988669Z [2024-04-11 23:20:03,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:20:04.957805296Z [2024-04-11 23:20:04,957: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:20:04.961088147Z [2024-04-11 23:20:04,960: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:04.989847967Z [2024-04-11 23:20:04,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:20:04.991245074Z [2024-04-11 23:20:04,991: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:04.991421636Z [2024-04-11 23:20:04,991: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:04.991888286Z [2024-04-11 23:20:04,991: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:04.991949736Z [2024-04-11 23:20:04,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:20:04.992090542Z [2024-04-11 23:20:04,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:20:04.992215476Z [2024-04-11 23:20:04,992: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:05.060788276Z [2024-04-11 23:20:05,060: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[49f0c89f-7dd3-48cd-ab53-302c57d0fc10] succeeded in 4.051712205999593s: None 2024-04-11T23:20:05.078856270Z [2024-04-11 23:20:05,078: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:05.351008095Z [2024-04-11 23:20:05,350: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3e43c191-5346-43bd-843a-bd7f8d528e01] succeeded in 4.333990967000318s: None 2024-04-11T23:20:05.762711495Z [2024-04-11 23:20:05,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2416db8-b23b-4e35-9cc1-a09153c2c2f5] succeeded in 2.1363071480000144s: None 2024-04-11T23:20:06.080865760Z [2024-04-11 23:20:06,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1db342d1-d2b0-4b91-9dd6-c254027ce621] received 2024-04-11T23:20:06.091638553Z [2024-04-11 23:20:06,091: INFO/ForkPoolWorker-15] [1db342d1-d2b0-4b91-9dd6-c254027ce621] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:20:06.349516634Z [2024-04-11 23:20:06,346: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:20:07.435232725Z [2024-04-11 23:20:07,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:20:07.438190630Z [2024-04-11 23:20:07,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:07.466122887Z [2024-04-11 23:20:07,465: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:20:07.467558546Z [2024-04-11 23:20:07,467: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:07.467575784Z [2024-04-11 23:20:07,467: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:07.467659277Z [2024-04-11 23:20:07,467: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:07.467676840Z [2024-04-11 23:20:07,467: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:20:07.468043634Z [2024-04-11 23:20:07,467: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:20:07.468212329Z [2024-04-11 23:20:07,468: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:07.553079923Z [2024-04-11 23:20:07,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:08.103230828Z [2024-04-11 23:20:08,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1db342d1-d2b0-4b91-9dd6-c254027ce621] succeeded in 2.019387392000226s: None 2024-04-11T23:20:08.297634682Z [2024-04-11 23:20:08,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53ad2a95-a499-464e-9660-5894b8819061] received 2024-04-11T23:20:08.305656959Z [2024-04-11 23:20:08,305: INFO/ForkPoolWorker-15] [53ad2a95-a499-464e-9660-5894b8819061] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:08.567757868Z [2024-04-11 23:20:08,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:20:09.520550873Z [2024-04-11 23:20:09,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:20:09.523480484Z [2024-04-11 23:20:09,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:20:09.558472287Z [2024-04-11 23:20:09,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:20:09.560237230Z [2024-04-11 23:20:09,559: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:20:09.560584626Z [2024-04-11 23:20:09,560: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:20:09.560893099Z [2024-04-11 23:20:09,560: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:20:09.561134894Z [2024-04-11 23:20:09,560: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:20:09.561563416Z [2024-04-11 23:20:09,561: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:20:09.562171175Z [2024-04-11 23:20:09,561: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:20:09.669336272Z [2024-04-11 23:20:09,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:20:10.282892012Z [2024-04-11 23:20:10,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53ad2a95-a499-464e-9660-5894b8819061] succeeded in 1.9827427640002497s: None 2024-04-11T23:21:00.839295379Z [2024-04-11 23:21:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e63a82bd-4b7b-4550-8df4-a8e73a81bc9d] received 2024-04-11T23:21:00.841879871Z [2024-04-11 23:21:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[536fbdc4-0c03-4ea2-8389-f754d41be42e] received 2024-04-11T23:21:00.844266896Z [2024-04-11 23:21:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33ad992d-1c5d-49e0-a77d-21634e549026] received 2024-04-11T23:21:00.852890818Z [2024-04-11 23:21:00,852: INFO/ForkPoolWorker-1] [33ad992d-1c5d-49e0-a77d-21634e549026] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:21:00.855146455Z [2024-04-11 23:21:00,854: INFO/ForkPoolWorker-16] [536fbdc4-0c03-4ea2-8389-f754d41be42e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:21:00.855861416Z [2024-04-11 23:21:00,855: INFO/ForkPoolWorker-15] [e63a82bd-4b7b-4550-8df4-a8e73a81bc9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:21:01.099859482Z [2024-04-11 23:21:01,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:21:01.112236619Z [2024-04-11 23:21:01,109: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:21:01.144989837Z [2024-04-11 23:21:01,142: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:21:01.227069414Z [2024-04-11 23:21:01,226: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:21:01.230421971Z [2024-04-11 23:21:01,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:21:01.251895134Z [2024-04-11 23:21:01,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:21:01.252928733Z [2024-04-11 23:21:01,252: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:21:01.253137400Z [2024-04-11 23:21:01,252: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:21:01.253282109Z [2024-04-11 23:21:01,253: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:21:01.253538766Z [2024-04-11 23:21:01,253: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:21:01.351536358Z [2024-04-11 23:21:01,351: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:21:01.878715790Z [2024-04-11 23:21:01,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e63a82bd-4b7b-4550-8df4-a8e73a81bc9d] succeeded in 1.033823296999799s: None 2024-04-11T23:21:02.107403314Z [2024-04-11 23:21:02,107: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:21:02.110225797Z [2024-04-11 23:21:02,109: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:21:02.140145140Z [2024-04-11 23:21:02,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:21:02.141373173Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:21:02.141410378Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:21:02.141570947Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:21:02.141618759Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:21:02.141862537Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:21:02.141932691Z [2024-04-11 23:21:02,141: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:21:02.168600643Z [2024-04-11 23:21:02,168: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:21:02.171222390Z [2024-04-11 23:21:02,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:21:02.187072668Z [2024-04-11 23:21:02,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:21:02.193305557Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:21:02.193387888Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:21:02.193570088Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:21:02.193670141Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:21:02.193978945Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:21:02.194047881Z [2024-04-11 23:21:02,193: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:21:02.212168504Z [2024-04-11 23:21:02,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:21:02.272979640Z [2024-04-11 23:21:02,272: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:21:03.852188918Z [2024-04-11 23:21:03,851: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33ad992d-1c5d-49e0-a77d-21634e549026] succeeded in 3.0059288200000083s: None 2024-04-11T23:21:04.438801531Z [2024-04-11 23:21:04,437: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[536fbdc4-0c03-4ea2-8389-f754d41be42e] succeeded in 3.5940693070001544s: None 2024-04-11T23:22:00.348925979Z [2024-04-11 23:22:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cd3c29f-ac59-450c-a8df-2a548ceadd43] received 2024-04-11T23:22:00.354158168Z [2024-04-11 23:22:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[686cee22-302a-4f87-8c24-f858766064e9] received 2024-04-11T23:22:00.355488432Z [2024-04-11 23:22:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c358e90d-f52b-48ef-a763-044e9a92ce14] received 2024-04-11T23:22:00.356438282Z [2024-04-11 23:22:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3c41bf5-753c-4abc-b477-23a8306edc18] received 2024-04-11T23:22:00.364021146Z [2024-04-11 23:22:00,363: INFO/ForkPoolWorker-1] [c358e90d-f52b-48ef-a763-044e9a92ce14] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:22:00.368947751Z [2024-04-11 23:22:00,368: INFO/ForkPoolWorker-15] [8cd3c29f-ac59-450c-a8df-2a548ceadd43] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:22:00.369420426Z [2024-04-11 23:22:00,369: INFO/ForkPoolWorker-16] [686cee22-302a-4f87-8c24-f858766064e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:22:00.370237380Z [2024-04-11 23:22:00,370: INFO/ForkPoolWorker-2] [d3c41bf5-753c-4abc-b477-23a8306edc18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:22:00.706476757Z [2024-04-11 23:22:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:22:00.772483393Z [2024-04-11 23:22:00,769: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:22:00.809982042Z [2024-04-11 23:22:00,807: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:22:00.819563712Z [2024-04-11 23:22:00,816: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:22:00.922428518Z [2024-04-11 23:22:00,922: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:22:00.981780633Z [2024-04-11 23:22:00,981: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:22:00.985515684Z [2024-04-11 23:22:00,985: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:22:01.050826937Z [2024-04-11 23:22:01,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:22:01.051995867Z [2024-04-11 23:22:01,051: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:22:01.052061302Z [2024-04-11 23:22:01,051: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:22:01.052159334Z [2024-04-11 23:22:01,052: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:22:01.052386321Z [2024-04-11 23:22:01,052: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:22:01.138273473Z [2024-04-11 23:22:01,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:22:01.537327642Z [2024-04-11 23:22:01,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c358e90d-f52b-48ef-a763-044e9a92ce14] succeeded in 1.179528277999907s: None 2024-04-11T23:22:01.844088484Z [2024-04-11 23:22:01,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8cd3c29f-ac59-450c-a8df-2a548ceadd43] succeeded in 1.4907985270001518s: None 2024-04-11T23:22:02.152865702Z [2024-04-11 23:22:02,152: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:22:02.155879042Z [2024-04-11 23:22:02,155: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:22:02.177484975Z [2024-04-11 23:22:02,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:22:02.178972405Z [2024-04-11 23:22:02,178: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:22:02.179132151Z [2024-04-11 23:22:02,178: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:22:02.179350315Z [2024-04-11 23:22:02,179: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:22:02.179496946Z [2024-04-11 23:22:02,179: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:22:02.179971756Z [2024-04-11 23:22:02,179: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:22:02.180117313Z [2024-04-11 23:22:02,179: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:22:02.256381230Z [2024-04-11 23:22:02,256: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:22:02.297418091Z [2024-04-11 23:22:02,297: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:22:02.300130099Z [2024-04-11 23:22:02,299: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:22:02.318104260Z [2024-04-11 23:22:02,317: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:22:02.319086179Z [2024-04-11 23:22:02,318: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:22:02.319175160Z [2024-04-11 23:22:02,319: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:22:02.319340871Z [2024-04-11 23:22:02,319: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:22:02.319406591Z [2024-04-11 23:22:02,319: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:22:02.319621916Z [2024-04-11 23:22:02,319: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:22:02.319698267Z [2024-04-11 23:22:02,319: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:22:02.391259286Z [2024-04-11 23:22:02,391: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:22:03.964858301Z [2024-04-11 23:22:03,964: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3c41bf5-753c-4abc-b477-23a8306edc18] succeeded in 3.604475578000347s: None 2024-04-11T23:22:04.103923967Z [2024-04-11 23:22:04,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[686cee22-302a-4f87-8c24-f858766064e9] succeeded in 3.7477213409997603s: None 2024-04-11T23:23:00.731513994Z [2024-04-11 23:23:00,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91de895b-b145-4abe-b585-9f8d3d28e76b] received 2024-04-11T23:23:00.739104638Z [2024-04-11 23:23:00,738: INFO/ForkPoolWorker-15] [91de895b-b145-4abe-b585-9f8d3d28e76b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:23:00.741169704Z [2024-04-11 23:23:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bc3a8ae-ac54-46e3-9371-9ff916f62774] received 2024-04-11T23:23:00.747050086Z [2024-04-11 23:23:00,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af3da9d-42ff-4a07-90f9-e45759c8d7fd] received 2024-04-11T23:23:00.753340376Z [2024-04-11 23:23:00,753: INFO/ForkPoolWorker-16] [7bc3a8ae-ac54-46e3-9371-9ff916f62774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:23:00.759082006Z [2024-04-11 23:23:00,758: INFO/ForkPoolWorker-1] [7af3da9d-42ff-4a07-90f9-e45759c8d7fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:23:01.008621301Z [2024-04-11 23:23:01,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:23:01.024007970Z [2024-04-11 23:23:01,019: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:23:01.038098945Z [2024-04-11 23:23:01,035: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:23:01.198954661Z [2024-04-11 23:23:01,198: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:23:01.203419070Z [2024-04-11 23:23:01,202: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:23:01.233335767Z [2024-04-11 23:23:01,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:23:01.234410710Z [2024-04-11 23:23:01,234: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:23:01.234490136Z [2024-04-11 23:23:01,234: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:23:01.234562809Z [2024-04-11 23:23:01,234: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:23:01.234838493Z [2024-04-11 23:23:01,234: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:23:01.360009985Z [2024-04-11 23:23:01,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:23:02.071088377Z [2024-04-11 23:23:02,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91de895b-b145-4abe-b585-9f8d3d28e76b] succeeded in 1.337948539000081s: None 2024-04-11T23:23:02.109966948Z [2024-04-11 23:23:02,109: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:23:02.112999665Z [2024-04-11 23:23:02,112: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:23:02.139694315Z [2024-04-11 23:23:02,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:23:02.141227275Z [2024-04-11 23:23:02,141: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:23:02.141419403Z [2024-04-11 23:23:02,141: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:23:02.141715756Z [2024-04-11 23:23:02,141: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:23:02.141894718Z [2024-04-11 23:23:02,141: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:23:02.142283872Z [2024-04-11 23:23:02,142: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:23:02.142415302Z [2024-04-11 23:23:02,142: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:23:02.231194454Z [2024-04-11 23:23:02,230: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:23:02.310368769Z [2024-04-11 23:23:02,309: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:23:02.313433353Z [2024-04-11 23:23:02,313: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:23:02.357847966Z [2024-04-11 23:23:02,357: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:23:02.360528237Z [2024-04-11 23:23:02,360: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:23:02.360835208Z [2024-04-11 23:23:02,360: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:23:02.361277043Z [2024-04-11 23:23:02,360: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:23:02.361568614Z [2024-04-11 23:23:02,361: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:23:02.362416831Z [2024-04-11 23:23:02,361: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:23:02.362736342Z [2024-04-11 23:23:02,362: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:23:02.473213680Z [2024-04-11 23:23:02,472: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:23:03.804147376Z [2024-04-11 23:23:03,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7bc3a8ae-ac54-46e3-9371-9ff916f62774] succeeded in 3.0609248239998124s: None 2024-04-11T23:23:05.236748276Z [2024-04-11 23:23:05,236: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7af3da9d-42ff-4a07-90f9-e45759c8d7fd] succeeded in 4.487674943000002s: None 2024-04-11T23:24:01.207450970Z [2024-04-11 23:24:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4757ed56-a12e-406b-8526-12bbd45543b5] received 2024-04-11T23:24:01.210377161Z [2024-04-11 23:24:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48565aca-807c-432e-8242-e12c1b1f69e8] received 2024-04-11T23:24:01.218207023Z [2024-04-11 23:24:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14856993-3f2d-4e09-9492-c6e864a70ad9] received 2024-04-11T23:24:01.218788184Z [2024-04-11 23:24:01,218: INFO/ForkPoolWorker-15] [4757ed56-a12e-406b-8526-12bbd45543b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:24:01.220977365Z [2024-04-11 23:24:01,220: INFO/ForkPoolWorker-16] [48565aca-807c-432e-8242-e12c1b1f69e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:24:01.221598963Z [2024-04-11 23:24:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06a7e4d9-597a-495e-96fd-6afd05babb4d] received 2024-04-11T23:24:01.238380337Z [2024-04-11 23:24:01,238: INFO/ForkPoolWorker-2] [06a7e4d9-597a-495e-96fd-6afd05babb4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:24:01.244099709Z [2024-04-11 23:24:01,243: INFO/ForkPoolWorker-1] [14856993-3f2d-4e09-9492-c6e864a70ad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:24:01.498047052Z [2024-04-11 23:24:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:24:01.510650728Z [2024-04-11 23:24:01,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:24:01.521280579Z [2024-04-11 23:24:01,518: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:24:01.643321872Z [2024-04-11 23:24:01,640: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:24:01.712511412Z [2024-04-11 23:24:01,711: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:24:01.877197441Z [2024-04-11 23:24:01,876: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:24:01.881120917Z [2024-04-11 23:24:01,880: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:24:01.937390584Z [2024-04-11 23:24:01,936: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:24:01.939199872Z [2024-04-11 23:24:01,938: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:24:01.939556563Z [2024-04-11 23:24:01,939: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:24:01.939784330Z [2024-04-11 23:24:01,939: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:24:01.940757483Z [2024-04-11 23:24:01,940: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:24:02.050847310Z [2024-04-11 23:24:02,050: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:24:02.196593718Z [2024-04-11 23:24:02,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48565aca-807c-432e-8242-e12c1b1f69e8] succeeded in 0.9844875750000028s: None 2024-04-11T23:24:02.659720429Z [2024-04-11 23:24:02,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:24:02.662889689Z [2024-04-11 23:24:02,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:24:02.671436097Z [2024-04-11 23:24:02,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[14856993-3f2d-4e09-9492-c6e864a70ad9] succeeded in 1.4493212630000016s: None 2024-04-11T23:24:02.689397947Z [2024-04-11 23:24:02,689: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:24:02.693721219Z [2024-04-11 23:24:02,692: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:24:02.693854817Z [2024-04-11 23:24:02,693: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:24:02.694069701Z [2024-04-11 23:24:02,693: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:24:02.694187839Z [2024-04-11 23:24:02,694: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:24:02.694488742Z [2024-04-11 23:24:02,694: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:24:02.694663235Z [2024-04-11 23:24:02,694: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:24:02.725929161Z [2024-04-11 23:24:02,725: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:24:02.729397418Z [2024-04-11 23:24:02,728: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:24:02.750702594Z [2024-04-11 23:24:02,750: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:24:02.753271649Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:24:02.753283542Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:24:02.753361579Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:24:02.753385029Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:24:02.753602506Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:24:02.753668254Z [2024-04-11 23:24:02,753: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:24:02.783669535Z [2024-04-11 23:24:02,783: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:24:02.824560205Z [2024-04-11 23:24:02,824: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:24:04.884277228Z [2024-04-11 23:24:04,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4757ed56-a12e-406b-8526-12bbd45543b5] succeeded in 3.671630355999696s: None 2024-04-11T23:24:05.333043950Z [2024-04-11 23:24:05,332: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06a7e4d9-597a-495e-96fd-6afd05babb4d] succeeded in 4.105358921000061s: None 2024-04-11T23:25:00.528527114Z [2024-04-11 23:25:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbc2dec0-5dbf-4e5c-976a-0afd92a781e8] received 2024-04-11T23:25:00.533687004Z [2024-04-11 23:25:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39ff6910-0a25-4735-a7d9-d4e389fd85fc] received 2024-04-11T23:25:00.537830672Z [2024-04-11 23:25:00,537: INFO/ForkPoolWorker-15] [cbc2dec0-5dbf-4e5c-976a-0afd92a781e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:00.541910251Z [2024-04-11 23:25:00,541: INFO/ForkPoolWorker-16] [39ff6910-0a25-4735-a7d9-d4e389fd85fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:25:00.549463062Z [2024-04-11 23:25:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16178d86-4f0d-4387-a53a-4cdb7f6796db] received 2024-04-11T23:25:00.553938772Z [2024-04-11 23:25:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[407bad2e-8c05-4db3-9201-142d310db275] received 2024-04-11T23:25:00.562889025Z [2024-04-11 23:25:00,562: INFO/ForkPoolWorker-2] [407bad2e-8c05-4db3-9201-142d310db275] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:25:00.577729878Z [2024-04-11 23:25:00,577: INFO/ForkPoolWorker-1] [16178d86-4f0d-4387-a53a-4cdb7f6796db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:25:00.802186133Z [2024-04-11 23:25:00,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:25:00.821358057Z [2024-04-11 23:25:00,817: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:25:00.896146845Z [2024-04-11 23:25:00,892: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:25:00.928556876Z [2024-04-11 23:25:00,925: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:25:01.042956462Z [2024-04-11 23:25:01,042: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:25:01.047303628Z [2024-04-11 23:25:01,046: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:01.073354621Z [2024-04-11 23:25:01,073: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:25:01.074531995Z [2024-04-11 23:25:01,074: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:25:01.074704227Z [2024-04-11 23:25:01,074: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:25:01.074817593Z [2024-04-11 23:25:01,074: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:25:01.075299983Z [2024-04-11 23:25:01,075: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:25:01.149351532Z [2024-04-11 23:25:01,149: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:01.798772715Z [2024-04-11 23:25:01,798: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16178d86-4f0d-4387-a53a-4cdb7f6796db] succeeded in 1.2402077000001555s: None 2024-04-11T23:25:02.008919294Z [2024-04-11 23:25:02,008: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:25:02.012299818Z [2024-04-11 23:25:02,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:02.040400333Z [2024-04-11 23:25:02,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:25:02.041580854Z [2024-04-11 23:25:02,041: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:02.041669252Z [2024-04-11 23:25:02,041: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:02.041881465Z [2024-04-11 23:25:02,041: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:02.041992608Z [2024-04-11 23:25:02,041: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:25:02.042342567Z [2024-04-11 23:25:02,042: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:25:02.042476433Z [2024-04-11 23:25:02,042: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:02.075281319Z [2024-04-11 23:25:02,074: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:25:02.078249541Z [2024-04-11 23:25:02,077: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:02.097727864Z [2024-04-11 23:25:02,097: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:25:02.102262346Z [2024-04-11 23:25:02,101: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:02.102753867Z [2024-04-11 23:25:02,102: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:02.103153694Z [2024-04-11 23:25:02,102: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:02.103401723Z [2024-04-11 23:25:02,103: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:25:02.104007241Z [2024-04-11 23:25:02,103: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:25:02.104804661Z [2024-04-11 23:25:02,104: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:02.142504678Z [2024-04-11 23:25:02,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:02.188196022Z [2024-04-11 23:25:02,187: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:25:02.191277370Z [2024-04-11 23:25:02,190: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:02.209238536Z [2024-04-11 23:25:02,208: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:02.210514514Z [2024-04-11 23:25:02,210: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:25:02.211803087Z [2024-04-11 23:25:02,211: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:02.211815235Z [2024-04-11 23:25:02,211: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:02.212350813Z [2024-04-11 23:25:02,212: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:02.212361744Z [2024-04-11 23:25:02,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:25:02.212940759Z [2024-04-11 23:25:02,212: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:25:02.213137087Z [2024-04-11 23:25:02,212: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:02.284199164Z [2024-04-11 23:25:02,283: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:02.642719525Z [2024-04-11 23:25:02,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbc2dec0-5dbf-4e5c-976a-0afd92a781e8] succeeded in 2.112637788000029s: None 2024-04-11T23:25:03.179104072Z [2024-04-11 23:25:03,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68df5b7b-3317-4386-b4fc-207f6864ac8a] received 2024-04-11T23:25:03.191618273Z [2024-04-11 23:25:03,191: INFO/ForkPoolWorker-15] [68df5b7b-3317-4386-b4fc-207f6864ac8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:03.469993987Z [2024-04-11 23:25:03,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:25:03.663880377Z [2024-04-11 23:25:03,663: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39ff6910-0a25-4735-a7d9-d4e389fd85fc] succeeded in 3.127041142000053s: None 2024-04-11T23:25:03.976862083Z [2024-04-11 23:25:03,976: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[407bad2e-8c05-4db3-9201-142d310db275] succeeded in 3.421392729999752s: None 2024-04-11T23:25:04.584438344Z [2024-04-11 23:25:04,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:25:04.587608536Z [2024-04-11 23:25:04,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:04.611170458Z [2024-04-11 23:25:04,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:25:04.613147073Z [2024-04-11 23:25:04,612: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:04.613316283Z [2024-04-11 23:25:04,613: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:04.613773367Z [2024-04-11 23:25:04,613: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:04.613803317Z [2024-04-11 23:25:04,613: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:25:04.614261527Z [2024-04-11 23:25:04,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:25:04.614530682Z [2024-04-11 23:25:04,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:04.719507181Z [2024-04-11 23:25:04,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:05.382019615Z [2024-04-11 23:25:05,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68df5b7b-3317-4386-b4fc-207f6864ac8a] succeeded in 2.1993372950000776s: None 2024-04-11T23:25:06.060900152Z [2024-04-11 23:25:06,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71e79fdb-cb63-4eff-863c-2a6dd5dc7029] received 2024-04-11T23:25:06.071405170Z [2024-04-11 23:25:06,071: INFO/ForkPoolWorker-15] [71e79fdb-cb63-4eff-863c-2a6dd5dc7029] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:25:06.338633950Z [2024-04-11 23:25:06,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:25:07.352078015Z [2024-04-11 23:25:07,351: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:25:07.355960037Z [2024-04-11 23:25:07,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:07.379285013Z [2024-04-11 23:25:07,378: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:25:07.380665275Z [2024-04-11 23:25:07,380: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:07.381063418Z [2024-04-11 23:25:07,380: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:07.381162347Z [2024-04-11 23:25:07,380: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:07.381357014Z [2024-04-11 23:25:07,381: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:25:07.381615558Z [2024-04-11 23:25:07,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:25:07.381624914Z [2024-04-11 23:25:07,381: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:07.462892210Z [2024-04-11 23:25:07,462: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:08.049217813Z [2024-04-11 23:25:08,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71e79fdb-cb63-4eff-863c-2a6dd5dc7029] succeeded in 1.9851143020000563s: None 2024-04-11T23:25:08.309263953Z [2024-04-11 23:25:08,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa80cee-bde0-4387-965c-ab230a1831a6] received 2024-04-11T23:25:08.320129452Z [2024-04-11 23:25:08,319: INFO/ForkPoolWorker-15] [2fa80cee-bde0-4387-965c-ab230a1831a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:08.567841257Z [2024-04-11 23:25:08,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:25:09.508005791Z [2024-04-11 23:25:09,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:25:09.510850286Z [2024-04-11 23:25:09,510: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:25:09.536064805Z [2024-04-11 23:25:09,535: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:25:09.537321439Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:25:09.537351273Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:25:09.537423886Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:25:09.537434566Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:25:09.537833311Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:25:09.537890692Z [2024-04-11 23:25:09,537: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:25:09.631129426Z [2024-04-11 23:25:09,630: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:25:10.137349134Z [2024-04-11 23:25:10,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fa80cee-bde0-4387-965c-ab230a1831a6] succeeded in 1.8249415660002342s: None 2024-04-11T23:26:00.802489041Z [2024-04-11 23:26:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445dcd95-fa9f-4338-9922-7d8b19c96f99] received 2024-04-11T23:26:00.806387117Z [2024-04-11 23:26:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a7a3f54-ab2d-4b04-8448-44e1258b6b82] received 2024-04-11T23:26:00.807889465Z [2024-04-11 23:26:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd79e33e-9766-4501-b10f-31c28d72ecdf] received 2024-04-11T23:26:00.814928371Z [2024-04-11 23:26:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de3c944f-e1f0-4b6d-8e5b-203d46483314] received 2024-04-11T23:26:00.818819272Z [2024-04-11 23:26:00,818: INFO/ForkPoolWorker-1] [fd79e33e-9766-4501-b10f-31c28d72ecdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:26:00.825014666Z [2024-04-11 23:26:00,824: INFO/ForkPoolWorker-15] [445dcd95-fa9f-4338-9922-7d8b19c96f99] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:26:00.829854525Z [2024-04-11 23:26:00,829: INFO/ForkPoolWorker-2] [de3c944f-e1f0-4b6d-8e5b-203d46483314] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:26:00.834819507Z [2024-04-11 23:26:00,834: INFO/ForkPoolWorker-16] [9a7a3f54-ab2d-4b04-8448-44e1258b6b82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:26:01.133793504Z [2024-04-11 23:26:01,131: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:26:01.169965123Z [2024-04-11 23:26:01,166: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:26:01.176820009Z [2024-04-11 23:26:01,174: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:26:01.186200491Z [2024-04-11 23:26:01,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:26:01.308262064Z [2024-04-11 23:26:01,307: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:26:01.311904631Z [2024-04-11 23:26:01,311: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:26:01.361228730Z [2024-04-11 23:26:01,361: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:26:01.368342590Z [2024-04-11 23:26:01,367: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:26:01.368647972Z [2024-04-11 23:26:01,368: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:26:01.368862491Z [2024-04-11 23:26:01,368: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:26:01.369390318Z [2024-04-11 23:26:01,369: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:26:01.429324321Z [2024-04-11 23:26:01,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:26:01.461146716Z [2024-04-11 23:26:01,460: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:26:01.933399055Z [2024-04-11 23:26:01,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[445dcd95-fa9f-4338-9922-7d8b19c96f99] succeeded in 1.1271533649996854s: None 2024-04-11T23:26:01.971513056Z [2024-04-11 23:26:01,971: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a7a3f54-ab2d-4b04-8448-44e1258b6b82] succeeded in 1.1618018649996884s: None 2024-04-11T23:26:02.200319171Z [2024-04-11 23:26:02,199: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:26:02.203259017Z [2024-04-11 23:26:02,202: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:26:02.229753570Z [2024-04-11 23:26:02,229: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:26:02.231553980Z [2024-04-11 23:26:02,231: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:26:02.231696503Z [2024-04-11 23:26:02,231: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:26:02.231903771Z [2024-04-11 23:26:02,231: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:26:02.232056752Z [2024-04-11 23:26:02,231: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:26:02.232780711Z [2024-04-11 23:26:02,232: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:26:02.232924208Z [2024-04-11 23:26:02,232: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:26:02.331389744Z [2024-04-11 23:26:02,331: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:26:02.492310849Z [2024-04-11 23:26:02,491: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:26:02.495099493Z [2024-04-11 23:26:02,494: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:26:02.520686929Z [2024-04-11 23:26:02,520: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:26:02.522021024Z [2024-04-11 23:26:02,521: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:26:02.522035284Z [2024-04-11 23:26:02,521: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:26:02.522191089Z [2024-04-11 23:26:02,522: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:26:02.522199770Z [2024-04-11 23:26:02,522: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:26:02.522509682Z [2024-04-11 23:26:02,522: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:26:02.522517451Z [2024-04-11 23:26:02,522: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:26:02.590294652Z [2024-04-11 23:26:02,590: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:26:03.727404760Z [2024-04-11 23:26:03,726: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[de3c944f-e1f0-4b6d-8e5b-203d46483314] succeeded in 2.910817410999698s: None 2024-04-11T23:26:04.491468947Z [2024-04-11 23:26:04,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd79e33e-9766-4501-b10f-31c28d72ecdf] succeeded in 3.682520971000031s: None 2024-04-11T23:27:00.293798673Z [2024-04-11 23:27:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7b6f9f4-d949-4be0-9481-aa118e47f5aa] received 2024-04-11T23:27:00.305223914Z [2024-04-11 23:27:00,304: INFO/ForkPoolWorker-15] [a7b6f9f4-d949-4be0-9481-aa118e47f5aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:27:00.308707213Z [2024-04-11 23:27:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[259be959-2a3d-48f0-931c-15e3db4bdb5b] received 2024-04-11T23:27:00.321192707Z [2024-04-11 23:27:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46e760a0-e71e-4bf8-87a9-b3a2ab21532e] received 2024-04-11T23:27:00.337159252Z [2024-04-11 23:27:00,336: INFO/ForkPoolWorker-16] [259be959-2a3d-48f0-931c-15e3db4bdb5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:27:00.339969460Z [2024-04-11 23:27:00,339: INFO/ForkPoolWorker-1] [46e760a0-e71e-4bf8-87a9-b3a2ab21532e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:27:00.592898548Z [2024-04-11 23:27:00,590: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:27:00.595521293Z [2024-04-11 23:27:00,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:27:00.620085090Z [2024-04-11 23:27:00,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:27:00.746508812Z [2024-04-11 23:27:00,746: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:27:00.749907420Z [2024-04-11 23:27:00,749: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:27:00.772733798Z [2024-04-11 23:27:00,772: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:27:00.773645077Z [2024-04-11 23:27:00,773: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:27:00.773788676Z [2024-04-11 23:27:00,773: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:27:00.773860200Z [2024-04-11 23:27:00,773: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:27:00.774100131Z [2024-04-11 23:27:00,773: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:27:00.856679277Z [2024-04-11 23:27:00,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:27:01.406973639Z [2024-04-11 23:27:01,406: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7b6f9f4-d949-4be0-9481-aa118e47f5aa] succeeded in 1.1093168099996547s: None 2024-04-11T23:27:01.583460805Z [2024-04-11 23:27:01,582: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:27:01.586403391Z [2024-04-11 23:27:01,585: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:27:01.602400491Z [2024-04-11 23:27:01,602: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:27:01.603637571Z [2024-04-11 23:27:01,603: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:27:01.603682524Z [2024-04-11 23:27:01,603: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:27:01.603799384Z [2024-04-11 23:27:01,603: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:27:01.603863045Z [2024-04-11 23:27:01,603: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:27:01.604558560Z [2024-04-11 23:27:01,604: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:27:01.604574860Z [2024-04-11 23:27:01,604: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:27:01.635725237Z [2024-04-11 23:27:01,635: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:27:01.638823296Z [2024-04-11 23:27:01,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:27:01.695359219Z [2024-04-11 23:27:01,695: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:27:01.699216695Z [2024-04-11 23:27:01,699: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:27:01.699777828Z [2024-04-11 23:27:01,699: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:27:01.700038164Z [2024-04-11 23:27:01,699: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:27:01.700187121Z [2024-04-11 23:27:01,700: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:27:01.701240717Z [2024-04-11 23:27:01,700: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:27:01.701591265Z [2024-04-11 23:27:01,701: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:27:01.713921486Z [2024-04-11 23:27:01,713: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:27:01.786950576Z [2024-04-11 23:27:01,786: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:27:03.255454088Z [2024-04-11 23:27:03,254: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46e760a0-e71e-4bf8-87a9-b3a2ab21532e] succeeded in 2.927597307999349s: None 2024-04-11T23:27:03.478490439Z [2024-04-11 23:27:03,478: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[259be959-2a3d-48f0-931c-15e3db4bdb5b] succeeded in 3.1484438579991547s: None 2024-04-11T23:28:00.414671571Z [2024-04-11 23:28:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a27e1110-6f40-4f4b-9a1d-b2ffb84baaf3] received 2024-04-11T23:28:00.421268868Z [2024-04-11 23:28:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52964bdb-0b8a-4269-9b23-1cc62386ce3c] received 2024-04-11T23:28:00.424095150Z [2024-04-11 23:28:00,423: INFO/ForkPoolWorker-15] [a27e1110-6f40-4f4b-9a1d-b2ffb84baaf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:28:00.424768044Z [2024-04-11 23:28:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a47f6ead-bbc8-4671-a7aa-404c80605fbf] received 2024-04-11T23:28:00.430649726Z [2024-04-11 23:28:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5e1bf16-7a03-4dcf-b70d-4778dea4fd9d] received 2024-04-11T23:28:00.432804432Z [2024-04-11 23:28:00,432: INFO/ForkPoolWorker-16] [52964bdb-0b8a-4269-9b23-1cc62386ce3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:28:00.442095709Z [2024-04-11 23:28:00,441: INFO/ForkPoolWorker-1] [a47f6ead-bbc8-4671-a7aa-404c80605fbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:28:00.444476978Z [2024-04-11 23:28:00,444: INFO/ForkPoolWorker-2] [d5e1bf16-7a03-4dcf-b70d-4778dea4fd9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:28:00.731169802Z [2024-04-11 23:28:00,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:28:00.740046910Z [2024-04-11 23:28:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:28:00.747114451Z [2024-04-11 23:28:00,742: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:28:01.034087693Z [2024-04-11 23:28:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:28:01.085038417Z [2024-04-11 23:28:01,084: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:28:01.176466117Z [2024-04-11 23:28:01,176: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:28:01.179808582Z [2024-04-11 23:28:01,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:28:01.213239960Z [2024-04-11 23:28:01,213: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:28:01.216517438Z [2024-04-11 23:28:01,216: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:28:01.216732323Z [2024-04-11 23:28:01,216: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:28:01.216886313Z [2024-04-11 23:28:01,216: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:28:01.217210786Z [2024-04-11 23:28:01,217: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:28:01.353267874Z [2024-04-11 23:28:01,353: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:28:01.721632437Z [2024-04-11 23:28:01,715: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a47f6ead-bbc8-4671-a7aa-404c80605fbf] succeeded in 1.2894638629995825s: None 2024-04-11T23:28:01.895394157Z [2024-04-11 23:28:01,894: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:28:01.898413614Z [2024-04-11 23:28:01,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:28:01.921906481Z [2024-04-11 23:28:01,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:28:01.923511046Z [2024-04-11 23:28:01,923: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:28:01.923613787Z [2024-04-11 23:28:01,923: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:28:01.923864852Z [2024-04-11 23:28:01,923: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:28:01.923987406Z [2024-04-11 23:28:01,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:28:01.924354871Z [2024-04-11 23:28:01,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:28:01.924538841Z [2024-04-11 23:28:01,924: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:28:01.942976009Z [2024-04-11 23:28:01,942: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52964bdb-0b8a-4269-9b23-1cc62386ce3c] succeeded in 1.5169024540000464s: None 2024-04-11T23:28:02.027516119Z [2024-04-11 23:28:02,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:28:02.038749405Z [2024-04-11 23:28:02,038: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:28:02.041676688Z [2024-04-11 23:28:02,041: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:28:02.065171446Z [2024-04-11 23:28:02,064: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:28:02.067108486Z [2024-04-11 23:28:02,066: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:28:02.067137884Z [2024-04-11 23:28:02,066: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:28:02.067405775Z [2024-04-11 23:28:02,067: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:28:02.067545697Z [2024-04-11 23:28:02,067: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:28:02.067998789Z [2024-04-11 23:28:02,067: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:28:02.068156440Z [2024-04-11 23:28:02,067: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:28:02.150122031Z [2024-04-11 23:28:02,149: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:28:03.386892738Z [2024-04-11 23:28:03,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a27e1110-6f40-4f4b-9a1d-b2ffb84baaf3] succeeded in 2.970139281000229s: None 2024-04-11T23:28:03.972597159Z [2024-04-11 23:28:03,972: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5e1bf16-7a03-4dcf-b70d-4778dea4fd9d] succeeded in 3.539307858999564s: None 2024-04-11T23:29:00.428273347Z [2024-04-11 23:29:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d0b50ad-3b9a-480f-a614-b9c9de175f31] received 2024-04-11T23:29:00.440255027Z [2024-04-11 23:29:00,440: INFO/ForkPoolWorker-15] [2d0b50ad-3b9a-480f-a614-b9c9de175f31] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:29:00.445357537Z [2024-04-11 23:29:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30da9276-456e-4045-aa88-035553d1f2b7] received 2024-04-11T23:29:00.447090833Z [2024-04-11 23:29:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6807010-7668-4765-9246-f8ff5d4b07e0] received 2024-04-11T23:29:00.454010645Z [2024-04-11 23:29:00,453: INFO/ForkPoolWorker-16] [30da9276-456e-4045-aa88-035553d1f2b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:29:00.462198278Z [2024-04-11 23:29:00,461: INFO/ForkPoolWorker-1] [f6807010-7668-4765-9246-f8ff5d4b07e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:29:00.709588778Z [2024-04-11 23:29:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:29:00.720248876Z [2024-04-11 23:29:00,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:29:00.728248866Z [2024-04-11 23:29:00,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:29:00.870466115Z [2024-04-11 23:29:00,870: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:29:00.874013914Z [2024-04-11 23:29:00,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:29:00.907065004Z [2024-04-11 23:29:00,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:29:00.908176778Z [2024-04-11 23:29:00,908: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:29:00.908326274Z [2024-04-11 23:29:00,908: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:29:00.908426316Z [2024-04-11 23:29:00,908: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:29:00.908646469Z [2024-04-11 23:29:00,908: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:29:00.981186351Z [2024-04-11 23:29:00,980: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:29:01.501814692Z [2024-04-11 23:29:01,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d0b50ad-3b9a-480f-a614-b9c9de175f31] succeeded in 1.0698659740000949s: None 2024-04-11T23:29:01.869694659Z [2024-04-11 23:29:01,869: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:29:01.872594808Z [2024-04-11 23:29:01,872: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:29:01.891639503Z [2024-04-11 23:29:01,891: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:29:01.891927567Z [2024-04-11 23:29:01,891: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:29:01.893041302Z [2024-04-11 23:29:01,892: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:29:01.893061947Z [2024-04-11 23:29:01,892: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:29:01.893143349Z [2024-04-11 23:29:01,893: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:29:01.893189290Z [2024-04-11 23:29:01,893: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:29:01.893365306Z [2024-04-11 23:29:01,893: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:29:01.893378163Z [2024-04-11 23:29:01,893: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:29:01.895041348Z [2024-04-11 23:29:01,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:29:01.919227119Z [2024-04-11 23:29:01,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:29:01.920285472Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:29:01.920422438Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:29:01.920561227Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:29:01.920628128Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:29:01.920851616Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:29:01.920940492Z [2024-04-11 23:29:01,920: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:29:01.962825304Z [2024-04-11 23:29:01,962: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:29:02.036788557Z [2024-04-11 23:29:02,036: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:29:03.401765380Z [2024-04-11 23:29:03,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6807010-7668-4765-9246-f8ff5d4b07e0] succeeded in 2.953020082999501s: None 2024-04-11T23:29:03.888877637Z [2024-04-11 23:29:03,888: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30da9276-456e-4045-aa88-035553d1f2b7] succeeded in 3.441790220999792s: None 2024-04-11T23:30:00.635250371Z [2024-04-11 23:30:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab7112b7-27c4-418d-80ad-df64b48049a4] received 2024-04-11T23:30:00.639996264Z [2024-04-11 23:30:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b0136cf-a14e-4f26-81b3-150aec59d1ec] received 2024-04-11T23:30:00.641770661Z [2024-04-11 23:30:00,641: INFO/ForkPoolWorker-15] [ab7112b7-27c4-418d-80ad-df64b48049a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:00.646205165Z [2024-04-11 23:30:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c886d766-356e-4dbd-9be4-b69d4329c633] received 2024-04-11T23:30:00.648876540Z [2024-04-11 23:30:00,648: INFO/ForkPoolWorker-16] [0b0136cf-a14e-4f26-81b3-150aec59d1ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:30:00.649140348Z [2024-04-11 23:30:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ab6e235-6bbb-48e5-b0e6-abb3784ef05b] received 2024-04-11T23:30:00.653840731Z [2024-04-11 23:30:00,653: INFO/ForkPoolWorker-1] [c886d766-356e-4dbd-9be4-b69d4329c633] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:30:00.654480298Z [2024-04-11 23:30:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14636cad-47f7-4a25-bc95-4f7a3c4bb89d] received 2024-04-11T23:30:00.676921532Z [2024-04-11 23:30:00,676: INFO/ForkPoolWorker-3] [14636cad-47f7-4a25-bc95-4f7a3c4bb89d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:30:00.685317569Z [2024-04-11 23:30:00,684: INFO/ForkPoolWorker-2] [5ab6e235-6bbb-48e5-b0e6-abb3784ef05b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:30:00.955481271Z [2024-04-11 23:30:00,949: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:30:00.990395656Z [2024-04-11 23:30:00,985: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:30:01.158471831Z [2024-04-11 23:30:01,154: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:30:01.234866427Z [2024-04-11 23:30:01,211: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:30:01.237923697Z [2024-04-11 23:30:01,220: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:30:01.619443292Z [2024-04-11 23:30:01,619: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:30:01.625577502Z [2024-04-11 23:30:01,625: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:01.676584825Z [2024-04-11 23:30:01,670: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:01.758304456Z [2024-04-11 23:30:01,758: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:30:01.764452615Z [2024-04-11 23:30:01,764: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:30:01.764485756Z [2024-04-11 23:30:01,764: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:30:01.764510710Z [2024-04-11 23:30:01,764: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:30:01.764724370Z [2024-04-11 23:30:01,764: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:30:01.932663290Z [2024-04-11 23:30:01,932: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:02.371550428Z [2024-04-11 23:30:02,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b0136cf-a14e-4f26-81b3-150aec59d1ec] succeeded in 1.7296061260003626s: None 2024-04-11T23:30:02.548347316Z [2024-04-11 23:30:02,548: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T23:30:02.555518863Z [2024-04-11 23:30:02,555: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:02.577549856Z [2024-04-11 23:30:02,577: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5ab6e235-6bbb-48e5-b0e6-abb3784ef05b] succeeded in 1.9235667009997997s: None 2024-04-11T23:30:02.582799857Z [2024-04-11 23:30:02,582: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:30:02.584246708Z [2024-04-11 23:30:02,584: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:02.584421220Z [2024-04-11 23:30:02,584: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:02.584628117Z [2024-04-11 23:30:02,584: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:02.584804273Z [2024-04-11 23:30:02,584: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T23:30:02.585124695Z [2024-04-11 23:30:02,584: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:30:02.585260754Z [2024-04-11 23:30:02,585: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:02.652772059Z [2024-04-11 23:30:02,652: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:30:02.655687029Z [2024-04-11 23:30:02,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:02.659485017Z [2024-04-11 23:30:02,659: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:02.690101555Z [2024-04-11 23:30:02,689: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:30:02.694422181Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:02.694435381Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:02.694559782Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:02.694688727Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:30:02.694995682Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:30:02.695195087Z [2024-04-11 23:30:02,694: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:02.775834327Z [2024-04-11 23:30:02,775: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:02.956949590Z [2024-04-11 23:30:02,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:30:02.959913390Z [2024-04-11 23:30:02,959: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:02.988869191Z [2024-04-11 23:30:02,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:30:02.990157996Z [2024-04-11 23:30:02,989: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:02.990296637Z [2024-04-11 23:30:02,990: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:02.990498378Z [2024-04-11 23:30:02,990: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:02.990617788Z [2024-04-11 23:30:02,990: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:30:02.990928175Z [2024-04-11 23:30:02,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:30:02.991036454Z [2024-04-11 23:30:02,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:03.084827409Z [2024-04-11 23:30:03,084: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:03.629896384Z [2024-04-11 23:30:03,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab7112b7-27c4-418d-80ad-df64b48049a4] succeeded in 2.9928889880002316s: None 2024-04-11T23:30:04.516939283Z [2024-04-11 23:30:04,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33a40e2a-9a46-47ec-b90a-86961a439687] received 2024-04-11T23:30:04.526441304Z [2024-04-11 23:30:04,526: INFO/ForkPoolWorker-15] [33a40e2a-9a46-47ec-b90a-86961a439687] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:04.661578736Z [2024-04-11 23:30:04,661: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c886d766-356e-4dbd-9be4-b69d4329c633] succeeded in 4.013324640000064s: None 2024-04-11T23:30:04.801148032Z [2024-04-11 23:30:04,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:30:04.952045242Z [2024-04-11 23:30:04,951: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[14636cad-47f7-4a25-bc95-4f7a3c4bb89d] succeeded in 4.292720333000034s: None 2024-04-11T23:30:05.953033829Z [2024-04-11 23:30:05,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:30:05.956889543Z [2024-04-11 23:30:05,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:05.999925103Z [2024-04-11 23:30:05,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:30:06.001772332Z [2024-04-11 23:30:06,001: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:06.001790799Z [2024-04-11 23:30:06,001: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:06.003655225Z [2024-04-11 23:30:06,001: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:06.003754001Z [2024-04-11 23:30:06,003: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:30:06.004086931Z [2024-04-11 23:30:06,003: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:30:06.004097932Z [2024-04-11 23:30:06,004: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:06.075215316Z [2024-04-11 23:30:06,074: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:06.673455173Z [2024-04-11 23:30:06,672: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33a40e2a-9a46-47ec-b90a-86961a439687] succeeded in 2.1516055940001024s: None 2024-04-11T23:30:06.933330143Z [2024-04-11 23:30:06,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00a42084-a21f-4072-8cdd-3562ae93b79e] received 2024-04-11T23:30:06.945009108Z [2024-04-11 23:30:06,944: INFO/ForkPoolWorker-15] [00a42084-a21f-4072-8cdd-3562ae93b79e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:30:07.201949830Z [2024-04-11 23:30:07,198: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:30:08.253346339Z [2024-04-11 23:30:08,252: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:30:08.256305226Z [2024-04-11 23:30:08,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:08.274871486Z [2024-04-11 23:30:08,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:30:08.276093398Z [2024-04-11 23:30:08,275: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:08.276160610Z [2024-04-11 23:30:08,276: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:08.276366162Z [2024-04-11 23:30:08,276: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:08.276452199Z [2024-04-11 23:30:08,276: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:30:08.277116301Z [2024-04-11 23:30:08,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:30:08.277187940Z [2024-04-11 23:30:08,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:08.368064913Z [2024-04-11 23:30:08,367: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:09.000254333Z [2024-04-11 23:30:08,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00a42084-a21f-4072-8cdd-3562ae93b79e] succeeded in 2.063626146000388s: None 2024-04-11T23:30:09.609998848Z [2024-04-11 23:30:09,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7abcd40a-6805-4bdb-a074-2e690747da4e] received 2024-04-11T23:30:09.619864204Z [2024-04-11 23:30:09,619: INFO/ForkPoolWorker-15] [7abcd40a-6805-4bdb-a074-2e690747da4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:09.892453873Z [2024-04-11 23:30:09,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:30:10.987601014Z [2024-04-11 23:30:10,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:30:10.990999561Z [2024-04-11 23:30:10,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:30:11.024998039Z [2024-04-11 23:30:11,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:30:11.027006958Z [2024-04-11 23:30:11,026: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:30:11.027101479Z [2024-04-11 23:30:11,026: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:30:11.027383055Z [2024-04-11 23:30:11,027: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:30:11.027533242Z [2024-04-11 23:30:11,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:30:11.027945547Z [2024-04-11 23:30:11,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:30:11.028090123Z [2024-04-11 23:30:11,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:30:11.128850124Z [2024-04-11 23:30:11,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:30:11.790459797Z [2024-04-11 23:30:11,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7abcd40a-6805-4bdb-a074-2e690747da4e] succeeded in 2.1783251980004934s: None 2024-04-11T23:31:00.555648021Z [2024-04-11 23:31:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd63c6cc-6a32-4d2a-bbfe-7ae94ccc2f52] received 2024-04-11T23:31:00.557042541Z [2024-04-11 23:31:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d700cfa-d624-457e-b766-7183b6d0d80a] received 2024-04-11T23:31:00.566849051Z [2024-04-11 23:31:00,566: INFO/ForkPoolWorker-15] [bd63c6cc-6a32-4d2a-bbfe-7ae94ccc2f52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:31:00.567296364Z [2024-04-11 23:31:00,567: INFO/ForkPoolWorker-16] [6d700cfa-d624-457e-b766-7183b6d0d80a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:31:00.572776538Z [2024-04-11 23:31:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0c140f4-5f9a-48cb-8721-553ba3aba5d2] received 2024-04-11T23:31:00.578024279Z [2024-04-11 23:31:00,577: INFO/ForkPoolWorker-1] [b0c140f4-5f9a-48cb-8721-553ba3aba5d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:31:00.833337336Z [2024-04-11 23:31:00,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:31:00.840569445Z [2024-04-11 23:31:00,837: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:31:00.850006103Z [2024-04-11 23:31:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:31:00.971568441Z [2024-04-11 23:31:00,971: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:31:00.975151761Z [2024-04-11 23:31:00,974: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:31:00.999729736Z [2024-04-11 23:31:00,999: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:31:01.003867852Z [2024-04-11 23:31:01,003: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:31:01.003925750Z [2024-04-11 23:31:01,003: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:31:01.003992488Z [2024-04-11 23:31:01,003: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:31:01.004385840Z [2024-04-11 23:31:01,004: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:31:01.098665446Z [2024-04-11 23:31:01,098: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:31:01.689525553Z [2024-04-11 23:31:01,689: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0c140f4-5f9a-48cb-8721-553ba3aba5d2] succeeded in 1.1155282380004792s: None 2024-04-11T23:31:01.880796536Z [2024-04-11 23:31:01,880: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:31:01.883695416Z [2024-04-11 23:31:01,883: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:31:01.910700029Z [2024-04-11 23:31:01,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:31:01.911976819Z [2024-04-11 23:31:01,911: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:31:01.911987421Z [2024-04-11 23:31:01,911: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:31:01.912113831Z [2024-04-11 23:31:01,911: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:31:01.912122994Z [2024-04-11 23:31:01,912: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:31:01.912410328Z [2024-04-11 23:31:01,912: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:31:01.912455845Z [2024-04-11 23:31:01,912: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:31:01.932990459Z [2024-04-11 23:31:01,932: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:31:01.935924985Z [2024-04-11 23:31:01,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:31:01.957196777Z [2024-04-11 23:31:01,956: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:31:01.958464850Z [2024-04-11 23:31:01,958: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:31:01.958856588Z [2024-04-11 23:31:01,958: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:31:01.959197940Z [2024-04-11 23:31:01,958: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:31:01.959225203Z [2024-04-11 23:31:01,959: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:31:01.959410614Z [2024-04-11 23:31:01,959: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:31:01.959571068Z [2024-04-11 23:31:01,959: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:31:01.993389688Z [2024-04-11 23:31:01,993: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:31:02.039070202Z [2024-04-11 23:31:02,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:31:03.425694424Z [2024-04-11 23:31:03,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd63c6cc-6a32-4d2a-bbfe-7ae94ccc2f52] succeeded in 2.8670231369997055s: None 2024-04-11T23:31:04.923731192Z [2024-04-11 23:31:04,923: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d700cfa-d624-457e-b766-7183b6d0d80a] succeeded in 4.362290949999988s: None 2024-04-11T23:32:00.478014507Z [2024-04-11 23:32:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6408a9d2-169a-4ebd-a099-59e533c0c888] received 2024-04-11T23:32:00.481525089Z [2024-04-11 23:32:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[606197f3-c211-4b1e-806b-0cfe7262f6bc] received 2024-04-11T23:32:00.485275654Z [2024-04-11 23:32:00,485: INFO/ForkPoolWorker-15] [6408a9d2-169a-4ebd-a099-59e533c0c888] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:32:00.497530365Z [2024-04-11 23:32:00,497: INFO/ForkPoolWorker-16] [606197f3-c211-4b1e-806b-0cfe7262f6bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:32:00.498166428Z [2024-04-11 23:32:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a94e0f6-8c6a-4a5e-8d3c-5f1295b6667b] received 2024-04-11T23:32:00.506205248Z [2024-04-11 23:32:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbfa36c8-6c6a-434f-8dc7-49fa5eb6375c] received 2024-04-11T23:32:00.511052150Z [2024-04-11 23:32:00,510: INFO/ForkPoolWorker-1] [0a94e0f6-8c6a-4a5e-8d3c-5f1295b6667b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:32:00.515863561Z [2024-04-11 23:32:00,515: INFO/ForkPoolWorker-2] [bbfa36c8-6c6a-434f-8dc7-49fa5eb6375c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:32:00.847924082Z [2024-04-11 23:32:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:32:00.868434623Z [2024-04-11 23:32:00,864: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:32:00.966697687Z [2024-04-11 23:32:00,963: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:32:01.011149863Z [2024-04-11 23:32:01,010: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:32:01.016669131Z [2024-04-11 23:32:01,016: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:32:01.055379510Z [2024-04-11 23:32:01,055: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:32:01.057016635Z [2024-04-11 23:32:01,056: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:32:01.057246393Z [2024-04-11 23:32:01,056: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:32:01.057424184Z [2024-04-11 23:32:01,057: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:32:01.058069942Z [2024-04-11 23:32:01,057: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:32:01.192174502Z [2024-04-11 23:32:01,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:32:01.210725764Z [2024-04-11 23:32:01,210: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:32:01.213081827Z [2024-04-11 23:32:01,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:32:01.996778275Z [2024-04-11 23:32:01,996: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a94e0f6-8c6a-4a5e-8d3c-5f1295b6667b] succeeded in 1.496236011000292s: None 2024-04-11T23:32:02.148333688Z [2024-04-11 23:32:02,147: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6408a9d2-169a-4ebd-a099-59e533c0c888] succeeded in 1.6684283260001394s: None 2024-04-11T23:32:02.379989716Z [2024-04-11 23:32:02,379: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:32:02.382762986Z [2024-04-11 23:32:02,382: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:32:02.418262603Z [2024-04-11 23:32:02,417: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:32:02.420157102Z [2024-04-11 23:32:02,419: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:32:02.420255345Z [2024-04-11 23:32:02,420: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:32:02.420542606Z [2024-04-11 23:32:02,420: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:32:02.420727366Z [2024-04-11 23:32:02,420: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:32:02.421175090Z [2024-04-11 23:32:02,420: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:32:02.421306703Z [2024-04-11 23:32:02,421: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:32:02.501297056Z [2024-04-11 23:32:02,500: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:32:02.870585535Z [2024-04-11 23:32:02,870: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:32:02.874212156Z [2024-04-11 23:32:02,873: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:32:02.911496907Z [2024-04-11 23:32:02,911: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:32:02.914192812Z [2024-04-11 23:32:02,913: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:32:02.914539245Z [2024-04-11 23:32:02,914: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:32:02.914993117Z [2024-04-11 23:32:02,914: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:32:02.915436892Z [2024-04-11 23:32:02,915: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:32:02.916177572Z [2024-04-11 23:32:02,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:32:02.917312523Z [2024-04-11 23:32:02,916: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:32:03.011551633Z [2024-04-11 23:32:03,011: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:32:04.488071369Z [2024-04-11 23:32:04,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bbfa36c8-6c6a-434f-8dc7-49fa5eb6375c] succeeded in 3.9775369720000526s: None 2024-04-11T23:32:04.993656369Z [2024-04-11 23:32:04,993: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[606197f3-c211-4b1e-806b-0cfe7262f6bc] succeeded in 4.50817501200072s: None 2024-04-11T23:33:00.672273663Z [2024-04-11 23:33:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc2cab6-a7a8-4e4c-b556-b35f40aabf2e] received 2024-04-11T23:33:00.676839741Z [2024-04-11 23:33:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cec41aa4-785e-43b6-849a-d3ab8e888e1b] received 2024-04-11T23:33:00.687400168Z [2024-04-11 23:33:00,687: INFO/ForkPoolWorker-16] [cec41aa4-785e-43b6-849a-d3ab8e888e1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:33:00.688354778Z [2024-04-11 23:33:00,687: INFO/ForkPoolWorker-15] [dbc2cab6-a7a8-4e4c-b556-b35f40aabf2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:33:00.690723713Z [2024-04-11 23:33:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3a90143-f9d0-47e1-a755-e316e62ab776] received 2024-04-11T23:33:00.702351551Z [2024-04-11 23:33:00,702: INFO/ForkPoolWorker-1] [b3a90143-f9d0-47e1-a755-e316e62ab776] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:33:00.991235696Z [2024-04-11 23:33:00,987: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:33:01.283624200Z [2024-04-11 23:33:01,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:33:01.286795528Z [2024-04-11 23:33:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:33:01.428272279Z [2024-04-11 23:33:01,427: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:33:01.432258035Z [2024-04-11 23:33:01,431: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:33:01.470334652Z [2024-04-11 23:33:01,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:33:01.473460195Z [2024-04-11 23:33:01,473: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:33:01.473831170Z [2024-04-11 23:33:01,473: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:33:01.474157498Z [2024-04-11 23:33:01,474: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:33:01.474516957Z [2024-04-11 23:33:01,474: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:33:01.590765463Z [2024-04-11 23:33:01,590: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:33:02.247773719Z [2024-04-11 23:33:02,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cec41aa4-785e-43b6-849a-d3ab8e888e1b] succeeded in 1.5677514909993988s: None 2024-04-11T23:33:02.447365494Z [2024-04-11 23:33:02,446: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:33:02.450128907Z [2024-04-11 23:33:02,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:33:02.477545517Z [2024-04-11 23:33:02,477: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:33:02.480853618Z [2024-04-11 23:33:02,480: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:33:02.480873753Z [2024-04-11 23:33:02,480: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:33:02.480998191Z [2024-04-11 23:33:02,480: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:33:02.481019656Z [2024-04-11 23:33:02,480: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:33:02.481584959Z [2024-04-11 23:33:02,481: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:33:02.481597715Z [2024-04-11 23:33:02,481: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:33:02.544097296Z [2024-04-11 23:33:02,543: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:33:02.583865972Z [2024-04-11 23:33:02,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:33:02.588547806Z [2024-04-11 23:33:02,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:33:02.608941081Z [2024-04-11 23:33:02,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:33:02.610476265Z [2024-04-11 23:33:02,610: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:33:02.610555656Z [2024-04-11 23:33:02,610: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:33:02.610713128Z [2024-04-11 23:33:02,610: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:33:02.610770072Z [2024-04-11 23:33:02,610: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:33:02.611112378Z [2024-04-11 23:33:02,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:33:02.611136435Z [2024-04-11 23:33:02,611: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:33:02.696968927Z [2024-04-11 23:33:02,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:33:04.128694559Z [2024-04-11 23:33:04,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbc2cab6-a7a8-4e4c-b556-b35f40aabf2e] succeeded in 3.453837556000508s: None 2024-04-11T23:33:05.415155853Z [2024-04-11 23:33:05,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3a90143-f9d0-47e1-a755-e316e62ab776] succeeded in 4.722638540999469s: None 2024-04-11T23:34:00.841348889Z [2024-04-11 23:34:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71219dac-7e5e-4fd0-b3ce-d30b0ed70904] received 2024-04-11T23:34:00.848657000Z [2024-04-11 23:34:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b7fc25e-a8fb-4900-8939-c38d075a8b0a] received 2024-04-11T23:34:00.850918393Z [2024-04-11 23:34:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d063f53-381a-415c-b93b-c480e5ce03c0] received 2024-04-11T23:34:00.851470832Z [2024-04-11 23:34:00,851: INFO/ForkPoolWorker-15] [71219dac-7e5e-4fd0-b3ce-d30b0ed70904] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:34:00.860656456Z [2024-04-11 23:34:00,860: INFO/ForkPoolWorker-16] [6b7fc25e-a8fb-4900-8939-c38d075a8b0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:34:00.861227851Z [2024-04-11 23:34:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51b7e36c-8f66-4881-8fd4-dcf820785d28] received 2024-04-11T23:34:00.899524138Z [2024-04-11 23:34:00,899: INFO/ForkPoolWorker-1] [6d063f53-381a-415c-b93b-c480e5ce03c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:34:00.901446549Z [2024-04-11 23:34:00,901: INFO/ForkPoolWorker-2] [51b7e36c-8f66-4881-8fd4-dcf820785d28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:34:01.331050643Z [2024-04-11 23:34:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:34:01.391220093Z [2024-04-11 23:34:01,361: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:34:01.518019629Z [2024-04-11 23:34:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:34:01.619687147Z [2024-04-11 23:34:01,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:34:01.724450147Z [2024-04-11 23:34:01,718: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:34:01.724471052Z [2024-04-11 23:34:01,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:34:01.807728960Z [2024-04-11 23:34:01,807: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:34:01.820310987Z [2024-04-11 23:34:01,820: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:34:01.820353448Z [2024-04-11 23:34:01,820: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:34:01.820435253Z [2024-04-11 23:34:01,820: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:34:01.820609849Z [2024-04-11 23:34:01,820: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:34:01.951006845Z [2024-04-11 23:34:01,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:34:02.088193874Z [2024-04-11 23:34:02,087: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:34:02.892531281Z [2024-04-11 23:34:02,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d063f53-381a-415c-b93b-c480e5ce03c0] succeeded in 2.038453971999843s: None 2024-04-11T23:34:03.292711061Z [2024-04-11 23:34:03,292: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:34:03.295883406Z [2024-04-11 23:34:03,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:34:03.313205183Z [2024-04-11 23:34:03,313: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:34:03.314678458Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:34:03.314685659Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:34:03.314689439Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:34:03.314693116Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:34:03.314696107Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:34:03.314699276Z [2024-04-11 23:34:03,314: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:34:03.325798318Z [2024-04-11 23:34:03,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71219dac-7e5e-4fd0-b3ce-d30b0ed70904] succeeded in 2.482585829000527s: None 2024-04-11T23:34:03.382776059Z [2024-04-11 23:34:03,382: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:34:03.396171240Z [2024-04-11 23:34:03,395: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:34:03.399417626Z [2024-04-11 23:34:03,399: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:34:03.428198838Z [2024-04-11 23:34:03,427: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:34:03.429992039Z [2024-04-11 23:34:03,429: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:34:03.430424806Z [2024-04-11 23:34:03,429: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:34:03.430666841Z [2024-04-11 23:34:03,430: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:34:03.430825259Z [2024-04-11 23:34:03,430: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:34:03.431259003Z [2024-04-11 23:34:03,431: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:34:03.431632296Z [2024-04-11 23:34:03,431: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:34:03.513676156Z [2024-04-11 23:34:03,513: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:34:05.121505186Z [2024-04-11 23:34:05,121: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[51b7e36c-8f66-4881-8fd4-dcf820785d28] succeeded in 4.24630551700011s: None 2024-04-11T23:34:05.261349664Z [2024-04-11 23:34:05,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b7fc25e-a8fb-4900-8939-c38d075a8b0a] succeeded in 4.410437962999822s: None 2024-04-11T23:35:01.053387539Z [2024-04-11 23:35:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0255959-3432-42b6-bc9b-ab635e5cddde] received 2024-04-11T23:35:01.061841122Z [2024-04-11 23:35:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a913122-3e23-42b3-b725-778452473535] received 2024-04-11T23:35:01.065851222Z [2024-04-11 23:35:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[612e927c-42f0-4d13-8f6c-d960912cba08] received 2024-04-11T23:35:01.067735320Z [2024-04-11 23:35:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[713600c7-3640-4c3b-a667-0c0580f2bc6d] received 2024-04-11T23:35:01.075340593Z [2024-04-11 23:35:01,075: INFO/ForkPoolWorker-1] [612e927c-42f0-4d13-8f6c-d960912cba08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:35:01.076144184Z [2024-04-11 23:35:01,075: INFO/ForkPoolWorker-16] [2a913122-3e23-42b3-b725-778452473535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:35:01.078785939Z [2024-04-11 23:35:01,078: INFO/ForkPoolWorker-2] [713600c7-3640-4c3b-a667-0c0580f2bc6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:35:01.085100238Z [2024-04-11 23:35:01,084: INFO/ForkPoolWorker-15] [c0255959-3432-42b6-bc9b-ab635e5cddde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:01.358101082Z [2024-04-11 23:35:01,355: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:35:01.397101111Z [2024-04-11 23:35:01,394: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:35:01.422523875Z [2024-04-11 23:35:01,418: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:35:01.431611325Z [2024-04-11 23:35:01,427: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:35:01.518215514Z [2024-04-11 23:35:01,517: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:35:01.522052493Z [2024-04-11 23:35:01,521: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:01.580715070Z [2024-04-11 23:35:01,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:35:01.585297539Z [2024-04-11 23:35:01,584: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:35:01.585774871Z [2024-04-11 23:35:01,585: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:35:01.585837152Z [2024-04-11 23:35:01,585: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:35:01.586619869Z [2024-04-11 23:35:01,586: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:35:01.737446804Z [2024-04-11 23:35:01,737: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:02.250450050Z [2024-04-11 23:35:02,250: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[713600c7-3640-4c3b-a667-0c0580f2bc6d] succeeded in 1.1767311880003035s: None 2024-04-11T23:35:02.608164503Z [2024-04-11 23:35:02,607: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:35:02.610881581Z [2024-04-11 23:35:02,610: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:02.620300648Z [2024-04-11 23:35:02,619: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:35:02.624440007Z [2024-04-11 23:35:02,624: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:02.633167085Z [2024-04-11 23:35:02,632: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:35:02.635577741Z [2024-04-11 23:35:02,635: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:02.635744568Z [2024-04-11 23:35:02,635: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:02.636003154Z [2024-04-11 23:35:02,635: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:02.636953965Z [2024-04-11 23:35:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:35:02.637541495Z [2024-04-11 23:35:02,637: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:35:02.638232937Z [2024-04-11 23:35:02,637: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:02.654643463Z [2024-04-11 23:35:02,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:35:02.656285100Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:02.656416142Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:02.656589777Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:02.656705512Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:35:02.656960517Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:35:02.657042126Z [2024-04-11 23:35:02,656: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:02.676720219Z [2024-04-11 23:35:02,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:35:02.679754249Z [2024-04-11 23:35:02,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:02.697835881Z [2024-04-11 23:35:02,697: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:35:02.698864012Z [2024-04-11 23:35:02,698: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:02.699025375Z [2024-04-11 23:35:02,698: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:02.699183505Z [2024-04-11 23:35:02,699: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:02.699262864Z [2024-04-11 23:35:02,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:35:02.699540663Z [2024-04-11 23:35:02,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:35:02.699661419Z [2024-04-11 23:35:02,699: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:02.705997865Z [2024-04-11 23:35:02,705: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:02.744997753Z [2024-04-11 23:35:02,744: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:02.780720201Z [2024-04-11 23:35:02,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:03.346254277Z [2024-04-11 23:35:03,345: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0255959-3432-42b6-bc9b-ab635e5cddde] succeeded in 2.2839918820000094s: None 2024-04-11T23:35:03.786915110Z [2024-04-11 23:35:03,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f18bd9cd-eb01-4a81-b436-a3c3c3efa75e] received 2024-04-11T23:35:03.798445072Z [2024-04-11 23:35:03,798: INFO/ForkPoolWorker-15] [f18bd9cd-eb01-4a81-b436-a3c3c3efa75e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:04.183874398Z [2024-04-11 23:35:04,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:35:04.249580832Z [2024-04-11 23:35:04,249: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a913122-3e23-42b3-b725-778452473535] succeeded in 3.1856453739992503s: None 2024-04-11T23:35:04.488747322Z [2024-04-11 23:35:04,481: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[612e927c-42f0-4d13-8f6c-d960912cba08] succeeded in 3.414761277999787s: None 2024-04-11T23:35:05.188789344Z [2024-04-11 23:35:05,188: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:35:05.191874410Z [2024-04-11 23:35:05,191: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:05.215309754Z [2024-04-11 23:35:05,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:35:05.216623486Z [2024-04-11 23:35:05,216: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:05.216713969Z [2024-04-11 23:35:05,216: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:05.216882527Z [2024-04-11 23:35:05,216: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:05.216927640Z [2024-04-11 23:35:05,216: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:35:05.217186145Z [2024-04-11 23:35:05,217: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:35:05.217505293Z [2024-04-11 23:35:05,217: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:05.304986958Z [2024-04-11 23:35:05,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:05.954370050Z [2024-04-11 23:35:05,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f18bd9cd-eb01-4a81-b436-a3c3c3efa75e] succeeded in 2.1646340820007026s: None 2024-04-11T23:35:06.596516032Z [2024-04-11 23:35:06,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea9dddb-ed5f-44e6-8e82-91b572841a5f] received 2024-04-11T23:35:06.604397459Z [2024-04-11 23:35:06,604: INFO/ForkPoolWorker-15] [6ea9dddb-ed5f-44e6-8e82-91b572841a5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:35:06.858199375Z [2024-04-11 23:35:06,855: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:35:07.784693304Z [2024-04-11 23:35:07,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:35:07.801343627Z [2024-04-11 23:35:07,800: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:07.846157177Z [2024-04-11 23:35:07,845: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:35:07.849229437Z [2024-04-11 23:35:07,849: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:07.849374379Z [2024-04-11 23:35:07,849: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:07.849541736Z [2024-04-11 23:35:07,849: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:07.849653956Z [2024-04-11 23:35:07,849: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:35:07.849900604Z [2024-04-11 23:35:07,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:35:07.850255148Z [2024-04-11 23:35:07,850: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:07.950045227Z [2024-04-11 23:35:07,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:08.557378866Z [2024-04-11 23:35:08,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ea9dddb-ed5f-44e6-8e82-91b572841a5f] succeeded in 1.9582678349997877s: None 2024-04-11T23:35:08.903933190Z [2024-04-11 23:35:08,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b11754bb-9e90-4ab4-9d01-e905e74adb1b] received 2024-04-11T23:35:08.913984661Z [2024-04-11 23:35:08,913: INFO/ForkPoolWorker-15] [b11754bb-9e90-4ab4-9d01-e905e74adb1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:09.147483887Z [2024-04-11 23:35:09,144: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:35:10.072520082Z [2024-04-11 23:35:10,070: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:35:10.080678760Z [2024-04-11 23:35:10,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:35:10.117397375Z [2024-04-11 23:35:10,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:35:10.120075372Z [2024-04-11 23:35:10,119: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:35:10.120252298Z [2024-04-11 23:35:10,120: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:35:10.120943069Z [2024-04-11 23:35:10,120: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:35:10.121109608Z [2024-04-11 23:35:10,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:35:10.121442024Z [2024-04-11 23:35:10,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:35:10.121574629Z [2024-04-11 23:35:10,121: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:35:10.198302509Z [2024-04-11 23:35:10,198: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:35:10.794291912Z [2024-04-11 23:35:10,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b11754bb-9e90-4ab4-9d01-e905e74adb1b] succeeded in 1.8885468580001543s: None 2024-04-11T23:36:00.964368680Z [2024-04-11 23:36:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ff014c0-40cd-4307-af12-43a4786e7b76] received 2024-04-11T23:36:00.966391886Z [2024-04-11 23:36:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24f6ff7e-2dac-407d-9bbe-160b86f07bf0] received 2024-04-11T23:36:00.972821640Z [2024-04-11 23:36:00,972: INFO/ForkPoolWorker-16] [24f6ff7e-2dac-407d-9bbe-160b86f07bf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:36:00.979667138Z [2024-04-11 23:36:00,979: INFO/ForkPoolWorker-15] [4ff014c0-40cd-4307-af12-43a4786e7b76] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:36:00.980090218Z [2024-04-11 23:36:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4a1e8b2-b27f-41fd-9014-1c843d5851f5] received 2024-04-11T23:36:00.986922765Z [2024-04-11 23:36:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dd9a978-a8e4-427e-9401-b16a38460d71] received 2024-04-11T23:36:00.992906623Z [2024-04-11 23:36:00,992: INFO/ForkPoolWorker-1] [e4a1e8b2-b27f-41fd-9014-1c843d5851f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:36:00.993727210Z [2024-04-11 23:36:00,993: INFO/ForkPoolWorker-2] [4dd9a978-a8e4-427e-9401-b16a38460d71] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:36:01.260021489Z [2024-04-11 23:36:01,257: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:36:01.260713706Z [2024-04-11 23:36:01,257: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:36:01.284180809Z [2024-04-11 23:36:01,278: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:36:01.299653737Z [2024-04-11 23:36:01,297: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:36:01.407798430Z [2024-04-11 23:36:01,407: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:36:01.411908895Z [2024-04-11 23:36:01,411: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:36:01.450710271Z [2024-04-11 23:36:01,450: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:36:01.456832064Z [2024-04-11 23:36:01,456: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:36:01.456970750Z [2024-04-11 23:36:01,456: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:36:01.457006957Z [2024-04-11 23:36:01,456: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:36:01.457199686Z [2024-04-11 23:36:01,457: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:36:01.559547477Z [2024-04-11 23:36:01,559: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:36:01.560271120Z [2024-04-11 23:36:01,560: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:36:02.062084576Z [2024-04-11 23:36:02,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ff014c0-40cd-4307-af12-43a4786e7b76] succeeded in 1.0947538840000561s: None 2024-04-11T23:36:02.122681484Z [2024-04-11 23:36:02,121: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4dd9a978-a8e4-427e-9401-b16a38460d71] succeeded in 1.1341133429996262s: None 2024-04-11T23:36:02.423025485Z [2024-04-11 23:36:02,422: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:36:02.426327530Z [2024-04-11 23:36:02,425: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:36:02.449359712Z [2024-04-11 23:36:02,449: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:36:02.450666365Z [2024-04-11 23:36:02,450: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:36:02.450802748Z [2024-04-11 23:36:02,450: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:36:02.450988109Z [2024-04-11 23:36:02,450: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:36:02.451094716Z [2024-04-11 23:36:02,450: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:36:02.451342628Z [2024-04-11 23:36:02,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:36:02.451467527Z [2024-04-11 23:36:02,451: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:36:02.483594620Z [2024-04-11 23:36:02,483: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:36:02.486365144Z [2024-04-11 23:36:02,486: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:36:02.511763304Z [2024-04-11 23:36:02,511: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:36:02.515651524Z [2024-04-11 23:36:02,515: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:36:02.515796574Z [2024-04-11 23:36:02,515: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:36:02.516018766Z [2024-04-11 23:36:02,515: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:36:02.516150945Z [2024-04-11 23:36:02,515: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:36:02.516480284Z [2024-04-11 23:36:02,516: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:36:02.516688052Z [2024-04-11 23:36:02,516: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:36:02.525541797Z [2024-04-11 23:36:02,525: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:36:02.600694913Z [2024-04-11 23:36:02,600: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:36:04.098774199Z [2024-04-11 23:36:04,098: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4a1e8b2-b27f-41fd-9014-1c843d5851f5] succeeded in 3.116709373000049s: None 2024-04-11T23:36:04.254469690Z [2024-04-11 23:36:04,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24f6ff7e-2dac-407d-9bbe-160b86f07bf0] succeeded in 3.2864963160000116s: None 2024-04-11T23:37:00.308537426Z [2024-04-11 23:37:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c4abe06-bad8-4b4e-8044-c295a556302b] received 2024-04-11T23:37:00.317182633Z [2024-04-11 23:37:00,316: INFO/ForkPoolWorker-15] [2c4abe06-bad8-4b4e-8044-c295a556302b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:37:00.320521443Z [2024-04-11 23:37:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad84f873-ac87-4157-b7a4-d3b4ad78fb94] received 2024-04-11T23:37:00.325525596Z [2024-04-11 23:37:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ada2ba8a-f0c9-45e5-af82-e0a81d883c8d] received 2024-04-11T23:37:00.334975119Z [2024-04-11 23:37:00,334: INFO/ForkPoolWorker-1] [ada2ba8a-f0c9-45e5-af82-e0a81d883c8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:37:00.337937326Z [2024-04-11 23:37:00,337: INFO/ForkPoolWorker-16] [ad84f873-ac87-4157-b7a4-d3b4ad78fb94] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:37:00.590297772Z [2024-04-11 23:37:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:37:00.590696585Z [2024-04-11 23:37:00,588: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:37:00.653533599Z [2024-04-11 23:37:00,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:37:00.795927867Z [2024-04-11 23:37:00,795: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:37:00.799283849Z [2024-04-11 23:37:00,798: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:37:00.821863222Z [2024-04-11 23:37:00,821: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:37:00.822992699Z [2024-04-11 23:37:00,822: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:37:00.823286890Z [2024-04-11 23:37:00,822: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:37:00.823441637Z [2024-04-11 23:37:00,823: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:37:00.824161999Z [2024-04-11 23:37:00,823: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:37:00.935526863Z [2024-04-11 23:37:00,935: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:37:01.459385611Z [2024-04-11 23:37:01,458: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad84f873-ac87-4157-b7a4-d3b4ad78fb94] succeeded in 1.1364495480002006s: None 2024-04-11T23:37:01.597007316Z [2024-04-11 23:37:01,596: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:37:01.600518798Z [2024-04-11 23:37:01,600: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:37:01.618410723Z [2024-04-11 23:37:01,618: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:37:01.619765449Z [2024-04-11 23:37:01,619: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:37:01.619849869Z [2024-04-11 23:37:01,619: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:37:01.619991284Z [2024-04-11 23:37:01,619: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:37:01.620066872Z [2024-04-11 23:37:01,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:37:01.620288530Z [2024-04-11 23:37:01,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:37:01.620398011Z [2024-04-11 23:37:01,620: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:37:01.641712270Z [2024-04-11 23:37:01,641: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:37:01.644991217Z [2024-04-11 23:37:01,644: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:37:01.704289665Z [2024-04-11 23:37:01,703: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:37:01.706956429Z [2024-04-11 23:37:01,706: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:37:01.707502530Z [2024-04-11 23:37:01,706: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:37:01.708972819Z [2024-04-11 23:37:01,708: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:37:01.708992889Z [2024-04-11 23:37:01,708: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:37:01.709979506Z [2024-04-11 23:37:01,709: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:37:01.710414599Z [2024-04-11 23:37:01,710: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:37:01.761078840Z [2024-04-11 23:37:01,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:37:01.777683802Z [2024-04-11 23:37:01,777: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:37:03.178884559Z [2024-04-11 23:37:03,178: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c4abe06-bad8-4b4e-8044-c295a556302b] succeeded in 2.8688963270005843s: None 2024-04-11T23:37:03.471895606Z [2024-04-11 23:37:03,471: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ada2ba8a-f0c9-45e5-af82-e0a81d883c8d] succeeded in 3.144775965000008s: None 2024-04-11T23:38:00.560413778Z [2024-04-11 23:38:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de415498-cc3a-4544-9753-cb9b9728c163] received 2024-04-11T23:38:00.566195168Z [2024-04-11 23:38:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a55582cb-d662-4291-b774-7c7518168f5b] received 2024-04-11T23:38:00.577860831Z [2024-04-11 23:38:00,577: INFO/ForkPoolWorker-15] [de415498-cc3a-4544-9753-cb9b9728c163] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:38:00.580169240Z [2024-04-11 23:38:00,579: INFO/ForkPoolWorker-16] [a55582cb-d662-4291-b774-7c7518168f5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:38:00.591841267Z [2024-04-11 23:38:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b917b439-df25-4338-b557-8c96ba6717a5] received 2024-04-11T23:38:00.596530366Z [2024-04-11 23:38:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e042d48-5555-4f8e-89f6-ab1cb5fe51a1] received 2024-04-11T23:38:00.617608921Z [2024-04-11 23:38:00,617: INFO/ForkPoolWorker-1] [b917b439-df25-4338-b557-8c96ba6717a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:38:00.645190642Z [2024-04-11 23:38:00,644: INFO/ForkPoolWorker-2] [3e042d48-5555-4f8e-89f6-ab1cb5fe51a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:38:00.946164093Z [2024-04-11 23:38:00,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:38:00.966804684Z [2024-04-11 23:38:00,960: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:38:01.017711032Z [2024-04-11 23:38:01,014: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:38:01.045707861Z [2024-04-11 23:38:01,042: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:38:01.278925590Z [2024-04-11 23:38:01,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:38:01.299703553Z [2024-04-11 23:38:01,299: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:38:01.317784157Z [2024-04-11 23:38:01,317: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:38:01.369440068Z [2024-04-11 23:38:01,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:38:01.371765205Z [2024-04-11 23:38:01,371: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:38:01.371888991Z [2024-04-11 23:38:01,371: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:38:01.372035108Z [2024-04-11 23:38:01,371: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:38:01.372393418Z [2024-04-11 23:38:01,372: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:38:01.570228389Z [2024-04-11 23:38:01,569: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:38:01.872205482Z [2024-04-11 23:38:01,871: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a55582cb-d662-4291-b774-7c7518168f5b] succeeded in 1.3025440139999773s: None 2024-04-11T23:38:02.134005091Z [2024-04-11 23:38:02,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de415498-cc3a-4544-9753-cb9b9728c163] succeeded in 1.5656999319999159s: None 2024-04-11T23:38:02.291658738Z [2024-04-11 23:38:02,291: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:38:02.294716062Z [2024-04-11 23:38:02,294: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:38:02.326660259Z [2024-04-11 23:38:02,326: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:38:02.329651982Z [2024-04-11 23:38:02,329: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:38:02.329763103Z [2024-04-11 23:38:02,329: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:38:02.329940443Z [2024-04-11 23:38:02,329: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:38:02.330032597Z [2024-04-11 23:38:02,329: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:38:02.330301235Z [2024-04-11 23:38:02,330: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:38:02.330426696Z [2024-04-11 23:38:02,330: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:38:02.452053607Z [2024-04-11 23:38:02,451: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:38:02.463940075Z [2024-04-11 23:38:02,463: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:38:02.464626982Z [2024-04-11 23:38:02,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:38:02.489571282Z [2024-04-11 23:38:02,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:38:02.490990840Z [2024-04-11 23:38:02,490: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:38:02.491130717Z [2024-04-11 23:38:02,490: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:38:02.491373520Z [2024-04-11 23:38:02,491: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:38:02.491510570Z [2024-04-11 23:38:02,491: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:38:02.491935371Z [2024-04-11 23:38:02,491: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:38:02.492064291Z [2024-04-11 23:38:02,491: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:38:02.606544914Z [2024-04-11 23:38:02,606: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:38:03.895514306Z [2024-04-11 23:38:03,895: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3e042d48-5555-4f8e-89f6-ab1cb5fe51a1] succeeded in 3.291032788000848s: None 2024-04-11T23:38:04.524029037Z [2024-04-11 23:38:04,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b917b439-df25-4338-b557-8c96ba6717a5] succeeded in 3.9259868999997707s: None 2024-04-11T23:39:00.679169780Z [2024-04-11 23:39:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc319184-6843-4319-8653-08570bc5bbd1] received 2024-04-11T23:39:00.683829024Z [2024-04-11 23:39:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55c79736-7822-4b6a-aa36-cb92e87c863e] received 2024-04-11T23:39:00.689771714Z [2024-04-11 23:39:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d71dfc9-495d-4713-9200-3ca98300c04a] received 2024-04-11T23:39:00.692230019Z [2024-04-11 23:39:00,691: INFO/ForkPoolWorker-15] [cc319184-6843-4319-8653-08570bc5bbd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:39:00.696205984Z [2024-04-11 23:39:00,695: INFO/ForkPoolWorker-16] [55c79736-7822-4b6a-aa36-cb92e87c863e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:39:00.698158795Z [2024-04-11 23:39:00,697: INFO/ForkPoolWorker-1] [7d71dfc9-495d-4713-9200-3ca98300c04a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:39:01.036697123Z [2024-04-11 23:39:01,033: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:39:01.052309003Z [2024-04-11 23:39:01,048: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:39:01.067080062Z [2024-04-11 23:39:01,063: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:39:01.232802200Z [2024-04-11 23:39:01,232: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:39:01.238486779Z [2024-04-11 23:39:01,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:39:01.288251155Z [2024-04-11 23:39:01,288: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:39:01.289178568Z [2024-04-11 23:39:01,288: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:39:01.289238325Z [2024-04-11 23:39:01,289: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:39:01.289310857Z [2024-04-11 23:39:01,289: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:39:01.289634130Z [2024-04-11 23:39:01,289: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:39:01.369366063Z [2024-04-11 23:39:01,369: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:39:01.961355256Z [2024-04-11 23:39:01,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d71dfc9-495d-4713-9200-3ca98300c04a] succeeded in 1.2694241660001353s: None 2024-04-11T23:39:02.270453723Z [2024-04-11 23:39:02,270: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:39:02.273646338Z [2024-04-11 23:39:02,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:39:02.295037317Z [2024-04-11 23:39:02,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:39:02.296278177Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:39:02.296435036Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:39:02.296605918Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:39:02.296717808Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:39:02.296988510Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:39:02.297098414Z [2024-04-11 23:39:02,296: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:39:02.363756313Z [2024-04-11 23:39:02,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:39:02.386884715Z [2024-04-11 23:39:02,386: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:39:02.389990013Z [2024-04-11 23:39:02,389: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:39:02.418453695Z [2024-04-11 23:39:02,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:39:02.419809903Z [2024-04-11 23:39:02,419: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:39:02.419946924Z [2024-04-11 23:39:02,419: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:39:02.420417683Z [2024-04-11 23:39:02,419: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:39:02.420524576Z [2024-04-11 23:39:02,420: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:39:02.420962212Z [2024-04-11 23:39:02,420: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:39:02.421030203Z [2024-04-11 23:39:02,420: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:39:02.499949073Z [2024-04-11 23:39:02,498: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:39:04.146180595Z [2024-04-11 23:39:04,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55c79736-7822-4b6a-aa36-cb92e87c863e] succeeded in 3.4602060979996168s: None 2024-04-11T23:39:04.476774580Z [2024-04-11 23:39:04,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc319184-6843-4319-8653-08570bc5bbd1] succeeded in 3.794810200000029s: None 2024-04-11T23:40:00.977258015Z [2024-04-11 23:40:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63beebcf-c924-403d-8ade-3e9449fca2ef] received 2024-04-11T23:40:00.983671535Z [2024-04-11 23:40:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff85ee03-2564-460b-977e-5fcd199f36b6] received 2024-04-11T23:40:00.986980991Z [2024-04-11 23:40:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eee90358-05b8-4616-8a36-60302bcf6f1b] received 2024-04-11T23:40:00.989554983Z [2024-04-11 23:40:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78e72cc6-38b9-437c-82ff-5295817a6493] received 2024-04-11T23:40:00.992440052Z [2024-04-11 23:40:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0655b48d-5f35-411b-922f-8ec79c860cc4] received 2024-04-11T23:40:00.998394757Z [2024-04-11 23:40:00,998: INFO/ForkPoolWorker-16] [ff85ee03-2564-460b-977e-5fcd199f36b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:00.998933646Z [2024-04-11 23:40:00,998: INFO/ForkPoolWorker-15] [63beebcf-c924-403d-8ade-3e9449fca2ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:40:01.006076445Z [2024-04-11 23:40:01,005: INFO/ForkPoolWorker-2] [78e72cc6-38b9-437c-82ff-5295817a6493] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:40:01.009397852Z [2024-04-11 23:40:01,009: INFO/ForkPoolWorker-1] [eee90358-05b8-4616-8a36-60302bcf6f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:40:01.016809293Z [2024-04-11 23:40:01,015: INFO/ForkPoolWorker-3] [0655b48d-5f35-411b-922f-8ec79c860cc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:40:01.340111603Z [2024-04-11 23:40:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:40:01.341423508Z [2024-04-11 23:40:01,337: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:40:01.445703293Z [2024-04-11 23:40:01,441: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:40:01.462607956Z [2024-04-11 23:40:01,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:40:01.634596014Z [2024-04-11 23:40:01,634: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:40:01.639987174Z [2024-04-11 23:40:01,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:40:01.646194462Z [2024-04-11 23:40:01,645: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:01.776014486Z [2024-04-11 23:40:01,775: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:40:01.777327270Z [2024-04-11 23:40:01,777: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:40:01.777350577Z [2024-04-11 23:40:01,777: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:40:01.777404930Z [2024-04-11 23:40:01,777: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:40:01.777591942Z [2024-04-11 23:40:01,777: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:40:01.863876682Z [2024-04-11 23:40:01,863: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:02.033984564Z [2024-04-11 23:40:02,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:02.506620954Z [2024-04-11 23:40:02,506: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[78e72cc6-38b9-437c-82ff-5295817a6493] succeeded in 1.5147968760002186s: None 2024-04-11T23:40:02.635961291Z [2024-04-11 23:40:02,635: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eee90358-05b8-4616-8a36-60302bcf6f1b] succeeded in 1.6471799480004847s: None 2024-04-11T23:40:02.774618352Z [2024-04-11 23:40:02,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:40:02.777473475Z [2024-04-11 23:40:02,777: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:02.823081014Z [2024-04-11 23:40:02,822: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:40:02.825356534Z [2024-04-11 23:40:02,825: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:02.825464018Z [2024-04-11 23:40:02,825: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:02.825700661Z [2024-04-11 23:40:02,825: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:02.825813424Z [2024-04-11 23:40:02,825: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:40:02.826199264Z [2024-04-11 23:40:02,826: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:40:02.826278801Z [2024-04-11 23:40:02,826: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:02.928239196Z [2024-04-11 23:40:02,927: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:03.015392667Z [2024-04-11 23:40:03,014: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T23:40:03.018907356Z [2024-04-11 23:40:03,018: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:03.084722837Z [2024-04-11 23:40:03,084: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:40:03.087620990Z [2024-04-11 23:40:03,087: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:03.089126646Z [2024-04-11 23:40:03,088: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:03.091830307Z [2024-04-11 23:40:03,091: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:03.091967762Z [2024-04-11 23:40:03,091: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T23:40:03.092440342Z [2024-04-11 23:40:03,092: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:40:03.093404823Z [2024-04-11 23:40:03,092: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:03.165226469Z [2024-04-11 23:40:03,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:40:03.168303679Z [2024-04-11 23:40:03,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:03.221481223Z [2024-04-11 23:40:03,214: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:40:03.221498478Z [2024-04-11 23:40:03,218: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:03.221502681Z [2024-04-11 23:40:03,218: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:03.221506470Z [2024-04-11 23:40:03,218: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:03.221510482Z [2024-04-11 23:40:03,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:40:03.221513450Z [2024-04-11 23:40:03,219: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:40:03.221516508Z [2024-04-11 23:40:03,219: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:03.229967599Z [2024-04-11 23:40:03,229: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:03.352264161Z [2024-04-11 23:40:03,352: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:03.547426038Z [2024-04-11 23:40:03,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2bdfa02-1d6b-4c3b-8a87-ba993e596d11] received 2024-04-11T23:40:03.557421986Z [2024-04-11 23:40:03,557: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff85ee03-2564-460b-977e-5fcd199f36b6] succeeded in 2.5695361469997806s: None 2024-04-11T23:40:03.560891790Z [2024-04-11 23:40:03,560: INFO/ForkPoolWorker-1] [d2bdfa02-1d6b-4c3b-8a87-ba993e596d11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:03.898503655Z [2024-04-11 23:40:03,895: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:40:04.897767439Z [2024-04-11 23:40:04,897: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0655b48d-5f35-411b-922f-8ec79c860cc4] succeeded in 3.9011546290003025s: None 2024-04-11T23:40:04.953869785Z [2024-04-11 23:40:04,953: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:40:04.956495987Z [2024-04-11 23:40:04,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:04.982076334Z [2024-04-11 23:40:04,981: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:40:04.983289621Z [2024-04-11 23:40:04,983: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:04.983432502Z [2024-04-11 23:40:04,983: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:04.983758034Z [2024-04-11 23:40:04,983: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:04.983842344Z [2024-04-11 23:40:04,983: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:40:04.984074904Z [2024-04-11 23:40:04,983: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:40:04.984593057Z [2024-04-11 23:40:04,984: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:05.078886530Z [2024-04-11 23:40:05,078: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:05.802660325Z [2024-04-11 23:40:05,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2bdfa02-1d6b-4c3b-8a87-ba993e596d11] succeeded in 2.2462330309999743s: None 2024-04-11T23:40:05.950835786Z [2024-04-11 23:40:05,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17c98696-d1f1-451e-b04f-39ebe910c2a9] received 2024-04-11T23:40:05.959372369Z [2024-04-11 23:40:05,958: INFO/ForkPoolWorker-16] [17c98696-d1f1-451e-b04f-39ebe910c2a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:40:06.231754382Z [2024-04-11 23:40:06,231: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63beebcf-c924-403d-8ade-3e9449fca2ef] succeeded in 5.252313284999218s: None 2024-04-11T23:40:06.233530249Z [2024-04-11 23:40:06,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:40:07.355086971Z [2024-04-11 23:40:07,354: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:40:07.358454476Z [2024-04-11 23:40:07,357: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:07.384826208Z [2024-04-11 23:40:07,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:40:07.386344743Z [2024-04-11 23:40:07,386: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:07.386498789Z [2024-04-11 23:40:07,386: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:07.386688463Z [2024-04-11 23:40:07,386: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:07.386813506Z [2024-04-11 23:40:07,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:40:07.387136001Z [2024-04-11 23:40:07,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:40:07.387259916Z [2024-04-11 23:40:07,387: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:07.502590186Z [2024-04-11 23:40:07,502: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:08.156326077Z [2024-04-11 23:40:08,155: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17c98696-d1f1-451e-b04f-39ebe910c2a9] succeeded in 2.2036372630000187s: None 2024-04-11T23:40:08.723278582Z [2024-04-11 23:40:08,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[750ac041-643d-4950-9be8-5852f5ba743a] received 2024-04-11T23:40:08.735386905Z [2024-04-11 23:40:08,735: INFO/ForkPoolWorker-15] [750ac041-643d-4950-9be8-5852f5ba743a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:08.968912635Z [2024-04-11 23:40:08,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:40:09.923434307Z [2024-04-11 23:40:09,923: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:40:09.926425169Z [2024-04-11 23:40:09,926: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:40:09.948181920Z [2024-04-11 23:40:09,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:40:09.949511702Z [2024-04-11 23:40:09,949: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:40:09.949715975Z [2024-04-11 23:40:09,949: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:40:09.949949700Z [2024-04-11 23:40:09,949: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:40:09.950130963Z [2024-04-11 23:40:09,949: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:40:09.950602679Z [2024-04-11 23:40:09,950: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:40:09.950756318Z [2024-04-11 23:40:09,950: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:40:10.012599776Z [2024-04-11 23:40:10,012: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:40:10.589959056Z [2024-04-11 23:40:10,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[750ac041-643d-4950-9be8-5852f5ba743a] succeeded in 1.8634011340000143s: None 2024-04-11T23:41:01.136224970Z [2024-04-11 23:41:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0b87061-a613-4565-ac1e-a7e8d1beaba7] received 2024-04-11T23:41:01.144124094Z [2024-04-11 23:41:01,143: INFO/ForkPoolWorker-15] [a0b87061-a613-4565-ac1e-a7e8d1beaba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:41:01.149031100Z [2024-04-11 23:41:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e158db8-1170-42fc-a53d-583914ebdbac] received 2024-04-11T23:41:01.151364329Z [2024-04-11 23:41:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1e5df30-65e3-433c-992f-aca186d2b3c6] received 2024-04-11T23:41:01.161267533Z [2024-04-11 23:41:01,161: INFO/ForkPoolWorker-16] [8e158db8-1170-42fc-a53d-583914ebdbac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:41:01.164871750Z [2024-04-11 23:41:01,164: INFO/ForkPoolWorker-1] [e1e5df30-65e3-433c-992f-aca186d2b3c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:41:01.432602328Z [2024-04-11 23:41:01,426: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:41:01.470121147Z [2024-04-11 23:41:01,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:41:01.614970019Z [2024-04-11 23:41:01,614: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:41:01.623858380Z [2024-04-11 23:41:01,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:41:01.670568654Z [2024-04-11 23:41:01,665: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:41:01.700523408Z [2024-04-11 23:41:01,690: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:41:01.700542593Z [2024-04-11 23:41:01,691: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:41:01.700546770Z [2024-04-11 23:41:01,691: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:41:01.700550399Z [2024-04-11 23:41:01,691: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:41:01.700553448Z [2024-04-11 23:41:01,691: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:41:01.910713262Z [2024-04-11 23:41:01,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:41:02.645466049Z [2024-04-11 23:41:02,645: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0b87061-a613-4565-ac1e-a7e8d1beaba7] succeeded in 1.5072025320005196s: None 2024-04-11T23:41:02.649247176Z [2024-04-11 23:41:02,648: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:41:02.654043168Z [2024-04-11 23:41:02,653: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:41:02.696911286Z [2024-04-11 23:41:02,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:41:02.705023961Z [2024-04-11 23:41:02,704: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:41:02.705073515Z [2024-04-11 23:41:02,704: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:41:02.705184325Z [2024-04-11 23:41:02,705: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:41:02.705250731Z [2024-04-11 23:41:02,705: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:41:02.705462569Z [2024-04-11 23:41:02,705: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:41:02.705536485Z [2024-04-11 23:41:02,705: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:41:02.846557401Z [2024-04-11 23:41:02,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:41:02.916500806Z [2024-04-11 23:41:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:41:02.919184096Z [2024-04-11 23:41:02,918: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:41:02.945930034Z [2024-04-11 23:41:02,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:41:02.947927819Z [2024-04-11 23:41:02,947: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:41:02.948152991Z [2024-04-11 23:41:02,947: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:41:02.948569146Z [2024-04-11 23:41:02,948: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:41:02.948734205Z [2024-04-11 23:41:02,948: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:41:02.949068811Z [2024-04-11 23:41:02,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:41:02.949233847Z [2024-04-11 23:41:02,949: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:41:03.043999675Z [2024-04-11 23:41:03,043: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:41:04.622116761Z [2024-04-11 23:41:04,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e158db8-1170-42fc-a53d-583914ebdbac] succeeded in 3.4713286910000534s: None 2024-04-11T23:41:05.020635174Z [2024-04-11 23:41:05,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1e5df30-65e3-433c-992f-aca186d2b3c6] succeeded in 3.8666899439995177s: None 2024-04-11T23:42:00.292089015Z [2024-04-11 23:42:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deeb0a3e-1478-4181-a8af-02cd5bc7af1d] received 2024-04-11T23:42:00.296828228Z [2024-04-11 23:42:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15e8d7b9-4f9a-45ef-a872-0da3587d0977] received 2024-04-11T23:42:00.298860319Z [2024-04-11 23:42:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[034707e0-b05f-4e4d-97f0-682d9d72c498] received 2024-04-11T23:42:00.302881394Z [2024-04-11 23:42:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d5211ca-40bd-4e24-9dbb-9f9ade36977d] received 2024-04-11T23:42:00.306719073Z [2024-04-11 23:42:00,306: INFO/ForkPoolWorker-15] [deeb0a3e-1478-4181-a8af-02cd5bc7af1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:42:00.310401183Z [2024-04-11 23:42:00,310: INFO/ForkPoolWorker-16] [15e8d7b9-4f9a-45ef-a872-0da3587d0977] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:42:00.312141548Z [2024-04-11 23:42:00,311: INFO/ForkPoolWorker-1] [034707e0-b05f-4e4d-97f0-682d9d72c498] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:42:00.328330199Z [2024-04-11 23:42:00,327: INFO/ForkPoolWorker-2] [3d5211ca-40bd-4e24-9dbb-9f9ade36977d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:42:00.587357115Z [2024-04-11 23:42:00,584: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:42:00.591059353Z [2024-04-11 23:42:00,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:42:00.615257348Z [2024-04-11 23:42:00,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:42:00.646364358Z [2024-04-11 23:42:00,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:42:00.729180911Z [2024-04-11 23:42:00,728: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:42:00.732657461Z [2024-04-11 23:42:00,732: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:42:00.762557026Z [2024-04-11 23:42:00,762: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:42:00.765609822Z [2024-04-11 23:42:00,765: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:42:00.765761818Z [2024-04-11 23:42:00,765: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:42:00.765876018Z [2024-04-11 23:42:00,765: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:42:00.766183742Z [2024-04-11 23:42:00,766: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:42:00.854556967Z [2024-04-11 23:42:00,854: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:42:00.857290369Z [2024-04-11 23:42:00,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:42:01.346417180Z [2024-04-11 23:42:01,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[deeb0a3e-1478-4181-a8af-02cd5bc7af1d] succeeded in 1.0530691889998707s: None 2024-04-11T23:42:01.407492297Z [2024-04-11 23:42:01,407: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d5211ca-40bd-4e24-9dbb-9f9ade36977d] succeeded in 1.0997242740004367s: None 2024-04-11T23:42:01.833060453Z [2024-04-11 23:42:01,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:42:01.836116996Z [2024-04-11 23:42:01,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:42:01.858703653Z [2024-04-11 23:42:01,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:42:01.860052934Z [2024-04-11 23:42:01,859: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:42:01.860193218Z [2024-04-11 23:42:01,859: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:42:01.860434810Z [2024-04-11 23:42:01,860: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:42:01.860609741Z [2024-04-11 23:42:01,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:42:01.861055504Z [2024-04-11 23:42:01,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:42:01.861213807Z [2024-04-11 23:42:01,861: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:42:01.894843413Z [2024-04-11 23:42:01,894: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:42:01.897751491Z [2024-04-11 23:42:01,897: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:42:01.922153579Z [2024-04-11 23:42:01,921: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:42:01.923570517Z [2024-04-11 23:42:01,923: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:42:01.923698214Z [2024-04-11 23:42:01,923: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:42:01.923939993Z [2024-04-11 23:42:01,923: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:42:01.924173654Z [2024-04-11 23:42:01,924: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:42:01.924458534Z [2024-04-11 23:42:01,924: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:42:01.924628907Z [2024-04-11 23:42:01,924: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:42:01.946693026Z [2024-04-11 23:42:01,946: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:42:02.007959699Z [2024-04-11 23:42:02,007: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:42:03.425908193Z [2024-04-11 23:42:03,425: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[034707e0-b05f-4e4d-97f0-682d9d72c498] succeeded in 3.1249504040006286s: None 2024-04-11T23:42:03.743375773Z [2024-04-11 23:42:03,742: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15e8d7b9-4f9a-45ef-a872-0da3587d0977] succeeded in 3.4445609909998893s: None 2024-04-11T23:43:00.297141562Z [2024-04-11 23:43:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c959481-a29d-4465-a333-39b53fac2c38] received 2024-04-11T23:43:00.298927763Z [2024-04-11 23:43:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e844a30-f13e-4b97-a531-75e3ca5ab521] received 2024-04-11T23:43:00.306119485Z [2024-04-11 23:43:00,305: INFO/ForkPoolWorker-15] [5c959481-a29d-4465-a333-39b53fac2c38] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:43:00.312295841Z [2024-04-11 23:43:00,311: INFO/ForkPoolWorker-16] [4e844a30-f13e-4b97-a531-75e3ca5ab521] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:43:00.314172012Z [2024-04-11 23:43:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bc2ae88-5987-412c-abab-96a31b9cf161] received 2024-04-11T23:43:00.326616738Z [2024-04-11 23:43:00,326: INFO/ForkPoolWorker-1] [0bc2ae88-5987-412c-abab-96a31b9cf161] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:43:00.582023228Z [2024-04-11 23:43:00,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:43:00.599675850Z [2024-04-11 23:43:00,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:43:00.617269666Z [2024-04-11 23:43:00,613: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:43:00.769648805Z [2024-04-11 23:43:00,769: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:43:00.773667295Z [2024-04-11 23:43:00,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:43:00.795917316Z [2024-04-11 23:43:00,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:43:00.797665005Z [2024-04-11 23:43:00,797: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:43:00.797835683Z [2024-04-11 23:43:00,797: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:43:00.797975450Z [2024-04-11 23:43:00,797: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:43:00.798238079Z [2024-04-11 23:43:00,798: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:43:00.887795829Z [2024-04-11 23:43:00,887: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:43:01.510665443Z [2024-04-11 23:43:01,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c959481-a29d-4465-a333-39b53fac2c38] succeeded in 1.2108647969998856s: None 2024-04-11T23:43:01.610676695Z [2024-04-11 23:43:01,610: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:43:01.613672833Z [2024-04-11 23:43:01,613: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:43:01.642774978Z [2024-04-11 23:43:01,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:43:01.645815347Z [2024-04-11 23:43:01,645: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:43:01.645890039Z [2024-04-11 23:43:01,645: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:43:01.646056682Z [2024-04-11 23:43:01,645: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:43:01.646126205Z [2024-04-11 23:43:01,645: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:43:01.646710526Z [2024-04-11 23:43:01,646: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:43:01.646727274Z [2024-04-11 23:43:01,646: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:43:01.765775036Z [2024-04-11 23:43:01,764: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:43:01.839907236Z [2024-04-11 23:43:01,827: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:43:01.839927190Z [2024-04-11 23:43:01,830: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:43:01.857565503Z [2024-04-11 23:43:01,857: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:43:01.860609480Z [2024-04-11 23:43:01,858: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:43:01.860615090Z [2024-04-11 23:43:01,858: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:43:01.860628959Z [2024-04-11 23:43:01,858: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:43:01.860633019Z [2024-04-11 23:43:01,858: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:43:01.860636059Z [2024-04-11 23:43:01,859: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:43:01.860639072Z [2024-04-11 23:43:01,859: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:43:01.924835638Z [2024-04-11 23:43:01,924: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:43:03.281106226Z [2024-04-11 23:43:03,280: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e844a30-f13e-4b97-a531-75e3ca5ab521] succeeded in 2.980397831999653s: None 2024-04-11T23:43:03.694241737Z [2024-04-11 23:43:03,693: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0bc2ae88-5987-412c-abab-96a31b9cf161] succeeded in 3.3775825029997577s: None 2024-04-11T23:44:00.408044971Z [2024-04-11 23:44:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18b0fd8-85aa-466e-8522-5070f605db79] received 2024-04-11T23:44:00.414215234Z [2024-04-11 23:44:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19a6b66e-c504-4aa3-8b86-533bb02b7a3e] received 2024-04-11T23:44:00.422869512Z [2024-04-11 23:44:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73046c63-efed-4181-865a-5bec06810cf9] received 2024-04-11T23:44:00.422886126Z [2024-04-11 23:44:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a7d04c5-1ee4-4323-8fc9-d5224b5f69f1] received 2024-04-11T23:44:00.445763971Z [2024-04-11 23:44:00,443: INFO/ForkPoolWorker-1] [73046c63-efed-4181-865a-5bec06810cf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:44:00.445787385Z [2024-04-11 23:44:00,443: INFO/ForkPoolWorker-16] [19a6b66e-c504-4aa3-8b86-533bb02b7a3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:44:00.482223310Z [2024-04-11 23:44:00,481: INFO/ForkPoolWorker-2] [8a7d04c5-1ee4-4323-8fc9-d5224b5f69f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:44:00.502862666Z [2024-04-11 23:44:00,502: INFO/ForkPoolWorker-15] [e18b0fd8-85aa-466e-8522-5070f605db79] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:44:01.139563849Z [2024-04-11 23:44:01,134: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:44:01.250127931Z [2024-04-11 23:44:01,242: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:44:01.290318316Z [2024-04-11 23:44:01,286: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:44:01.338044747Z [2024-04-11 23:44:01,322: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:44:01.386237956Z [2024-04-11 23:44:01,386: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:44:01.968142583Z [2024-04-11 23:44:01,967: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:44:01.972115384Z [2024-04-11 23:44:01,971: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:44:02.017734677Z [2024-04-11 23:44:02,017: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:44:02.021047650Z [2024-04-11 23:44:02,020: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:44:02.021199028Z [2024-04-11 23:44:02,021: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:44:02.021229178Z [2024-04-11 23:44:02,021: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:44:02.021436367Z [2024-04-11 23:44:02,021: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:44:02.144411010Z [2024-04-11 23:44:02,144: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:44:02.580233033Z [2024-04-11 23:44:02,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e18b0fd8-85aa-466e-8522-5070f605db79] succeeded in 2.1430565210002896s: None 2024-04-11T23:44:02.915034022Z [2024-04-11 23:44:02,914: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73046c63-efed-4181-865a-5bec06810cf9] succeeded in 2.4887591030001204s: None 2024-04-11T23:44:03.417265643Z [2024-04-11 23:44:03,416: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:44:03.420542000Z [2024-04-11 23:44:03,420: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:44:03.420752589Z [2024-04-11 23:44:03,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:44:03.423555266Z [2024-04-11 23:44:03,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:44:03.452354068Z [2024-04-11 23:44:03,452: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:44:03.453926621Z [2024-04-11 23:44:03,453: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:44:03.454380115Z [2024-04-11 23:44:03,454: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:44:03.454795644Z [2024-04-11 23:44:03,454: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:44:03.454942456Z [2024-04-11 23:44:03,454: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:44:03.455191333Z [2024-04-11 23:44:03,455: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:44:03.455287904Z [2024-04-11 23:44:03,455: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:44:03.462052895Z [2024-04-11 23:44:03,461: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:44:03.464706126Z [2024-04-11 23:44:03,464: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:44:03.464722226Z [2024-04-11 23:44:03,464: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:44:03.464864347Z [2024-04-11 23:44:03,464: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:44:03.464974226Z [2024-04-11 23:44:03,464: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:44:03.465243329Z [2024-04-11 23:44:03,465: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:44:03.465351000Z [2024-04-11 23:44:03,465: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:44:03.558674099Z [2024-04-11 23:44:03,558: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:44:03.620066023Z [2024-04-11 23:44:03,619: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:44:05.251407763Z [2024-04-11 23:44:05,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19a6b66e-c504-4aa3-8b86-533bb02b7a3e] succeeded in 4.834572310999647s: None 2024-04-11T23:44:05.582173706Z [2024-04-11 23:44:05,581: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8a7d04c5-1ee4-4323-8fc9-d5224b5f69f1] succeeded in 5.1467548580003495s: None 2024-04-11T23:45:00.942501693Z [2024-04-11 23:45:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d0a89e2-ea98-4e3f-a0dc-561b54e60647] received 2024-04-11T23:45:00.947368886Z [2024-04-11 23:45:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acdf822a-b080-4912-82d2-c8bb5c3bd9dd] received 2024-04-11T23:45:00.952669944Z [2024-04-11 23:45:00,952: INFO/ForkPoolWorker-15] [9d0a89e2-ea98-4e3f-a0dc-561b54e60647] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:00.956156433Z [2024-04-11 23:45:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[869c4401-5d4b-4245-b43a-0b141d9a9f53] received 2024-04-11T23:45:00.957461870Z [2024-04-11 23:45:00,957: INFO/ForkPoolWorker-16] [acdf822a-b080-4912-82d2-c8bb5c3bd9dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:45:00.963136971Z [2024-04-11 23:45:00,962: INFO/ForkPoolWorker-1] [869c4401-5d4b-4245-b43a-0b141d9a9f53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:45:00.974582717Z [2024-04-11 23:45:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e833bd1-8fb0-487d-986b-3d2f0b432e14] received 2024-04-11T23:45:00.991933774Z [2024-04-11 23:45:00,991: INFO/ForkPoolWorker-2] [5e833bd1-8fb0-487d-986b-3d2f0b432e14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:45:01.242867741Z [2024-04-11 23:45:01,239: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:45:01.301063658Z [2024-04-11 23:45:01,298: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:45:01.418692017Z [2024-04-11 23:45:01,411: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:45:01.442829571Z [2024-04-11 23:45:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:45:01.455618152Z [2024-04-11 23:45:01,455: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:45:01.459312518Z [2024-04-11 23:45:01,458: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:01.489092514Z [2024-04-11 23:45:01,488: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:45:01.490000823Z [2024-04-11 23:45:01,489: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:45:01.490148763Z [2024-04-11 23:45:01,489: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:45:01.490331875Z [2024-04-11 23:45:01,490: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:45:01.490603251Z [2024-04-11 23:45:01,490: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:45:01.589555952Z [2024-04-11 23:45:01,589: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:02.281784972Z [2024-04-11 23:45:02,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acdf822a-b080-4912-82d2-c8bb5c3bd9dd] succeeded in 1.3319129450001128s: None 2024-04-11T23:45:02.467956885Z [2024-04-11 23:45:02,467: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:45:02.471071462Z [2024-04-11 23:45:02,470: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:02.502231075Z [2024-04-11 23:45:02,501: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:45:02.503608745Z [2024-04-11 23:45:02,503: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:02.503666742Z [2024-04-11 23:45:02,503: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:02.503887282Z [2024-04-11 23:45:02,503: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:02.503925489Z [2024-04-11 23:45:02,503: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:45:02.504270469Z [2024-04-11 23:45:02,504: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:45:02.504494643Z [2024-04-11 23:45:02,504: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:02.586974064Z [2024-04-11 23:45:02,586: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:02.693627361Z [2024-04-11 23:45:02,693: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:45:02.696921176Z [2024-04-11 23:45:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:02.725297323Z [2024-04-11 23:45:02,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:45:02.729329220Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:02.729341690Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:02.729546713Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:02.729667387Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:45:02.729932995Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:45:02.730087712Z [2024-04-11 23:45:02,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:02.812478154Z [2024-04-11 23:45:02,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:02.826789069Z [2024-04-11 23:45:02,826: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:45:02.830442112Z [2024-04-11 23:45:02,829: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:02.860751710Z [2024-04-11 23:45:02,860: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:45:02.861894631Z [2024-04-11 23:45:02,861: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:02.861907745Z [2024-04-11 23:45:02,861: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:02.862106119Z [2024-04-11 23:45:02,861: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:02.862150728Z [2024-04-11 23:45:02,862: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:45:02.862408993Z [2024-04-11 23:45:02,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:45:02.862420680Z [2024-04-11 23:45:02,862: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:02.950565100Z [2024-04-11 23:45:02,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:03.433178262Z [2024-04-11 23:45:03,432: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d0a89e2-ea98-4e3f-a0dc-561b54e60647] succeeded in 2.487505670000246s: None 2024-04-11T23:45:03.897799357Z [2024-04-11 23:45:03,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd97aae4-87af-4f45-9bf0-0ccd988c447a] received 2024-04-11T23:45:03.903944480Z [2024-04-11 23:45:03,903: INFO/ForkPoolWorker-15] [bd97aae4-87af-4f45-9bf0-0ccd988c447a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:04.145621235Z [2024-04-11 23:45:04,145: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e833bd1-8fb0-487d-986b-3d2f0b432e14] succeeded in 3.1694854360002864s: None 2024-04-11T23:45:04.205963201Z [2024-04-11 23:45:04,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:45:04.859651406Z [2024-04-11 23:45:04,859: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[869c4401-5d4b-4245-b43a-0b141d9a9f53] succeeded in 3.902088212000308s: None 2024-04-11T23:45:05.298489901Z [2024-04-11 23:45:05,298: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:45:05.301233854Z [2024-04-11 23:45:05,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:05.326142335Z [2024-04-11 23:45:05,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:45:05.328065435Z [2024-04-11 23:45:05,327: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:05.328279272Z [2024-04-11 23:45:05,327: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:05.328538363Z [2024-04-11 23:45:05,328: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:05.328670629Z [2024-04-11 23:45:05,328: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:45:05.329062735Z [2024-04-11 23:45:05,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:45:05.329258282Z [2024-04-11 23:45:05,329: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:05.420417418Z [2024-04-11 23:45:05,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:06.090129096Z [2024-04-11 23:45:06,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd97aae4-87af-4f45-9bf0-0ccd988c447a] succeeded in 2.1908248810004807s: None 2024-04-11T23:45:06.357219088Z [2024-04-11 23:45:06,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba84a227-9e8b-412c-82d7-e10799141656] received 2024-04-11T23:45:06.369558664Z [2024-04-11 23:45:06,369: INFO/ForkPoolWorker-15] [ba84a227-9e8b-412c-82d7-e10799141656] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:45:06.627784362Z [2024-04-11 23:45:06,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:45:07.592161029Z [2024-04-11 23:45:07,591: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:45:07.595229613Z [2024-04-11 23:45:07,594: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:07.613037722Z [2024-04-11 23:45:07,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:45:07.614253085Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:07.614309724Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:07.614402116Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:07.614444014Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:45:07.614732310Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:45:07.614793926Z [2024-04-11 23:45:07,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:07.694155709Z [2024-04-11 23:45:07,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:08.337317080Z [2024-04-11 23:45:08,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba84a227-9e8b-412c-82d7-e10799141656] succeeded in 1.975863685999684s: None 2024-04-11T23:45:08.745493498Z [2024-04-11 23:45:08,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6c7d655-f6e5-4141-a159-aad91bca541d] received 2024-04-11T23:45:08.753522383Z [2024-04-11 23:45:08,753: INFO/ForkPoolWorker-15] [c6c7d655-f6e5-4141-a159-aad91bca541d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:09.012829734Z [2024-04-11 23:45:09,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:45:09.979423358Z [2024-04-11 23:45:09,978: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:45:09.982467376Z [2024-04-11 23:45:09,981: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:45:10.026449754Z [2024-04-11 23:45:10,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:45:10.027840245Z [2024-04-11 23:45:10,027: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:45:10.028010884Z [2024-04-11 23:45:10,027: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:45:10.028226599Z [2024-04-11 23:45:10,028: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:45:10.028366198Z [2024-04-11 23:45:10,028: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:45:10.028701332Z [2024-04-11 23:45:10,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:45:10.028854980Z [2024-04-11 23:45:10,028: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:45:10.138778942Z [2024-04-11 23:45:10,138: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:45:10.770398659Z [2024-04-11 23:45:10,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6c7d655-f6e5-4141-a159-aad91bca541d] succeeded in 2.0227093940002305s: None 2024-04-11T23:46:00.344676136Z [2024-04-11 23:46:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82276af9-8600-4def-a2fb-52a8056598b1] received 2024-04-11T23:46:00.346262826Z [2024-04-11 23:46:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0042115c-c1de-4aac-9617-a5b3416d530a] received 2024-04-11T23:46:00.347608504Z [2024-04-11 23:46:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25fc1ade-71c7-458b-8800-6600a006e9b0] received 2024-04-11T23:46:00.350135550Z [2024-04-11 23:46:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[618c48cb-04c3-4e6f-8faa-c915a466cc5a] received 2024-04-11T23:46:00.360183604Z [2024-04-11 23:46:00,359: INFO/ForkPoolWorker-2] [618c48cb-04c3-4e6f-8faa-c915a466cc5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:46:00.370576170Z [2024-04-11 23:46:00,370: INFO/ForkPoolWorker-16] [0042115c-c1de-4aac-9617-a5b3416d530a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:46:00.371831398Z [2024-04-11 23:46:00,371: INFO/ForkPoolWorker-1] [25fc1ade-71c7-458b-8800-6600a006e9b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:46:00.372992520Z [2024-04-11 23:46:00,372: INFO/ForkPoolWorker-15] [82276af9-8600-4def-a2fb-52a8056598b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:46:00.622233195Z [2024-04-11 23:46:00,619: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:46:00.705910358Z [2024-04-11 23:46:00,702: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:46:00.781573220Z [2024-04-11 23:46:00,778: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:46:00.810911399Z [2024-04-11 23:46:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:46:00.874792821Z [2024-04-11 23:46:00,874: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:46:00.878764241Z [2024-04-11 23:46:00,878: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:46:00.902855864Z [2024-04-11 23:46:00,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:46:00.904867499Z [2024-04-11 23:46:00,904: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:46:00.905365952Z [2024-04-11 23:46:00,905: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:46:00.905513466Z [2024-04-11 23:46:00,905: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:46:00.905839933Z [2024-04-11 23:46:00,905: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:46:01.012829645Z [2024-04-11 23:46:01,012: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:46:01.034873369Z [2024-04-11 23:46:01,034: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:46:01.512855078Z [2024-04-11 23:46:01,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82276af9-8600-4def-a2fb-52a8056598b1] succeeded in 1.1597180879998632s: None 2024-04-11T23:46:01.593013436Z [2024-04-11 23:46:01,592: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25fc1ade-71c7-458b-8800-6600a006e9b0] succeeded in 1.2407154349994016s: None 2024-04-11T23:46:01.807093877Z [2024-04-11 23:46:01,806: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:46:01.810705675Z [2024-04-11 23:46:01,810: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:46:01.832421053Z [2024-04-11 23:46:01,832: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:46:01.834079087Z [2024-04-11 23:46:01,833: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:46:01.834128503Z [2024-04-11 23:46:01,834: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:46:01.834288462Z [2024-04-11 23:46:01,834: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:46:01.834330434Z [2024-04-11 23:46:01,834: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:46:01.834569846Z [2024-04-11 23:46:01,834: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:46:01.834613890Z [2024-04-11 23:46:01,834: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:46:01.935808030Z [2024-04-11 23:46:01,935: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:46:02.074906799Z [2024-04-11 23:46:02,074: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:46:02.078265824Z [2024-04-11 23:46:02,077: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:46:02.095806880Z [2024-04-11 23:46:02,095: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:46:02.097010747Z [2024-04-11 23:46:02,096: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:46:02.097335712Z [2024-04-11 23:46:02,097: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:46:02.097519554Z [2024-04-11 23:46:02,097: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:46:02.097652205Z [2024-04-11 23:46:02,097: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:46:02.097874984Z [2024-04-11 23:46:02,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:46:02.098194011Z [2024-04-11 23:46:02,098: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:46:02.159436991Z [2024-04-11 23:46:02,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:46:03.732333661Z [2024-04-11 23:46:03,731: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[618c48cb-04c3-4e6f-8faa-c915a466cc5a] succeeded in 3.3803755469998578s: None 2024-04-11T23:46:04.550849606Z [2024-04-11 23:46:04,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0042115c-c1de-4aac-9617-a5b3416d530a] succeeded in 4.2004621829992175s: None 2024-04-11T23:47:00.609594273Z [2024-04-11 23:47:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2d7121f-d0a5-4995-b29d-87fc63a7ae99] received 2024-04-11T23:47:00.613221110Z [2024-04-11 23:47:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14bbd23f-0ebc-4f9f-a46e-06e8e3256b43] received 2024-04-11T23:47:00.617040483Z [2024-04-11 23:47:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1061dd79-96e9-462b-a1a1-2a624c30b4d5] received 2024-04-11T23:47:00.619594589Z [2024-04-11 23:47:00,619: INFO/ForkPoolWorker-16] [14bbd23f-0ebc-4f9f-a46e-06e8e3256b43] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:47:00.620522438Z [2024-04-11 23:47:00,620: INFO/ForkPoolWorker-15] [a2d7121f-d0a5-4995-b29d-87fc63a7ae99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:47:00.637941723Z [2024-04-11 23:47:00,637: INFO/ForkPoolWorker-1] [1061dd79-96e9-462b-a1a1-2a624c30b4d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:47:00.901325271Z [2024-04-11 23:47:00,898: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:47:00.927811337Z [2024-04-11 23:47:00,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:47:00.949472782Z [2024-04-11 23:47:00,946: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:47:01.050165620Z [2024-04-11 23:47:01,049: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:47:01.053502422Z [2024-04-11 23:47:01,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:47:01.072710634Z [2024-04-11 23:47:01,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:47:01.073510027Z [2024-04-11 23:47:01,073: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:47:01.073543078Z [2024-04-11 23:47:01,073: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:47:01.073617280Z [2024-04-11 23:47:01,073: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:47:01.073741179Z [2024-04-11 23:47:01,073: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:47:01.170494318Z [2024-04-11 23:47:01,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:47:01.736505375Z [2024-04-11 23:47:01,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14bbd23f-0ebc-4f9f-a46e-06e8e3256b43] succeeded in 1.1218501280000055s: None 2024-04-11T23:47:02.047088007Z [2024-04-11 23:47:02,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:47:02.050496509Z [2024-04-11 23:47:02,050: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:47:02.098235608Z [2024-04-11 23:47:02,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:47:02.099410403Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:47:02.099468397Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:47:02.099576199Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:47:02.099643798Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:47:02.099884124Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:47:02.099935012Z [2024-04-11 23:47:02,099: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:47:02.169079060Z [2024-04-11 23:47:02,168: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:47:02.171831394Z [2024-04-11 23:47:02,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:47:02.172552364Z [2024-04-11 23:47:02,172: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:47:02.209599752Z [2024-04-11 23:47:02,209: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:47:02.210844658Z [2024-04-11 23:47:02,210: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:47:02.210890542Z [2024-04-11 23:47:02,210: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:47:02.210975041Z [2024-04-11 23:47:02,210: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:47:02.211007228Z [2024-04-11 23:47:02,210: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:47:02.212020316Z [2024-04-11 23:47:02,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:47:02.212078980Z [2024-04-11 23:47:02,211: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:47:02.296161479Z [2024-04-11 23:47:02,295: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:47:04.217616003Z [2024-04-11 23:47:04,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1061dd79-96e9-462b-a1a1-2a624c30b4d5] succeeded in 3.597552213000199s: None 2024-04-11T23:47:04.416521016Z [2024-04-11 23:47:04,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2d7121f-d0a5-4995-b29d-87fc63a7ae99] succeeded in 3.8019476460003716s: None 2024-04-11T23:48:00.693838647Z [2024-04-11 23:48:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df75f1d-a9be-46bd-9adf-6c9876fcc341] received 2024-04-11T23:48:00.696616540Z [2024-04-11 23:48:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[091ac224-3f81-4fc6-ad60-4aba4aeee5f4] received 2024-04-11T23:48:00.704058171Z [2024-04-11 23:48:00,703: INFO/ForkPoolWorker-16] [091ac224-3f81-4fc6-ad60-4aba4aeee5f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:48:00.706729033Z [2024-04-11 23:48:00,706: INFO/ForkPoolWorker-15] [8df75f1d-a9be-46bd-9adf-6c9876fcc341] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:48:00.712192331Z [2024-04-11 23:48:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a52602d-259b-41ee-958b-6a25458d81fe] received 2024-04-11T23:48:00.716453882Z [2024-04-11 23:48:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d5a8755-dc40-4968-b5c8-673abee72409] received 2024-04-11T23:48:00.721463430Z [2024-04-11 23:48:00,721: INFO/ForkPoolWorker-1] [4a52602d-259b-41ee-958b-6a25458d81fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:48:00.735484274Z [2024-04-11 23:48:00,732: INFO/ForkPoolWorker-2] [6d5a8755-dc40-4968-b5c8-673abee72409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:48:00.980351477Z [2024-04-11 23:48:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:48:01.012486735Z [2024-04-11 23:48:01,009: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:48:01.058201353Z [2024-04-11 23:48:01,046: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:48:01.063049343Z [2024-04-11 23:48:01,059: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:48:01.183260484Z [2024-04-11 23:48:01,182: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:48:01.186629065Z [2024-04-11 23:48:01,186: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:48:01.225254236Z [2024-04-11 23:48:01,225: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:48:01.227762394Z [2024-04-11 23:48:01,227: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:48:01.227943587Z [2024-04-11 23:48:01,227: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:48:01.228075760Z [2024-04-11 23:48:01,227: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:48:01.228343426Z [2024-04-11 23:48:01,228: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:48:01.305938979Z [2024-04-11 23:48:01,305: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:48:01.401577823Z [2024-04-11 23:48:01,401: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:48:01.958128361Z [2024-04-11 23:48:01,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a52602d-259b-41ee-958b-6a25458d81fe] succeeded in 1.2441930049999428s: None 2024-04-11T23:48:01.980329996Z [2024-04-11 23:48:01,979: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8df75f1d-a9be-46bd-9adf-6c9876fcc341] succeeded in 1.2817168370002037s: None 2024-04-11T23:48:02.224860833Z [2024-04-11 23:48:02,224: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:48:02.227926623Z [2024-04-11 23:48:02,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:48:02.267326911Z [2024-04-11 23:48:02,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:48:02.272352948Z [2024-04-11 23:48:02,272: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:48:02.272608279Z [2024-04-11 23:48:02,272: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:48:02.272755025Z [2024-04-11 23:48:02,272: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:48:02.272867633Z [2024-04-11 23:48:02,272: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:48:02.273140695Z [2024-04-11 23:48:02,273: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:48:02.273247162Z [2024-04-11 23:48:02,273: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:48:02.296390575Z [2024-04-11 23:48:02,296: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:48:02.299128555Z [2024-04-11 23:48:02,298: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:48:02.337323187Z [2024-04-11 23:48:02,337: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:48:02.341449854Z [2024-04-11 23:48:02,341: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:48:02.341624964Z [2024-04-11 23:48:02,341: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:48:02.341979972Z [2024-04-11 23:48:02,341: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:48:02.342270399Z [2024-04-11 23:48:02,341: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:48:02.342644938Z [2024-04-11 23:48:02,342: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:48:02.342804248Z [2024-04-11 23:48:02,342: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:48:02.358721314Z [2024-04-11 23:48:02,357: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:48:02.430696100Z [2024-04-11 23:48:02,429: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:48:04.871241499Z [2024-04-11 23:48:04,870: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6d5a8755-dc40-4968-b5c8-673abee72409] succeeded in 4.150496552999357s: None 2024-04-11T23:48:05.173340440Z [2024-04-11 23:48:05,173: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[091ac224-3f81-4fc6-ad60-4aba4aeee5f4] succeeded in 4.474904512999274s: None 2024-04-11T23:49:00.739438483Z [2024-04-11 23:49:00,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4360e6ac-4b3c-4e1d-baa8-64cea9e4838b] received 2024-04-11T23:49:00.741956590Z [2024-04-11 23:49:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9fb0feb-ade4-4cae-9d23-79e8e54d57fd] received 2024-04-11T23:49:00.744205953Z [2024-04-11 23:49:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12eeb401-1129-49a6-b448-de45da362a37] received 2024-04-11T23:49:00.747978690Z [2024-04-11 23:49:00,747: INFO/ForkPoolWorker-16] [c9fb0feb-ade4-4cae-9d23-79e8e54d57fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:49:00.748369380Z [2024-04-11 23:49:00,748: INFO/ForkPoolWorker-15] [4360e6ac-4b3c-4e1d-baa8-64cea9e4838b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:49:00.758519381Z [2024-04-11 23:49:00,758: INFO/ForkPoolWorker-1] [12eeb401-1129-49a6-b448-de45da362a37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:49:00.997192556Z [2024-04-11 23:49:00,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:49:01.023290026Z [2024-04-11 23:49:01,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:49:01.073637227Z [2024-04-11 23:49:01,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:49:01.221339930Z [2024-04-11 23:49:01,220: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:49:01.224719674Z [2024-04-11 23:49:01,224: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:49:01.251516394Z [2024-04-11 23:49:01,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:49:01.252469123Z [2024-04-11 23:49:01,252: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:49:01.252632131Z [2024-04-11 23:49:01,252: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:49:01.252728863Z [2024-04-11 23:49:01,252: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:49:01.252953781Z [2024-04-11 23:49:01,252: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:49:01.363801213Z [2024-04-11 23:49:01,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:49:01.948712209Z [2024-04-11 23:49:01,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4360e6ac-4b3c-4e1d-baa8-64cea9e4838b] succeeded in 1.2078563470004156s: None 2024-04-11T23:49:01.990398765Z [2024-04-11 23:49:01,989: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:49:01.993132662Z [2024-04-11 23:49:01,992: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:49:02.017560070Z [2024-04-11 23:49:02,017: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:49:02.018675944Z [2024-04-11 23:49:02,018: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:49:02.018748822Z [2024-04-11 23:49:02,018: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:49:02.018898018Z [2024-04-11 23:49:02,018: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:49:02.018943365Z [2024-04-11 23:49:02,018: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:49:02.019151272Z [2024-04-11 23:49:02,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:49:02.019216574Z [2024-04-11 23:49:02,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:49:02.140357490Z [2024-04-11 23:49:02,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:49:02.170920512Z [2024-04-11 23:49:02,170: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:49:02.173612133Z [2024-04-11 23:49:02,173: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:49:02.187418239Z [2024-04-11 23:49:02,187: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:49:02.188347173Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:49:02.188410407Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:49:02.188563610Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:49:02.188688577Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:49:02.189016788Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:49:02.189077007Z [2024-04-11 23:49:02,188: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:49:02.283628262Z [2024-04-11 23:49:02,283: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:49:03.719291101Z [2024-04-11 23:49:03,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12eeb401-1129-49a6-b448-de45da362a37] succeeded in 2.972850997999558s: None 2024-04-11T23:49:04.003101450Z [2024-04-11 23:49:04,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9fb0feb-ade4-4cae-9d23-79e8e54d57fd] succeeded in 3.2597276030001012s: None 2024-04-11T23:50:00.903957221Z [2024-04-11 23:50:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4a422a0-c3cb-463e-a5ba-441c9e2f9517] received 2024-04-11T23:50:00.905691086Z [2024-04-11 23:50:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af8e32fd-99e8-4b4a-9de1-194b784b0483] received 2024-04-11T23:50:00.914970420Z [2024-04-11 23:50:00,914: INFO/ForkPoolWorker-15] [c4a422a0-c3cb-463e-a5ba-441c9e2f9517] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:50:00.915485108Z [2024-04-11 23:50:00,915: INFO/ForkPoolWorker-16] [af8e32fd-99e8-4b4a-9de1-194b784b0483] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:50:00.942665796Z [2024-04-11 23:50:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaf6ab52-a9cd-4173-acfc-ea1c41be3710] received 2024-04-11T23:50:00.949323941Z [2024-04-11 23:50:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c056a3ae-5ff1-4fb2-b430-e5599873c8ab] received 2024-04-11T23:50:00.955493995Z [2024-04-11 23:50:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd15e664-5312-4629-94b3-c8065d32d129] received 2024-04-11T23:50:00.966957884Z [2024-04-11 23:50:00,966: INFO/ForkPoolWorker-2] [c056a3ae-5ff1-4fb2-b430-e5599873c8ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:50:00.974541376Z [2024-04-11 23:50:00,974: INFO/ForkPoolWorker-1] [aaf6ab52-a9cd-4173-acfc-ea1c41be3710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:01.000964431Z [2024-04-11 23:50:01,000: INFO/ForkPoolWorker-3] [fd15e664-5312-4629-94b3-c8065d32d129] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:50:01.236801316Z [2024-04-11 23:50:01,231: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:50:01.264928734Z [2024-04-11 23:50:01,261: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:50:01.382333281Z [2024-04-11 23:50:01,379: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:50:01.497506858Z [2024-04-11 23:50:01,497: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:01.541461076Z [2024-04-11 23:50:01,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:50:01.687150561Z [2024-04-11 23:50:01,686: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:50:01.704928331Z [2024-04-11 23:50:01,690: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:01.781425628Z [2024-04-11 23:50:01,778: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:50:01.795844229Z [2024-04-11 23:50:01,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:50:01.804196002Z [2024-04-11 23:50:01,803: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:50:01.804480898Z [2024-04-11 23:50:01,804: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:50:01.804624254Z [2024-04-11 23:50:01,804: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:50:01.808735789Z [2024-04-11 23:50:01,808: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:50:02.010987695Z [2024-04-11 23:50:02,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:02.566522221Z [2024-04-11 23:50:02,566: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:50:02.569837141Z [2024-04-11 23:50:02,569: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:02.610667435Z [2024-04-11 23:50:02,610: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:50:02.613196913Z [2024-04-11 23:50:02,613: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:02.613288233Z [2024-04-11 23:50:02,613: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:02.613452182Z [2024-04-11 23:50:02,613: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:02.613569735Z [2024-04-11 23:50:02,613: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:50:02.614008374Z [2024-04-11 23:50:02,613: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:50:02.614135733Z [2024-04-11 23:50:02,614: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:02.653145105Z [2024-04-11 23:50:02,652: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c056a3ae-5ff1-4fb2-b430-e5599873c8ab] succeeded in 1.6971007060001284s: None 2024-04-11T23:50:02.773636538Z [2024-04-11 23:50:02,773: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:03.134083595Z [2024-04-11 23:50:03,133: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-11T23:50:03.137565724Z [2024-04-11 23:50:03,137: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:03.161460080Z [2024-04-11 23:50:03,161: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-11T23:50:03.167956625Z [2024-04-11 23:50:03,167: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:03.167981611Z [2024-04-11 23:50:03,167: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:03.168721213Z [2024-04-11 23:50:03,167: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:03.172562833Z [2024-04-11 23:50:03,168: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-11T23:50:03.172858820Z [2024-04-11 23:50:03,172: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:50:03.172930493Z [2024-04-11 23:50:03,172: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:03.242425916Z [2024-04-11 23:50:03,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4a422a0-c3cb-463e-a5ba-441c9e2f9517] succeeded in 2.335817913000028s: None 2024-04-11T23:50:03.287460391Z [2024-04-11 23:50:03,287: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:03.515015774Z [2024-04-11 23:50:03,514: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:50:03.517821925Z [2024-04-11 23:50:03,517: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:03.534605208Z [2024-04-11 23:50:03,534: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:50:03.537672749Z [2024-04-11 23:50:03,537: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:03.537775265Z [2024-04-11 23:50:03,537: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:03.537913903Z [2024-04-11 23:50:03,537: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:03.537934455Z [2024-04-11 23:50:03,537: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:50:03.538190801Z [2024-04-11 23:50:03,538: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:50:03.538230853Z [2024-04-11 23:50:03,538: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:03.664114519Z [2024-04-11 23:50:03,663: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:04.406947570Z [2024-04-11 23:50:04,406: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aaf6ab52-a9cd-4173-acfc-ea1c41be3710] succeeded in 3.4532074339995233s: None 2024-04-11T23:50:04.408953273Z [2024-04-11 23:50:04,408: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af8e32fd-99e8-4b4a-9de1-194b784b0483] succeeded in 3.4976808310002525s: None 2024-04-11T23:50:05.072231499Z [2024-04-11 23:50:05,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a86bcf3d-18d1-4ec0-bb4b-d9cf6a9f27c9] received 2024-04-11T23:50:05.089238730Z [2024-04-11 23:50:05,088: INFO/ForkPoolWorker-15] [a86bcf3d-18d1-4ec0-bb4b-d9cf6a9f27c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:05.136588083Z [2024-04-11 23:50:05,136: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fd15e664-5312-4629-94b3-c8065d32d129] succeeded in 4.178406150000228s: None 2024-04-11T23:50:05.325458916Z [2024-04-11 23:50:05,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:50:06.350046907Z [2024-04-11 23:50:06,349: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:50:06.353085651Z [2024-04-11 23:50:06,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:06.374349864Z [2024-04-11 23:50:06,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:50:06.375626452Z [2024-04-11 23:50:06,375: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:06.375784161Z [2024-04-11 23:50:06,375: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:06.375981502Z [2024-04-11 23:50:06,375: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:06.376122581Z [2024-04-11 23:50:06,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:50:06.377016706Z [2024-04-11 23:50:06,376: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:50:06.377031335Z [2024-04-11 23:50:06,376: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:06.457291232Z [2024-04-11 23:50:06,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:07.143910810Z [2024-04-11 23:50:07,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a86bcf3d-18d1-4ec0-bb4b-d9cf6a9f27c9] succeeded in 2.066641788999732s: None 2024-04-11T23:50:07.442536544Z [2024-04-11 23:50:07,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0759941e-2d49-4e14-98f6-7e85792a65fc] received 2024-04-11T23:50:07.453720843Z [2024-04-11 23:50:07,453: INFO/ForkPoolWorker-15] [0759941e-2d49-4e14-98f6-7e85792a65fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:50:07.694261636Z [2024-04-11 23:50:07,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:50:08.817979809Z [2024-04-11 23:50:08,817: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:50:08.820610737Z [2024-04-11 23:50:08,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:08.838943279Z [2024-04-11 23:50:08,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:50:08.840104824Z [2024-04-11 23:50:08,839: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:08.840127781Z [2024-04-11 23:50:08,840: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:08.840217687Z [2024-04-11 23:50:08,840: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:08.840238025Z [2024-04-11 23:50:08,840: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:50:08.840470264Z [2024-04-11 23:50:08,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:50:08.840553799Z [2024-04-11 23:50:08,840: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:08.923253842Z [2024-04-11 23:50:08,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:09.603324597Z [2024-04-11 23:50:09,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0759941e-2d49-4e14-98f6-7e85792a65fc] succeeded in 2.1579632799994215s: None 2024-04-11T23:50:10.117506637Z [2024-04-11 23:50:10,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[657855aa-c81e-44ed-a64f-e5d0daf6e59f] received 2024-04-11T23:50:10.136799991Z [2024-04-11 23:50:10,136: INFO/ForkPoolWorker-15] [657855aa-c81e-44ed-a64f-e5d0daf6e59f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:10.365577885Z [2024-04-11 23:50:10,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:50:11.316741293Z [2024-04-11 23:50:11,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:50:11.319668657Z [2024-04-11 23:50:11,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:50:11.338684110Z [2024-04-11 23:50:11,338: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:50:11.340126065Z [2024-04-11 23:50:11,339: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:50:11.340299284Z [2024-04-11 23:50:11,340: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:50:11.340528683Z [2024-04-11 23:50:11,340: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:50:11.340695212Z [2024-04-11 23:50:11,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:50:11.341040352Z [2024-04-11 23:50:11,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:50:11.341159623Z [2024-04-11 23:50:11,340: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:50:11.417713586Z [2024-04-11 23:50:11,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:50:12.030907159Z [2024-04-11 23:50:12,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[657855aa-c81e-44ed-a64f-e5d0daf6e59f] succeeded in 1.9118145550000918s: None 2024-04-11T23:51:01.031618148Z [2024-04-11 23:51:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76a05223-4b8d-46c8-8d0c-8878777c6a2a] received 2024-04-11T23:51:01.037896270Z [2024-04-11 23:51:01,037: INFO/ForkPoolWorker-15] [76a05223-4b8d-46c8-8d0c-8878777c6a2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:51:01.044907518Z [2024-04-11 23:51:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d6afe53-b427-4edd-a602-10df6926d5fa] received 2024-04-11T23:51:01.055200640Z [2024-04-11 23:51:01,054: INFO/ForkPoolWorker-16] [5d6afe53-b427-4edd-a602-10df6926d5fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:51:01.064620154Z [2024-04-11 23:51:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9e6bd73-c6d0-4b14-b1e3-6e6ffe56b231] received 2024-04-11T23:51:01.085405900Z [2024-04-11 23:51:01,085: INFO/ForkPoolWorker-1] [d9e6bd73-c6d0-4b14-b1e3-6e6ffe56b231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:51:01.446843629Z [2024-04-11 23:51:01,443: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:51:01.451611674Z [2024-04-11 23:51:01,448: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:51:01.489135613Z [2024-04-11 23:51:01,482: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:51:01.634623606Z [2024-04-11 23:51:01,634: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:51:01.651649466Z [2024-04-11 23:51:01,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:51:01.724234909Z [2024-04-11 23:51:01,720: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:51:01.724254553Z [2024-04-11 23:51:01,722: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:51:01.724258406Z [2024-04-11 23:51:01,722: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:51:01.724269025Z [2024-04-11 23:51:01,723: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:51:01.724272071Z [2024-04-11 23:51:01,723: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:51:01.873726716Z [2024-04-11 23:51:01,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:51:02.497378743Z [2024-04-11 23:51:02,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d6afe53-b427-4edd-a602-10df6926d5fa] succeeded in 1.4512092620007024s: None 2024-04-11T23:51:02.948711597Z [2024-04-11 23:51:02,948: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:51:02.953132842Z [2024-04-11 23:51:02,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:51:02.985346169Z [2024-04-11 23:51:02,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:51:02.992614941Z [2024-04-11 23:51:02,985: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:51:02.992631079Z [2024-04-11 23:51:02,985: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:51:02.992634770Z [2024-04-11 23:51:02,986: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:51:02.992637889Z [2024-04-11 23:51:02,986: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:51:02.992640875Z [2024-04-11 23:51:02,986: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:51:02.992643760Z [2024-04-11 23:51:02,986: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:51:03.112033760Z [2024-04-11 23:51:03,107: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:51:03.168180105Z [2024-04-11 23:51:03,167: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:51:03.173725804Z [2024-04-11 23:51:03,171: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:51:03.231603678Z [2024-04-11 23:51:03,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:51:03.235547440Z [2024-04-11 23:51:03,232: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:51:03.235559990Z [2024-04-11 23:51:03,232: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:51:03.235563859Z [2024-04-11 23:51:03,232: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:51:03.235567277Z [2024-04-11 23:51:03,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:51:03.235570587Z [2024-04-11 23:51:03,233: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:51:03.235573401Z [2024-04-11 23:51:03,233: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:51:03.335221778Z [2024-04-11 23:51:03,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:51:04.968170373Z [2024-04-11 23:51:04,967: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9e6bd73-c6d0-4b14-b1e3-6e6ffe56b231] succeeded in 3.8971680459999334s: None 2024-04-11T23:51:05.239129125Z [2024-04-11 23:51:05,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76a05223-4b8d-46c8-8d0c-8878777c6a2a] succeeded in 4.204429368000092s: None 2024-04-11T23:52:00.941916944Z [2024-04-11 23:52:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[777e39df-36e6-4d3f-88a9-c04ff18eb3d4] received 2024-04-11T23:52:00.945983625Z [2024-04-11 23:52:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[234b509e-2d0e-49f9-b0bb-ca0d8ec38f02] received 2024-04-11T23:52:00.946804032Z [2024-04-11 23:52:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2c88bd1-95bf-4d3d-afd2-7e52437452d5] received 2024-04-11T23:52:00.950391216Z [2024-04-11 23:52:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c00781d-80e6-46fc-a638-62e499d75d3b] received 2024-04-11T23:52:00.954526887Z [2024-04-11 23:52:00,954: INFO/ForkPoolWorker-16] [234b509e-2d0e-49f9-b0bb-ca0d8ec38f02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:52:00.956146043Z [2024-04-11 23:52:00,955: INFO/ForkPoolWorker-1] [c2c88bd1-95bf-4d3d-afd2-7e52437452d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:52:00.960196499Z [2024-04-11 23:52:00,959: INFO/ForkPoolWorker-15] [777e39df-36e6-4d3f-88a9-c04ff18eb3d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:52:00.967330066Z [2024-04-11 23:52:00,967: INFO/ForkPoolWorker-2] [1c00781d-80e6-46fc-a638-62e499d75d3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:52:01.220250292Z [2024-04-11 23:52:01,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:52:01.230483943Z [2024-04-11 23:52:01,227: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:52:01.237648900Z [2024-04-11 23:52:01,234: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:52:01.252724576Z [2024-04-11 23:52:01,249: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:52:01.392332802Z [2024-04-11 23:52:01,391: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:52:01.395791792Z [2024-04-11 23:52:01,395: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:52:01.437873929Z [2024-04-11 23:52:01,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:52:01.444724406Z [2024-04-11 23:52:01,444: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:52:01.448781747Z [2024-04-11 23:52:01,448: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:52:01.448923563Z [2024-04-11 23:52:01,448: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:52:01.448989062Z [2024-04-11 23:52:01,448: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:52:01.449433404Z [2024-04-11 23:52:01,449: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:52:01.535148745Z [2024-04-11 23:52:01,534: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:52:01.997279595Z [2024-04-11 23:52:01,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[777e39df-36e6-4d3f-88a9-c04ff18eb3d4] succeeded in 1.0443301730001622s: None 2024-04-11T23:52:02.106505078Z [2024-04-11 23:52:02,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2c88bd1-95bf-4d3d-afd2-7e52437452d5] succeeded in 1.1558310059999712s: None 2024-04-11T23:52:02.366088111Z [2024-04-11 23:52:02,365: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:52:02.368916766Z [2024-04-11 23:52:02,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:52:02.392924203Z [2024-04-11 23:52:02,392: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:52:02.394503715Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:52:02.394537069Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:52:02.394565320Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:52:02.394669170Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:52:02.394888243Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:52:02.394912973Z [2024-04-11 23:52:02,394: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:52:02.435958731Z [2024-04-11 23:52:02,435: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:52:02.439117219Z [2024-04-11 23:52:02,438: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:52:02.467109650Z [2024-04-11 23:52:02,466: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:52:02.468783606Z [2024-04-11 23:52:02,468: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:52:02.469005817Z [2024-04-11 23:52:02,468: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:52:02.469392397Z [2024-04-11 23:52:02,469: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:52:02.469649400Z [2024-04-11 23:52:02,469: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:52:02.469934641Z [2024-04-11 23:52:02,469: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:52:02.470270966Z [2024-04-11 23:52:02,470: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:52:02.470589562Z [2024-04-11 23:52:02,470: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:52:02.555411662Z [2024-04-11 23:52:02,555: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:52:03.994694931Z [2024-04-11 23:52:03,994: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c00781d-80e6-46fc-a638-62e499d75d3b] succeeded in 3.039184762000332s: None 2024-04-11T23:52:04.223103776Z [2024-04-11 23:52:04,222: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[234b509e-2d0e-49f9-b0bb-ca0d8ec38f02] succeeded in 3.2749532230000113s: None 2024-04-11T23:53:01.019458402Z [2024-04-11 23:53:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[530b7d43-4b1f-4464-ae92-e58aa1236768] received 2024-04-11T23:53:01.025300223Z [2024-04-11 23:53:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22db85d2-bd10-4ed6-9fb1-3fc84f138b1d] received 2024-04-11T23:53:01.027910384Z [2024-04-11 23:53:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7abf0dea-04b4-44a3-a1f5-4c53b3b030ab] received 2024-04-11T23:53:01.029361359Z [2024-04-11 23:53:01,029: INFO/ForkPoolWorker-15] [530b7d43-4b1f-4464-ae92-e58aa1236768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:53:01.038405197Z [2024-04-11 23:53:01,037: INFO/ForkPoolWorker-16] [22db85d2-bd10-4ed6-9fb1-3fc84f138b1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:53:01.040156288Z [2024-04-11 23:53:01,040: INFO/ForkPoolWorker-1] [7abf0dea-04b4-44a3-a1f5-4c53b3b030ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:53:01.281015982Z [2024-04-11 23:53:01,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:53:01.292134498Z [2024-04-11 23:53:01,289: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:53:01.313771299Z [2024-04-11 23:53:01,309: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:53:01.449092277Z [2024-04-11 23:53:01,448: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:53:01.455539786Z [2024-04-11 23:53:01,454: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:53:01.481005826Z [2024-04-11 23:53:01,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:53:01.482567859Z [2024-04-11 23:53:01,482: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:53:01.482681942Z [2024-04-11 23:53:01,482: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:53:01.482723091Z [2024-04-11 23:53:01,482: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:53:01.482932568Z [2024-04-11 23:53:01,482: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:53:01.571955181Z [2024-04-11 23:53:01,571: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:53:02.209949704Z [2024-04-11 23:53:02,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22db85d2-bd10-4ed6-9fb1-3fc84f138b1d] succeeded in 1.1814656099995773s: None 2024-04-11T23:53:02.366498349Z [2024-04-11 23:53:02,366: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:53:02.369789345Z [2024-04-11 23:53:02,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:53:02.391771208Z [2024-04-11 23:53:02,391: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:53:02.393010362Z [2024-04-11 23:53:02,392: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:53:02.393169674Z [2024-04-11 23:53:02,392: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:53:02.393473099Z [2024-04-11 23:53:02,393: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:53:02.393637942Z [2024-04-11 23:53:02,393: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:53:02.393908922Z [2024-04-11 23:53:02,393: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:53:02.394334317Z [2024-04-11 23:53:02,394: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:53:02.406267788Z [2024-04-11 23:53:02,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:53:02.409186603Z [2024-04-11 23:53:02,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:53:02.427424492Z [2024-04-11 23:53:02,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:53:02.428866658Z [2024-04-11 23:53:02,428: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:53:02.428939853Z [2024-04-11 23:53:02,428: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:53:02.429074661Z [2024-04-11 23:53:02,428: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:53:02.429169375Z [2024-04-11 23:53:02,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:53:02.429389897Z [2024-04-11 23:53:02,429: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:53:02.429471060Z [2024-04-11 23:53:02,429: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:53:02.497147835Z [2024-04-11 23:53:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:53:02.503014040Z [2024-04-11 23:53:02,502: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:53:04.379504661Z [2024-04-11 23:53:04,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[530b7d43-4b1f-4464-ae92-e58aa1236768] succeeded in 3.3572927340001115s: None 2024-04-11T23:53:05.040222221Z [2024-04-11 23:53:05,039: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7abf0dea-04b4-44a3-a1f5-4c53b3b030ab] succeeded in 4.01053901799969s: None 2024-04-11T23:54:01.076511350Z [2024-04-11 23:54:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a28662c-9227-4731-ac3a-5624c268161f] received 2024-04-11T23:54:01.076543296Z [2024-04-11 23:54:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5d7453a-f6a7-4b63-a30f-642aeb6207d0] received 2024-04-11T23:54:01.084211923Z [2024-04-11 23:54:01,083: INFO/ForkPoolWorker-16] [c5d7453a-f6a7-4b63-a30f-642aeb6207d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:54:01.087237667Z [2024-04-11 23:54:01,086: INFO/ForkPoolWorker-15] [0a28662c-9227-4731-ac3a-5624c268161f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:54:01.093340577Z [2024-04-11 23:54:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d98fc30-258c-4abb-8095-973f42a6b787] received 2024-04-11T23:54:01.095670529Z [2024-04-11 23:54:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34197cb3-afc6-4573-99a9-9d8cd3e85704] received 2024-04-11T23:54:01.102324682Z [2024-04-11 23:54:01,102: INFO/ForkPoolWorker-2] [34197cb3-afc6-4573-99a9-9d8cd3e85704] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:54:01.209345288Z [2024-04-11 23:54:01,208: INFO/ForkPoolWorker-1] [0d98fc30-258c-4abb-8095-973f42a6b787] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:54:01.529085068Z [2024-04-11 23:54:01,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:54:01.530068557Z [2024-04-11 23:54:01,523: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:54:01.599163212Z [2024-04-11 23:54:01,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:54:01.759599700Z [2024-04-11 23:54:01,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:54:01.794646076Z [2024-04-11 23:54:01,794: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:54:01.850366295Z [2024-04-11 23:54:01,850: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:54:01.853669268Z [2024-04-11 23:54:01,853: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:54:01.879376639Z [2024-04-11 23:54:01,879: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:54:01.880938488Z [2024-04-11 23:54:01,880: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:54:01.881058808Z [2024-04-11 23:54:01,880: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:54:01.881126662Z [2024-04-11 23:54:01,881: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:54:01.883637467Z [2024-04-11 23:54:01,881: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:54:01.978241257Z [2024-04-11 23:54:01,978: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:54:02.336133378Z [2024-04-11 23:54:02,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a28662c-9227-4731-ac3a-5624c268161f] succeeded in 1.2600669420007762s: None 2024-04-11T23:54:02.636260626Z [2024-04-11 23:54:02,635: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34197cb3-afc6-4573-99a9-9d8cd3e85704] succeeded in 1.5392299410004853s: None 2024-04-11T23:54:02.741096756Z [2024-04-11 23:54:02,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:54:02.744025788Z [2024-04-11 23:54:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:54:02.770487862Z [2024-04-11 23:54:02,770: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:54:02.771745678Z [2024-04-11 23:54:02,771: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:54:02.771940227Z [2024-04-11 23:54:02,771: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:54:02.772148319Z [2024-04-11 23:54:02,771: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:54:02.772296882Z [2024-04-11 23:54:02,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:54:02.772599627Z [2024-04-11 23:54:02,772: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:54:02.772741861Z [2024-04-11 23:54:02,772: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:54:02.838396820Z [2024-04-11 23:54:02,838: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:54:03.036023630Z [2024-04-11 23:54:03,035: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:54:03.038967478Z [2024-04-11 23:54:03,038: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:54:03.061568221Z [2024-04-11 23:54:03,061: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:54:03.062873801Z [2024-04-11 23:54:03,062: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:54:03.062924145Z [2024-04-11 23:54:03,062: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:54:03.063040725Z [2024-04-11 23:54:03,062: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:54:03.063085531Z [2024-04-11 23:54:03,063: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:54:03.063293025Z [2024-04-11 23:54:03,063: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:54:03.063340339Z [2024-04-11 23:54:03,063: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:54:03.154598789Z [2024-04-11 23:54:03,154: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:54:04.496761635Z [2024-04-11 23:54:04,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5d7453a-f6a7-4b63-a30f-642aeb6207d0] succeeded in 3.4204999260000477s: None 2024-04-11T23:54:05.124226589Z [2024-04-11 23:54:05,123: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d98fc30-258c-4abb-8095-973f42a6b787] succeeded in 3.9661410640001122s: None 2024-04-11T23:55:01.158699779Z [2024-04-11 23:55:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbf68b18-fcf2-4881-8e87-7c6581a836c5] received 2024-04-11T23:55:01.163016786Z [2024-04-11 23:55:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4b912d0-434a-4371-b4a3-e8a7b2392694] received 2024-04-11T23:55:01.166928324Z [2024-04-11 23:55:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fa24c8f-a974-421a-8e57-cf08f5ce3695] received 2024-04-11T23:55:01.170761853Z [2024-04-11 23:55:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[517ce490-c383-440d-a4b6-0cd17e2d9311] received 2024-04-11T23:55:01.178433740Z [2024-04-11 23:55:01,178: INFO/ForkPoolWorker-15] [cbf68b18-fcf2-4881-8e87-7c6581a836c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:01.184969950Z [2024-04-11 23:55:01,184: INFO/ForkPoolWorker-2] [517ce490-c383-440d-a4b6-0cd17e2d9311] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:55:01.187963651Z [2024-04-11 23:55:01,187: INFO/ForkPoolWorker-1] [9fa24c8f-a974-421a-8e57-cf08f5ce3695] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:55:01.188071163Z [2024-04-11 23:55:01,187: INFO/ForkPoolWorker-16] [c4b912d0-434a-4371-b4a3-e8a7b2392694] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:55:01.513886930Z [2024-04-11 23:55:01,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:55:01.515306157Z [2024-04-11 23:55:01,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:55:01.538571503Z [2024-04-11 23:55:01,534: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:55:01.540328236Z [2024-04-11 23:55:01,536: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:55:01.752549325Z [2024-04-11 23:55:01,751: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:55:01.764538092Z [2024-04-11 23:55:01,760: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:01.804542754Z [2024-04-11 23:55:01,804: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:55:01.806637638Z [2024-04-11 23:55:01,806: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:55:01.806655982Z [2024-04-11 23:55:01,806: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:55:01.806715824Z [2024-04-11 23:55:01,806: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:55:01.806884215Z [2024-04-11 23:55:01,806: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:55:01.907999396Z [2024-04-11 23:55:01,907: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:02.487140526Z [2024-04-11 23:55:02,486: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4b912d0-434a-4371-b4a3-e8a7b2392694] succeeded in 1.316214755999681s: None 2024-04-11T23:55:02.749565838Z [2024-04-11 23:55:02,749: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:55:02.752887545Z [2024-04-11 23:55:02,752: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:02.798406784Z [2024-04-11 23:55:02,798: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:55:02.801555038Z [2024-04-11 23:55:02,801: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:02.801730754Z [2024-04-11 23:55:02,801: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:02.801974981Z [2024-04-11 23:55:02,801: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:02.802122892Z [2024-04-11 23:55:02,801: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:55:02.802561517Z [2024-04-11 23:55:02,802: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:55:02.803159911Z [2024-04-11 23:55:02,803: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:02.897381023Z [2024-04-11 23:55:02,896: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:55:02.900721485Z [2024-04-11 23:55:02,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:02.924988114Z [2024-04-11 23:55:02,924: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:55:02.926322668Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:02.926377121Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:02.926506043Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:02.926689470Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:55:02.927022861Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:55:02.927080206Z [2024-04-11 23:55:02,926: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:02.929827471Z [2024-04-11 23:55:02,929: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:03.034271315Z [2024-04-11 23:55:03,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:03.070593375Z [2024-04-11 23:55:03,070: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:55:03.074162769Z [2024-04-11 23:55:03,073: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:03.099931308Z [2024-04-11 23:55:03,099: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:55:03.101272441Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:03.101373777Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:03.101445520Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:03.101513997Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:55:03.101762616Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:55:03.101771674Z [2024-04-11 23:55:03,101: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:03.198105699Z [2024-04-11 23:55:03,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:03.878141936Z [2024-04-11 23:55:03,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbf68b18-fcf2-4881-8e87-7c6581a836c5] succeeded in 2.7128081799992287s: None 2024-04-11T23:55:04.124918380Z [2024-04-11 23:55:04,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8d0c62d-3f9e-47d9-b511-7b85fdc3102c] received 2024-04-11T23:55:04.133518074Z [2024-04-11 23:55:04,133: INFO/ForkPoolWorker-15] [d8d0c62d-3f9e-47d9-b511-7b85fdc3102c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:04.387542416Z [2024-04-11 23:55:04,384: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:55:04.494760775Z [2024-04-11 23:55:04,494: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[517ce490-c383-440d-a4b6-0cd17e2d9311] succeeded in 3.3190620539999145s: None 2024-04-11T23:55:04.798727627Z [2024-04-11 23:55:04,798: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9fa24c8f-a974-421a-8e57-cf08f5ce3695] succeeded in 3.6288242949995038s: None 2024-04-11T23:55:05.573702207Z [2024-04-11 23:55:05,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:55:05.576662535Z [2024-04-11 23:55:05,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:05.601997758Z [2024-04-11 23:55:05,601: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:55:05.603736032Z [2024-04-11 23:55:05,603: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:05.603979128Z [2024-04-11 23:55:05,603: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:05.604254368Z [2024-04-11 23:55:05,604: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:05.604477947Z [2024-04-11 23:55:05,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:55:05.605008279Z [2024-04-11 23:55:05,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:55:05.605227666Z [2024-04-11 23:55:05,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:05.698706093Z [2024-04-11 23:55:05,698: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:06.418637396Z [2024-04-11 23:55:06,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8d0c62d-3f9e-47d9-b511-7b85fdc3102c] succeeded in 2.288047256000027s: None 2024-04-11T23:55:06.533539759Z [2024-04-11 23:55:06,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e189879-7e95-4f88-a95f-2dd3cf2fc4de] received 2024-04-11T23:55:06.544847207Z [2024-04-11 23:55:06,544: INFO/ForkPoolWorker-15] [1e189879-7e95-4f88-a95f-2dd3cf2fc4de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:55:06.820506022Z [2024-04-11 23:55:06,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:55:07.907798415Z [2024-04-11 23:55:07,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:55:07.911670483Z [2024-04-11 23:55:07,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:07.938012543Z [2024-04-11 23:55:07,937: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:55:07.939151507Z [2024-04-11 23:55:07,938: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:07.939218672Z [2024-04-11 23:55:07,939: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:07.939366129Z [2024-04-11 23:55:07,939: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:07.939381841Z [2024-04-11 23:55:07,939: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:55:07.939588162Z [2024-04-11 23:55:07,939: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:55:07.939614708Z [2024-04-11 23:55:07,939: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:08.041963107Z [2024-04-11 23:55:08,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:08.646294784Z [2024-04-11 23:55:08,645: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e189879-7e95-4f88-a95f-2dd3cf2fc4de] succeeded in 2.109038554000108s: None 2024-04-11T23:55:08.956169057Z [2024-04-11 23:55:08,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b28de0d7-ea32-40bb-917c-167a5bfa2527] received 2024-04-11T23:55:08.966794530Z [2024-04-11 23:55:08,966: INFO/ForkPoolWorker-15] [b28de0d7-ea32-40bb-917c-167a5bfa2527] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:09.266088329Z [2024-04-11 23:55:09,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-11T23:55:10.381752138Z [2024-04-11 23:55:10,381: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:55:10.384861388Z [2024-04-11 23:55:10,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:55:10.415497753Z [2024-04-11 23:55:10,415: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:55:10.417578186Z [2024-04-11 23:55:10,417: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:55:10.417616039Z [2024-04-11 23:55:10,417: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:55:10.417831393Z [2024-04-11 23:55:10,417: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:55:10.417859783Z [2024-04-11 23:55:10,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:55:10.418184411Z [2024-04-11 23:55:10,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-11T23:55:10.418212634Z [2024-04-11 23:55:10,418: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:55:10.521217963Z [2024-04-11 23:55:10,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:55:11.131620491Z [2024-04-11 23:55:11,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b28de0d7-ea32-40bb-917c-167a5bfa2527] succeeded in 2.1732076949992916s: None 2024-04-11T23:56:00.742954716Z [2024-04-11 23:56:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f007e3c-01b8-42f5-848f-92eb58070252] received 2024-04-11T23:56:00.746559582Z [2024-04-11 23:56:00,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c7e154c-58dd-41b0-af72-aff666f52517] received 2024-04-11T23:56:00.751525718Z [2024-04-11 23:56:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34be06a4-c317-43da-a752-31d87a34eeff] received 2024-04-11T23:56:00.753240933Z [2024-04-11 23:56:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08eff6fe-eba7-4a2a-8db9-cfcfd03ffa32] received 2024-04-11T23:56:00.766490481Z [2024-04-11 23:56:00,766: INFO/ForkPoolWorker-2] [08eff6fe-eba7-4a2a-8db9-cfcfd03ffa32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:56:00.767023298Z [2024-04-11 23:56:00,766: INFO/ForkPoolWorker-16] [1c7e154c-58dd-41b0-af72-aff666f52517] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:56:00.768639397Z [2024-04-11 23:56:00,768: INFO/ForkPoolWorker-15] [4f007e3c-01b8-42f5-848f-92eb58070252] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:56:00.775587577Z [2024-04-11 23:56:00,775: INFO/ForkPoolWorker-1] [34be06a4-c317-43da-a752-31d87a34eeff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:56:01.021057938Z [2024-04-11 23:56:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:56:01.080469987Z [2024-04-11 23:56:01,076: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:56:01.118465107Z [2024-04-11 23:56:01,114: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:56:01.156612351Z [2024-04-11 23:56:01,156: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-11T23:56:01.159891675Z [2024-04-11 23:56:01,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:56:01.179111507Z [2024-04-11 23:56:01,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:56:01.180135035Z [2024-04-11 23:56:01,179: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:56:01.180170362Z [2024-04-11 23:56:01,180: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:56:01.180329169Z [2024-04-11 23:56:01,180: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-11T23:56:01.180538228Z [2024-04-11 23:56:01,180: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:56:01.183769728Z [2024-04-11 23:56:01,175: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:56:01.251188131Z [2024-04-11 23:56:01,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:56:01.622753746Z [2024-04-11 23:56:01,622: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:56:01.985649125Z [2024-04-11 23:56:01,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f007e3c-01b8-42f5-848f-92eb58070252] succeeded in 1.2369128769996678s: None 2024-04-11T23:56:02.218114043Z [2024-04-11 23:56:02,217: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c7e154c-58dd-41b0-af72-aff666f52517] succeeded in 1.4660208270006478s: None 2024-04-11T23:56:02.417331332Z [2024-04-11 23:56:02,416: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-11T23:56:02.420240096Z [2024-04-11 23:56:02,419: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:56:02.451794530Z [2024-04-11 23:56:02,451: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:56:02.454585328Z [2024-04-11 23:56:02,454: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:56:02.454601744Z [2024-04-11 23:56:02,454: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:56:02.454927457Z [2024-04-11 23:56:02,454: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:56:02.454955802Z [2024-04-11 23:56:02,454: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-11T23:56:02.455225046Z [2024-04-11 23:56:02,455: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:56:02.455236722Z [2024-04-11 23:56:02,455: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:56:02.568397893Z [2024-04-11 23:56:02,568: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:56:02.656282880Z [2024-04-11 23:56:02,655: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:56:02.659210791Z [2024-04-11 23:56:02,658: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:56:02.679744697Z [2024-04-11 23:56:02,679: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:56:02.680816196Z [2024-04-11 23:56:02,680: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:56:02.680850129Z [2024-04-11 23:56:02,680: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:56:02.681036872Z [2024-04-11 23:56:02,680: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:56:02.681137570Z [2024-04-11 23:56:02,680: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:56:02.681481562Z [2024-04-11 23:56:02,681: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:56:02.681594629Z [2024-04-11 23:56:02,681: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:56:02.767328605Z [2024-04-11 23:56:02,767: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:56:05.167124442Z [2024-04-11 23:56:05,166: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34be06a4-c317-43da-a752-31d87a34eeff] succeeded in 4.410878496000805s: None 2024-04-11T23:56:05.202249508Z [2024-04-11 23:56:05,201: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[08eff6fe-eba7-4a2a-8db9-cfcfd03ffa32] succeeded in 4.445999588000632s: None 2024-04-11T23:57:00.237524241Z [2024-04-11 23:57:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6edc906d-d7da-4046-b139-d22c67439adf] received 2024-04-11T23:57:00.252903195Z [2024-04-11 23:57:00,252: INFO/ForkPoolWorker-15] [6edc906d-d7da-4046-b139-d22c67439adf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:57:00.257636473Z [2024-04-11 23:57:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dbc85c2-04b3-4c45-9ce0-695128724851] received 2024-04-11T23:57:00.264002872Z [2024-04-11 23:57:00,263: INFO/ForkPoolWorker-16] [0dbc85c2-04b3-4c45-9ce0-695128724851] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:57:00.267761767Z [2024-04-11 23:57:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43e8d806-5965-4590-bdb0-9a4d87e0e933] received 2024-04-11T23:57:00.277396745Z [2024-04-11 23:57:00,277: INFO/ForkPoolWorker-1] [43e8d806-5965-4590-bdb0-9a4d87e0e933] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:57:00.588963641Z [2024-04-11 23:57:00,585: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:57:00.595936942Z [2024-04-11 23:57:00,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:57:00.651207185Z [2024-04-11 23:57:00,648: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:57:00.801832840Z [2024-04-11 23:57:00,801: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-11T23:57:00.805607339Z [2024-04-11 23:57:00,805: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:57:00.831850668Z [2024-04-11 23:57:00,831: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:57:00.832780068Z [2024-04-11 23:57:00,832: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:57:00.832894587Z [2024-04-11 23:57:00,832: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:57:00.832988488Z [2024-04-11 23:57:00,832: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-11T23:57:00.833563364Z [2024-04-11 23:57:00,833: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:57:00.922322525Z [2024-04-11 23:57:00,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:57:01.394629215Z [2024-04-11 23:57:01,394: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43e8d806-5965-4590-bdb0-9a4d87e0e933] succeeded in 1.1238891620005234s: None 2024-04-11T23:57:01.547427211Z [2024-04-11 23:57:01,547: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:57:01.550988092Z [2024-04-11 23:57:01,550: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:57:01.569989743Z [2024-04-11 23:57:01,569: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:57:01.571103651Z [2024-04-11 23:57:01,570: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:57:01.571129296Z [2024-04-11 23:57:01,571: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:57:01.571237008Z [2024-04-11 23:57:01,571: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:57:01.571281211Z [2024-04-11 23:57:01,571: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:57:01.571492916Z [2024-04-11 23:57:01,571: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:57:01.571516685Z [2024-04-11 23:57:01,571: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:57:01.643878579Z [2024-04-11 23:57:01,643: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:57:01.648038496Z [2024-04-11 23:57:01,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:57:01.657589630Z [2024-04-11 23:57:01,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:57:01.678541856Z [2024-04-11 23:57:01,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:57:01.681215500Z [2024-04-11 23:57:01,679: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:57:01.681221139Z [2024-04-11 23:57:01,680: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:57:01.681224834Z [2024-04-11 23:57:01,680: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:57:01.681228101Z [2024-04-11 23:57:01,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:57:01.681230958Z [2024-04-11 23:57:01,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:57:01.681233531Z [2024-04-11 23:57:01,680: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:57:01.770629519Z [2024-04-11 23:57:01,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:57:03.080983232Z [2024-04-11 23:57:03,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0dbc85c2-04b3-4c45-9ce0-695128724851] succeeded in 2.8218937040001038s: None 2024-04-11T23:57:04.289423113Z [2024-04-11 23:57:04,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6edc906d-d7da-4046-b139-d22c67439adf] succeeded in 4.0490376529996865s: None 2024-04-11T23:58:00.306478610Z [2024-04-11 23:58:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e206c72-5c90-46e8-a290-ae5a3dccd238] received 2024-04-11T23:58:00.310558125Z [2024-04-11 23:58:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[551110ff-64c3-4fc9-b984-ddcf9a8ced32] received 2024-04-11T23:58:00.312725603Z [2024-04-11 23:58:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[278f24f0-a751-4b40-94e3-71943f2d06df] received 2024-04-11T23:58:00.314302679Z [2024-04-11 23:58:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac552ab-1f76-4210-8a13-2036b149352a] received 2024-04-11T23:58:00.320228090Z [2024-04-11 23:58:00,319: INFO/ForkPoolWorker-15] [6e206c72-5c90-46e8-a290-ae5a3dccd238] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:58:00.322024958Z [2024-04-11 23:58:00,321: INFO/ForkPoolWorker-1] [278f24f0-a751-4b40-94e3-71943f2d06df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:58:00.322510999Z [2024-04-11 23:58:00,322: INFO/ForkPoolWorker-2] [6ac552ab-1f76-4210-8a13-2036b149352a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:58:00.325961837Z [2024-04-11 23:58:00,325: INFO/ForkPoolWorker-16] [551110ff-64c3-4fc9-b984-ddcf9a8ced32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:58:00.618823875Z [2024-04-11 23:58:00,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:58:00.640224385Z [2024-04-11 23:58:00,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:58:00.642390529Z [2024-04-11 23:58:00,639: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:58:00.649057791Z [2024-04-11 23:58:00,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-11T23:58:00.789704999Z [2024-04-11 23:58:00,789: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-11T23:58:00.793000964Z [2024-04-11 23:58:00,792: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:58:00.821256147Z [2024-04-11 23:58:00,821: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-11T23:58:00.825072848Z [2024-04-11 23:58:00,824: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:58:00.825254926Z [2024-04-11 23:58:00,825: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:58:00.825455704Z [2024-04-11 23:58:00,825: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-11T23:58:00.825720213Z [2024-04-11 23:58:00,825: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:58:00.901881612Z [2024-04-11 23:58:00,901: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:58:00.933499463Z [2024-04-11 23:58:00,933: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:58:01.495947083Z [2024-04-11 23:58:01,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e206c72-5c90-46e8-a290-ae5a3dccd238] succeeded in 1.1868178480008282s: None 2024-04-11T23:58:01.532117448Z [2024-04-11 23:58:01,531: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ac552ab-1f76-4210-8a13-2036b149352a] succeeded in 1.2164860779994342s: None 2024-04-11T23:58:01.875963231Z [2024-04-11 23:58:01,875: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:58:01.879578143Z [2024-04-11 23:58:01,879: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:58:01.902531790Z [2024-04-11 23:58:01,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:58:01.903865260Z [2024-04-11 23:58:01,903: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:58:01.903880836Z [2024-04-11 23:58:01,903: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:58:01.904052677Z [2024-04-11 23:58:01,903: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:58:01.904114932Z [2024-04-11 23:58:01,904: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:58:01.904490989Z [2024-04-11 23:58:01,904: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:58:01.904535078Z [2024-04-11 23:58:01,904: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:58:01.926756702Z [2024-04-11 23:58:01,926: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-11T23:58:01.931095791Z [2024-04-11 23:58:01,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:58:01.953156622Z [2024-04-11 23:58:01,952: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:58:01.954434032Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:58:01.954513516Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:58:01.954573077Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:58:01.954730273Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-11T23:58:01.954897398Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:58:01.954975940Z [2024-04-11 23:58:01,954: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:58:01.993351568Z [2024-04-11 23:58:01,993: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:58:02.027275048Z [2024-04-11 23:58:02,027: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:58:03.490984774Z [2024-04-11 23:58:03,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[278f24f0-a751-4b40-94e3-71943f2d06df] succeeded in 3.1769420109994826s: None 2024-04-11T23:58:03.902628199Z [2024-04-11 23:58:03,902: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[551110ff-64c3-4fc9-b984-ddcf9a8ced32] succeeded in 3.5894247240003097s: None 2024-04-11T23:59:00.898721133Z [2024-04-11 23:59:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be148fa8-cc4c-4cd0-84d6-9fcadd1b8f92] received 2024-04-11T23:59:00.903567370Z [2024-04-11 23:59:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d712e7a-7eb6-4c3b-aed7-63448c8d87a9] received 2024-04-11T23:59:00.905506939Z [2024-04-11 23:59:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a1d24d7-17c2-4930-b4f0-645d460993ca] received 2024-04-11T23:59:00.911116139Z [2024-04-11 23:59:00,910: INFO/ForkPoolWorker-16] [3d712e7a-7eb6-4c3b-aed7-63448c8d87a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:59:00.912272524Z [2024-04-11 23:59:00,912: INFO/ForkPoolWorker-1] [3a1d24d7-17c2-4930-b4f0-645d460993ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:59:00.912768097Z [2024-04-11 23:59:00,912: INFO/ForkPoolWorker-15] [be148fa8-cc4c-4cd0-84d6-9fcadd1b8f92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:59:01.157882056Z [2024-04-11 23:59:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-11T23:59:01.173915723Z [2024-04-11 23:59:01,171: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-11T23:59:01.175915198Z [2024-04-11 23:59:01,173: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-11T23:59:01.316134833Z [2024-04-11 23:59:01,315: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-11T23:59:01.319494556Z [2024-04-11 23:59:01,319: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:59:01.342646191Z [2024-04-11 23:59:01,342: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-11T23:59:01.343725998Z [2024-04-11 23:59:01,343: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-11T23:59:01.343893310Z [2024-04-11 23:59:01,343: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-11T23:59:01.343991039Z [2024-04-11 23:59:01,343: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-11T23:59:01.344187905Z [2024-04-11 23:59:01,344: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-11T23:59:01.429192854Z [2024-04-11 23:59:01,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:59:02.037751929Z [2024-04-11 23:59:02,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d712e7a-7eb6-4c3b-aed7-63448c8d87a9] succeeded in 1.131119452999883s: None 2024-04-11T23:59:02.195951670Z [2024-04-11 23:59:02,195: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-11T23:59:02.199131070Z [2024-04-11 23:59:02,198: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:59:02.213386382Z [2024-04-11 23:59:02,213: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-11T23:59:02.216853142Z [2024-04-11 23:59:02,216: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-11T23:59:02.217465875Z [2024-04-11 23:59:02,217: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-11T23:59:02.218705422Z [2024-04-11 23:59:02,218: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:59:02.218757250Z [2024-04-11 23:59:02,218: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:59:02.218929750Z [2024-04-11 23:59:02,218: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:59:02.218991276Z [2024-04-11 23:59:02,218: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-11T23:59:02.219343006Z [2024-04-11 23:59:02,219: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-11T23:59:02.219465665Z [2024-04-11 23:59:02,219: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:59:02.233253909Z [2024-04-11 23:59:02,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-11T23:59:02.234252880Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-11T23:59:02.234337236Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-11T23:59:02.234488031Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-11T23:59:02.234557253Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-11T23:59:02.234805598Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-11T23:59:02.234890421Z [2024-04-11 23:59:02,234: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-11T23:59:02.292844055Z [2024-04-11 23:59:02,292: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:59:02.307178106Z [2024-04-11 23:59:02,306: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-11T23:59:03.833559269Z [2024-04-11 23:59:03,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be148fa8-cc4c-4cd0-84d6-9fcadd1b8f92] succeeded in 2.9317861640001865s: None 2024-04-11T23:59:04.206104139Z [2024-04-11 23:59:04,205: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a1d24d7-17c2-4930-b4f0-645d460993ca] succeeded in 3.2987772910000785s: None 2024-04-12T00:00:00.231218905Z [2024-04-12 00:00:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48f19703-d5ef-4e5c-b26a-1d09c64015e9] received 2024-04-12T00:00:00.234155571Z [2024-04-12 00:00:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eeb0db2-01ad-4acd-b586-947bcd4633c7] received 2024-04-12T00:00:00.240998885Z [2024-04-12 00:00:00,240: INFO/ForkPoolWorker-15] [48f19703-d5ef-4e5c-b26a-1d09c64015e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:00:00.246384352Z [2024-04-12 00:00:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[787048c8-90b7-461b-970a-2642c5b1b076] received 2024-04-12T00:00:00.246520381Z [2024-04-12 00:00:00,246: INFO/ForkPoolWorker-16] [8eeb0db2-01ad-4acd-b586-947bcd4633c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:00:00.253732390Z [2024-04-12 00:00:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48d5c19c-930f-4997-be2a-24e61ca2dac8] received 2024-04-12T00:00:00.255753342Z [2024-04-12 00:00:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffd3ac3e-473e-47f7-810c-d321d5c2c2f9] received 2024-04-12T00:00:00.256862740Z [2024-04-12 00:00:00,256: INFO/ForkPoolWorker-1] [787048c8-90b7-461b-970a-2642c5b1b076] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:00.263268869Z [2024-04-12 00:00:00,263: INFO/ForkPoolWorker-2] [48d5c19c-930f-4997-be2a-24e61ca2dac8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:00:00.274583719Z [2024-04-12 00:00:00,274: INFO/ForkPoolWorker-3] [ffd3ac3e-473e-47f7-810c-d321d5c2c2f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:00:00.677910899Z [2024-04-12 00:00:00,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:00:00.685233061Z [2024-04-12 00:00:00,682: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:00:00.755497235Z [2024-04-12 00:00:00,742: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:00:00.780262955Z [2024-04-12 00:00:00,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:00:00.828146694Z [2024-04-12 00:00:00,820: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:00:01.134908043Z [2024-04-12 00:00:01,134: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:00:01.148295669Z [2024-04-12 00:00:01,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:01.213510200Z [2024-04-12 00:00:01,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:00:01.218606282Z [2024-04-12 00:00:01,215: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:00:01.219200958Z [2024-04-12 00:00:01,218: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:00:01.220247703Z [2024-04-12 00:00:01,219: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:00:01.220788337Z [2024-04-12 00:00:01,220: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:00:01.319276320Z [2024-04-12 00:00:01,319: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:01.395533467Z [2024-04-12 00:00:01,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:02.214619778Z [2024-04-12 00:00:02,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48f19703-d5ef-4e5c-b26a-1d09c64015e9] succeeded in 1.9791369419999683s: None 2024-04-12T00:00:02.314009648Z [2024-04-12 00:00:02,313: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[48d5c19c-930f-4997-be2a-24e61ca2dac8] succeeded in 2.058797534000405s: None 2024-04-12T00:00:02.421851633Z [2024-04-12 00:00:02,421: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:00:02.426815308Z [2024-04-12 00:00:02,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:02.445751860Z [2024-04-12 00:00:02,445: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:00:02.450965850Z [2024-04-12 00:00:02,450: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:02.465740151Z [2024-04-12 00:00:02,465: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:00:02.467350113Z [2024-04-12 00:00:02,467: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:02.467399494Z [2024-04-12 00:00:02,467: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:02.470499865Z [2024-04-12 00:00:02,467: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:02.470624150Z [2024-04-12 00:00:02,470: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:00:02.470917282Z [2024-04-12 00:00:02,470: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:00:02.470990427Z [2024-04-12 00:00:02,470: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:02.472080137Z [2024-04-12 00:00:02,471: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:00:02.473997358Z [2024-04-12 00:00:02,473: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:02.474076478Z [2024-04-12 00:00:02,473: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:02.474210982Z [2024-04-12 00:00:02,474: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:02.474251545Z [2024-04-12 00:00:02,474: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:00:02.474696804Z [2024-04-12 00:00:02,474: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:00:02.475014083Z [2024-04-12 00:00:02,474: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:02.565340513Z [2024-04-12 00:00:02,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:02.570092089Z [2024-04-12 00:00:02,569: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:02.697799291Z [2024-04-12 00:00:02,697: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T00:00:02.700781000Z [2024-04-12 00:00:02,700: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:02.737375854Z [2024-04-12 00:00:02,737: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:00:02.740678379Z [2024-04-12 00:00:02,740: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:02.741031438Z [2024-04-12 00:00:02,740: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:02.741301943Z [2024-04-12 00:00:02,740: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:02.741393090Z [2024-04-12 00:00:02,741: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T00:00:02.741759393Z [2024-04-12 00:00:02,741: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:00:02.741866872Z [2024-04-12 00:00:02,741: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:02.836386966Z [2024-04-12 00:00:02,836: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:03.159401239Z [2024-04-12 00:00:03,159: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[787048c8-90b7-461b-970a-2642c5b1b076] succeeded in 2.9076393719997213s: None 2024-04-12T00:00:03.664498266Z [2024-04-12 00:00:03,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60213d8e-ee9f-4629-a42d-c1877350da03] received 2024-04-12T00:00:03.674991319Z [2024-04-12 00:00:03,674: INFO/ForkPoolWorker-15] [60213d8e-ee9f-4629-a42d-c1877350da03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:03.955307826Z [2024-04-12 00:00:03,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:00:04.507003208Z [2024-04-12 00:00:04,506: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ffd3ac3e-473e-47f7-810c-d321d5c2c2f9] succeeded in 4.247897076999834s: None 2024-04-12T00:00:04.988487023Z [2024-04-12 00:00:04,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:00:04.991623708Z [2024-04-12 00:00:04,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:05.016123212Z [2024-04-12 00:00:05,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:00:05.017470361Z [2024-04-12 00:00:05,017: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:05.017499245Z [2024-04-12 00:00:05,017: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:05.017694863Z [2024-04-12 00:00:05,017: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:05.017781589Z [2024-04-12 00:00:05,017: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:00:05.018257628Z [2024-04-12 00:00:05,018: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:00:05.018275728Z [2024-04-12 00:00:05,018: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:05.120007350Z [2024-04-12 00:00:05,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:05.325232402Z [2024-04-12 00:00:05,324: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8eeb0db2-01ad-4acd-b586-947bcd4633c7] succeeded in 5.088287106999815s: None 2024-04-12T00:00:05.712172966Z [2024-04-12 00:00:05,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfeb33eb-0246-4c7f-acb0-31a474f205c0] received 2024-04-12T00:00:05.720102906Z [2024-04-12 00:00:05,719: INFO/ForkPoolWorker-16] [cfeb33eb-0246-4c7f-acb0-31a474f205c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:00:05.778110729Z [2024-04-12 00:00:05,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60213d8e-ee9f-4629-a42d-c1877350da03] succeeded in 2.1104855450003015s: None 2024-04-12T00:00:06.004068599Z [2024-04-12 00:00:06,001: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:00:06.974683907Z [2024-04-12 00:00:06,974: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:00:06.977483335Z [2024-04-12 00:00:06,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:07.001828289Z [2024-04-12 00:00:07,001: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:00:07.003376412Z [2024-04-12 00:00:07,002: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:07.003406965Z [2024-04-12 00:00:07,003: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:07.003431904Z [2024-04-12 00:00:07,003: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:07.003442821Z [2024-04-12 00:00:07,003: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:00:07.003781407Z [2024-04-12 00:00:07,003: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:00:07.003792964Z [2024-04-12 00:00:07,003: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:07.092422915Z [2024-04-12 00:00:07,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:07.763231640Z [2024-04-12 00:00:07,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cfeb33eb-0246-4c7f-acb0-31a474f205c0] succeeded in 2.047124011000051s: None 2024-04-12T00:00:08.524566799Z [2024-04-12 00:00:08,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e89d2d0e-7555-4bc1-ac0b-93bb4a726248] received 2024-04-12T00:00:08.535507689Z [2024-04-12 00:00:08,535: INFO/ForkPoolWorker-15] [e89d2d0e-7555-4bc1-ac0b-93bb4a726248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:08.802659887Z [2024-04-12 00:00:08,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:00:09.819157794Z [2024-04-12 00:00:09,818: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:00:09.822105348Z [2024-04-12 00:00:09,821: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:00:09.841336205Z [2024-04-12 00:00:09,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:00:09.844006051Z [2024-04-12 00:00:09,843: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:00:09.844089325Z [2024-04-12 00:00:09,843: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:00:09.844151191Z [2024-04-12 00:00:09,843: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:00:09.844166891Z [2024-04-12 00:00:09,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:00:09.844227583Z [2024-04-12 00:00:09,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:00:09.844250044Z [2024-04-12 00:00:09,844: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:00:09.921673501Z [2024-04-12 00:00:09,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:00:10.537313422Z [2024-04-12 00:00:10,536: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e89d2d0e-7555-4bc1-ac0b-93bb4a726248] succeeded in 2.0096989849998863s: None 2024-04-12T00:01:01.179976371Z [2024-04-12 00:01:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74cae889-ea61-4b58-a45f-d3b866097e3b] received 2024-04-12T00:01:01.184683433Z [2024-04-12 00:01:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3ad1a27-d77d-4911-8fe5-fecec00d4894] received 2024-04-12T00:01:01.190617975Z [2024-04-12 00:01:01,190: INFO/ForkPoolWorker-15] [74cae889-ea61-4b58-a45f-d3b866097e3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:01:01.195888485Z [2024-04-12 00:01:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48aa2dc2-b07e-4d3e-89e2-54016362bcb5] received 2024-04-12T00:01:01.196927256Z [2024-04-12 00:01:01,196: INFO/ForkPoolWorker-16] [f3ad1a27-d77d-4911-8fe5-fecec00d4894] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:01:01.211294232Z [2024-04-12 00:01:01,210: INFO/ForkPoolWorker-1] [48aa2dc2-b07e-4d3e-89e2-54016362bcb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:01:01.464488366Z [2024-04-12 00:01:01,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:01:01.496148215Z [2024-04-12 00:01:01,492: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:01:01.554033796Z [2024-04-12 00:01:01,550: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:01:01.646917936Z [2024-04-12 00:01:01,646: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:01:01.652767239Z [2024-04-12 00:01:01,652: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:01:01.744308301Z [2024-04-12 00:01:01,744: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:01:01.750621430Z [2024-04-12 00:01:01,750: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:01:01.750787838Z [2024-04-12 00:01:01,750: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:01:01.750869067Z [2024-04-12 00:01:01,750: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:01:01.751105171Z [2024-04-12 00:01:01,751: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:01:01.852803865Z [2024-04-12 00:01:01,852: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:01:02.475073037Z [2024-04-12 00:01:02,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3ad1a27-d77d-4911-8fe5-fecec00d4894] succeeded in 1.2877353369995035s: None 2024-04-12T00:01:02.646967405Z [2024-04-12 00:01:02,646: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:01:02.649830670Z [2024-04-12 00:01:02,649: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:01:02.657530785Z [2024-04-12 00:01:02,657: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:01:02.660938786Z [2024-04-12 00:01:02,660: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:01:02.680633940Z [2024-04-12 00:01:02,680: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:01:02.682764863Z [2024-04-12 00:01:02,682: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:01:02.682788595Z [2024-04-12 00:01:02,682: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:01:02.682980954Z [2024-04-12 00:01:02,682: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:01:02.682998579Z [2024-04-12 00:01:02,682: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:01:02.683373869Z [2024-04-12 00:01:02,683: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:01:02.683388509Z [2024-04-12 00:01:02,683: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:01:02.685314180Z [2024-04-12 00:01:02,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:01:02.686842918Z [2024-04-12 00:01:02,686: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:01:02.686854261Z [2024-04-12 00:01:02,686: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:01:02.686983963Z [2024-04-12 00:01:02,686: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:01:02.686996504Z [2024-04-12 00:01:02,686: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:01:02.687218060Z [2024-04-12 00:01:02,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:01:02.687269042Z [2024-04-12 00:01:02,687: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:01:02.759708842Z [2024-04-12 00:01:02,759: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:01:02.785628691Z [2024-04-12 00:01:02,785: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:01:04.604010228Z [2024-04-12 00:01:04,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74cae889-ea61-4b58-a45f-d3b866097e3b] succeeded in 3.421058002000791s: None 2024-04-12T00:01:05.253616392Z [2024-04-12 00:01:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48aa2dc2-b07e-4d3e-89e2-54016362bcb5] succeeded in 4.054735609999625s: None 2024-04-12T00:02:00.451473112Z [2024-04-12 00:02:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfbfb4cd-7060-4bb3-9c6b-531104ee2c0c] received 2024-04-12T00:02:00.453965473Z [2024-04-12 00:02:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97465765-d7a2-44a5-89cd-97e7b8df4956] received 2024-04-12T00:02:00.458916626Z [2024-04-12 00:02:00,458: INFO/ForkPoolWorker-15] [bfbfb4cd-7060-4bb3-9c6b-531104ee2c0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:02:00.465079709Z [2024-04-12 00:02:00,464: INFO/ForkPoolWorker-16] [97465765-d7a2-44a5-89cd-97e7b8df4956] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:02:00.473465137Z [2024-04-12 00:02:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20de1bd9-b0b9-453b-8b18-cdf9283f4b02] received 2024-04-12T00:02:00.475784475Z [2024-04-12 00:02:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a88c7596-10e0-440d-aba4-6c3703263b8c] received 2024-04-12T00:02:00.484682394Z [2024-04-12 00:02:00,484: INFO/ForkPoolWorker-1] [20de1bd9-b0b9-453b-8b18-cdf9283f4b02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:02:00.492826903Z [2024-04-12 00:02:00,492: INFO/ForkPoolWorker-2] [a88c7596-10e0-440d-aba4-6c3703263b8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:02:00.766279495Z [2024-04-12 00:02:00,762: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:02:00.837037851Z [2024-04-12 00:02:00,833: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:02:00.888632476Z [2024-04-12 00:02:00,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:02:00.895611054Z [2024-04-12 00:02:00,890: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:02:01.086305398Z [2024-04-12 00:02:01,085: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:02:01.091258407Z [2024-04-12 00:02:01,090: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:02:01.112610294Z [2024-04-12 00:02:01,112: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:02:01.113865217Z [2024-04-12 00:02:01,113: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:02:01.114198738Z [2024-04-12 00:02:01,113: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:02:01.114230776Z [2024-04-12 00:02:01,114: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:02:01.114860337Z [2024-04-12 00:02:01,114: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:02:01.148573253Z [2024-04-12 00:02:01,148: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:02:01.223511806Z [2024-04-12 00:02:01,223: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:02:01.718774726Z [2024-04-12 00:02:01,718: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfbfb4cd-7060-4bb3-9c6b-531104ee2c0c] succeeded in 1.2650654680001026s: None 2024-04-12T00:02:01.926940695Z [2024-04-12 00:02:01,926: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20de1bd9-b0b9-453b-8b18-cdf9283f4b02] succeeded in 1.452293995999753s: None 2024-04-12T00:02:01.961532045Z [2024-04-12 00:02:01,961: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:02:01.964527343Z [2024-04-12 00:02:01,964: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:02:01.981442205Z [2024-04-12 00:02:01,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:02:01.982458406Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:02:01.982536191Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:02:01.982669791Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:02:01.982740782Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:02:01.982945243Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:02:01.983020853Z [2024-04-12 00:02:01,982: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:02:02.050747891Z [2024-04-12 00:02:02,050: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:02:02.061004683Z [2024-04-12 00:02:02,060: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:02:02.064062167Z [2024-04-12 00:02:02,063: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:02:02.086491895Z [2024-04-12 00:02:02,086: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:02:02.087875815Z [2024-04-12 00:02:02,087: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:02:02.088057852Z [2024-04-12 00:02:02,087: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:02:02.088734287Z [2024-04-12 00:02:02,088: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:02:02.088907666Z [2024-04-12 00:02:02,088: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:02:02.089152424Z [2024-04-12 00:02:02,089: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:02:02.089550040Z [2024-04-12 00:02:02,089: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:02:02.182352415Z [2024-04-12 00:02:02,182: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:02:03.562502752Z [2024-04-12 00:02:03,562: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97465765-d7a2-44a5-89cd-97e7b8df4956] succeeded in 3.105627287999596s: None 2024-04-12T00:02:04.059531088Z [2024-04-12 00:02:04,059: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a88c7596-10e0-440d-aba4-6c3703263b8c] succeeded in 3.580771015999744s: None 2024-04-12T00:03:00.949541880Z [2024-04-12 00:03:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7952649c-3c9e-4824-bd3a-a711b22be259] received 2024-04-12T00:03:00.952725107Z [2024-04-12 00:03:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f8ca104-3f5c-4fb3-8b72-13b74f73b501] received 2024-04-12T00:03:00.954655051Z [2024-04-12 00:03:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1639074f-443f-44a4-a1eb-97cd12fa551c] received 2024-04-12T00:03:00.957857463Z [2024-04-12 00:03:00,957: INFO/ForkPoolWorker-15] [7952649c-3c9e-4824-bd3a-a711b22be259] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:03:00.960936193Z [2024-04-12 00:03:00,960: INFO/ForkPoolWorker-1] [1639074f-443f-44a4-a1eb-97cd12fa551c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:03:00.968180999Z [2024-04-12 00:03:00,967: INFO/ForkPoolWorker-16] [0f8ca104-3f5c-4fb3-8b72-13b74f73b501] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:03:01.211294090Z [2024-04-12 00:03:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:03:01.222012587Z [2024-04-12 00:03:01,219: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:03:01.224910538Z [2024-04-12 00:03:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:03:01.374401884Z [2024-04-12 00:03:01,374: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:03:01.378253481Z [2024-04-12 00:03:01,377: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:03:01.403566354Z [2024-04-12 00:03:01,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:03:01.405277356Z [2024-04-12 00:03:01,405: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:03:01.405495492Z [2024-04-12 00:03:01,405: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:03:01.405664938Z [2024-04-12 00:03:01,405: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:03:01.405942621Z [2024-04-12 00:03:01,405: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:03:01.537578745Z [2024-04-12 00:03:01,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:03:02.089332883Z [2024-04-12 00:03:02,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7952649c-3c9e-4824-bd3a-a711b22be259] succeeded in 1.1372143700000379s: None 2024-04-12T00:03:02.274517033Z [2024-04-12 00:03:02,274: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:03:02.277497532Z [2024-04-12 00:03:02,277: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:03:02.295986935Z [2024-04-12 00:03:02,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:03:02.297447701Z [2024-04-12 00:03:02,297: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:03:02.297484400Z [2024-04-12 00:03:02,297: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:03:02.297651228Z [2024-04-12 00:03:02,297: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:03:02.297674189Z [2024-04-12 00:03:02,297: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:03:02.298346692Z [2024-04-12 00:03:02,298: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:03:02.298360682Z [2024-04-12 00:03:02,298: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:03:02.321424739Z [2024-04-12 00:03:02,321: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:03:02.324211483Z [2024-04-12 00:03:02,323: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:03:02.346036454Z [2024-04-12 00:03:02,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:03:02.347870708Z [2024-04-12 00:03:02,347: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:03:02.347964994Z [2024-04-12 00:03:02,347: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:03:02.348128162Z [2024-04-12 00:03:02,347: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:03:02.348250981Z [2024-04-12 00:03:02,348: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:03:02.348522616Z [2024-04-12 00:03:02,348: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:03:02.348615853Z [2024-04-12 00:03:02,348: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:03:02.370895408Z [2024-04-12 00:03:02,370: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:03:02.429006794Z [2024-04-12 00:03:02,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:03:03.740935544Z [2024-04-12 00:03:03,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1639074f-443f-44a4-a1eb-97cd12fa551c] succeeded in 2.784662457000195s: None 2024-04-12T00:03:04.226796284Z [2024-04-12 00:03:04,226: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f8ca104-3f5c-4fb3-8b72-13b74f73b501] succeeded in 3.271701880999899s: None 2024-04-12T00:04:00.987720599Z [2024-04-12 00:04:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91175fcb-910a-491d-a585-7fbc1a01a747] received 2024-04-12T00:04:00.990559401Z [2024-04-12 00:04:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[099d4f6f-2e6a-40d3-aaf2-719ee12059cc] received 2024-04-12T00:04:00.994040426Z [2024-04-12 00:04:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f3a790a-7d97-49ea-bdc5-f2effbce84ed] received 2024-04-12T00:04:00.996711277Z [2024-04-12 00:04:00,996: INFO/ForkPoolWorker-15] [91175fcb-910a-491d-a585-7fbc1a01a747] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:04:00.996989143Z [2024-04-12 00:04:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f05454-c283-4086-b023-70c5b99041ec] received 2024-04-12T00:04:01.007120876Z [2024-04-12 00:04:01,006: INFO/ForkPoolWorker-2] [99f05454-c283-4086-b023-70c5b99041ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:04:01.007658208Z [2024-04-12 00:04:01,007: INFO/ForkPoolWorker-1] [6f3a790a-7d97-49ea-bdc5-f2effbce84ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:04:01.009407811Z [2024-04-12 00:04:01,009: INFO/ForkPoolWorker-16] [099d4f6f-2e6a-40d3-aaf2-719ee12059cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:04:01.275139918Z [2024-04-12 00:04:01,272: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:04:01.335038563Z [2024-04-12 00:04:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:04:01.350411562Z [2024-04-12 00:04:01,340: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:04:01.364053054Z [2024-04-12 00:04:01,360: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:04:01.505828791Z [2024-04-12 00:04:01,505: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:04:01.509208113Z [2024-04-12 00:04:01,508: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:04:01.549275668Z [2024-04-12 00:04:01,547: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:04:01.557178798Z [2024-04-12 00:04:01,556: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:04:01.557318810Z [2024-04-12 00:04:01,557: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:04:01.557452070Z [2024-04-12 00:04:01,557: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:04:01.557760587Z [2024-04-12 00:04:01,557: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:04:01.633811023Z [2024-04-12 00:04:01,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:04:01.751122678Z [2024-04-12 00:04:01,750: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:04:02.280599991Z [2024-04-12 00:04:02,280: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99f05454-c283-4086-b023-70c5b99041ec] succeeded in 1.2817079850001392s: None 2024-04-12T00:04:02.331040039Z [2024-04-12 00:04:02,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91175fcb-910a-491d-a585-7fbc1a01a747] succeeded in 1.3392567319997397s: None 2024-04-12T00:04:02.536496892Z [2024-04-12 00:04:02,536: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:04:02.539290462Z [2024-04-12 00:04:02,538: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:04:02.562591923Z [2024-04-12 00:04:02,562: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:04:02.564106920Z [2024-04-12 00:04:02,563: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:04:02.564226190Z [2024-04-12 00:04:02,564: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:04:02.564483565Z [2024-04-12 00:04:02,564: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:04:02.564610439Z [2024-04-12 00:04:02,564: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:04:02.564904931Z [2024-04-12 00:04:02,564: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:04:02.565038198Z [2024-04-12 00:04:02,564: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:04:02.640878376Z [2024-04-12 00:04:02,640: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:04:02.678867938Z [2024-04-12 00:04:02,678: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:04:02.682104422Z [2024-04-12 00:04:02,681: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:04:02.709668497Z [2024-04-12 00:04:02,709: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:04:02.711454701Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:04:02.711473479Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:04:02.711645618Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:04:02.711654214Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:04:02.711967963Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:04:02.711975667Z [2024-04-12 00:04:02,711: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:04:02.793259950Z [2024-04-12 00:04:02,792: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:04:04.318409669Z [2024-04-12 00:04:04,317: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f3a790a-7d97-49ea-bdc5-f2effbce84ed] succeeded in 3.3197098199998436s: None 2024-04-12T00:04:04.426566706Z [2024-04-12 00:04:04,426: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[099d4f6f-2e6a-40d3-aaf2-719ee12059cc] succeeded in 3.4332641780001723s: None 2024-04-12T00:05:00.637076435Z [2024-04-12 00:05:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a4f0450-1b0a-4bc0-95b9-41d9ffc3d5d9] received 2024-04-12T00:05:00.639848851Z [2024-04-12 00:05:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f30f3af6-3a60-4bfa-a0e7-f422b1c7fc81] received 2024-04-12T00:05:00.643554176Z [2024-04-12 00:05:00,643: INFO/ForkPoolWorker-15] [7a4f0450-1b0a-4bc0-95b9-41d9ffc3d5d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:00.647343167Z [2024-04-12 00:05:00,647: INFO/ForkPoolWorker-16] [f30f3af6-3a60-4bfa-a0e7-f422b1c7fc81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:05:00.652157942Z [2024-04-12 00:05:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95d61a0e-f017-43a2-b37e-4c834f69f7b0] received 2024-04-12T00:05:00.664917975Z [2024-04-12 00:05:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25f90c0e-d132-44d8-b4c8-3e44a3c6421c] received 2024-04-12T00:05:00.675597832Z [2024-04-12 00:05:00,673: INFO/ForkPoolWorker-1] [95d61a0e-f017-43a2-b37e-4c834f69f7b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:05:00.681932457Z [2024-04-12 00:05:00,681: INFO/ForkPoolWorker-2] [25f90c0e-d132-44d8-b4c8-3e44a3c6421c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:05:00.898601391Z [2024-04-12 00:05:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:05:00.912221611Z [2024-04-12 00:05:00,909: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:05:00.941762825Z [2024-04-12 00:05:00,938: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:05:00.977237623Z [2024-04-12 00:05:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:05:01.070313088Z [2024-04-12 00:05:01,069: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:05:01.073700981Z [2024-04-12 00:05:01,073: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:01.107634235Z [2024-04-12 00:05:01,107: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:05:01.110578040Z [2024-04-12 00:05:01,110: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:05:01.112232310Z [2024-04-12 00:05:01,110: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:05:01.112266591Z [2024-04-12 00:05:01,112: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:05:01.113166546Z [2024-04-12 00:05:01,113: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:05:01.207366874Z [2024-04-12 00:05:01,207: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:01.793315933Z [2024-04-12 00:05:01,792: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25f90c0e-d132-44d8-b4c8-3e44a3c6421c] succeeded in 1.1215416600007302s: None 2024-04-12T00:05:01.990718751Z [2024-04-12 00:05:01,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:05:01.993833444Z [2024-04-12 00:05:01,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:02.025934523Z [2024-04-12 00:05:02,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:05:02.026983441Z [2024-04-12 00:05:02,026: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:02.027056024Z [2024-04-12 00:05:02,026: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:02.027178435Z [2024-04-12 00:05:02,027: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:02.027251115Z [2024-04-12 00:05:02,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:05:02.027444889Z [2024-04-12 00:05:02,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:05:02.028262386Z [2024-04-12 00:05:02,028: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:02.097726531Z [2024-04-12 00:05:02,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:02.110605139Z [2024-04-12 00:05:02,110: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:05:02.114051440Z [2024-04-12 00:05:02,113: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:02.132771371Z [2024-04-12 00:05:02,132: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:05:02.134327589Z [2024-04-12 00:05:02,134: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:02.134451528Z [2024-04-12 00:05:02,134: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:02.134591850Z [2024-04-12 00:05:02,134: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:02.134654136Z [2024-04-12 00:05:02,134: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:05:02.135341880Z [2024-04-12 00:05:02,135: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:05:02.135456815Z [2024-04-12 00:05:02,135: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:02.209966211Z [2024-04-12 00:05:02,209: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:02.247099324Z [2024-04-12 00:05:02,246: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:05:02.250220464Z [2024-04-12 00:05:02,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:02.274540350Z [2024-04-12 00:05:02,274: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:05:02.275972869Z [2024-04-12 00:05:02,275: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:02.276091218Z [2024-04-12 00:05:02,275: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:02.276292790Z [2024-04-12 00:05:02,276: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:02.276431229Z [2024-04-12 00:05:02,276: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:05:02.276737309Z [2024-04-12 00:05:02,276: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:05:02.276852126Z [2024-04-12 00:05:02,276: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:02.359556400Z [2024-04-12 00:05:02,359: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:02.635534130Z [2024-04-12 00:05:02,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a4f0450-1b0a-4bc0-95b9-41d9ffc3d5d9] succeeded in 1.9967916209998293s: None 2024-04-12T00:05:03.039087758Z [2024-04-12 00:05:03,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8b6c31c-57bc-43f9-b8c3-63970aac8a47] received 2024-04-12T00:05:03.048912910Z [2024-04-12 00:05:03,048: INFO/ForkPoolWorker-15] [f8b6c31c-57bc-43f9-b8c3-63970aac8a47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:03.298669022Z [2024-04-12 00:05:03,295: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:05:03.773544719Z [2024-04-12 00:05:03,773: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95d61a0e-f017-43a2-b37e-4c834f69f7b0] succeeded in 3.119700782000109s: None 2024-04-12T00:05:03.940743687Z [2024-04-12 00:05:03,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f30f3af6-3a60-4bfa-a0e7-f422b1c7fc81] succeeded in 3.2996293289997993s: None 2024-04-12T00:05:04.391199982Z [2024-04-12 00:05:04,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:05:04.394454932Z [2024-04-12 00:05:04,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:04.414234826Z [2024-04-12 00:05:04,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:05:04.416191180Z [2024-04-12 00:05:04,416: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:04.416367596Z [2024-04-12 00:05:04,416: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:04.416624159Z [2024-04-12 00:05:04,416: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:04.416747925Z [2024-04-12 00:05:04,416: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:05:04.417022408Z [2024-04-12 00:05:04,416: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:05:04.417142747Z [2024-04-12 00:05:04,417: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:04.488916533Z [2024-04-12 00:05:04,488: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:05.187727923Z [2024-04-12 00:05:05,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8b6c31c-57bc-43f9-b8c3-63970aac8a47] succeeded in 2.144681853000293s: None 2024-04-12T00:05:05.514099438Z [2024-04-12 00:05:05,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc213abf-ed1e-4848-bc4f-ab205243b13d] received 2024-04-12T00:05:05.527117325Z [2024-04-12 00:05:05,526: INFO/ForkPoolWorker-15] [bc213abf-ed1e-4848-bc4f-ab205243b13d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:05:05.789981325Z [2024-04-12 00:05:05,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:05:06.697643850Z [2024-04-12 00:05:06,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:05:06.700503282Z [2024-04-12 00:05:06,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:06.729216709Z [2024-04-12 00:05:06,728: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:05:06.730944839Z [2024-04-12 00:05:06,730: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:06.730968546Z [2024-04-12 00:05:06,730: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:06.731139887Z [2024-04-12 00:05:06,730: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:06.731245715Z [2024-04-12 00:05:06,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:05:06.731677032Z [2024-04-12 00:05:06,731: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:05:06.731703083Z [2024-04-12 00:05:06,731: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:06.847416995Z [2024-04-12 00:05:06,847: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:07.457574253Z [2024-04-12 00:05:07,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc213abf-ed1e-4848-bc4f-ab205243b13d] succeeded in 1.9409131780003008s: None 2024-04-12T00:05:08.342043960Z [2024-04-12 00:05:08,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0852d032-51d1-4e3f-935d-e99568186696] received 2024-04-12T00:05:08.353577249Z [2024-04-12 00:05:08,353: INFO/ForkPoolWorker-15] [0852d032-51d1-4e3f-935d-e99568186696] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:08.620749098Z [2024-04-12 00:05:08,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:05:09.595538018Z [2024-04-12 00:05:09,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:05:09.598526166Z [2024-04-12 00:05:09,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:05:09.619727965Z [2024-04-12 00:05:09,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:05:09.621208336Z [2024-04-12 00:05:09,620: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:05:09.621425064Z [2024-04-12 00:05:09,621: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:05:09.621653855Z [2024-04-12 00:05:09,621: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:05:09.621684774Z [2024-04-12 00:05:09,621: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:05:09.622543003Z [2024-04-12 00:05:09,622: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:05:09.622556338Z [2024-04-12 00:05:09,622: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:05:09.707179749Z [2024-04-12 00:05:09,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:05:10.312563738Z [2024-04-12 00:05:10,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0852d032-51d1-4e3f-935d-e99568186696] succeeded in 1.9663713080008165s: None 2024-04-12T00:06:01.187664363Z [2024-04-12 00:06:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04422353-ef2f-4081-9264-9f1f27852ff9] received 2024-04-12T00:06:01.189504307Z [2024-04-12 00:06:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b7c738d-c405-4bb4-af09-eaf9e424a86b] received 2024-04-12T00:06:01.192531842Z [2024-04-12 00:06:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2739ef5-de33-4f42-ae2a-dbc860de98d9] received 2024-04-12T00:06:01.204942248Z [2024-04-12 00:06:01,204: INFO/ForkPoolWorker-1] [a2739ef5-de33-4f42-ae2a-dbc860de98d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:06:01.205886669Z [2024-04-12 00:06:01,205: INFO/ForkPoolWorker-16] [7b7c738d-c405-4bb4-af09-eaf9e424a86b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:06:01.206767263Z [2024-04-12 00:06:01,206: INFO/ForkPoolWorker-15] [04422353-ef2f-4081-9264-9f1f27852ff9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:06:01.208961143Z [2024-04-12 00:06:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[835ec1e2-ce45-48c5-bccf-2c0bb843cae7] received 2024-04-12T00:06:01.216671404Z [2024-04-12 00:06:01,216: INFO/ForkPoolWorker-2] [835ec1e2-ce45-48c5-bccf-2c0bb843cae7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:06:01.496690563Z [2024-04-12 00:06:01,493: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:06:01.573913315Z [2024-04-12 00:06:01,570: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:06:01.582459924Z [2024-04-12 00:06:01,579: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:06:01.633413659Z [2024-04-12 00:06:01,630: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:06:01.719387254Z [2024-04-12 00:06:01,716: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:06:01.720843860Z [2024-04-12 00:06:01,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:06:01.748116439Z [2024-04-12 00:06:01,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:06:01.749064524Z [2024-04-12 00:06:01,748: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:06:01.749126139Z [2024-04-12 00:06:01,749: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:06:01.749173407Z [2024-04-12 00:06:01,749: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:06:01.749353066Z [2024-04-12 00:06:01,749: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:06:01.865648364Z [2024-04-12 00:06:01,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:06:02.016627295Z [2024-04-12 00:06:02,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:06:02.400104497Z [2024-04-12 00:06:02,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04422353-ef2f-4081-9264-9f1f27852ff9] succeeded in 1.2104903800000102s: None 2024-04-12T00:06:02.621754657Z [2024-04-12 00:06:02,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2739ef5-de33-4f42-ae2a-dbc860de98d9] succeeded in 1.4276060400006827s: None 2024-04-12T00:06:02.725388243Z [2024-04-12 00:06:02,725: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:06:02.728083421Z [2024-04-12 00:06:02,727: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:06:02.747907546Z [2024-04-12 00:06:02,747: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:06:02.750951396Z [2024-04-12 00:06:02,750: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:06:02.751576568Z [2024-04-12 00:06:02,751: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:06:02.751746476Z [2024-04-12 00:06:02,751: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:06:02.751867609Z [2024-04-12 00:06:02,751: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:06:02.752136324Z [2024-04-12 00:06:02,752: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:06:02.752562248Z [2024-04-12 00:06:02,752: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:06:02.780999728Z [2024-04-12 00:06:02,780: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:06:02.784554590Z [2024-04-12 00:06:02,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:06:02.817640409Z [2024-04-12 00:06:02,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:06:02.819067700Z [2024-04-12 00:06:02,818: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:06:02.819188591Z [2024-04-12 00:06:02,819: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:06:02.819361673Z [2024-04-12 00:06:02,819: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:06:02.819528867Z [2024-04-12 00:06:02,819: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:06:02.819985435Z [2024-04-12 00:06:02,819: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:06:02.820261025Z [2024-04-12 00:06:02,820: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:06:02.831225748Z [2024-04-12 00:06:02,831: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:06:02.896951335Z [2024-04-12 00:06:02,896: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:06:04.619194215Z [2024-04-12 00:06:04,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b7c738d-c405-4bb4-af09-eaf9e424a86b] succeeded in 3.4253449110001384s: None 2024-04-12T00:06:05.080124591Z [2024-04-12 00:06:05,079: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[835ec1e2-ce45-48c5-bccf-2c0bb843cae7] succeeded in 3.8692364689995884s: None 2024-04-12T00:07:00.288266218Z [2024-04-12 00:07:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca60f0dd-f297-4a99-b7aa-7a8f0441bb5f] received 2024-04-12T00:07:00.290803697Z [2024-04-12 00:07:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a061ed3-d7e7-4353-a1c0-c7ceb7f8813f] received 2024-04-12T00:07:00.298430803Z [2024-04-12 00:07:00,298: INFO/ForkPoolWorker-15] [ca60f0dd-f297-4a99-b7aa-7a8f0441bb5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:07:00.302674377Z [2024-04-12 00:07:00,302: INFO/ForkPoolWorker-16] [9a061ed3-d7e7-4353-a1c0-c7ceb7f8813f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:07:00.303369914Z [2024-04-12 00:07:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3b793b4-0a0a-4fad-976e-f2e5daf2c840] received 2024-04-12T00:07:00.312914052Z [2024-04-12 00:07:00,312: INFO/ForkPoolWorker-1] [d3b793b4-0a0a-4fad-976e-f2e5daf2c840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:07:00.547256022Z [2024-04-12 00:07:00,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:07:00.556917687Z [2024-04-12 00:07:00,553: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:07:00.580169492Z [2024-04-12 00:07:00,577: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:07:00.689418970Z [2024-04-12 00:07:00,689: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:07:00.692841962Z [2024-04-12 00:07:00,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:07:00.710894685Z [2024-04-12 00:07:00,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:07:00.712062513Z [2024-04-12 00:07:00,711: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:07:00.712107299Z [2024-04-12 00:07:00,711: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:07:00.712176504Z [2024-04-12 00:07:00,712: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:07:00.712317725Z [2024-04-12 00:07:00,712: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:07:00.786670422Z [2024-04-12 00:07:00,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:07:01.335804611Z [2024-04-12 00:07:01,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca60f0dd-f297-4a99-b7aa-7a8f0441bb5f] succeeded in 1.042747292999593s: None 2024-04-12T00:07:01.514791357Z [2024-04-12 00:07:01,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:07:01.517754384Z [2024-04-12 00:07:01,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:07:01.539463144Z [2024-04-12 00:07:01,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:07:01.541199218Z [2024-04-12 00:07:01,540: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:07:01.541222605Z [2024-04-12 00:07:01,541: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:07:01.541370420Z [2024-04-12 00:07:01,541: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:07:01.541381685Z [2024-04-12 00:07:01,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:07:01.541608224Z [2024-04-12 00:07:01,541: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:07:01.541621082Z [2024-04-12 00:07:01,541: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:07:01.608013697Z [2024-04-12 00:07:01,607: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:07:01.623023574Z [2024-04-12 00:07:01,622: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:07:01.625851988Z [2024-04-12 00:07:01,625: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:07:01.641680035Z [2024-04-12 00:07:01,641: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:07:01.642543639Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:07:01.642581706Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:07:01.642662240Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:07:01.642688218Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:07:01.642856107Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:07:01.642891310Z [2024-04-12 00:07:01,642: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:07:01.733149627Z [2024-04-12 00:07:01,732: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:07:03.106532282Z [2024-04-12 00:07:03,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3b793b4-0a0a-4fad-976e-f2e5daf2c840] succeeded in 2.8010478090000106s: None 2024-04-12T00:07:03.319129341Z [2024-04-12 00:07:03,318: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a061ed3-d7e7-4353-a1c0-c7ceb7f8813f] succeeded in 3.0236926870002208s: None 2024-04-12T00:08:00.288931188Z [2024-04-12 00:08:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f97b6cd-0e63-46c5-951d-203b0932ebd5] received 2024-04-12T00:08:00.296450806Z [2024-04-12 00:08:00,296: INFO/ForkPoolWorker-15] [1f97b6cd-0e63-46c5-951d-203b0932ebd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:08:00.305466682Z [2024-04-12 00:08:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6528d2a-995b-4560-ac6f-f044954a1b3d] received 2024-04-12T00:08:00.307039771Z [2024-04-12 00:08:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[093692eb-6c1d-4b21-9d65-5dfdd4ecdaba] received 2024-04-12T00:08:00.311127894Z [2024-04-12 00:08:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abb11dff-dd6b-4c80-9570-3879915f65f9] received 2024-04-12T00:08:00.313504515Z [2024-04-12 00:08:00,313: INFO/ForkPoolWorker-1] [093692eb-6c1d-4b21-9d65-5dfdd4ecdaba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:08:00.322023444Z [2024-04-12 00:08:00,321: INFO/ForkPoolWorker-16] [b6528d2a-995b-4560-ac6f-f044954a1b3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:08:00.322653544Z [2024-04-12 00:08:00,322: INFO/ForkPoolWorker-2] [abb11dff-dd6b-4c80-9570-3879915f65f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:08:00.681511071Z [2024-04-12 00:08:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:08:00.697668704Z [2024-04-12 00:08:00,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:08:00.728646114Z [2024-04-12 00:08:00,725: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:08:00.815127117Z [2024-04-12 00:08:00,810: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:08:00.840633009Z [2024-04-12 00:08:00,840: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:08:00.843760305Z [2024-04-12 00:08:00,843: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:08:00.886568895Z [2024-04-12 00:08:00,886: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:08:00.890540649Z [2024-04-12 00:08:00,890: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:08:00.890579488Z [2024-04-12 00:08:00,890: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:08:00.890622389Z [2024-04-12 00:08:00,890: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:08:00.890813382Z [2024-04-12 00:08:00,890: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:08:00.894522620Z [2024-04-12 00:08:00,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:08:00.994231475Z [2024-04-12 00:08:00,994: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:08:01.413206741Z [2024-04-12 00:08:01,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6528d2a-995b-4560-ac6f-f044954a1b3d] succeeded in 1.1047728029998325s: None 2024-04-12T00:08:01.555461885Z [2024-04-12 00:08:01,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f97b6cd-0e63-46c5-951d-203b0932ebd5] succeeded in 1.263911175999965s: None 2024-04-12T00:08:01.848658365Z [2024-04-12 00:08:01,848: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:08:01.851476268Z [2024-04-12 00:08:01,851: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:08:01.868666738Z [2024-04-12 00:08:01,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:08:01.869868280Z [2024-04-12 00:08:01,869: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:08:01.869918094Z [2024-04-12 00:08:01,869: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:08:01.870052289Z [2024-04-12 00:08:01,869: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:08:01.870116363Z [2024-04-12 00:08:01,870: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:08:01.870322482Z [2024-04-12 00:08:01,870: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:08:01.870385018Z [2024-04-12 00:08:01,870: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:08:01.969162893Z [2024-04-12 00:08:01,968: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:08:02.052364470Z [2024-04-12 00:08:02,052: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:08:02.057174479Z [2024-04-12 00:08:02,056: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:08:02.088924045Z [2024-04-12 00:08:02,088: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:08:02.092298309Z [2024-04-12 00:08:02,092: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:08:02.096629891Z [2024-04-12 00:08:02,096: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:08:02.096778687Z [2024-04-12 00:08:02,096: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:08:02.096886455Z [2024-04-12 00:08:02,096: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:08:02.097125424Z [2024-04-12 00:08:02,097: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:08:02.097189862Z [2024-04-12 00:08:02,097: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:08:02.180620066Z [2024-04-12 00:08:02,180: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:08:03.648046487Z [2024-04-12 00:08:03,647: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[093692eb-6c1d-4b21-9d65-5dfdd4ecdaba] succeeded in 3.3395482320001975s: None 2024-04-12T00:08:03.917101273Z [2024-04-12 00:08:03,916: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[abb11dff-dd6b-4c80-9570-3879915f65f9] succeeded in 3.6045420320006087s: None 2024-04-12T00:09:00.319626237Z [2024-04-12 00:09:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c1a8fbc-ffc9-411d-8215-6b8ef405071f] received 2024-04-12T00:09:00.326591719Z [2024-04-12 00:09:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5cd7234-eb3d-4ac4-ab50-458fb56a6d3e] received 2024-04-12T00:09:00.331493604Z [2024-04-12 00:09:00,331: INFO/ForkPoolWorker-15] [0c1a8fbc-ffc9-411d-8215-6b8ef405071f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:09:00.336689481Z [2024-04-12 00:09:00,336: INFO/ForkPoolWorker-16] [c5cd7234-eb3d-4ac4-ab50-458fb56a6d3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:09:00.337090201Z [2024-04-12 00:09:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76255e4f-b50c-40a9-b099-dbb0053fae0a] received 2024-04-12T00:09:00.365003956Z [2024-04-12 00:09:00,364: INFO/ForkPoolWorker-1] [76255e4f-b50c-40a9-b099-dbb0053fae0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:09:00.659913863Z [2024-04-12 00:09:00,656: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:09:00.794610451Z [2024-04-12 00:09:00,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:09:00.815205123Z [2024-04-12 00:09:00,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:09:00.930388117Z [2024-04-12 00:09:00,930: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:09:00.933518071Z [2024-04-12 00:09:00,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:09:00.957092385Z [2024-04-12 00:09:00,956: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:09:00.958583038Z [2024-04-12 00:09:00,958: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:09:00.959032771Z [2024-04-12 00:09:00,958: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:09:00.959156514Z [2024-04-12 00:09:00,958: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:09:00.959390067Z [2024-04-12 00:09:00,959: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:09:01.071911127Z [2024-04-12 00:09:01,071: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:09:01.730931238Z [2024-04-12 00:09:01,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5cd7234-eb3d-4ac4-ab50-458fb56a6d3e] succeeded in 1.3895075899999938s: None 2024-04-12T00:09:01.956689699Z [2024-04-12 00:09:01,956: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:09:01.959365280Z [2024-04-12 00:09:01,958: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:09:01.988584309Z [2024-04-12 00:09:01,988: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:09:01.990203520Z [2024-04-12 00:09:01,989: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:09:01.990259279Z [2024-04-12 00:09:01,990: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:09:01.990417445Z [2024-04-12 00:09:01,990: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:09:01.990497649Z [2024-04-12 00:09:01,990: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:09:01.991333465Z [2024-04-12 00:09:01,991: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:09:01.991502799Z [2024-04-12 00:09:01,991: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:09:02.032268966Z [2024-04-12 00:09:02,031: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:09:02.035323500Z [2024-04-12 00:09:02,034: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:09:02.053716269Z [2024-04-12 00:09:02,053: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:09:02.054801401Z [2024-04-12 00:09:02,054: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:09:02.054986706Z [2024-04-12 00:09:02,054: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:09:02.055158851Z [2024-04-12 00:09:02,054: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:09:02.055361588Z [2024-04-12 00:09:02,055: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:09:02.055976143Z [2024-04-12 00:09:02,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:09:02.056167199Z [2024-04-12 00:09:02,055: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:09:02.077407928Z [2024-04-12 00:09:02,077: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:09:02.146684562Z [2024-04-12 00:09:02,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:09:03.603158391Z [2024-04-12 00:09:03,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c1a8fbc-ffc9-411d-8215-6b8ef405071f] succeeded in 3.279902786999628s: None 2024-04-12T00:09:04.029047100Z [2024-04-12 00:09:04,028: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76255e4f-b50c-40a9-b099-dbb0053fae0a] succeeded in 3.6875600859993938s: None 2024-04-12T00:10:00.894407767Z [2024-04-12 00:10:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe9e0974-466c-484d-9807-4a95e9a74960] received 2024-04-12T00:10:00.896197306Z [2024-04-12 00:10:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[554c66ad-ded4-434a-b77b-9b09b218c9c5] received 2024-04-12T00:10:00.898688515Z [2024-04-12 00:10:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48e552bd-9c18-4d71-903f-1e6d31c67b86] received 2024-04-12T00:10:00.902811354Z [2024-04-12 00:10:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2378a8cc-bfce-4295-bfa5-56f293668206] received 2024-04-12T00:10:00.909806113Z [2024-04-12 00:10:00,909: INFO/ForkPoolWorker-15] [fe9e0974-466c-484d-9807-4a95e9a74960] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:00.910303578Z [2024-04-12 00:10:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e9cc31c-3695-409f-b822-2e70e20d78bb] received 2024-04-12T00:10:00.910809106Z [2024-04-12 00:10:00,910: INFO/ForkPoolWorker-16] [554c66ad-ded4-434a-b77b-9b09b218c9c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:10:00.915139682Z [2024-04-12 00:10:00,914: INFO/ForkPoolWorker-1] [48e552bd-9c18-4d71-903f-1e6d31c67b86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:10:00.916230935Z [2024-04-12 00:10:00,915: INFO/ForkPoolWorker-2] [2378a8cc-bfce-4295-bfa5-56f293668206] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:10:00.925702525Z [2024-04-12 00:10:00,925: INFO/ForkPoolWorker-3] [6e9cc31c-3695-409f-b822-2e70e20d78bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:10:01.210686310Z [2024-04-12 00:10:01,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:10:01.315379850Z [2024-04-12 00:10:01,311: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:10:01.351592516Z [2024-04-12 00:10:01,347: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:10:01.380078985Z [2024-04-12 00:10:01,376: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:10:01.684488301Z [2024-04-12 00:10:01,681: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:01.696654700Z [2024-04-12 00:10:01,693: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:10:01.907345001Z [2024-04-12 00:10:01,906: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T00:10:01.911814234Z [2024-04-12 00:10:01,911: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:01.960224557Z [2024-04-12 00:10:01,960: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:10:01.962723355Z [2024-04-12 00:10:01,962: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:10:01.962783471Z [2024-04-12 00:10:01,962: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:10:01.962818099Z [2024-04-12 00:10:01,962: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T00:10:01.963007743Z [2024-04-12 00:10:01,962: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:10:02.041471421Z [2024-04-12 00:10:02,041: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:02.712075992Z [2024-04-12 00:10:02,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[554c66ad-ded4-434a-b77b-9b09b218c9c5] succeeded in 1.8123932549997335s: None 2024-04-12T00:10:02.764235670Z [2024-04-12 00:10:02,763: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6e9cc31c-3695-409f-b822-2e70e20d78bb] succeeded in 1.8519863540004735s: None 2024-04-12T00:10:02.767230389Z [2024-04-12 00:10:02,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:10:02.771353721Z [2024-04-12 00:10:02,771: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:02.824901480Z [2024-04-12 00:10:02,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:10:02.835562525Z [2024-04-12 00:10:02,835: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:02.835924447Z [2024-04-12 00:10:02,835: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:02.836200185Z [2024-04-12 00:10:02,836: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:02.839666271Z [2024-04-12 00:10:02,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:10:02.840043760Z [2024-04-12 00:10:02,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:10:02.840204406Z [2024-04-12 00:10:02,840: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:02.920662466Z [2024-04-12 00:10:02,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:03.459260133Z [2024-04-12 00:10:03,458: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:10:03.462178659Z [2024-04-12 00:10:03,461: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:03.476468836Z [2024-04-12 00:10:03,476: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:10:03.479417192Z [2024-04-12 00:10:03,479: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:03.496795671Z [2024-04-12 00:10:03,496: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:10:03.498479306Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:03.498526642Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:03.498662259Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:03.498698034Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:10:03.498914553Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:10:03.498986288Z [2024-04-12 00:10:03,498: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:03.507970093Z [2024-04-12 00:10:03,507: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:10:03.511385662Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:03.511397377Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:03.511503024Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:03.511508593Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:10:03.511721524Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:10:03.511746431Z [2024-04-12 00:10:03,511: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:03.591200995Z [2024-04-12 00:10:03,588: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:03.635818158Z [2024-04-12 00:10:03,635: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:03.698932619Z [2024-04-12 00:10:03,698: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe9e0974-466c-484d-9807-4a95e9a74960] succeeded in 2.800060724999639s: None 2024-04-12T00:10:03.915192675Z [2024-04-12 00:10:03,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97b31626-bced-427b-b534-fb664879524e] received 2024-04-12T00:10:03.922649209Z [2024-04-12 00:10:03,922: INFO/ForkPoolWorker-15] [97b31626-bced-427b-b534-fb664879524e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:04.313076184Z [2024-04-12 00:10:04,310: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:10:05.251195485Z [2024-04-12 00:10:05,250: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:10:05.254150474Z [2024-04-12 00:10:05,253: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:05.271146248Z [2024-04-12 00:10:05,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:10:05.272439302Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:05.273014200Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:05.273043602Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:05.273053280Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:10:05.273060894Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:10:05.273095639Z [2024-04-12 00:10:05,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:05.339309802Z [2024-04-12 00:10:05,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:05.410178523Z [2024-04-12 00:10:05,409: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48e552bd-9c18-4d71-903f-1e6d31c67b86] succeeded in 4.5090110860001005s: None 2024-04-12T00:10:05.658613139Z [2024-04-12 00:10:05,658: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2378a8cc-bfce-4295-bfa5-56f293668206] succeeded in 4.754098098000213s: None 2024-04-12T00:10:05.990246446Z [2024-04-12 00:10:05,989: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97b31626-bced-427b-b534-fb664879524e] succeeded in 2.071322761999909s: None 2024-04-12T00:10:06.352304536Z [2024-04-12 00:10:06,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68e1c15a-6cb1-45e3-aba1-f388dd9f8cb2] received 2024-04-12T00:10:06.358236336Z [2024-04-12 00:10:06,357: INFO/ForkPoolWorker-15] [68e1c15a-6cb1-45e3-aba1-f388dd9f8cb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:10:06.608115104Z [2024-04-12 00:10:06,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:10:07.571196130Z [2024-04-12 00:10:07,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:10:07.574299677Z [2024-04-12 00:10:07,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:07.591621047Z [2024-04-12 00:10:07,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:10:07.592696880Z [2024-04-12 00:10:07,592: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:07.592715512Z [2024-04-12 00:10:07,592: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:07.592876611Z [2024-04-12 00:10:07,592: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:07.592926175Z [2024-04-12 00:10:07,592: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:10:07.593168002Z [2024-04-12 00:10:07,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:10:07.593226734Z [2024-04-12 00:10:07,593: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:07.681108971Z [2024-04-12 00:10:07,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:08.263497792Z [2024-04-12 00:10:08,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68e1c15a-6cb1-45e3-aba1-f388dd9f8cb2] succeeded in 1.9094274799999766s: None 2024-04-12T00:10:09.050667982Z [2024-04-12 00:10:09,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b42595f-6bc1-4916-b291-622db8084deb] received 2024-04-12T00:10:09.057764005Z [2024-04-12 00:10:09,057: INFO/ForkPoolWorker-15] [6b42595f-6bc1-4916-b291-622db8084deb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:09.325925960Z [2024-04-12 00:10:09,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:10:10.376799213Z [2024-04-12 00:10:10,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:10:10.379698360Z [2024-04-12 00:10:10,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:10:10.394896697Z [2024-04-12 00:10:10,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:10:10.395790888Z [2024-04-12 00:10:10,395: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:10:10.395821059Z [2024-04-12 00:10:10,395: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:10:10.395958347Z [2024-04-12 00:10:10,395: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:10:10.395987379Z [2024-04-12 00:10:10,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:10:10.396162254Z [2024-04-12 00:10:10,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:10:10.396188651Z [2024-04-12 00:10:10,396: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:10:10.483381267Z [2024-04-12 00:10:10,482: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:10:11.029840749Z [2024-04-12 00:10:11,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b42595f-6bc1-4916-b291-622db8084deb] succeeded in 1.9762662769999224s: None 2024-04-12T00:11:00.989596052Z [2024-04-12 00:11:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c90e215b-9b8d-4012-b497-092211d5dbcd] received 2024-04-12T00:11:00.991012335Z [2024-04-12 00:11:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f0e9ce0-fda5-4517-a6e8-7e5d24549829] received 2024-04-12T00:11:00.995509414Z [2024-04-12 00:11:00,995: INFO/ForkPoolWorker-15] [c90e215b-9b8d-4012-b497-092211d5dbcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:11:00.995783131Z [2024-04-12 00:11:00,995: INFO/ForkPoolWorker-16] [4f0e9ce0-fda5-4517-a6e8-7e5d24549829] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:11:00.998754335Z [2024-04-12 00:11:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a8c5640-c2c7-4490-9bd6-ee76c0cc1ffc] received 2024-04-12T00:11:01.008946387Z [2024-04-12 00:11:01,008: INFO/ForkPoolWorker-1] [8a8c5640-c2c7-4490-9bd6-ee76c0cc1ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:11:01.261596603Z [2024-04-12 00:11:01,258: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:11:01.296360583Z [2024-04-12 00:11:01,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:11:01.369105080Z [2024-04-12 00:11:01,366: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:11:01.443329492Z [2024-04-12 00:11:01,442: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:11:01.451401570Z [2024-04-12 00:11:01,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:11:01.477176208Z [2024-04-12 00:11:01,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:11:01.478832403Z [2024-04-12 00:11:01,478: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:11:01.478961859Z [2024-04-12 00:11:01,478: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:11:01.479513129Z [2024-04-12 00:11:01,479: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:11:01.479764236Z [2024-04-12 00:11:01,479: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:11:01.582822056Z [2024-04-12 00:11:01,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:11:02.170500564Z [2024-04-12 00:11:02,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c90e215b-9b8d-4012-b497-092211d5dbcd] succeeded in 1.179732956999942s: None 2024-04-12T00:11:02.402188590Z [2024-04-12 00:11:02,401: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:11:02.406320093Z [2024-04-12 00:11:02,405: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:11:02.429205275Z [2024-04-12 00:11:02,428: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:11:02.433043976Z [2024-04-12 00:11:02,432: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:11:02.433063481Z [2024-04-12 00:11:02,432: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:11:02.433248491Z [2024-04-12 00:11:02,433: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:11:02.433319128Z [2024-04-12 00:11:02,433: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:11:02.433876200Z [2024-04-12 00:11:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:11:02.433935459Z [2024-04-12 00:11:02,433: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:11:02.500011182Z [2024-04-12 00:11:02,499: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:11:02.502976078Z [2024-04-12 00:11:02,502: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:11:02.503647322Z [2024-04-12 00:11:02,503: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:11:02.521593004Z [2024-04-12 00:11:02,521: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:11:02.523073638Z [2024-04-12 00:11:02,522: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:11:02.523182507Z [2024-04-12 00:11:02,523: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:11:02.523328557Z [2024-04-12 00:11:02,523: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:11:02.523437820Z [2024-04-12 00:11:02,523: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:11:02.523689397Z [2024-04-12 00:11:02,523: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:11:02.523804666Z [2024-04-12 00:11:02,523: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:11:02.594992636Z [2024-04-12 00:11:02,594: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:11:04.115821114Z [2024-04-12 00:11:04,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f0e9ce0-fda5-4517-a6e8-7e5d24549829] succeeded in 3.1237045580000995s: None 2024-04-12T00:11:04.977971824Z [2024-04-12 00:11:04,977: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a8c5640-c2c7-4490-9bd6-ee76c0cc1ffc] succeeded in 3.972939268999653s: None 2024-04-12T00:12:00.703580085Z [2024-04-12 00:12:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51b30a8c-5474-4f85-b676-63ef96a2b5ce] received 2024-04-12T00:12:00.705304590Z [2024-04-12 00:12:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b5d4292-0ab2-4edd-a411-5e4e737be763] received 2024-04-12T00:12:00.714298286Z [2024-04-12 00:12:00,713: INFO/ForkPoolWorker-15] [51b30a8c-5474-4f85-b676-63ef96a2b5ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:12:00.714598275Z [2024-04-12 00:12:00,714: INFO/ForkPoolWorker-16] [6b5d4292-0ab2-4edd-a411-5e4e737be763] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:12:00.720938791Z [2024-04-12 00:12:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f65b14d-f849-4550-b5bc-4bad56504ad6] received 2024-04-12T00:12:00.724160435Z [2024-04-12 00:12:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e7df650-4c27-4774-b1a6-92181c5fa012] received 2024-04-12T00:12:00.732524425Z [2024-04-12 00:12:00,730: INFO/ForkPoolWorker-1] [4f65b14d-f849-4550-b5bc-4bad56504ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:12:00.734021174Z [2024-04-12 00:12:00,733: INFO/ForkPoolWorker-2] [3e7df650-4c27-4774-b1a6-92181c5fa012] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:12:00.967787521Z [2024-04-12 00:12:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:12:01.039938639Z [2024-04-12 00:12:01,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:12:01.047722550Z [2024-04-12 00:12:01,043: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:12:01.116015242Z [2024-04-12 00:12:01,112: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:12:01.193578005Z [2024-04-12 00:12:01,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:12:01.335093879Z [2024-04-12 00:12:01,334: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:12:01.339258242Z [2024-04-12 00:12:01,338: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:12:01.369913225Z [2024-04-12 00:12:01,369: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:12:01.378154702Z [2024-04-12 00:12:01,377: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:12:01.378197681Z [2024-04-12 00:12:01,378: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:12:01.378238214Z [2024-04-12 00:12:01,378: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:12:01.378969898Z [2024-04-12 00:12:01,378: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:12:01.506509249Z [2024-04-12 00:12:01,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:12:01.750864937Z [2024-04-12 00:12:01,750: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51b30a8c-5474-4f85-b676-63ef96a2b5ce] succeeded in 1.0447610800001712s: None 2024-04-12T00:12:02.193917113Z [2024-04-12 00:12:02,193: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b5d4292-0ab2-4edd-a411-5e4e737be763] succeeded in 1.4847894270005781s: None 2024-04-12T00:12:02.365491147Z [2024-04-12 00:12:02,365: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:12:02.368537277Z [2024-04-12 00:12:02,368: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:12:02.397739082Z [2024-04-12 00:12:02,397: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:12:02.399327177Z [2024-04-12 00:12:02,399: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:12:02.399658076Z [2024-04-12 00:12:02,399: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:12:02.400097396Z [2024-04-12 00:12:02,399: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:12:02.400339772Z [2024-04-12 00:12:02,400: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:12:02.400708464Z [2024-04-12 00:12:02,400: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:12:02.401238198Z [2024-04-12 00:12:02,400: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:12:02.469191334Z [2024-04-12 00:12:02,468: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:12:02.472358864Z [2024-04-12 00:12:02,471: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:12:02.496066915Z [2024-04-12 00:12:02,495: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:12:02.499372287Z [2024-04-12 00:12:02,497: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:12:02.499622200Z [2024-04-12 00:12:02,499: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:12:02.499745256Z [2024-04-12 00:12:02,499: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:12:02.499776539Z [2024-04-12 00:12:02,499: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:12:02.500058586Z [2024-04-12 00:12:02,499: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:12:02.500145332Z [2024-04-12 00:12:02,500: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:12:02.502274678Z [2024-04-12 00:12:02,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:12:02.584578388Z [2024-04-12 00:12:02,584: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:12:04.203997907Z [2024-04-12 00:12:04,203: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3e7df650-4c27-4774-b1a6-92181c5fa012] succeeded in 3.4784663000000364s: None 2024-04-12T00:12:04.288506809Z [2024-04-12 00:12:04,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f65b14d-f849-4550-b5bc-4bad56504ad6] succeeded in 3.5647357759999068s: None 2024-04-12T00:13:00.684268216Z [2024-04-12 00:13:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e393f590-c8d6-448b-bed6-a474eb3a5cb4] received 2024-04-12T00:13:00.688752612Z [2024-04-12 00:13:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7bbba9e-9c94-4115-b77f-f84c732043ca] received 2024-04-12T00:13:00.692085009Z [2024-04-12 00:13:00,691: INFO/ForkPoolWorker-15] [e393f590-c8d6-448b-bed6-a474eb3a5cb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:13:00.700087582Z [2024-04-12 00:13:00,699: INFO/ForkPoolWorker-16] [f7bbba9e-9c94-4115-b77f-f84c732043ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:13:00.702347924Z [2024-04-12 00:13:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b046b95-8430-4984-9cb2-a7e1c30d6c3c] received 2024-04-12T00:13:00.716175435Z [2024-04-12 00:13:00,715: INFO/ForkPoolWorker-1] [9b046b95-8430-4984-9cb2-a7e1c30d6c3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:13:00.956929299Z [2024-04-12 00:13:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:13:00.957423141Z [2024-04-12 00:13:00,954: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:13:01.032231823Z [2024-04-12 00:13:01,028: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:13:01.195759430Z [2024-04-12 00:13:01,195: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:13:01.200742785Z [2024-04-12 00:13:01,200: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:13:01.228756681Z [2024-04-12 00:13:01,228: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:13:01.229997858Z [2024-04-12 00:13:01,229: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:13:01.230121371Z [2024-04-12 00:13:01,229: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:13:01.230204596Z [2024-04-12 00:13:01,230: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:13:01.230558178Z [2024-04-12 00:13:01,230: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:13:01.362608870Z [2024-04-12 00:13:01,362: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:13:02.072122622Z [2024-04-12 00:13:02,071: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b046b95-8430-4984-9cb2-a7e1c30d6c3c] succeeded in 1.3629925599998387s: None 2024-04-12T00:13:02.115503661Z [2024-04-12 00:13:02,115: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:13:02.119116591Z [2024-04-12 00:13:02,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:13:02.141733334Z [2024-04-12 00:13:02,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:13:02.143244090Z [2024-04-12 00:13:02,142: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:13:02.143260124Z [2024-04-12 00:13:02,143: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:13:02.143535789Z [2024-04-12 00:13:02,143: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:13:02.143574948Z [2024-04-12 00:13:02,143: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:13:02.143826233Z [2024-04-12 00:13:02,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:13:02.144050224Z [2024-04-12 00:13:02,143: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:13:02.179773098Z [2024-04-12 00:13:02,179: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:13:02.182762427Z [2024-04-12 00:13:02,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:13:02.211871751Z [2024-04-12 00:13:02,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:13:02.212911990Z [2024-04-12 00:13:02,212: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:13:02.212972040Z [2024-04-12 00:13:02,212: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:13:02.213126476Z [2024-04-12 00:13:02,212: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:13:02.213182943Z [2024-04-12 00:13:02,213: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:13:02.213419654Z [2024-04-12 00:13:02,213: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:13:02.213472051Z [2024-04-12 00:13:02,213: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:13:02.233923657Z [2024-04-12 00:13:02,233: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:13:02.292454022Z [2024-04-12 00:13:02,292: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:13:03.707894745Z [2024-04-12 00:13:03,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e393f590-c8d6-448b-bed6-a474eb3a5cb4] succeeded in 3.020727223999529s: None 2024-04-12T00:13:04.248142969Z [2024-04-12 00:13:04,247: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7bbba9e-9c94-4115-b77f-f84c732043ca] succeeded in 3.557434682999883s: None 2024-04-12T00:13:37.253797286Z [2024-04-12 00:13:37,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[082d12bf-fb2e-4bc9-acbc-ff772aa15f55] received 2024-04-12T00:13:37.265030650Z [2024-04-12 00:13:37,264: INFO/ForkPoolWorker-15] [082d12bf-fb2e-4bc9-acbc-ff772aa15f55] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:13:37.516836058Z [2024-04-12 00:13:37,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:13:37.649149046Z [2024-04-12 00:13:37,648: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:13:37.652475999Z [2024-04-12 00:13:37,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:13:37.678097910Z [2024-04-12 00:13:37,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:13:37.679067598Z [2024-04-12 00:13:37,678: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:13:37.679127191Z [2024-04-12 00:13:37,679: INFO/ForkPoolWorker-15] Read SDNC b63fd59f-0b48-48c8-b54a-551b5fad46ba (epa_03) 2024-04-12T00:13:37.679256916Z [2024-04-12 00:13:37,679: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-12T00:13:37.679298325Z [2024-04-12 00:13:37,679: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:13:37.679480418Z [2024-04-12 00:13:37,679: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:13:37.689157971Z [2024-04-12 00:13:37,687: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba 2024-04-12T00:13:37.792757710Z [2024-04-12 00:13:37,792: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:13:38.376364243Z [2024-04-12 00:13:38,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[082d12bf-fb2e-4bc9-acbc-ff772aa15f55] succeeded in 1.1201605870001003s: None 2024-04-12T00:14:00.242975819Z [2024-04-12 00:14:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa2465ad-c895-41e6-a1d4-d511d9d52b6c] received 2024-04-12T00:14:00.244596736Z [2024-04-12 00:14:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d99ba38-a240-431a-b314-e8702f2bc50d] received 2024-04-12T00:14:00.245898461Z [2024-04-12 00:14:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67ac1b3c-9b15-4bc9-a725-a3579fb181dc] received 2024-04-12T00:14:00.251246166Z [2024-04-12 00:14:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60cb06a2-104d-4f33-8222-fcb9acb29933] received 2024-04-12T00:14:00.252241383Z [2024-04-12 00:14:00,251: INFO/ForkPoolWorker-1] [67ac1b3c-9b15-4bc9-a725-a3579fb181dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:14:00.255883782Z [2024-04-12 00:14:00,255: INFO/ForkPoolWorker-15] [fa2465ad-c895-41e6-a1d4-d511d9d52b6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:14:00.258292381Z [2024-04-12 00:14:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[944ae3f1-8079-42fd-a46a-6e07588b4f89] received 2024-04-12T00:14:00.266029917Z [2024-04-12 00:14:00,265: INFO/ForkPoolWorker-2] [60cb06a2-104d-4f33-8222-fcb9acb29933] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:14:00.267372952Z [2024-04-12 00:14:00,267: INFO/ForkPoolWorker-16] [2d99ba38-a240-431a-b314-e8702f2bc50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:14:00.268739359Z [2024-04-12 00:14:00,268: INFO/ForkPoolWorker-3] [944ae3f1-8079-42fd-a46a-6e07588b4f89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:14:00.578294121Z [2024-04-12 00:14:00,575: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:14:00.624365697Z [2024-04-12 00:14:00,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:14:00.649305519Z [2024-04-12 00:14:00,644: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:14:00.674550663Z [2024-04-12 00:14:00,665: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:14:00.691991455Z [2024-04-12 00:14:00,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:14:00.827748306Z [2024-04-12 00:14:00,827: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T00:14:00.831438892Z [2024-04-12 00:14:00,831: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:14:00.844607961Z [2024-04-12 00:14:00,844: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:14:00.847909274Z [2024-04-12 00:14:00,847: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:14:00.862744572Z [2024-04-12 00:14:00,862: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:14:00.865517864Z [2024-04-12 00:14:00,865: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:14:00.865619756Z [2024-04-12 00:14:00,865: INFO/ForkPoolWorker-3] Read SDNC b63fd59f-0b48-48c8-b54a-551b5fad46ba (epa_03) 2024-04-12T00:14:00.865744661Z [2024-04-12 00:14:00,865: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-12T00:14:00.865856738Z [2024-04-12 00:14:00,865: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T00:14:00.866159173Z [2024-04-12 00:14:00,865: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:14:00.871966048Z [2024-04-12 00:14:00,871: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba 2024-04-12T00:14:00.886526682Z [2024-04-12 00:14:00,886: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:14:00.887336834Z [2024-04-12 00:14:00,887: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:14:00.887390733Z [2024-04-12 00:14:00,887: INFO/ForkPoolWorker-1] Read SDNC b63fd59f-0b48-48c8-b54a-551b5fad46ba (epa_03) 2024-04-12T00:14:00.887563391Z [2024-04-12 00:14:00,887: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-12T00:14:00.887660225Z [2024-04-12 00:14:00,887: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:14:00.887938290Z [2024-04-12 00:14:00,887: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:14:00.895202816Z [2024-04-12 00:14:00,895: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba 2024-04-12T00:14:00.895418896Z [2024-04-12 00:14:00,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:14:00.958570953Z [2024-04-12 00:14:00,958: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:14:01.023955927Z [2024-04-12 00:14:01,023: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:14:01.496191399Z [2024-04-12 00:14:01,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa2465ad-c895-41e6-a1d4-d511d9d52b6c] succeeded in 1.2513720090000788s: None 2024-04-12T00:14:01.562277237Z [2024-04-12 00:14:01,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67ac1b3c-9b15-4bc9-a725-a3579fb181dc] succeeded in 1.315153958999872s: None 2024-04-12T00:14:01.570846723Z [2024-04-12 00:14:01,570: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[944ae3f1-8079-42fd-a46a-6e07588b4f89] succeeded in 1.3083192840003903s: None 2024-04-12T00:14:01.873915638Z [2024-04-12 00:14:01,873: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:14:01.876944998Z [2024-04-12 00:14:01,876: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:14:01.897231823Z [2024-04-12 00:14:01,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:14:01.898273367Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:14:01.898359415Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:14:01.898517272Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:14:01.898608157Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:14:01.898930851Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:14:01.899017441Z [2024-04-12 00:14:01,898: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:14:01.983465312Z [2024-04-12 00:14:01,983: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:14:01.998808499Z [2024-04-12 00:14:01,998: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:14:02.001741351Z [2024-04-12 00:14:02,001: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:14:02.024571578Z [2024-04-12 00:14:02,024: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:14:02.025723943Z [2024-04-12 00:14:02,025: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:14:02.025927562Z [2024-04-12 00:14:02,025: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:14:02.026149638Z [2024-04-12 00:14:02,025: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:14:02.026358005Z [2024-04-12 00:14:02,026: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:14:02.027014382Z [2024-04-12 00:14:02,026: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:14:02.027154535Z [2024-04-12 00:14:02,026: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:14:02.120190285Z [2024-04-12 00:14:02,119: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:14:03.783914209Z [2024-04-12 00:14:03,783: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60cb06a2-104d-4f33-8222-fcb9acb29933] succeeded in 3.530053320000661s: None 2024-04-12T00:14:04.579861845Z [2024-04-12 00:14:04,579: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d99ba38-a240-431a-b314-e8702f2bc50d] succeeded in 4.332161465999889s: None 2024-04-12T00:15:00.994170749Z [2024-04-12 00:15:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[371c328d-472c-448e-b0fe-edccc3a1938d] received 2024-04-12T00:15:00.998446535Z [2024-04-12 00:15:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7566922-573a-465d-aa67-14133fdf4cc3] received 2024-04-12T00:15:01.003555988Z [2024-04-12 00:15:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499db702-fb73-420c-ab82-0bb2f9748522] received 2024-04-12T00:15:01.007458438Z [2024-04-12 00:15:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ec606ee-fda9-4213-b035-fd724fdc2ad5] received 2024-04-12T00:15:01.007683567Z [2024-04-12 00:15:01,007: INFO/ForkPoolWorker-16] [c7566922-573a-465d-aa67-14133fdf4cc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:01.007740034Z [2024-04-12 00:15:01,007: INFO/ForkPoolWorker-15] [371c328d-472c-448e-b0fe-edccc3a1938d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:15:01.008519436Z [2024-04-12 00:15:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[133cd3fd-3233-4c7b-95ba-16b6bf6532a1] received 2024-04-12T00:15:01.026468761Z [2024-04-12 00:15:01,025: INFO/ForkPoolWorker-1] [499db702-fb73-420c-ab82-0bb2f9748522] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:15:01.027098012Z [2024-04-12 00:15:01,026: INFO/ForkPoolWorker-2] [4ec606ee-fda9-4213-b035-fd724fdc2ad5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:01.030345382Z [2024-04-12 00:15:01,030: INFO/ForkPoolWorker-3] [133cd3fd-3233-4c7b-95ba-16b6bf6532a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:01.319266137Z [2024-04-12 00:15:01,315: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:15:01.331979149Z [2024-04-12 00:15:01,327: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:15:01.358829799Z [2024-04-12 00:15:01,355: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:01.477845495Z [2024-04-12 00:15:01,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:15:01.531451571Z [2024-04-12 00:15:01,531: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T00:15:01.531984077Z [2024-04-12 00:15:01,528: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:01.535421713Z [2024-04-12 00:15:01,535: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:01.576230546Z [2024-04-12 00:15:01,576: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:15:01.581987799Z [2024-04-12 00:15:01,581: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:15:01.582215303Z [2024-04-12 00:15:01,582: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:15:01.582354978Z [2024-04-12 00:15:01,582: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T00:15:01.582609962Z [2024-04-12 00:15:01,582: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:15:01.774786858Z [2024-04-12 00:15:01,774: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:01.821440613Z [2024-04-12 00:15:01,817: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:15:01.830972803Z [2024-04-12 00:15:01,830: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:01.880717357Z [2024-04-12 00:15:01,880: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:15:01.881903221Z [2024-04-12 00:15:01,881: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:15:01.882031501Z [2024-04-12 00:15:01,881: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:15:01.882074445Z [2024-04-12 00:15:01,881: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:15:01.882249207Z [2024-04-12 00:15:01,882: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:15:01.890053245Z [2024-04-12 00:15:01,889: WARNING/ForkPoolWorker-2] Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:01.892695738Z [2024-04-12 00:15:01,892: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:01.893398770Z [2024-04-12 00:15:01,893: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:15:01.895987762Z [2024-04-12 00:15:01,895: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:01.937649692Z [2024-04-12 00:15:01,937: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:15:01.939320709Z [2024-04-12 00:15:01,939: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:15:01.939439428Z [2024-04-12 00:15:01,939: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:15:01.939481697Z [2024-04-12 00:15:01,939: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:15:01.939680415Z [2024-04-12 00:15:01,939: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:15:01.945008998Z [2024-04-12 00:15:01,942: ERROR/ForkPoolWorker-2] [4ec606ee-fda9-4213-b035-fd724fdc2ad5] Failed to execute task Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' could not be found; either it does not exist or it failed to parse.. 2024-04-12T00:15:01.945020924Z Traceback (most recent call last): 2024-04-12T00:15:01.945024625Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T00:15:01.945027789Z args.func(args) 2024-04-12T00:15:01.945030964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T00:15:01.945034195Z return func(*args, **kwargs) 2024-04-12T00:15:01.945036821Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T00:15:01.945039432Z return f(*args, **kwargs) 2024-04-12T00:15:01.945042028Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T00:15:01.945044704Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T00:15:01.945047315Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T00:15:01.945049858Z raise AirflowException( 2024-04-12T00:15:01.945053567Z airflow.exceptions.AirflowException: Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' could not be found; either it does not exist or it failed to parse. 2024-04-12T00:15:01.969323400Z [2024-04-12 00:15:01,968: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ec606ee-fda9-4213-b035-fd724fdc2ad5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4ec606ee-fda9-4213-b035-fd724fdc2ad5') 2024-04-12T00:15:01.969391668Z Traceback (most recent call last): 2024-04-12T00:15:01.969396355Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T00:15:01.969399786Z R = retval = fun(*args, **kwargs) 2024-04-12T00:15:01.969402990Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T00:15:01.969417073Z return self.run(*args, **kwargs) 2024-04-12T00:15:01.969420673Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T00:15:01.969424106Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T00:15:01.969427075Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T00:15:01.969430203Z raise AirflowException(msg) 2024-04-12T00:15:01.969433715Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4ec606ee-fda9-4213-b035-fd724fdc2ad5 2024-04-12T00:15:02.391505959Z [2024-04-12 00:15:02,391: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[133cd3fd-3233-4c7b-95ba-16b6bf6532a1] succeeded in 1.375610642000538s: None 2024-04-12T00:15:02.562006750Z [2024-04-12 00:15:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:15:02.565177067Z [2024-04-12 00:15:02,564: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:02.593235093Z [2024-04-12 00:15:02,593: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:15:02.594562131Z [2024-04-12 00:15:02,594: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:02.594744250Z [2024-04-12 00:15:02,594: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:02.594980683Z [2024-04-12 00:15:02,594: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:02.595125905Z [2024-04-12 00:15:02,595: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:15:02.595452254Z [2024-04-12 00:15:02,595: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:15:02.595606365Z [2024-04-12 00:15:02,595: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:02.608792625Z [2024-04-12 00:15:02,608: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:15:02.611734319Z [2024-04-12 00:15:02,611: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:02.630557385Z [2024-04-12 00:15:02,630: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:15:02.631477018Z [2024-04-12 00:15:02,631: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:15:02.634776673Z [2024-04-12 00:15:02,634: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:02.635639054Z [2024-04-12 00:15:02,635: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:02.635674751Z [2024-04-12 00:15:02,635: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:02.635848067Z [2024-04-12 00:15:02,635: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:02.635879269Z [2024-04-12 00:15:02,635: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:15:02.636076185Z [2024-04-12 00:15:02,635: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:15:02.636109378Z [2024-04-12 00:15:02,636: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:02.661112245Z [2024-04-12 00:15:02,660: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:15:02.662936232Z [2024-04-12 00:15:02,662: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:02.662982490Z [2024-04-12 00:15:02,662: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:02.663050147Z [2024-04-12 00:15:02,662: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:02.663076861Z [2024-04-12 00:15:02,663: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:15:02.663237792Z [2024-04-12 00:15:02,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:15:02.663270577Z [2024-04-12 00:15:02,663: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:02.677597765Z [2024-04-12 00:15:02,677: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:02.718952819Z [2024-04-12 00:15:02,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:02.742288396Z [2024-04-12 00:15:02,742: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:03.288254682Z [2024-04-12 00:15:03,287: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7566922-573a-465d-aa67-14133fdf4cc3] succeeded in 2.2880094299998746s: None 2024-04-12T00:15:03.436770456Z [2024-04-12 00:15:03,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb5470b5-ae22-43fa-8ef7-860f08e9d69c] received 2024-04-12T00:15:03.452645785Z [2024-04-12 00:15:03,448: INFO/ForkPoolWorker-16] [cb5470b5-ae22-43fa-8ef7-860f08e9d69c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:03.761441735Z [2024-04-12 00:15:03,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:15:04.136242059Z [2024-04-12 00:15:04,135: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[499db702-fb73-420c-ab82-0bb2f9748522] succeeded in 3.1262150949996794s: None 2024-04-12T00:15:04.629103006Z [2024-04-12 00:15:04,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[371c328d-472c-448e-b0fe-edccc3a1938d] succeeded in 3.6324471590005487s: None 2024-04-12T00:15:04.781987670Z [2024-04-12 00:15:04,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:15:04.784892633Z [2024-04-12 00:15:04,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:04.805417034Z [2024-04-12 00:15:04,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:15:04.806779667Z [2024-04-12 00:15:04,806: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:04.806949316Z [2024-04-12 00:15:04,806: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:04.807196338Z [2024-04-12 00:15:04,806: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:04.807350822Z [2024-04-12 00:15:04,807: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:15:04.807693478Z [2024-04-12 00:15:04,807: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:15:04.807970180Z [2024-04-12 00:15:04,807: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:04.892097878Z [2024-04-12 00:15:04,891: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:05.561064952Z [2024-04-12 00:15:05,560: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb5470b5-ae22-43fa-8ef7-860f08e9d69c] succeeded in 2.1204043389998333s: None 2024-04-12T00:15:05.857586356Z [2024-04-12 00:15:05,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85cf3a8b-575c-4833-af59-0ad1e375c2b7] received 2024-04-12T00:15:05.869173855Z [2024-04-12 00:15:05,868: INFO/ForkPoolWorker-15] [85cf3a8b-575c-4833-af59-0ad1e375c2b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:15:06.115264697Z [2024-04-12 00:15:06,112: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:15:07.057593062Z [2024-04-12 00:15:07,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:15:07.060470224Z [2024-04-12 00:15:07,060: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:07.084835213Z [2024-04-12 00:15:07,084: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:15:07.086247219Z [2024-04-12 00:15:07,085: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:07.086350995Z [2024-04-12 00:15:07,086: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:07.086684712Z [2024-04-12 00:15:07,086: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:07.086712111Z [2024-04-12 00:15:07,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:15:07.087094998Z [2024-04-12 00:15:07,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:15:07.087268184Z [2024-04-12 00:15:07,087: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:07.183009144Z [2024-04-12 00:15:07,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:07.925434524Z [2024-04-12 00:15:07,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85cf3a8b-575c-4833-af59-0ad1e375c2b7] succeeded in 2.065262805999737s: None 2024-04-12T00:15:08.061492994Z [2024-04-12 00:15:08,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d291bbcc-9a5b-4feb-97ed-e570a6bc59d9] received 2024-04-12T00:15:08.068910637Z [2024-04-12 00:15:08,068: INFO/ForkPoolWorker-15] [d291bbcc-9a5b-4feb-97ed-e570a6bc59d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:08.340182215Z [2024-04-12 00:15:08,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:15:09.266755455Z [2024-04-12 00:15:09,266: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:15:09.269715524Z [2024-04-12 00:15:09,269: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:09.290013718Z [2024-04-12 00:15:09,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:15:09.291615674Z [2024-04-12 00:15:09,291: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:15:09.291647783Z [2024-04-12 00:15:09,291: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:15:09.291951805Z [2024-04-12 00:15:09,291: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:15:09.291968124Z [2024-04-12 00:15:09,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:15:09.292231193Z [2024-04-12 00:15:09,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:15:09.292291975Z [2024-04-12 00:15:09,292: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:15:09.378724504Z [2024-04-12 00:15:09,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:15:10.026661291Z [2024-04-12 00:15:10,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d291bbcc-9a5b-4feb-97ed-e570a6bc59d9] succeeded in 1.9620730030001141s: None 2024-04-12T00:15:13.182641157Z [2024-04-12 00:15:13,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bee06817-6b1a-46c1-8c5c-17990396457e] received 2024-04-12T00:15:13.190109450Z [2024-04-12 00:15:13,189: INFO/ForkPoolWorker-15] [bee06817-6b1a-46c1-8c5c-17990396457e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:13.422321171Z [2024-04-12 00:15:13,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:13.548040894Z [2024-04-12 00:15:13,547: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:15:13.551269328Z [2024-04-12 00:15:13,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:13.575119386Z [2024-04-12 00:15:13,574: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:15:13.576161017Z [2024-04-12 00:15:13,575: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:15:13.576365256Z [2024-04-12 00:15:13,576: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:15:13.576479857Z [2024-04-12 00:15:13,576: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:15:13.577260570Z [2024-04-12 00:15:13,577: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:15:13.584601334Z [2024-04-12 00:15:13,584: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:13.584923758Z [2024-04-12 00:15:13,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:15:13.585719003Z [2024-04-12 00:15:13,585: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:15:13.588134045Z [2024-04-12 00:15:13,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:15:13.600716009Z [2024-04-12 00:15:13,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:15:13.602135546Z [2024-04-12 00:15:13,601: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:15:13.602306376Z [2024-04-12 00:15:13,602: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:15:13.602481895Z [2024-04-12 00:15:13,602: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:15:13.602689557Z [2024-04-12 00:15:13,602: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:15:13.606058457Z [2024-04-12 00:15:13,605: ERROR/ForkPoolWorker-15] [bee06817-6b1a-46c1-8c5c-17990396457e] Failed to execute task Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' could not be found; either it does not exist or it failed to parse.. 2024-04-12T00:15:13.606096646Z Traceback (most recent call last): 2024-04-12T00:15:13.606103459Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T00:15:13.606109735Z args.func(args) 2024-04-12T00:15:13.606116040Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T00:15:13.606122136Z return func(*args, **kwargs) 2024-04-12T00:15:13.606127604Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T00:15:13.606132988Z return f(*args, **kwargs) 2024-04-12T00:15:13.606138690Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T00:15:13.606144191Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T00:15:13.606149583Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T00:15:13.606155027Z raise AirflowException( 2024-04-12T00:15:13.606161427Z airflow.exceptions.AirflowException: Dag 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba' could not be found; either it does not exist or it failed to parse. 2024-04-12T00:15:13.640186009Z [2024-04-12 00:15:13,639: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bee06817-6b1a-46c1-8c5c-17990396457e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bee06817-6b1a-46c1-8c5c-17990396457e') 2024-04-12T00:15:13.640222026Z Traceback (most recent call last): 2024-04-12T00:15:13.640234357Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T00:15:13.640244626Z R = retval = fun(*args, **kwargs) 2024-04-12T00:15:13.640254608Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T00:15:13.640264969Z return self.run(*args, **kwargs) 2024-04-12T00:15:13.640275677Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T00:15:13.640286203Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T00:15:13.640295874Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T00:15:13.640306411Z raise AirflowException(msg) 2024-04-12T00:15:13.640316986Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bee06817-6b1a-46c1-8c5c-17990396457e 2024-04-12T00:16:01.106672102Z [2024-04-12 00:16:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aea54443-e0be-4bf6-8772-c4c2ca3f208a] received 2024-04-12T00:16:01.110892387Z [2024-04-12 00:16:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f06901b-d20c-41c4-9b12-d09561e97ade] received 2024-04-12T00:16:01.114540989Z [2024-04-12 00:16:01,114: INFO/ForkPoolWorker-15] [aea54443-e0be-4bf6-8772-c4c2ca3f208a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:16:01.120869461Z [2024-04-12 00:16:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[698b89dd-68da-4d0c-a0f2-13cfa0c1a73e] received 2024-04-12T00:16:01.131592202Z [2024-04-12 00:16:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[facf47da-7984-482c-9c34-dc1f9b1c85ff] received 2024-04-12T00:16:01.136524239Z [2024-04-12 00:16:01,136: INFO/ForkPoolWorker-1] [698b89dd-68da-4d0c-a0f2-13cfa0c1a73e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:16:01.139142313Z [2024-04-12 00:16:01,138: INFO/ForkPoolWorker-16] [3f06901b-d20c-41c4-9b12-d09561e97ade] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:16:01.141982353Z [2024-04-12 00:16:01,141: INFO/ForkPoolWorker-2] [facf47da-7984-482c-9c34-dc1f9b1c85ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:16:01.439071903Z [2024-04-12 00:16:01,434: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:16:01.457949205Z [2024-04-12 00:16:01,454: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:16:01.498674126Z [2024-04-12 00:16:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:16:01.525173191Z [2024-04-12 00:16:01,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:16:01.578055484Z [2024-04-12 00:16:01,577: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:16:01.581563719Z [2024-04-12 00:16:01,581: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:16:01.604660314Z [2024-04-12 00:16:01,604: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:16:01.606044969Z [2024-04-12 00:16:01,605: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:16:01.606055750Z [2024-04-12 00:16:01,605: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:16:01.606059631Z [2024-04-12 00:16:01,605: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:16:01.606062880Z [2024-04-12 00:16:01,605: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:16:01.713492769Z [2024-04-12 00:16:01,713: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:16:01.783196035Z [2024-04-12 00:16:01,782: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:16:02.219470978Z [2024-04-12 00:16:02,219: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[facf47da-7984-482c-9c34-dc1f9b1c85ff] succeeded in 1.0864011150006263s: None 2024-04-12T00:16:02.370845993Z [2024-04-12 00:16:02,370: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[698b89dd-68da-4d0c-a0f2-13cfa0c1a73e] succeeded in 1.2450004779993833s: None 2024-04-12T00:16:02.667735764Z [2024-04-12 00:16:02,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:16:02.668045224Z [2024-04-12 00:16:02,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:16:02.670557462Z [2024-04-12 00:16:02,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:16:02.670926984Z [2024-04-12 00:16:02,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:16:02.689711116Z [2024-04-12 00:16:02,689: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:16:02.691461317Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:16:02.691480277Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:16:02.691634495Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:16:02.691654301Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:16:02.691808383Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:16:02.691881553Z [2024-04-12 00:16:02,691: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:16:02.700463439Z [2024-04-12 00:16:02,700: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:16:02.701974659Z [2024-04-12 00:16:02,701: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:16:02.702020469Z [2024-04-12 00:16:02,701: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:16:02.702134923Z [2024-04-12 00:16:02,701: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:16:02.702173396Z [2024-04-12 00:16:02,702: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:16:02.702392904Z [2024-04-12 00:16:02,702: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:16:02.702424945Z [2024-04-12 00:16:02,702: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:16:02.751984200Z [2024-04-12 00:16:02,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:16:02.761243297Z [2024-04-12 00:16:02,761: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:16:04.307718327Z [2024-04-12 00:16:04,307: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f06901b-d20c-41c4-9b12-d09561e97ade] succeeded in 3.1934393809997346s: None 2024-04-12T00:16:04.708702130Z [2024-04-12 00:16:04,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aea54443-e0be-4bf6-8772-c4c2ca3f208a] succeeded in 3.5993923840005664s: None 2024-04-12T00:17:00.958799130Z [2024-04-12 00:17:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6901ab11-9692-4f68-bf7b-898583b54017] received 2024-04-12T00:17:00.962061377Z [2024-04-12 00:17:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ebefc08-054c-414f-aac0-5a102da82b91] received 2024-04-12T00:17:00.966308001Z [2024-04-12 00:17:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[053e677b-bab1-4125-a7e3-f9aa88e3c90f] received 2024-04-12T00:17:00.968479042Z [2024-04-12 00:17:00,968: INFO/ForkPoolWorker-15] [6901ab11-9692-4f68-bf7b-898583b54017] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:17:00.968971253Z [2024-04-12 00:17:00,968: INFO/ForkPoolWorker-16] [8ebefc08-054c-414f-aac0-5a102da82b91] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:17:00.978034714Z [2024-04-12 00:17:00,977: INFO/ForkPoolWorker-1] [053e677b-bab1-4125-a7e3-f9aa88e3c90f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:17:01.217701504Z [2024-04-12 00:17:01,214: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:17:01.228731142Z [2024-04-12 00:17:01,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:17:01.245565005Z [2024-04-12 00:17:01,242: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:17:01.365314811Z [2024-04-12 00:17:01,364: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:17:01.368772425Z [2024-04-12 00:17:01,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:17:01.389539803Z [2024-04-12 00:17:01,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:17:01.390322197Z [2024-04-12 00:17:01,390: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:17:01.390418515Z [2024-04-12 00:17:01,390: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:17:01.390485933Z [2024-04-12 00:17:01,390: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:17:01.390653215Z [2024-04-12 00:17:01,390: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:17:01.498958268Z [2024-04-12 00:17:01,498: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:17:02.053394551Z [2024-04-12 00:17:02,052: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ebefc08-054c-414f-aac0-5a102da82b91] succeeded in 1.0892066010001145s: None 2024-04-12T00:17:02.254967995Z [2024-04-12 00:17:02,254: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:17:02.257955543Z [2024-04-12 00:17:02,257: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:17:02.275888911Z [2024-04-12 00:17:02,275: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:17:02.277280529Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:17:02.277304878Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:17:02.277444059Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:17:02.277535425Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:17:02.277792073Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:17:02.277946500Z [2024-04-12 00:17:02,277: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:17:02.339960735Z [2024-04-12 00:17:02,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:17:02.343039681Z [2024-04-12 00:17:02,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:17:02.356017715Z [2024-04-12 00:17:02,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:17:02.364870989Z [2024-04-12 00:17:02,364: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:17:02.366268402Z [2024-04-12 00:17:02,366: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:17:02.366461139Z [2024-04-12 00:17:02,366: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:17:02.366732835Z [2024-04-12 00:17:02,366: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:17:02.367071508Z [2024-04-12 00:17:02,366: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:17:02.367332478Z [2024-04-12 00:17:02,367: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:17:02.367438353Z [2024-04-12 00:17:02,367: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:17:02.440414102Z [2024-04-12 00:17:02,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:17:03.813309557Z [2024-04-12 00:17:03,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6901ab11-9692-4f68-bf7b-898583b54017] succeeded in 2.849701627000286s: None 2024-04-12T00:17:04.548495254Z [2024-04-12 00:17:04,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[053e677b-bab1-4125-a7e3-f9aa88e3c90f] succeeded in 3.5789372580002237s: None 2024-04-12T00:18:00.854160075Z [2024-04-12 00:18:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[debb35ea-e7fd-4c0a-a8e4-f07614f4d919] received 2024-04-12T00:18:00.857100656Z [2024-04-12 00:18:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76a0e08d-e7dd-42e4-b93b-b3c60accf7dc] received 2024-04-12T00:18:00.860840136Z [2024-04-12 00:18:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cb83f34-3490-455b-b826-c09159cb8159] received 2024-04-12T00:18:00.862352373Z [2024-04-12 00:18:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcfdcb8f-2e0f-446a-bc10-dc6ddb47d505] received 2024-04-12T00:18:00.868079108Z [2024-04-12 00:18:00,867: INFO/ForkPoolWorker-1] [2cb83f34-3490-455b-b826-c09159cb8159] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:18:00.869086242Z [2024-04-12 00:18:00,868: INFO/ForkPoolWorker-15] [debb35ea-e7fd-4c0a-a8e4-f07614f4d919] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:18:00.869883442Z [2024-04-12 00:18:00,869: INFO/ForkPoolWorker-2] [bcfdcb8f-2e0f-446a-bc10-dc6ddb47d505] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:18:00.870929843Z [2024-04-12 00:18:00,870: INFO/ForkPoolWorker-16] [76a0e08d-e7dd-42e4-b93b-b3c60accf7dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:18:01.173234298Z [2024-04-12 00:18:01,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:18:01.188160966Z [2024-04-12 00:18:01,185: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:18:01.244418457Z [2024-04-12 00:18:01,241: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:18:01.249722805Z [2024-04-12 00:18:01,246: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:18:01.385083809Z [2024-04-12 00:18:01,384: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:18:01.388411768Z [2024-04-12 00:18:01,388: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:18:01.415131743Z [2024-04-12 00:18:01,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:18:01.416640523Z [2024-04-12 00:18:01,416: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:18:01.416814488Z [2024-04-12 00:18:01,416: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:18:01.416924133Z [2024-04-12 00:18:01,416: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:18:01.417173724Z [2024-04-12 00:18:01,417: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:18:01.471730942Z [2024-04-12 00:18:01,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:18:01.519105968Z [2024-04-12 00:18:01,518: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:18:02.116570093Z [2024-04-12 00:18:02,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[debb35ea-e7fd-4c0a-a8e4-f07614f4d919] succeeded in 1.2603772100001152s: None 2024-04-12T00:18:02.293417686Z [2024-04-12 00:18:02,293: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76a0e08d-e7dd-42e4-b93b-b3c60accf7dc] succeeded in 1.434654366000359s: None 2024-04-12T00:18:02.387153959Z [2024-04-12 00:18:02,386: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:18:02.390106993Z [2024-04-12 00:18:02,389: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:18:02.416356084Z [2024-04-12 00:18:02,416: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:18:02.419035159Z [2024-04-12 00:18:02,418: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:18:02.419889311Z [2024-04-12 00:18:02,419: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:18:02.420276058Z [2024-04-12 00:18:02,419: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:18:02.420952018Z [2024-04-12 00:18:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:18:02.421362765Z [2024-04-12 00:18:02,421: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:18:02.421840281Z [2024-04-12 00:18:02,421: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:18:02.488240316Z [2024-04-12 00:18:02,488: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:18:02.542419384Z [2024-04-12 00:18:02,542: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:18:02.545927767Z [2024-04-12 00:18:02,545: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:18:02.571264498Z [2024-04-12 00:18:02,571: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:18:02.572629886Z [2024-04-12 00:18:02,572: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:18:02.572791264Z [2024-04-12 00:18:02,572: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:18:02.573000905Z [2024-04-12 00:18:02,572: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:18:02.573131558Z [2024-04-12 00:18:02,573: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:18:02.573400754Z [2024-04-12 00:18:02,573: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:18:02.573825251Z [2024-04-12 00:18:02,573: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:18:02.644193126Z [2024-04-12 00:18:02,643: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:18:04.005924312Z [2024-04-12 00:18:04,005: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2cb83f34-3490-455b-b826-c09159cb8159] succeeded in 3.1435665230001177s: None 2024-04-12T00:18:04.785767643Z [2024-04-12 00:18:04,785: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bcfdcb8f-2e0f-446a-bc10-dc6ddb47d505] succeeded in 3.9216779580001457s: None 2024-04-12T00:19:00.485469794Z [2024-04-12 00:19:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499a6f88-5d4c-4c12-90ea-892e6295e95a] received 2024-04-12T00:19:00.494882139Z [2024-04-12 00:19:00,494: INFO/ForkPoolWorker-15] [499a6f88-5d4c-4c12-90ea-892e6295e95a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:19:00.501282972Z [2024-04-12 00:19:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90e21524-7035-4d8a-89db-bff3a86e4f41] received 2024-04-12T00:19:00.506436324Z [2024-04-12 00:19:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb1f42f9-2331-41ca-9c2a-7c61d13d83e5] received 2024-04-12T00:19:00.511617936Z [2024-04-12 00:19:00,511: INFO/ForkPoolWorker-16] [90e21524-7035-4d8a-89db-bff3a86e4f41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:19:00.520466194Z [2024-04-12 00:19:00,520: INFO/ForkPoolWorker-1] [bb1f42f9-2331-41ca-9c2a-7c61d13d83e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:19:00.818664622Z [2024-04-12 00:19:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:19:00.824118930Z [2024-04-12 00:19:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:19:00.827804691Z [2024-04-12 00:19:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:19:01.102487183Z [2024-04-12 00:19:01,102: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:19:01.106182938Z [2024-04-12 00:19:01,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:19:01.134477455Z [2024-04-12 00:19:01,134: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:19:01.137415417Z [2024-04-12 00:19:01,137: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:19:01.137563605Z [2024-04-12 00:19:01,137: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:19:01.137643483Z [2024-04-12 00:19:01,137: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:19:01.137894927Z [2024-04-12 00:19:01,137: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:19:01.226288822Z [2024-04-12 00:19:01,226: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:19:01.770748116Z [2024-04-12 00:19:01,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[499a6f88-5d4c-4c12-90ea-892e6295e95a] succeeded in 1.2824588009998479s: None 2024-04-12T00:19:01.929924296Z [2024-04-12 00:19:01,929: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:19:01.932927898Z [2024-04-12 00:19:01,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:19:01.962876474Z [2024-04-12 00:19:01,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:19:01.964335024Z [2024-04-12 00:19:01,964: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:19:01.964627804Z [2024-04-12 00:19:01,964: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:19:01.964890785Z [2024-04-12 00:19:01,964: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:19:01.965113994Z [2024-04-12 00:19:01,964: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:19:01.965587000Z [2024-04-12 00:19:01,965: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:19:01.965792752Z [2024-04-12 00:19:01,965: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:19:02.005010639Z [2024-04-12 00:19:02,004: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:19:02.008100103Z [2024-04-12 00:19:02,007: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:19:02.028524455Z [2024-04-12 00:19:02,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:19:02.029713164Z [2024-04-12 00:19:02,029: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:19:02.029850118Z [2024-04-12 00:19:02,029: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:19:02.030131650Z [2024-04-12 00:19:02,029: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:19:02.030286327Z [2024-04-12 00:19:02,030: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:19:02.030676152Z [2024-04-12 00:19:02,030: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:19:02.030765991Z [2024-04-12 00:19:02,030: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:19:02.049043786Z [2024-04-12 00:19:02,048: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:19:02.116658124Z [2024-04-12 00:19:02,116: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:19:03.921875159Z [2024-04-12 00:19:03,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90e21524-7035-4d8a-89db-bff3a86e4f41] succeeded in 3.418134268000358s: None 2024-04-12T00:19:04.909765571Z [2024-04-12 00:19:04,909: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb1f42f9-2331-41ca-9c2a-7c61d13d83e5] succeeded in 4.401580226999613s: None 2024-04-12T00:20:00.830449199Z [2024-04-12 00:20:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5320d67-c69f-4710-9ee8-6b0253c61697] received 2024-04-12T00:20:00.832809038Z [2024-04-12 00:20:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebf8f810-5f3d-4c83-bbb9-49d41944d624] received 2024-04-12T00:20:00.839910004Z [2024-04-12 00:20:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b74ac835-aa84-4914-99a0-76bd75969f71] received 2024-04-12T00:20:00.842567083Z [2024-04-12 00:20:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43021a1a-7cd0-4133-9464-ce2d8c05e2fc] received 2024-04-12T00:20:00.843829561Z [2024-04-12 00:20:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77528fbf-0dad-48d4-8159-90cba9a1c042] received 2024-04-12T00:20:00.850732581Z [2024-04-12 00:20:00,850: INFO/ForkPoolWorker-16] [ebf8f810-5f3d-4c83-bbb9-49d41944d624] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:20:00.854033688Z [2024-04-12 00:20:00,853: INFO/ForkPoolWorker-1] [b74ac835-aa84-4914-99a0-76bd75969f71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:00.855051176Z [2024-04-12 00:20:00,854: INFO/ForkPoolWorker-2] [43021a1a-7cd0-4133-9464-ce2d8c05e2fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:20:00.855541443Z [2024-04-12 00:20:00,855: INFO/ForkPoolWorker-15] [c5320d67-c69f-4710-9ee8-6b0253c61697] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:20:00.861304142Z [2024-04-12 00:20:00,861: INFO/ForkPoolWorker-3] [77528fbf-0dad-48d4-8159-90cba9a1c042] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:20:01.126465052Z [2024-04-12 00:20:01,122: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:20:01.164609046Z [2024-04-12 00:20:01,157: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:20:01.201662069Z [2024-04-12 00:20:01,197: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:20:01.257679148Z [2024-04-12 00:20:01,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:20:01.448457046Z [2024-04-12 00:20:01,448: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:01.452899847Z [2024-04-12 00:20:01,446: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:20:01.713363530Z [2024-04-12 00:20:01,713: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:20:01.718732016Z [2024-04-12 00:20:01,717: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:01.792290686Z [2024-04-12 00:20:01,792: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:20:01.795251220Z [2024-04-12 00:20:01,795: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:20:01.795381591Z [2024-04-12 00:20:01,795: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:20:01.795456483Z [2024-04-12 00:20:01,795: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:20:01.795754733Z [2024-04-12 00:20:01,795: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:20:01.977014011Z [2024-04-12 00:20:01,976: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:02.223321153Z [2024-04-12 00:20:02,222: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[77528fbf-0dad-48d4-8159-90cba9a1c042] succeeded in 1.3755632640004478s: None 2024-04-12T00:20:02.613300751Z [2024-04-12 00:20:02,612: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[43021a1a-7cd0-4133-9464-ce2d8c05e2fc] succeeded in 1.7680126409995864s: None 2024-04-12T00:20:02.636044024Z [2024-04-12 00:20:02,635: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:20:02.638869613Z [2024-04-12 00:20:02,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:02.667380391Z [2024-04-12 00:20:02,667: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:20:02.668892218Z [2024-04-12 00:20:02,668: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:02.669007524Z [2024-04-12 00:20:02,668: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:02.669178480Z [2024-04-12 00:20:02,668: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:02.669332322Z [2024-04-12 00:20:02,669: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:20:02.669808822Z [2024-04-12 00:20:02,669: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:20:02.669918167Z [2024-04-12 00:20:02,669: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:02.745285158Z [2024-04-12 00:20:02,745: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:02.868642396Z [2024-04-12 00:20:02,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:20:02.872150027Z [2024-04-12 00:20:02,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:02.903865783Z [2024-04-12 00:20:02,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:20:02.906302174Z [2024-04-12 00:20:02,906: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:02.906420511Z [2024-04-12 00:20:02,906: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:02.906895309Z [2024-04-12 00:20:02,906: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:02.907015233Z [2024-04-12 00:20:02,906: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:20:02.907252061Z [2024-04-12 00:20:02,907: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:20:02.907438848Z [2024-04-12 00:20:02,907: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:03.060273382Z [2024-04-12 00:20:03,060: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:03.276454805Z [2024-04-12 00:20:03,276: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:20:03.279316508Z [2024-04-12 00:20:03,278: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:03.306951002Z [2024-04-12 00:20:03,306: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:20:03.311174198Z [2024-04-12 00:20:03,310: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:03.311187034Z [2024-04-12 00:20:03,311: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:03.311263533Z [2024-04-12 00:20:03,311: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:03.311327112Z [2024-04-12 00:20:03,311: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:20:03.311481079Z [2024-04-12 00:20:03,311: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:20:03.311519960Z [2024-04-12 00:20:03,311: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:03.364737530Z [2024-04-12 00:20:03,364: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b74ac835-aa84-4914-99a0-76bd75969f71] succeeded in 2.52065136300007s: None 2024-04-12T00:20:03.376834919Z [2024-04-12 00:20:03,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:04.103437734Z [2024-04-12 00:20:04,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d736dfb-a4bc-4f09-846b-f7e180747d18] received 2024-04-12T00:20:04.115831148Z [2024-04-12 00:20:04,113: INFO/ForkPoolWorker-1] [4d736dfb-a4bc-4f09-846b-f7e180747d18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:04.399598885Z [2024-04-12 00:20:04,396: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:20:04.548500860Z [2024-04-12 00:20:04,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5320d67-c69f-4710-9ee8-6b0253c61697] succeeded in 3.714651797999977s: None 2024-04-12T00:20:05.036044104Z [2024-04-12 00:20:05,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebf8f810-5f3d-4c83-bbb9-49d41944d624] succeeded in 4.193526201999703s: None 2024-04-12T00:20:05.354529168Z [2024-04-12 00:20:05,354: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:20:05.357451572Z [2024-04-12 00:20:05,357: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:05.381101802Z [2024-04-12 00:20:05,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:20:05.382708694Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:05.382738862Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:05.382750272Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:05.382760194Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:20:05.383210263Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:20:05.383230297Z [2024-04-12 00:20:05,382: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:05.474175896Z [2024-04-12 00:20:05,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:06.226331095Z [2024-04-12 00:20:06,225: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d736dfb-a4bc-4f09-846b-f7e180747d18] succeeded in 2.120182429000124s: None 2024-04-12T00:20:06.580427915Z [2024-04-12 00:20:06,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6228e854-bcc3-41ac-a062-778c449efc97] received 2024-04-12T00:20:06.591390652Z [2024-04-12 00:20:06,591: INFO/ForkPoolWorker-15] [6228e854-bcc3-41ac-a062-778c449efc97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:20:06.880309474Z [2024-04-12 00:20:06,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:20:07.925342145Z [2024-04-12 00:20:07,924: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:20:07.936095076Z [2024-04-12 00:20:07,928: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:07.949967892Z [2024-04-12 00:20:07,949: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:20:07.951069148Z [2024-04-12 00:20:07,950: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:07.951081853Z [2024-04-12 00:20:07,950: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:07.951114086Z [2024-04-12 00:20:07,950: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:07.951156742Z [2024-04-12 00:20:07,951: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:20:07.951338155Z [2024-04-12 00:20:07,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:20:07.951345808Z [2024-04-12 00:20:07,951: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:08.029168743Z [2024-04-12 00:20:08,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:08.523553664Z [2024-04-12 00:20:08,522: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6228e854-bcc3-41ac-a062-778c449efc97] succeeded in 1.93875060100072s: None 2024-04-12T00:20:09.176582133Z [2024-04-12 00:20:09,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea7dd532-9e47-4483-88b3-1ca6dfc81553] received 2024-04-12T00:20:09.187101374Z [2024-04-12 00:20:09,186: INFO/ForkPoolWorker-15] [ea7dd532-9e47-4483-88b3-1ca6dfc81553] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:09.417643861Z [2024-04-12 00:20:09,415: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:20:10.475925396Z [2024-04-12 00:20:10,475: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:20:10.480818579Z [2024-04-12 00:20:10,480: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:20:10.503833445Z [2024-04-12 00:20:10,503: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:20:10.506031327Z [2024-04-12 00:20:10,505: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:20:10.506280040Z [2024-04-12 00:20:10,505: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:20:10.506704723Z [2024-04-12 00:20:10,506: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:20:10.507078824Z [2024-04-12 00:20:10,506: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:20:10.507635877Z [2024-04-12 00:20:10,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:20:10.507943871Z [2024-04-12 00:20:10,507: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:20:10.600752904Z [2024-04-12 00:20:10,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:20:11.272200381Z [2024-04-12 00:20:11,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea7dd532-9e47-4483-88b3-1ca6dfc81553] succeeded in 2.093371799999659s: None 2024-04-12T00:21:01.064550975Z [2024-04-12 00:21:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba99d85-907a-46e6-8297-ac8875945074] received 2024-04-12T00:21:01.067430372Z [2024-04-12 00:21:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68500ce9-ae62-444f-9dae-98f9624ebec0] received 2024-04-12T00:21:01.074847312Z [2024-04-12 00:21:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09c031cc-bd07-45b7-bfcf-02b40b22b817] received 2024-04-12T00:21:01.078638224Z [2024-04-12 00:21:01,078: INFO/ForkPoolWorker-16] [68500ce9-ae62-444f-9dae-98f9624ebec0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:21:01.081045029Z [2024-04-12 00:21:01,080: INFO/ForkPoolWorker-15] [9ba99d85-907a-46e6-8297-ac8875945074] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:21:01.093489668Z [2024-04-12 00:21:01,088: INFO/ForkPoolWorker-1] [09c031cc-bd07-45b7-bfcf-02b40b22b817] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:21:01.330718876Z [2024-04-12 00:21:01,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:21:01.353187654Z [2024-04-12 00:21:01,349: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:21:01.415199271Z [2024-04-12 00:21:01,410: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:21:01.582049300Z [2024-04-12 00:21:01,581: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:21:01.586074958Z [2024-04-12 00:21:01,585: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:21:01.622755419Z [2024-04-12 00:21:01,622: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:21:01.625256646Z [2024-04-12 00:21:01,624: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:21:01.625310504Z [2024-04-12 00:21:01,625: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:21:01.625321091Z [2024-04-12 00:21:01,625: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:21:01.625982182Z [2024-04-12 00:21:01,625: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:21:01.727905098Z [2024-04-12 00:21:01,725: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:21:02.303933398Z [2024-04-12 00:21:02,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[09c031cc-bd07-45b7-bfcf-02b40b22b817] succeeded in 1.2250656420001178s: None 2024-04-12T00:21:02.442549815Z [2024-04-12 00:21:02,442: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:21:02.442907974Z [2024-04-12 00:21:02,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:21:02.445767260Z [2024-04-12 00:21:02,445: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:21:02.446121125Z [2024-04-12 00:21:02,445: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:21:02.469450937Z [2024-04-12 00:21:02,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:21:02.470629168Z [2024-04-12 00:21:02,470: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:21:02.470689862Z [2024-04-12 00:21:02,470: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:21:02.470835945Z [2024-04-12 00:21:02,470: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:21:02.470858399Z [2024-04-12 00:21:02,470: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:21:02.471132399Z [2024-04-12 00:21:02,470: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:21:02.471214407Z [2024-04-12 00:21:02,471: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:21:02.479541367Z [2024-04-12 00:21:02,478: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:21:02.481613709Z [2024-04-12 00:21:02,481: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:21:02.481663015Z [2024-04-12 00:21:02,481: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:21:02.481858288Z [2024-04-12 00:21:02,481: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:21:02.481926105Z [2024-04-12 00:21:02,481: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:21:02.482248755Z [2024-04-12 00:21:02,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:21:02.482301009Z [2024-04-12 00:21:02,482: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:21:02.540489529Z [2024-04-12 00:21:02,540: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:21:02.578759663Z [2024-04-12 00:21:02,578: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:21:05.349837246Z [2024-04-12 00:21:05,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68500ce9-ae62-444f-9dae-98f9624ebec0] succeeded in 4.278985862000809s: None 2024-04-12T00:21:06.130681894Z [2024-04-12 00:21:06,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ba99d85-907a-46e6-8297-ac8875945074] succeeded in 5.061120112000026s: None 2024-04-12T00:22:01.152895911Z [2024-04-12 00:22:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f08a1ec6-0222-4db1-8add-ce46b96a5be6] received 2024-04-12T00:22:01.155182443Z [2024-04-12 00:22:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d438ff1b-664b-402a-8b21-bdfda1f08e44] received 2024-04-12T00:22:01.165476548Z [2024-04-12 00:22:01,165: INFO/ForkPoolWorker-16] [d438ff1b-664b-402a-8b21-bdfda1f08e44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:22:01.166607713Z [2024-04-12 00:22:01,166: INFO/ForkPoolWorker-15] [f08a1ec6-0222-4db1-8add-ce46b96a5be6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:22:01.176988885Z [2024-04-12 00:22:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[074478e4-7f83-48f2-bf91-aebc03eb29b6] received 2024-04-12T00:22:01.185380034Z [2024-04-12 00:22:01,185: INFO/ForkPoolWorker-1] [074478e4-7f83-48f2-bf91-aebc03eb29b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:22:01.189900601Z [2024-04-12 00:22:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54013137-fc1a-48df-916f-aec1f6335413] received 2024-04-12T00:22:01.199912773Z [2024-04-12 00:22:01,199: INFO/ForkPoolWorker-2] [54013137-fc1a-48df-916f-aec1f6335413] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:22:01.453741643Z [2024-04-12 00:22:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:22:01.503344657Z [2024-04-12 00:22:01,499: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:22:01.533128638Z [2024-04-12 00:22:01,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:22:01.596069093Z [2024-04-12 00:22:01,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:22:01.794276138Z [2024-04-12 00:22:01,793: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:22:01.797804673Z [2024-04-12 00:22:01,797: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:22:01.827695183Z [2024-04-12 00:22:01,827: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:22:01.831098076Z [2024-04-12 00:22:01,830: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:22:01.831202857Z [2024-04-12 00:22:01,831: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:22:01.831279742Z [2024-04-12 00:22:01,831: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:22:01.831503454Z [2024-04-12 00:22:01,831: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:22:01.872966420Z [2024-04-12 00:22:01,872: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:22:01.924515321Z [2024-04-12 00:22:01,924: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:22:02.489018295Z [2024-04-12 00:22:02,488: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[54013137-fc1a-48df-916f-aec1f6335413] succeeded in 1.2980075929999657s: None 2024-04-12T00:22:02.503634278Z [2024-04-12 00:22:02,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[074478e4-7f83-48f2-bf91-aebc03eb29b6] succeeded in 1.325174368000262s: None 2024-04-12T00:22:02.578322142Z [2024-04-12 00:22:02,577: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:22:02.581407997Z [2024-04-12 00:22:02,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:22:02.600796603Z [2024-04-12 00:22:02,600: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:22:02.602071753Z [2024-04-12 00:22:02,601: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:22:02.602083444Z [2024-04-12 00:22:02,601: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:22:02.602338332Z [2024-04-12 00:22:02,602: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:22:02.602471539Z [2024-04-12 00:22:02,602: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:22:02.602745458Z [2024-04-12 00:22:02,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:22:02.603158977Z [2024-04-12 00:22:02,602: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:22:02.673490576Z [2024-04-12 00:22:02,673: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:22:02.676731256Z [2024-04-12 00:22:02,676: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:22:02.686419245Z [2024-04-12 00:22:02,686: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:22:02.697636702Z [2024-04-12 00:22:02,697: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:22:02.699634297Z [2024-04-12 00:22:02,699: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:22:02.699747121Z [2024-04-12 00:22:02,699: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:22:02.699963540Z [2024-04-12 00:22:02,699: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:22:02.700022259Z [2024-04-12 00:22:02,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:22:02.700344904Z [2024-04-12 00:22:02,700: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:22:02.700467448Z [2024-04-12 00:22:02,700: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:22:02.784977026Z [2024-04-12 00:22:02,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:22:04.318796942Z [2024-04-12 00:22:04,318: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d438ff1b-664b-402a-8b21-bdfda1f08e44] succeeded in 3.1618747630000144s: None 2024-04-12T00:22:05.186869099Z [2024-04-12 00:22:05,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f08a1ec6-0222-4db1-8add-ce46b96a5be6] succeeded in 4.029719524999564s: None 2024-04-12T00:23:00.900595203Z [2024-04-12 00:23:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b118c6d-f148-425e-bb6b-0ccef1a5db58] received 2024-04-12T00:23:00.908036100Z [2024-04-12 00:23:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca2e36f6-4315-4828-a9bd-75fd9dc7a292] received 2024-04-12T00:23:00.910892125Z [2024-04-12 00:23:00,910: INFO/ForkPoolWorker-15] [8b118c6d-f148-425e-bb6b-0ccef1a5db58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:23:00.915146736Z [2024-04-12 00:23:00,914: INFO/ForkPoolWorker-16] [ca2e36f6-4315-4828-a9bd-75fd9dc7a292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:23:00.920218147Z [2024-04-12 00:23:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21246758-00eb-4c90-941c-072a1c5f7a15] received 2024-04-12T00:23:00.935610321Z [2024-04-12 00:23:00,935: INFO/ForkPoolWorker-1] [21246758-00eb-4c90-941c-072a1c5f7a15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:23:01.216798966Z [2024-04-12 00:23:01,213: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:23:01.237882583Z [2024-04-12 00:23:01,233: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:23:01.247327249Z [2024-04-12 00:23:01,244: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:23:01.392168039Z [2024-04-12 00:23:01,391: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:23:01.399236214Z [2024-04-12 00:23:01,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:23:01.442832577Z [2024-04-12 00:23:01,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:23:01.448973909Z [2024-04-12 00:23:01,444: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:23:01.449016838Z [2024-04-12 00:23:01,444: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:23:01.449022088Z [2024-04-12 00:23:01,445: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:23:01.449025488Z [2024-04-12 00:23:01,445: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:23:01.536173525Z [2024-04-12 00:23:01,535: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:23:02.096483896Z [2024-04-12 00:23:02,095: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b118c6d-f148-425e-bb6b-0ccef1a5db58] succeeded in 1.1926257789991723s: None 2024-04-12T00:23:02.353753443Z [2024-04-12 00:23:02,353: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:23:02.356494652Z [2024-04-12 00:23:02,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:23:02.371032797Z [2024-04-12 00:23:02,370: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:23:02.372008556Z [2024-04-12 00:23:02,371: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:23:02.372031133Z [2024-04-12 00:23:02,371: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:23:02.372213115Z [2024-04-12 00:23:02,372: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:23:02.372229057Z [2024-04-12 00:23:02,372: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:23:02.372528003Z [2024-04-12 00:23:02,372: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:23:02.372640585Z [2024-04-12 00:23:02,372: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:23:02.458942535Z [2024-04-12 00:23:02,458: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:23:02.613786019Z [2024-04-12 00:23:02,613: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:23:02.617231641Z [2024-04-12 00:23:02,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:23:02.641974796Z [2024-04-12 00:23:02,641: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:23:02.643516533Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:23:02.643541904Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:23:02.643726093Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:23:02.643744440Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:23:02.644032465Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:23:02.644077316Z [2024-04-12 00:23:02,643: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:23:02.764062974Z [2024-04-12 00:23:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:23:04.585202991Z [2024-04-12 00:23:04,584: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca2e36f6-4315-4828-a9bd-75fd9dc7a292] succeeded in 3.675018691999867s: None 2024-04-12T00:23:04.885824693Z [2024-04-12 00:23:04,885: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21246758-00eb-4c90-941c-072a1c5f7a15] succeeded in 3.9631033470004695s: None 2024-04-12T00:24:00.840546179Z [2024-04-12 00:24:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43588e5a-2ae6-4193-8251-9c569353d60e] received 2024-04-12T00:24:00.844620186Z [2024-04-12 00:24:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6b0a10b-0679-42a0-89ed-e674ea8c28c8] received 2024-04-12T00:24:00.857077778Z [2024-04-12 00:24:00,856: INFO/ForkPoolWorker-15] [43588e5a-2ae6-4193-8251-9c569353d60e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:24:00.862177804Z [2024-04-12 00:24:00,861: INFO/ForkPoolWorker-16] [a6b0a10b-0679-42a0-89ed-e674ea8c28c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:24:00.862761228Z [2024-04-12 00:24:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b489e23-4814-425d-96a9-fa0bd8365ccd] received 2024-04-12T00:24:00.866696837Z [2024-04-12 00:24:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d50ab5-c532-4515-b9b6-1fb5cc2111fd] received 2024-04-12T00:24:00.873547987Z [2024-04-12 00:24:00,873: INFO/ForkPoolWorker-1] [1b489e23-4814-425d-96a9-fa0bd8365ccd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:24:00.878928228Z [2024-04-12 00:24:00,878: INFO/ForkPoolWorker-2] [20d50ab5-c532-4515-b9b6-1fb5cc2111fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:24:01.171365419Z [2024-04-12 00:24:01,168: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:24:01.172351838Z [2024-04-12 00:24:01,169: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:24:01.250892498Z [2024-04-12 00:24:01,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:24:01.333510743Z [2024-04-12 00:24:01,329: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:24:01.503195603Z [2024-04-12 00:24:01,502: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:24:01.506549644Z [2024-04-12 00:24:01,506: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:24:01.511765612Z [2024-04-12 00:24:01,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:24:01.540537534Z [2024-04-12 00:24:01,540: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:24:01.543117679Z [2024-04-12 00:24:01,542: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:24:01.543284942Z [2024-04-12 00:24:01,543: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:24:01.543475669Z [2024-04-12 00:24:01,543: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:24:01.543814962Z [2024-04-12 00:24:01,543: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:24:01.656067587Z [2024-04-12 00:24:01,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:24:02.119994657Z [2024-04-12 00:24:02,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43588e5a-2ae6-4193-8251-9c569353d60e] succeeded in 1.2731685559992911s: None 2024-04-12T00:24:02.326012716Z [2024-04-12 00:24:02,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b489e23-4814-425d-96a9-fa0bd8365ccd] succeeded in 1.4605515379998906s: None 2024-04-12T00:24:02.433777018Z [2024-04-12 00:24:02,433: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:24:02.436841288Z [2024-04-12 00:24:02,436: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:24:02.459607730Z [2024-04-12 00:24:02,459: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:24:02.461286980Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:24:02.461303235Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:24:02.461465566Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:24:02.461476819Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:24:02.461718068Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:24:02.461728106Z [2024-04-12 00:24:02,461: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:24:02.492644263Z [2024-04-12 00:24:02,490: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:24:02.494059403Z [2024-04-12 00:24:02,493: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:24:02.520750780Z [2024-04-12 00:24:02,520: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:24:02.523221748Z [2024-04-12 00:24:02,522: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:24:02.523312769Z [2024-04-12 00:24:02,523: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:24:02.524638839Z [2024-04-12 00:24:02,523: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:24:02.524652994Z [2024-04-12 00:24:02,524: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:24:02.524892499Z [2024-04-12 00:24:02,524: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:24:02.524900600Z [2024-04-12 00:24:02,524: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:24:02.568340987Z [2024-04-12 00:24:02,567: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:24:02.617027510Z [2024-04-12 00:24:02,616: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:24:04.358000212Z [2024-04-12 00:24:04,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6b0a10b-0679-42a0-89ed-e674ea8c28c8] succeeded in 3.51108246000058s: None 2024-04-12T00:24:05.332491448Z [2024-04-12 00:24:05,331: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20d50ab5-c532-4515-b9b6-1fb5cc2111fd] succeeded in 4.463342084000033s: None 2024-04-12T00:25:00.423879309Z [2024-04-12 00:25:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba80216e-20fd-4678-a453-8cf361d71c04] received 2024-04-12T00:25:00.426019038Z [2024-04-12 00:25:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d55137a-097a-4dda-a494-91804253fa75] received 2024-04-12T00:25:00.436918185Z [2024-04-12 00:25:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[408b3af0-6c03-4d8d-9826-5140bd82bccb] received 2024-04-12T00:25:00.439979917Z [2024-04-12 00:25:00,439: INFO/ForkPoolWorker-16] [8d55137a-097a-4dda-a494-91804253fa75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:25:00.440471407Z [2024-04-12 00:25:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b856fda2-a46b-4493-bdb2-3b3cc214f7b9] received 2024-04-12T00:25:00.441238080Z [2024-04-12 00:25:00,440: INFO/ForkPoolWorker-15] [ba80216e-20fd-4678-a453-8cf361d71c04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:00.446598953Z [2024-04-12 00:25:00,446: INFO/ForkPoolWorker-1] [408b3af0-6c03-4d8d-9826-5140bd82bccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:25:00.458014251Z [2024-04-12 00:25:00,457: INFO/ForkPoolWorker-2] [b856fda2-a46b-4493-bdb2-3b3cc214f7b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:25:00.744603949Z [2024-04-12 00:25:00,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:25:00.750026062Z [2024-04-12 00:25:00,746: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:25:00.756249812Z [2024-04-12 00:25:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:25:00.775781643Z [2024-04-12 00:25:00,772: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:25:00.922146515Z [2024-04-12 00:25:00,921: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:25:00.925836160Z [2024-04-12 00:25:00,925: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:00.960900165Z [2024-04-12 00:25:00,960: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:25:00.962026332Z [2024-04-12 00:25:00,961: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:25:00.962339289Z [2024-04-12 00:25:00,962: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:25:00.962562566Z [2024-04-12 00:25:00,962: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:25:00.963358347Z [2024-04-12 00:25:00,963: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:25:01.071019766Z [2024-04-12 00:25:01,070: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:01.676473009Z [2024-04-12 00:25:01,666: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b856fda2-a46b-4493-bdb2-3b3cc214f7b9] succeeded in 1.2236043639995842s: None 2024-04-12T00:25:01.893782427Z [2024-04-12 00:25:01,893: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:25:01.897030439Z [2024-04-12 00:25:01,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:01.919267132Z [2024-04-12 00:25:01,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:25:01.920884146Z [2024-04-12 00:25:01,920: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:01.921096275Z [2024-04-12 00:25:01,920: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:01.921189654Z [2024-04-12 00:25:01,920: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:01.921365711Z [2024-04-12 00:25:01,921: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:25:01.921669335Z [2024-04-12 00:25:01,921: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:25:01.921683291Z [2024-04-12 00:25:01,921: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:02.001830727Z [2024-04-12 00:25:02,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:02.055813505Z [2024-04-12 00:25:02,055: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:25:02.059428413Z [2024-04-12 00:25:02,058: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:02.086472241Z [2024-04-12 00:25:02,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:25:02.087837539Z [2024-04-12 00:25:02,087: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:02.087928050Z [2024-04-12 00:25:02,087: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:02.088139297Z [2024-04-12 00:25:02,087: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:02.088224467Z [2024-04-12 00:25:02,088: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:25:02.088548030Z [2024-04-12 00:25:02,088: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:25:02.088912846Z [2024-04-12 00:25:02,088: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:02.114511811Z [2024-04-12 00:25:02,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:25:02.117855569Z [2024-04-12 00:25:02,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:02.158523252Z [2024-04-12 00:25:02,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:25:02.160525926Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:02.160558729Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:02.160582346Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:02.160592339Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:25:02.161095533Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:25:02.161114840Z [2024-04-12 00:25:02,160: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:02.167067736Z [2024-04-12 00:25:02,166: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:02.254014161Z [2024-04-12 00:25:02,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:02.785693262Z [2024-04-12 00:25:02,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba80216e-20fd-4678-a453-8cf361d71c04] succeeded in 2.3594750339998427s: None 2024-04-12T00:25:03.464894355Z [2024-04-12 00:25:03,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0b14eb-09e9-4909-9de5-d1e76dc875f0] received 2024-04-12T00:25:03.474160472Z [2024-04-12 00:25:03,473: INFO/ForkPoolWorker-15] [8f0b14eb-09e9-4909-9de5-d1e76dc875f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:03.528425626Z [2024-04-12 00:25:03,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d55137a-097a-4dda-a494-91804253fa75] succeeded in 3.098795482999776s: None 2024-04-12T00:25:03.765704575Z [2024-04-12 00:25:03,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:25:03.937880665Z [2024-04-12 00:25:03,937: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[408b3af0-6c03-4d8d-9826-5140bd82bccb] succeeded in 3.4991158700004235s: None 2024-04-12T00:25:04.908469724Z [2024-04-12 00:25:04,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:25:04.911193960Z [2024-04-12 00:25:04,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:04.931914175Z [2024-04-12 00:25:04,931: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:25:04.932908078Z [2024-04-12 00:25:04,932: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:04.932964436Z [2024-04-12 00:25:04,932: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:04.933120977Z [2024-04-12 00:25:04,932: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:04.933177672Z [2024-04-12 00:25:04,933: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:25:04.933465825Z [2024-04-12 00:25:04,933: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:25:04.933483964Z [2024-04-12 00:25:04,933: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:05.013867985Z [2024-04-12 00:25:05,013: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:05.534217407Z [2024-04-12 00:25:05,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f0b14eb-09e9-4909-9de5-d1e76dc875f0] succeeded in 2.0679602760001217s: None 2024-04-12T00:25:05.861826681Z [2024-04-12 00:25:05,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22663c5e-e9a3-4515-a21d-c3b7ce4ca522] received 2024-04-12T00:25:05.875602933Z [2024-04-12 00:25:05,875: INFO/ForkPoolWorker-15] [22663c5e-e9a3-4515-a21d-c3b7ce4ca522] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:25:06.149219952Z [2024-04-12 00:25:06,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:25:07.170544267Z [2024-04-12 00:25:07,170: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:25:07.173946712Z [2024-04-12 00:25:07,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:07.193972445Z [2024-04-12 00:25:07,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:25:07.195281707Z [2024-04-12 00:25:07,195: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:07.195467703Z [2024-04-12 00:25:07,195: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:07.195779442Z [2024-04-12 00:25:07,195: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:07.195966279Z [2024-04-12 00:25:07,195: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:25:07.196302098Z [2024-04-12 00:25:07,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:25:07.196541117Z [2024-04-12 00:25:07,196: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:07.295753133Z [2024-04-12 00:25:07,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:07.848467108Z [2024-04-12 00:25:07,848: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22663c5e-e9a3-4515-a21d-c3b7ce4ca522] succeeded in 1.9785528239999621s: None 2024-04-12T00:25:08.576470263Z [2024-04-12 00:25:08,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e808305-bb79-4703-9244-99ac24408251] received 2024-04-12T00:25:08.586963315Z [2024-04-12 00:25:08,586: INFO/ForkPoolWorker-15] [8e808305-bb79-4703-9244-99ac24408251] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:08.820598467Z [2024-04-12 00:25:08,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:25:09.776956487Z [2024-04-12 00:25:09,776: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:25:09.779748998Z [2024-04-12 00:25:09,779: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:25:09.800809981Z [2024-04-12 00:25:09,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:25:09.801960976Z [2024-04-12 00:25:09,801: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:25:09.802197473Z [2024-04-12 00:25:09,802: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:25:09.802395738Z [2024-04-12 00:25:09,802: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:25:09.802535728Z [2024-04-12 00:25:09,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:25:09.802824310Z [2024-04-12 00:25:09,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:25:09.802957610Z [2024-04-12 00:25:09,802: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:25:09.878487237Z [2024-04-12 00:25:09,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:25:10.474725506Z [2024-04-12 00:25:10,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e808305-bb79-4703-9244-99ac24408251] succeeded in 1.8950816679998752s: None 2024-04-12T00:26:00.968284187Z [2024-04-12 00:26:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7192678-678a-4fcb-b621-ae3fdc595231] received 2024-04-12T00:26:00.972808165Z [2024-04-12 00:26:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fb2de63-6eee-4b34-bf1b-712179ef34a3] received 2024-04-12T00:26:00.974395636Z [2024-04-12 00:26:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[050cba56-091c-43b7-8088-41b6cd833154] received 2024-04-12T00:26:00.975940594Z [2024-04-12 00:26:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b8ff04e-8e11-4d6e-bc57-6beed8c87aac] received 2024-04-12T00:26:00.986003773Z [2024-04-12 00:26:00,985: INFO/ForkPoolWorker-1] [050cba56-091c-43b7-8088-41b6cd833154] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:26:00.989321727Z [2024-04-12 00:26:00,988: INFO/ForkPoolWorker-15] [f7192678-678a-4fcb-b621-ae3fdc595231] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:26:00.990105027Z [2024-04-12 00:26:00,989: INFO/ForkPoolWorker-2] [1b8ff04e-8e11-4d6e-bc57-6beed8c87aac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:26:00.992357862Z [2024-04-12 00:26:00,992: INFO/ForkPoolWorker-16] [0fb2de63-6eee-4b34-bf1b-712179ef34a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:26:01.304182248Z [2024-04-12 00:26:01,300: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:26:01.316118392Z [2024-04-12 00:26:01,309: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:26:01.317384835Z [2024-04-12 00:26:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:26:01.322760906Z [2024-04-12 00:26:01,319: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:26:01.483278948Z [2024-04-12 00:26:01,482: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:26:01.487793686Z [2024-04-12 00:26:01,487: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:26:01.525102820Z [2024-04-12 00:26:01,524: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:26:01.529137589Z [2024-04-12 00:26:01,528: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:26:01.529178913Z [2024-04-12 00:26:01,529: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:26:01.529219256Z [2024-04-12 00:26:01,529: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:26:01.529468022Z [2024-04-12 00:26:01,529: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:26:01.621272178Z [2024-04-12 00:26:01,621: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:26:01.728068903Z [2024-04-12 00:26:01,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:26:02.266569375Z [2024-04-12 00:26:02,266: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[050cba56-091c-43b7-8088-41b6cd833154] succeeded in 1.2895835270001044s: None 2024-04-12T00:26:02.323176290Z [2024-04-12 00:26:02,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7192678-678a-4fcb-b621-ae3fdc595231] succeeded in 1.3447261100000105s: None 2024-04-12T00:26:02.598931709Z [2024-04-12 00:26:02,598: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:26:02.603111148Z [2024-04-12 00:26:02,602: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:26:02.605033525Z [2024-04-12 00:26:02,604: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:26:02.606671127Z [2024-04-12 00:26:02,606: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:26:02.633721314Z [2024-04-12 00:26:02,633: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:26:02.635403376Z [2024-04-12 00:26:02,635: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:26:02.635546275Z [2024-04-12 00:26:02,635: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:26:02.635787316Z [2024-04-12 00:26:02,635: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:26:02.635872298Z [2024-04-12 00:26:02,635: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:26:02.636505033Z [2024-04-12 00:26:02,636: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:26:02.636533991Z [2024-04-12 00:26:02,636: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:26:02.640688023Z [2024-04-12 00:26:02,637: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:26:02.645504740Z [2024-04-12 00:26:02,645: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:26:02.645799013Z [2024-04-12 00:26:02,645: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:26:02.646692625Z [2024-04-12 00:26:02,646: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:26:02.647031843Z [2024-04-12 00:26:02,646: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:26:02.647591782Z [2024-04-12 00:26:02,647: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:26:02.647888991Z [2024-04-12 00:26:02,647: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:26:02.735399391Z [2024-04-12 00:26:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:26:02.741411389Z [2024-04-12 00:26:02,741: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:26:04.517516243Z [2024-04-12 00:26:04,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0fb2de63-6eee-4b34-bf1b-712179ef34a3] succeeded in 3.542230458000631s: None 2024-04-12T00:26:05.549279532Z [2024-04-12 00:26:05,548: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1b8ff04e-8e11-4d6e-bc57-6beed8c87aac] succeeded in 4.571658708000541s: None 2024-04-12T00:27:00.292230328Z [2024-04-12 00:27:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35182969-cce9-4116-a030-7b80b6b9a2f4] received 2024-04-12T00:27:00.297073137Z [2024-04-12 00:27:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29d64a27-3432-4f40-9121-f13c896dcb88] received 2024-04-12T00:27:00.299450604Z [2024-04-12 00:27:00,299: INFO/ForkPoolWorker-15] [35182969-cce9-4116-a030-7b80b6b9a2f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:27:00.299767760Z [2024-04-12 00:27:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a9aba10-4085-43a3-9e64-14318bfc5f55] received 2024-04-12T00:27:00.312492919Z [2024-04-12 00:27:00,312: INFO/ForkPoolWorker-1] [1a9aba10-4085-43a3-9e64-14318bfc5f55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:27:00.316963842Z [2024-04-12 00:27:00,316: INFO/ForkPoolWorker-16] [29d64a27-3432-4f40-9121-f13c896dcb88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:27:00.629952787Z [2024-04-12 00:27:00,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:27:00.706326935Z [2024-04-12 00:27:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:27:00.786326059Z [2024-04-12 00:27:00,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:27:00.936521152Z [2024-04-12 00:27:00,936: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:27:00.940185955Z [2024-04-12 00:27:00,939: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:27:00.966106092Z [2024-04-12 00:27:00,965: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:27:00.967569534Z [2024-04-12 00:27:00,967: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:27:00.967710833Z [2024-04-12 00:27:00,967: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:27:00.967814003Z [2024-04-12 00:27:00,967: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:27:00.968149489Z [2024-04-12 00:27:00,967: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:27:01.053567056Z [2024-04-12 00:27:01,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:27:01.621211168Z [2024-04-12 00:27:01,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35182969-cce9-4116-a030-7b80b6b9a2f4] succeeded in 1.3270969349996449s: None 2024-04-12T00:27:01.765492601Z [2024-04-12 00:27:01,765: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:27:01.768643379Z [2024-04-12 00:27:01,768: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:27:01.790574162Z [2024-04-12 00:27:01,790: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:27:01.793848398Z [2024-04-12 00:27:01,793: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:27:01.793984708Z [2024-04-12 00:27:01,793: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:27:01.794308319Z [2024-04-12 00:27:01,793: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:27:01.794409360Z [2024-04-12 00:27:01,794: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:27:01.794647828Z [2024-04-12 00:27:01,794: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:27:01.794817383Z [2024-04-12 00:27:01,794: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:27:01.815972388Z [2024-04-12 00:27:01,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:27:01.818898835Z [2024-04-12 00:27:01,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:27:01.843311890Z [2024-04-12 00:27:01,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:27:01.844652147Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:27:01.844679250Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:27:01.844700330Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:27:01.844769239Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:27:01.845027110Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:27:01.845077578Z [2024-04-12 00:27:01,844: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:27:01.871045484Z [2024-04-12 00:27:01,870: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:27:01.917824643Z [2024-04-12 00:27:01,917: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:27:03.736084134Z [2024-04-12 00:27:03,735: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a9aba10-4085-43a3-9e64-14318bfc5f55] succeeded in 3.4337976280003204s: None 2024-04-12T00:27:04.826453169Z [2024-04-12 00:27:04,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29d64a27-3432-4f40-9121-f13c896dcb88] succeeded in 4.5257481610005925s: None 2024-04-12T00:28:00.591418634Z [2024-04-12 00:28:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bd9389b-23a6-4de3-91f7-ed84f1157448] received 2024-04-12T00:28:00.593403482Z [2024-04-12 00:28:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a5e8efe-0583-4395-9798-e22496d76352] received 2024-04-12T00:28:00.602098516Z [2024-04-12 00:28:00,601: INFO/ForkPoolWorker-16] [3a5e8efe-0583-4395-9798-e22496d76352] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:28:00.602344239Z [2024-04-12 00:28:00,601: INFO/ForkPoolWorker-15] [1bd9389b-23a6-4de3-91f7-ed84f1157448] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:28:00.604217144Z [2024-04-12 00:28:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2179c6a3-7558-4509-8c0e-b7fd868df12b] received 2024-04-12T00:28:00.605748060Z [2024-04-12 00:28:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa6e57c-18da-4cf1-a155-0270fdf3ac86] received 2024-04-12T00:28:00.613082061Z [2024-04-12 00:28:00,612: INFO/ForkPoolWorker-2] [8fa6e57c-18da-4cf1-a155-0270fdf3ac86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:28:00.614845527Z [2024-04-12 00:28:00,614: INFO/ForkPoolWorker-1] [2179c6a3-7558-4509-8c0e-b7fd868df12b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:28:00.877700742Z [2024-04-12 00:28:00,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:28:00.899516731Z [2024-04-12 00:28:00,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:28:00.913739815Z [2024-04-12 00:28:00,910: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:28:00.926364212Z [2024-04-12 00:28:00,923: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:28:01.094695479Z [2024-04-12 00:28:01,094: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:28:01.101294461Z [2024-04-12 00:28:01,099: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:28:01.136465955Z [2024-04-12 00:28:01,136: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:28:01.137453542Z [2024-04-12 00:28:01,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:28:01.140349716Z [2024-04-12 00:28:01,140: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:28:01.142042857Z [2024-04-12 00:28:01,140: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:28:01.142228857Z [2024-04-12 00:28:01,141: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:28:01.142518083Z [2024-04-12 00:28:01,142: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:28:01.269149540Z [2024-04-12 00:28:01,268: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:28:01.776273858Z [2024-04-12 00:28:01,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bd9389b-23a6-4de3-91f7-ed84f1157448] succeeded in 1.1811255140000867s: None 2024-04-12T00:28:01.856151955Z [2024-04-12 00:28:01,855: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a5e8efe-0583-4395-9798-e22496d76352] succeeded in 1.2607337970002845s: None 2024-04-12T00:28:02.138156344Z [2024-04-12 00:28:02,137: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:28:02.141084176Z [2024-04-12 00:28:02,140: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:28:02.165854420Z [2024-04-12 00:28:02,165: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:28:02.167551244Z [2024-04-12 00:28:02,167: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:28:02.167731276Z [2024-04-12 00:28:02,167: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:28:02.167969592Z [2024-04-12 00:28:02,167: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:28:02.168131802Z [2024-04-12 00:28:02,167: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:28:02.168936483Z [2024-04-12 00:28:02,168: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:28:02.169084862Z [2024-04-12 00:28:02,168: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:28:02.192414124Z [2024-04-12 00:28:02,192: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:28:02.195645739Z [2024-04-12 00:28:02,195: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:28:02.215524050Z [2024-04-12 00:28:02,215: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:28:02.217034100Z [2024-04-12 00:28:02,216: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:28:02.217307639Z [2024-04-12 00:28:02,217: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:28:02.217494250Z [2024-04-12 00:28:02,217: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:28:02.217643539Z [2024-04-12 00:28:02,217: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:28:02.217962532Z [2024-04-12 00:28:02,217: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:28:02.218429406Z [2024-04-12 00:28:02,218: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:28:02.267989430Z [2024-04-12 00:28:02,267: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:28:02.285550455Z [2024-04-12 00:28:02,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:28:03.698407596Z [2024-04-12 00:28:03,697: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2179c6a3-7558-4509-8c0e-b7fd868df12b] succeeded in 3.0925048830004016s: None 2024-04-12T00:28:04.139581176Z [2024-04-12 00:28:04,138: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8fa6e57c-18da-4cf1-a155-0270fdf3ac86] succeeded in 3.532035361999988s: None 2024-04-12T00:29:01.188032164Z [2024-04-12 00:29:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cef608e7-2ee3-4137-8cbf-53ab01c09b06] received 2024-04-12T00:29:01.193617259Z [2024-04-12 00:29:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cc5703b-4f04-4d0b-ac97-c13b3fdb7abd] received 2024-04-12T00:29:01.198264657Z [2024-04-12 00:29:01,198: INFO/ForkPoolWorker-15] [cef608e7-2ee3-4137-8cbf-53ab01c09b06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:29:01.204347751Z [2024-04-12 00:29:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed971bb7-25b9-45a2-ad25-5c4eae3a3b81] received 2024-04-12T00:29:01.205412077Z [2024-04-12 00:29:01,205: INFO/ForkPoolWorker-16] [9cc5703b-4f04-4d0b-ac97-c13b3fdb7abd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:29:01.230115654Z [2024-04-12 00:29:01,229: INFO/ForkPoolWorker-1] [ed971bb7-25b9-45a2-ad25-5c4eae3a3b81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:29:01.547421492Z [2024-04-12 00:29:01,540: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:29:01.549612559Z [2024-04-12 00:29:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:29:01.567511852Z [2024-04-12 00:29:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:29:01.795588852Z [2024-04-12 00:29:01,794: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:29:01.800002008Z [2024-04-12 00:29:01,799: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:29:01.850488282Z [2024-04-12 00:29:01,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:29:01.851704866Z [2024-04-12 00:29:01,851: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:29:01.851850323Z [2024-04-12 00:29:01,851: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:29:01.852033489Z [2024-04-12 00:29:01,851: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:29:01.852445942Z [2024-04-12 00:29:01,852: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:29:01.964801336Z [2024-04-12 00:29:01,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:29:02.603981386Z [2024-04-12 00:29:02,603: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cc5703b-4f04-4d0b-ac97-c13b3fdb7abd] succeeded in 1.4071460690001913s: None 2024-04-12T00:29:02.729014560Z [2024-04-12 00:29:02,728: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:29:02.732218598Z [2024-04-12 00:29:02,731: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:29:02.753138696Z [2024-04-12 00:29:02,752: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:29:02.754432995Z [2024-04-12 00:29:02,754: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:29:02.754611493Z [2024-04-12 00:29:02,754: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:29:02.754861751Z [2024-04-12 00:29:02,754: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:29:02.754920192Z [2024-04-12 00:29:02,754: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:29:02.755146591Z [2024-04-12 00:29:02,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:29:02.755678635Z [2024-04-12 00:29:02,755: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:29:02.854194232Z [2024-04-12 00:29:02,853: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:29:02.856996720Z [2024-04-12 00:29:02,856: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:29:02.865694293Z [2024-04-12 00:29:02,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:29:02.890259964Z [2024-04-12 00:29:02,889: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:29:02.891877534Z [2024-04-12 00:29:02,891: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:29:02.892024643Z [2024-04-12 00:29:02,891: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:29:02.892252864Z [2024-04-12 00:29:02,892: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:29:02.892439865Z [2024-04-12 00:29:02,892: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:29:02.892734636Z [2024-04-12 00:29:02,892: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:29:02.893128018Z [2024-04-12 00:29:02,893: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:29:02.970476672Z [2024-04-12 00:29:02,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:29:04.507778225Z [2024-04-12 00:29:04,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cef608e7-2ee3-4137-8cbf-53ab01c09b06] succeeded in 3.3161659179995695s: None 2024-04-12T00:29:05.146874906Z [2024-04-12 00:29:05,146: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed971bb7-25b9-45a2-ad25-5c4eae3a3b81] succeeded in 3.9354937589996553s: None 2024-04-12T00:30:00.504575326Z [2024-04-12 00:30:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[749f9ada-9ab5-438f-b963-0f6d702557d2] received 2024-04-12T00:30:00.507898000Z [2024-04-12 00:30:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c115ea1f-59d2-4480-b7a5-832be06c3ccd] received 2024-04-12T00:30:00.515019364Z [2024-04-12 00:30:00,514: INFO/ForkPoolWorker-16] [c115ea1f-59d2-4480-b7a5-832be06c3ccd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:30:00.520176642Z [2024-04-12 00:30:00,519: INFO/ForkPoolWorker-15] [749f9ada-9ab5-438f-b963-0f6d702557d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:00.527482210Z [2024-04-12 00:30:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29198241-339d-40d6-969b-8d216fb6df61] received 2024-04-12T00:30:00.533621066Z [2024-04-12 00:30:00,533: INFO/ForkPoolWorker-1] [29198241-339d-40d6-969b-8d216fb6df61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:30:00.540021529Z [2024-04-12 00:30:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43c0a763-c172-4cc9-ad83-fe9f5708efea] received 2024-04-12T00:30:00.541584090Z [2024-04-12 00:30:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8616aec-38a8-4fb0-8cb5-c9a86e2cae5f] received 2024-04-12T00:30:00.558198249Z [2024-04-12 00:30:00,557: INFO/ForkPoolWorker-2] [43c0a763-c172-4cc9-ad83-fe9f5708efea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:30:00.567272396Z [2024-04-12 00:30:00,566: INFO/ForkPoolWorker-3] [c8616aec-38a8-4fb0-8cb5-c9a86e2cae5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:30:00.909276821Z [2024-04-12 00:30:00,905: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:30:00.996920374Z [2024-04-12 00:30:00,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:30:01.068842957Z [2024-04-12 00:30:01,063: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:30:01.076678349Z [2024-04-12 00:30:01,076: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T00:30:01.080510285Z [2024-04-12 00:30:01,080: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:01.093518150Z [2024-04-12 00:30:01,082: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:30:01.120603423Z [2024-04-12 00:30:01,120: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:30:01.124349510Z [2024-04-12 00:30:01,124: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:30:01.124442593Z [2024-04-12 00:30:01,124: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:30:01.126403824Z [2024-04-12 00:30:01,124: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T00:30:01.126716153Z [2024-04-12 00:30:01,126: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:30:01.279763131Z [2024-04-12 00:30:01,276: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:30:01.284812847Z [2024-04-12 00:30:01,284: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:01.541750850Z [2024-04-12 00:30:01,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:02.312232958Z [2024-04-12 00:30:02,311: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c8616aec-38a8-4fb0-8cb5-c9a86e2cae5f] succeeded in 1.7650367400001414s: None 2024-04-12T00:30:02.325264794Z [2024-04-12 00:30:02,324: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c115ea1f-59d2-4480-b7a5-832be06c3ccd] succeeded in 1.815684926999893s: None 2024-04-12T00:30:02.647370884Z [2024-04-12 00:30:02,646: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:30:02.650552171Z [2024-04-12 00:30:02,650: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:02.660669703Z [2024-04-12 00:30:02,660: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:30:02.663794105Z [2024-04-12 00:30:02,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:02.678167093Z [2024-04-12 00:30:02,677: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:30:02.679459276Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:02.679477189Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:02.679533410Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:02.679573584Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:30:02.679853934Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:30:02.679866175Z [2024-04-12 00:30:02,679: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:02.694615550Z [2024-04-12 00:30:02,694: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:30:02.696356215Z [2024-04-12 00:30:02,696: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:02.696592560Z [2024-04-12 00:30:02,696: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:02.696907727Z [2024-04-12 00:30:02,696: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:02.697100942Z [2024-04-12 00:30:02,696: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:30:02.697616633Z [2024-04-12 00:30:02,697: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:30:02.697816307Z [2024-04-12 00:30:02,697: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:02.756613212Z [2024-04-12 00:30:02,756: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:02.781481466Z [2024-04-12 00:30:02,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:02.847827420Z [2024-04-12 00:30:02,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:30:02.850962667Z [2024-04-12 00:30:02,850: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:02.901027494Z [2024-04-12 00:30:02,900: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:30:02.903130333Z [2024-04-12 00:30:02,902: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:02.903165641Z [2024-04-12 00:30:02,903: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:02.903229547Z [2024-04-12 00:30:02,903: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:02.903272582Z [2024-04-12 00:30:02,903: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:30:02.908984368Z [2024-04-12 00:30:02,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:30:02.909021722Z [2024-04-12 00:30:02,908: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:03.045341135Z [2024-04-12 00:30:03,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:03.529040790Z [2024-04-12 00:30:03,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[749f9ada-9ab5-438f-b963-0f6d702557d2] succeeded in 3.0213039469999785s: None 2024-04-12T00:30:04.157014374Z [2024-04-12 00:30:04,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff6dc83f-d582-4db0-a898-87d401d9cb51] received 2024-04-12T00:30:04.168842559Z [2024-04-12 00:30:04,168: INFO/ForkPoolWorker-15] [ff6dc83f-d582-4db0-a898-87d401d9cb51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:04.520153553Z [2024-04-12 00:30:04,519: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29198241-339d-40d6-969b-8d216fb6df61] succeeded in 3.990815551999731s: None 2024-04-12T00:30:04.534802937Z [2024-04-12 00:30:04,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:30:04.601910381Z [2024-04-12 00:30:04,601: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[43c0a763-c172-4cc9-ad83-fe9f5708efea] succeeded in 4.059090642000228s: None 2024-04-12T00:30:05.507403749Z [2024-04-12 00:30:05,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:30:05.510785726Z [2024-04-12 00:30:05,510: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:05.531244373Z [2024-04-12 00:30:05,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:30:05.532590998Z [2024-04-12 00:30:05,532: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:05.532722488Z [2024-04-12 00:30:05,532: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:05.532912624Z [2024-04-12 00:30:05,532: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:05.533024642Z [2024-04-12 00:30:05,532: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:30:05.533314160Z [2024-04-12 00:30:05,533: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:30:05.533402162Z [2024-04-12 00:30:05,533: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:05.628526198Z [2024-04-12 00:30:05,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:06.299111347Z [2024-04-12 00:30:06,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff6dc83f-d582-4db0-a898-87d401d9cb51] succeeded in 2.1381523949994516s: None 2024-04-12T00:30:06.545982873Z [2024-04-12 00:30:06,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcd37d93-8e61-4db6-ab96-610a3336c617] received 2024-04-12T00:30:06.553968441Z [2024-04-12 00:30:06,553: INFO/ForkPoolWorker-15] [fcd37d93-8e61-4db6-ab96-610a3336c617] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:30:06.915063844Z [2024-04-12 00:30:06,911: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:30:07.939378897Z [2024-04-12 00:30:07,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:30:07.942013379Z [2024-04-12 00:30:07,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:07.979061379Z [2024-04-12 00:30:07,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:30:07.980718557Z [2024-04-12 00:30:07,980: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:07.980790444Z [2024-04-12 00:30:07,980: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:07.980971618Z [2024-04-12 00:30:07,980: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:07.981050697Z [2024-04-12 00:30:07,980: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:30:07.981320075Z [2024-04-12 00:30:07,981: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:30:07.981401489Z [2024-04-12 00:30:07,981: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:08.081672247Z [2024-04-12 00:30:08,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:08.630814875Z [2024-04-12 00:30:08,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcd37d93-8e61-4db6-ab96-610a3336c617] succeeded in 2.0828691759998037s: None 2024-04-12T00:30:09.171278435Z [2024-04-12 00:30:09,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd4735e6-7a49-4856-9482-ad1f681c784c] received 2024-04-12T00:30:09.201782326Z [2024-04-12 00:30:09,201: INFO/ForkPoolWorker-15] [dd4735e6-7a49-4856-9482-ad1f681c784c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:09.440271232Z [2024-04-12 00:30:09,437: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:30:10.430016242Z [2024-04-12 00:30:10,429: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:30:10.433101688Z [2024-04-12 00:30:10,432: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:30:10.452295997Z [2024-04-12 00:30:10,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:30:10.453709725Z [2024-04-12 00:30:10,453: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:30:10.453841940Z [2024-04-12 00:30:10,453: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:30:10.454100624Z [2024-04-12 00:30:10,453: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:30:10.454236419Z [2024-04-12 00:30:10,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:30:10.454703356Z [2024-04-12 00:30:10,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:30:10.454878434Z [2024-04-12 00:30:10,454: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:30:10.550169425Z [2024-04-12 00:30:10,549: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:30:11.124277789Z [2024-04-12 00:30:11,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd4735e6-7a49-4856-9482-ad1f681c784c] succeeded in 1.9477815439995538s: None 2024-04-12T00:31:01.163807559Z [2024-04-12 00:31:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6df8bf8-f407-4297-9f78-dccd32a34474] received 2024-04-12T00:31:01.171916326Z [2024-04-12 00:31:01,171: INFO/ForkPoolWorker-15] [d6df8bf8-f407-4297-9f78-dccd32a34474] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:31:01.175885095Z [2024-04-12 00:31:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db7fbd7d-7882-4ac1-9e15-c5e661079704] received 2024-04-12T00:31:01.178616073Z [2024-04-12 00:31:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cf07f31-67e2-4c92-a4f2-19030bb840b4] received 2024-04-12T00:31:01.195899332Z [2024-04-12 00:31:01,195: INFO/ForkPoolWorker-1] [9cf07f31-67e2-4c92-a4f2-19030bb840b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:31:01.196552035Z [2024-04-12 00:31:01,194: INFO/ForkPoolWorker-16] [db7fbd7d-7882-4ac1-9e15-c5e661079704] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:31:01.457333489Z [2024-04-12 00:31:01,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:31:01.461461587Z [2024-04-12 00:31:01,458: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:31:01.504303401Z [2024-04-12 00:31:01,501: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:31:01.656507616Z [2024-04-12 00:31:01,656: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:31:01.660017308Z [2024-04-12 00:31:01,659: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:31:01.736522093Z [2024-04-12 00:31:01,735: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:31:01.738137625Z [2024-04-12 00:31:01,737: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:31:01.738149951Z [2024-04-12 00:31:01,737: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:31:01.738153680Z [2024-04-12 00:31:01,737: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:31:01.738156477Z [2024-04-12 00:31:01,737: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:31:01.821299172Z [2024-04-12 00:31:01,821: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:31:02.385774871Z [2024-04-12 00:31:02,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db7fbd7d-7882-4ac1-9e15-c5e661079704] succeeded in 1.2080489449999732s: None 2024-04-12T00:31:02.523970441Z [2024-04-12 00:31:02,523: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:31:02.527017744Z [2024-04-12 00:31:02,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:31:02.554755530Z [2024-04-12 00:31:02,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:31:02.556223703Z [2024-04-12 00:31:02,556: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:31:02.556463463Z [2024-04-12 00:31:02,556: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:31:02.556697505Z [2024-04-12 00:31:02,556: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:31:02.556850946Z [2024-04-12 00:31:02,556: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:31:02.557710624Z [2024-04-12 00:31:02,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:31:02.557989180Z [2024-04-12 00:31:02,557: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:31:02.570343914Z [2024-04-12 00:31:02,570: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:31:02.573327612Z [2024-04-12 00:31:02,573: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:31:02.591266967Z [2024-04-12 00:31:02,591: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:31:02.592549625Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:31:02.592557807Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:31:02.592665260Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:31:02.592836590Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:31:02.593061334Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:31:02.593069189Z [2024-04-12 00:31:02,592: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:31:02.657441947Z [2024-04-12 00:31:02,657: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:31:02.681604857Z [2024-04-12 00:31:02,681: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:31:04.687663144Z [2024-04-12 00:31:04,687: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6df8bf8-f407-4297-9f78-dccd32a34474] succeeded in 3.5217168199997104s: None 2024-04-12T00:31:05.101549077Z [2024-04-12 00:31:05,100: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9cf07f31-67e2-4c92-a4f2-19030bb840b4] succeeded in 3.9206958270006s: None 2024-04-12T00:32:01.144765735Z [2024-04-12 00:32:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b28a45b-8935-4c4f-8592-b231b72df9ed] received 2024-04-12T00:32:01.147164955Z [2024-04-12 00:32:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89e2b6d8-8bd4-477d-bcb3-655c10cd37b8] received 2024-04-12T00:32:01.155616318Z [2024-04-12 00:32:01,155: INFO/ForkPoolWorker-16] [89e2b6d8-8bd4-477d-bcb3-655c10cd37b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:32:01.157083589Z [2024-04-12 00:32:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef3d18e0-d338-45ba-9160-6789ae1c6f61] received 2024-04-12T00:32:01.158604328Z [2024-04-12 00:32:01,158: INFO/ForkPoolWorker-15] [7b28a45b-8935-4c4f-8592-b231b72df9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:32:01.161118209Z [2024-04-12 00:32:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[229997db-1948-4489-b818-c04577983268] received 2024-04-12T00:32:01.168238576Z [2024-04-12 00:32:01,168: INFO/ForkPoolWorker-2] [229997db-1948-4489-b818-c04577983268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:32:01.170018990Z [2024-04-12 00:32:01,169: INFO/ForkPoolWorker-1] [ef3d18e0-d338-45ba-9160-6789ae1c6f61] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:32:01.594948882Z [2024-04-12 00:32:01,591: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:32:01.622176106Z [2024-04-12 00:32:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:32:01.623543525Z [2024-04-12 00:32:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:32:01.816441122Z [2024-04-12 00:32:01,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:32:01.855435297Z [2024-04-12 00:32:01,855: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:32:01.859029624Z [2024-04-12 00:32:01,858: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:32:01.908587444Z [2024-04-12 00:32:01,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:32:01.913127215Z [2024-04-12 00:32:01,912: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:32:01.913258687Z [2024-04-12 00:32:01,913: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:32:01.913334472Z [2024-04-12 00:32:01,913: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:32:01.913847440Z [2024-04-12 00:32:01,913: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:32:02.042065336Z [2024-04-12 00:32:02,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:32:02.066030073Z [2024-04-12 00:32:02,065: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:32:02.663691025Z [2024-04-12 00:32:02,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b28a45b-8935-4c4f-8592-b231b72df9ed] succeeded in 1.5137877769993793s: None 2024-04-12T00:32:02.669742119Z [2024-04-12 00:32:02,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef3d18e0-d338-45ba-9160-6789ae1c6f61] succeeded in 1.5093716139999742s: None 2024-04-12T00:32:02.889222528Z [2024-04-12 00:32:02,888: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:32:02.893163224Z [2024-04-12 00:32:02,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:32:02.912607003Z [2024-04-12 00:32:02,912: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:32:02.913734336Z [2024-04-12 00:32:02,913: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:32:02.913794697Z [2024-04-12 00:32:02,913: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:32:02.913925499Z [2024-04-12 00:32:02,913: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:32:02.913987062Z [2024-04-12 00:32:02,913: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:32:02.914752904Z [2024-04-12 00:32:02,914: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:32:02.914786322Z [2024-04-12 00:32:02,914: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:32:03.012672394Z [2024-04-12 00:32:03,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:32:03.137598357Z [2024-04-12 00:32:03,137: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:32:03.140616247Z [2024-04-12 00:32:03,140: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:32:03.166577679Z [2024-04-12 00:32:03,166: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:32:03.167436867Z [2024-04-12 00:32:03,167: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:32:03.167447172Z [2024-04-12 00:32:03,167: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:32:03.167719495Z [2024-04-12 00:32:03,167: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:32:03.167788315Z [2024-04-12 00:32:03,167: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:32:03.168086642Z [2024-04-12 00:32:03,167: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:32:03.168157672Z [2024-04-12 00:32:03,168: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:32:03.234326249Z [2024-04-12 00:32:03,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:32:05.025406648Z [2024-04-12 00:32:05,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[229997db-1948-4489-b818-c04577983268] succeeded in 3.8622121719999996s: None 2024-04-12T00:32:05.423010567Z [2024-04-12 00:32:05,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89e2b6d8-8bd4-477d-bcb3-655c10cd37b8] succeeded in 4.273513727999671s: None 2024-04-12T00:33:00.524038083Z [2024-04-12 00:33:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445db898-0f71-47e6-b413-b0f2f33828f6] received 2024-04-12T00:33:00.533332071Z [2024-04-12 00:33:00,533: INFO/ForkPoolWorker-15] [445db898-0f71-47e6-b413-b0f2f33828f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:33:00.533665124Z [2024-04-12 00:33:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7efc893c-e487-49ed-b673-dbc6b8e354d9] received 2024-04-12T00:33:00.546540627Z [2024-04-12 00:33:00,545: INFO/ForkPoolWorker-16] [7efc893c-e487-49ed-b673-dbc6b8e354d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:33:00.549074263Z [2024-04-12 00:33:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82413737-e6b7-4f7d-8ea0-e10ccf86da78] received 2024-04-12T00:33:00.573711811Z [2024-04-12 00:33:00,573: INFO/ForkPoolWorker-1] [82413737-e6b7-4f7d-8ea0-e10ccf86da78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:33:00.769646830Z [2024-04-12 00:33:00,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:33:00.821241000Z [2024-04-12 00:33:00,817: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:33:00.850007230Z [2024-04-12 00:33:00,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:33:00.895347110Z [2024-04-12 00:33:00,894: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:33:00.899295164Z [2024-04-12 00:33:00,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:33:00.918343637Z [2024-04-12 00:33:00,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:33:00.919247204Z [2024-04-12 00:33:00,919: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:33:00.919321273Z [2024-04-12 00:33:00,919: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:33:00.919379462Z [2024-04-12 00:33:00,919: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:33:00.919552018Z [2024-04-12 00:33:00,919: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:33:01.048337882Z [2024-04-12 00:33:01,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:33:01.682297181Z [2024-04-12 00:33:01,681: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[445db898-0f71-47e6-b413-b0f2f33828f6] succeeded in 1.1556060160000925s: None 2024-04-12T00:33:01.987998450Z [2024-04-12 00:33:01,987: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:33:01.991217862Z [2024-04-12 00:33:01,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:33:01.992339562Z [2024-04-12 00:33:01,991: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:33:02.011997001Z [2024-04-12 00:33:02,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:33:02.029419003Z [2024-04-12 00:33:02,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:33:02.030276959Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:33:02.030304027Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:33:02.030369367Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:33:02.030383753Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:33:02.030601740Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:33:02.030679810Z [2024-04-12 00:33:02,030: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:33:02.033463074Z [2024-04-12 00:33:02,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:33:02.034903995Z [2024-04-12 00:33:02,034: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:33:02.035170901Z [2024-04-12 00:33:02,034: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:33:02.035464507Z [2024-04-12 00:33:02,035: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:33:02.035722344Z [2024-04-12 00:33:02,035: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:33:02.036253288Z [2024-04-12 00:33:02,035: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:33:02.036488697Z [2024-04-12 00:33:02,036: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:33:02.092699350Z [2024-04-12 00:33:02,092: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:33:02.121382804Z [2024-04-12 00:33:02,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:33:03.529490528Z [2024-04-12 00:33:03,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7efc893c-e487-49ed-b673-dbc6b8e354d9] succeeded in 2.993877961999715s: None 2024-04-12T00:33:04.406515263Z [2024-04-12 00:33:04,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82413737-e6b7-4f7d-8ea0-e10ccf86da78] succeeded in 3.8555047179997928s: None 2024-04-12T00:34:01.083342558Z [2024-04-12 00:34:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec4e5f06-5dca-41d2-a9b0-1d643320be4b] received 2024-04-12T00:34:01.090787934Z [2024-04-12 00:34:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fa7b857-40d9-44c6-856f-ad0a8421954e] received 2024-04-12T00:34:01.092447087Z [2024-04-12 00:34:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e734a18f-b319-494f-8e1c-9d64f4805361] received 2024-04-12T00:34:01.095195766Z [2024-04-12 00:34:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cb17156-016b-4f27-b285-ccb7a84f0f0d] received 2024-04-12T00:34:01.107143435Z [2024-04-12 00:34:01,106: INFO/ForkPoolWorker-15] [ec4e5f06-5dca-41d2-a9b0-1d643320be4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:34:01.107354110Z [2024-04-12 00:34:01,106: INFO/ForkPoolWorker-1] [e734a18f-b319-494f-8e1c-9d64f4805361] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:34:01.109487341Z [2024-04-12 00:34:01,109: INFO/ForkPoolWorker-16] [9fa7b857-40d9-44c6-856f-ad0a8421954e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:34:01.116158987Z [2024-04-12 00:34:01,115: INFO/ForkPoolWorker-2] [9cb17156-016b-4f27-b285-ccb7a84f0f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:34:01.365133152Z [2024-04-12 00:34:01,362: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:34:01.417495379Z [2024-04-12 00:34:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:34:01.476116366Z [2024-04-12 00:34:01,472: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:34:01.481894130Z [2024-04-12 00:34:01,478: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:34:01.626045285Z [2024-04-12 00:34:01,625: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:34:01.629748728Z [2024-04-12 00:34:01,629: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:34:01.682907739Z [2024-04-12 00:34:01,682: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:34:01.697497041Z [2024-04-12 00:34:01,690: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:34:01.697512935Z [2024-04-12 00:34:01,690: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:34:01.697518015Z [2024-04-12 00:34:01,690: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:34:01.697521778Z [2024-04-12 00:34:01,690: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:34:01.715668792Z [2024-04-12 00:34:01,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:34:01.821284915Z [2024-04-12 00:34:01,821: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:34:02.181096379Z [2024-04-12 00:34:02,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec4e5f06-5dca-41d2-a9b0-1d643320be4b] succeeded in 1.09592926500045s: None 2024-04-12T00:34:02.377087631Z [2024-04-12 00:34:02,376: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9cb17156-016b-4f27-b285-ccb7a84f0f0d] succeeded in 1.2769308630004161s: None 2024-04-12T00:34:02.653831913Z [2024-04-12 00:34:02,653: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:34:02.657199163Z [2024-04-12 00:34:02,656: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:34:02.659857062Z [2024-04-12 00:34:02,659: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:34:02.664606453Z [2024-04-12 00:34:02,664: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:34:02.680644132Z [2024-04-12 00:34:02,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:34:02.682073033Z [2024-04-12 00:34:02,681: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:34:02.682445183Z [2024-04-12 00:34:02,682: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:34:02.682631688Z [2024-04-12 00:34:02,682: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:34:02.682738896Z [2024-04-12 00:34:02,682: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:34:02.682994827Z [2024-04-12 00:34:02,682: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:34:02.683042489Z [2024-04-12 00:34:02,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:34:02.683778938Z [2024-04-12 00:34:02,683: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:34:02.684770517Z [2024-04-12 00:34:02,684: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:34:02.684829355Z [2024-04-12 00:34:02,684: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:34:02.684977295Z [2024-04-12 00:34:02,684: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:34:02.685049133Z [2024-04-12 00:34:02,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:34:02.685364779Z [2024-04-12 00:34:02,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:34:02.685484653Z [2024-04-12 00:34:02,685: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:34:02.752265068Z [2024-04-12 00:34:02,751: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:34:02.762934984Z [2024-04-12 00:34:02,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:34:04.432252753Z [2024-04-12 00:34:04,431: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e734a18f-b319-494f-8e1c-9d64f4805361] succeeded in 3.3369396409998444s: None 2024-04-12T00:34:05.125861417Z [2024-04-12 00:34:05,125: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fa7b857-40d9-44c6-856f-ad0a8421954e] succeeded in 4.032989524999721s: None 2024-04-12T00:35:01.014851907Z [2024-04-12 00:35:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd320fa9-8b1b-4f7c-872c-b04282c768aa] received 2024-04-12T00:35:01.021810882Z [2024-04-12 00:35:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b1c8422-38b3-4828-ac62-efe80bfcad35] received 2024-04-12T00:35:01.023152280Z [2024-04-12 00:35:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a795223e-5338-4d15-82bb-f209286d8674] received 2024-04-12T00:35:01.024628578Z [2024-04-12 00:35:01,022: INFO/ForkPoolWorker-15] [fd320fa9-8b1b-4f7c-872c-b04282c768aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:35:01.028766798Z [2024-04-12 00:35:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9aabb24-b2bf-427b-90cb-49b6d9cc8ded] received 2024-04-12T00:35:01.032023974Z [2024-04-12 00:35:01,031: INFO/ForkPoolWorker-1] [a795223e-5338-4d15-82bb-f209286d8674] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:01.033528547Z [2024-04-12 00:35:01,033: INFO/ForkPoolWorker-16] [3b1c8422-38b3-4828-ac62-efe80bfcad35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:35:01.036089659Z [2024-04-12 00:35:01,035: INFO/ForkPoolWorker-2] [e9aabb24-b2bf-427b-90cb-49b6d9cc8ded] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:35:01.284315738Z [2024-04-12 00:35:01,280: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:35:01.323182280Z [2024-04-12 00:35:01,319: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:35:01.340464364Z [2024-04-12 00:35:01,337: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:35:01.517450241Z [2024-04-12 00:35:01,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:35:01.790229008Z [2024-04-12 00:35:01,789: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:35:01.794633819Z [2024-04-12 00:35:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:01.811415260Z [2024-04-12 00:35:01,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:35:01.813145822Z [2024-04-12 00:35:01,812: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:35:01.813285608Z [2024-04-12 00:35:01,813: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:35:01.813398098Z [2024-04-12 00:35:01,813: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:35:01.813605585Z [2024-04-12 00:35:01,813: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:35:01.891135816Z [2024-04-12 00:35:01,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:02.489932092Z [2024-04-12 00:35:02,489: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd320fa9-8b1b-4f7c-872c-b04282c768aa] succeeded in 1.4717392479997216s: None 2024-04-12T00:35:02.546201740Z [2024-04-12 00:35:02,545: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:35:02.549117293Z [2024-04-12 00:35:02,548: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:02.563117798Z [2024-04-12 00:35:02,561: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:35:02.564725319Z [2024-04-12 00:35:02,564: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:35:02.565882493Z [2024-04-12 00:35:02,565: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:02.566050161Z [2024-04-12 00:35:02,565: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:02.566200082Z [2024-04-12 00:35:02,565: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:02.566313676Z [2024-04-12 00:35:02,566: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:02.566451779Z [2024-04-12 00:35:02,566: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:35:02.566747330Z [2024-04-12 00:35:02,566: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:35:02.566885202Z [2024-04-12 00:35:02,566: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:02.586526525Z [2024-04-12 00:35:02,586: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:35:02.587464926Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:02.587518804Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:02.587634677Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:02.587671890Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:35:02.587934437Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:35:02.587970155Z [2024-04-12 00:35:02,587: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:02.635485643Z [2024-04-12 00:35:02,635: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:02.669239200Z [2024-04-12 00:35:02,669: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:02.812509182Z [2024-04-12 00:35:02,812: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:35:02.821219169Z [2024-04-12 00:35:02,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:02.846693444Z [2024-04-12 00:35:02,846: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:35:02.848394674Z [2024-04-12 00:35:02,848: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:02.848551227Z [2024-04-12 00:35:02,848: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:02.848828787Z [2024-04-12 00:35:02,848: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:02.848869944Z [2024-04-12 00:35:02,848: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:35:02.849140901Z [2024-04-12 00:35:02,848: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:35:02.849238252Z [2024-04-12 00:35:02,849: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:02.995759963Z [2024-04-12 00:35:02,995: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:03.759296035Z [2024-04-12 00:35:03,758: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a795223e-5338-4d15-82bb-f209286d8674] succeeded in 2.73488329599968s: None 2024-04-12T00:35:03.873284420Z [2024-04-12 00:35:03,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9d26454-1e48-440f-90fc-b216e69bf15e] received 2024-04-12T00:35:03.894505139Z [2024-04-12 00:35:03,894: INFO/ForkPoolWorker-15] [f9d26454-1e48-440f-90fc-b216e69bf15e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:04.152248967Z [2024-04-12 00:35:04,151: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9aabb24-b2bf-427b-90cb-49b6d9cc8ded] succeeded in 3.120976370999415s: None 2024-04-12T00:35:04.212104255Z [2024-04-12 00:35:04,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:35:04.528335334Z [2024-04-12 00:35:04,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b1c8422-38b3-4828-ac62-efe80bfcad35] succeeded in 3.501917367000715s: None 2024-04-12T00:35:05.381330907Z [2024-04-12 00:35:05,380: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:35:05.384501780Z [2024-04-12 00:35:05,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:05.421365533Z [2024-04-12 00:35:05,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:35:05.423499454Z [2024-04-12 00:35:05,423: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:05.423937702Z [2024-04-12 00:35:05,423: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:05.424357625Z [2024-04-12 00:35:05,424: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:05.424667132Z [2024-04-12 00:35:05,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:35:05.425340002Z [2024-04-12 00:35:05,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:35:05.425635366Z [2024-04-12 00:35:05,425: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:05.530366768Z [2024-04-12 00:35:05,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:06.193550195Z [2024-04-12 00:35:06,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9d26454-1e48-440f-90fc-b216e69bf15e] succeeded in 2.3172597649991076s: None 2024-04-12T00:35:07.021416343Z [2024-04-12 00:35:07,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a164e82-5e0c-4062-8ce9-080c0d8d7492] received 2024-04-12T00:35:07.032559779Z [2024-04-12 00:35:07,032: INFO/ForkPoolWorker-15] [9a164e82-5e0c-4062-8ce9-080c0d8d7492] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:35:07.308961970Z [2024-04-12 00:35:07,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:35:08.518165232Z [2024-04-12 00:35:08,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:35:08.521371670Z [2024-04-12 00:35:08,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:08.547520113Z [2024-04-12 00:35:08,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:35:08.548732538Z [2024-04-12 00:35:08,548: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:08.548757051Z [2024-04-12 00:35:08,548: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:08.548964990Z [2024-04-12 00:35:08,548: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:08.548973969Z [2024-04-12 00:35:08,548: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:35:08.549297801Z [2024-04-12 00:35:08,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:35:08.549308368Z [2024-04-12 00:35:08,549: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:08.659750853Z [2024-04-12 00:35:08,659: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:09.302283670Z [2024-04-12 00:35:09,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a164e82-5e0c-4062-8ce9-080c0d8d7492] succeeded in 2.279088679000779s: None 2024-04-12T00:35:10.151281565Z [2024-04-12 00:35:10,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96fa8edc-513b-419e-bb97-6963431c3e33] received 2024-04-12T00:35:10.159705923Z [2024-04-12 00:35:10,159: INFO/ForkPoolWorker-15] [96fa8edc-513b-419e-bb97-6963431c3e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:10.432587103Z [2024-04-12 00:35:10,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:35:11.436195339Z [2024-04-12 00:35:11,435: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:35:11.439398577Z [2024-04-12 00:35:11,439: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:35:11.458432858Z [2024-04-12 00:35:11,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:35:11.459693113Z [2024-04-12 00:35:11,459: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:35:11.459852948Z [2024-04-12 00:35:11,459: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:35:11.460061146Z [2024-04-12 00:35:11,459: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:35:11.460197385Z [2024-04-12 00:35:11,460: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:35:11.460513929Z [2024-04-12 00:35:11,460: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:35:11.460698591Z [2024-04-12 00:35:11,460: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:35:11.540842584Z [2024-04-12 00:35:11,540: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:35:12.171109660Z [2024-04-12 00:35:12,169: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96fa8edc-513b-419e-bb97-6963431c3e33] succeeded in 2.0164687630003755s: None 2024-04-12T00:36:01.053728407Z [2024-04-12 00:36:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89f17c87-f218-4c93-89b0-1b1e1f6f76cd] received 2024-04-12T00:36:01.058142874Z [2024-04-12 00:36:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9feb0212-4355-42e9-ab49-f01a4bc783c7] received 2024-04-12T00:36:01.063965981Z [2024-04-12 00:36:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97abb3eb-e152-4d07-997c-44c219c70932] received 2024-04-12T00:36:01.066443138Z [2024-04-12 00:36:01,066: INFO/ForkPoolWorker-15] [89f17c87-f218-4c93-89b0-1b1e1f6f76cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:36:01.068991132Z [2024-04-12 00:36:01,068: INFO/ForkPoolWorker-16] [9feb0212-4355-42e9-ab49-f01a4bc783c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:36:01.073151119Z [2024-04-12 00:36:01,072: INFO/ForkPoolWorker-1] [97abb3eb-e152-4d07-997c-44c219c70932] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:36:01.081027108Z [2024-04-12 00:36:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae3414fc-ca7a-4128-9f37-ec5fb4a5c9c7] received 2024-04-12T00:36:01.089394936Z [2024-04-12 00:36:01,089: INFO/ForkPoolWorker-2] [ae3414fc-ca7a-4128-9f37-ec5fb4a5c9c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:36:01.358625194Z [2024-04-12 00:36:01,355: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:36:01.396029176Z [2024-04-12 00:36:01,393: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:36:01.450889389Z [2024-04-12 00:36:01,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:36:01.455484447Z [2024-04-12 00:36:01,452: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:36:01.498035422Z [2024-04-12 00:36:01,497: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:36:01.501487451Z [2024-04-12 00:36:01,501: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:36:01.524423553Z [2024-04-12 00:36:01,524: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:36:01.525413597Z [2024-04-12 00:36:01,525: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:36:01.525529884Z [2024-04-12 00:36:01,525: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:36:01.526152972Z [2024-04-12 00:36:01,526: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:36:01.526513367Z [2024-04-12 00:36:01,526: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:36:01.608314090Z [2024-04-12 00:36:01,608: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:36:01.750742551Z [2024-04-12 00:36:01,750: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:36:02.173339367Z [2024-04-12 00:36:02,173: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9feb0212-4355-42e9-ab49-f01a4bc783c7] succeeded in 1.1124146559996007s: None 2024-04-12T00:36:02.316065095Z [2024-04-12 00:36:02,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89f17c87-f218-4c93-89b0-1b1e1f6f76cd] succeeded in 1.256630429001234s: None 2024-04-12T00:36:02.531497899Z [2024-04-12 00:36:02,531: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:36:02.534247853Z [2024-04-12 00:36:02,533: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:36:02.550790335Z [2024-04-12 00:36:02,549: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:36:02.551046159Z [2024-04-12 00:36:02,550: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:36:02.551053993Z [2024-04-12 00:36:02,550: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:36:02.551182072Z [2024-04-12 00:36:02,550: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:36:02.551202932Z [2024-04-12 00:36:02,551: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:36:02.551705644Z [2024-04-12 00:36:02,551: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:36:02.551712556Z [2024-04-12 00:36:02,551: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:36:02.596822531Z [2024-04-12 00:36:02,596: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:36:02.599476976Z [2024-04-12 00:36:02,599: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:36:02.617708370Z [2024-04-12 00:36:02,617: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:36:02.620356932Z [2024-04-12 00:36:02,620: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:36:02.621806426Z [2024-04-12 00:36:02,621: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:36:02.621861728Z [2024-04-12 00:36:02,621: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:36:02.622062686Z [2024-04-12 00:36:02,621: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:36:02.622102179Z [2024-04-12 00:36:02,622: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:36:02.622470907Z [2024-04-12 00:36:02,622: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:36:02.622484406Z [2024-04-12 00:36:02,622: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:36:02.695164656Z [2024-04-12 00:36:02,694: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:36:04.037519224Z [2024-04-12 00:36:04,036: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97abb3eb-e152-4d07-997c-44c219c70932] succeeded in 2.970591642000727s: None 2024-04-12T00:36:04.406017513Z [2024-04-12 00:36:04,405: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae3414fc-ca7a-4128-9f37-ec5fb4a5c9c7] succeeded in 3.322959499000717s: None 2024-04-12T00:37:00.885493369Z [2024-04-12 00:37:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5620189f-b59b-4017-b293-c8fc013e2c41] received 2024-04-12T00:37:00.887821197Z [2024-04-12 00:37:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1540564e-90c8-4228-b972-dc876b060baa] received 2024-04-12T00:37:00.889325513Z [2024-04-12 00:37:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4c4268a-1c74-4f1e-911a-959f1b747e8b] received 2024-04-12T00:37:00.900428997Z [2024-04-12 00:37:00,900: INFO/ForkPoolWorker-15] [5620189f-b59b-4017-b293-c8fc013e2c41] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:37:00.904669257Z [2024-04-12 00:37:00,904: INFO/ForkPoolWorker-16] [1540564e-90c8-4228-b972-dc876b060baa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:37:00.905516491Z [2024-04-12 00:37:00,905: INFO/ForkPoolWorker-1] [e4c4268a-1c74-4f1e-911a-959f1b747e8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:37:01.158893923Z [2024-04-12 00:37:01,155: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:37:01.291056686Z [2024-04-12 00:37:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:37:01.360057071Z [2024-04-12 00:37:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:37:01.423408205Z [2024-04-12 00:37:01,423: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:37:01.426988130Z [2024-04-12 00:37:01,426: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:37:01.453906142Z [2024-04-12 00:37:01,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:37:01.454975856Z [2024-04-12 00:37:01,454: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:37:01.455140214Z [2024-04-12 00:37:01,454: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:37:01.455264592Z [2024-04-12 00:37:01,455: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:37:01.455521332Z [2024-04-12 00:37:01,455: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:37:01.527319306Z [2024-04-12 00:37:01,527: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:37:02.075767635Z [2024-04-12 00:37:02,075: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5620189f-b59b-4017-b293-c8fc013e2c41] succeeded in 1.187004123999941s: None 2024-04-12T00:37:02.277964825Z [2024-04-12 00:37:02,277: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:37:02.281058047Z [2024-04-12 00:37:02,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:37:02.301772651Z [2024-04-12 00:37:02,301: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:37:02.303385636Z [2024-04-12 00:37:02,303: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:37:02.303651678Z [2024-04-12 00:37:02,303: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:37:02.304043708Z [2024-04-12 00:37:02,303: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:37:02.304115713Z [2024-04-12 00:37:02,304: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:37:02.304397339Z [2024-04-12 00:37:02,304: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:37:02.304803008Z [2024-04-12 00:37:02,304: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:37:02.383003183Z [2024-04-12 00:37:02,382: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:37:02.626957806Z [2024-04-12 00:37:02,626: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:37:02.630852722Z [2024-04-12 00:37:02,630: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:37:02.655882456Z [2024-04-12 00:37:02,655: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:37:02.657421207Z [2024-04-12 00:37:02,657: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:37:02.658270560Z [2024-04-12 00:37:02,657: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:37:02.658600297Z [2024-04-12 00:37:02,658: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:37:02.658774026Z [2024-04-12 00:37:02,658: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:37:02.659095887Z [2024-04-12 00:37:02,658: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:37:02.659255159Z [2024-04-12 00:37:02,659: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:37:02.760228945Z [2024-04-12 00:37:02,760: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:37:04.110592367Z [2024-04-12 00:37:04,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1540564e-90c8-4228-b972-dc876b060baa] succeeded in 3.21987744100079s: None 2024-04-12T00:37:04.789855380Z [2024-04-12 00:37:04,789: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4c4268a-1c74-4f1e-911a-959f1b747e8b] succeeded in 3.8985044269993523s: None 2024-04-12T00:38:00.546099113Z [2024-04-12 00:38:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5efa6e90-71b5-49e2-afc6-cb7909c54cab] received 2024-04-12T00:38:00.547957454Z [2024-04-12 00:38:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c30c19d6-5895-481a-83ad-e697b9a31259] received 2024-04-12T00:38:00.550839106Z [2024-04-12 00:38:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a28b0b10-2159-4c02-9713-c41f5497c842] received 2024-04-12T00:38:00.553246316Z [2024-04-12 00:38:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80c932f6-b846-4456-b17f-df681cb01b07] received 2024-04-12T00:38:00.557739859Z [2024-04-12 00:38:00,557: INFO/ForkPoolWorker-15] [5efa6e90-71b5-49e2-afc6-cb7909c54cab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:38:00.558416773Z [2024-04-12 00:38:00,558: INFO/ForkPoolWorker-16] [c30c19d6-5895-481a-83ad-e697b9a31259] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:38:00.569160299Z [2024-04-12 00:38:00,568: INFO/ForkPoolWorker-2] [80c932f6-b846-4456-b17f-df681cb01b07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:38:00.569358834Z [2024-04-12 00:38:00,568: INFO/ForkPoolWorker-1] [a28b0b10-2159-4c02-9713-c41f5497c842] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:38:00.954032725Z [2024-04-12 00:38:00,950: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:38:01.053169105Z [2024-04-12 00:38:01,049: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:38:01.102249349Z [2024-04-12 00:38:01,096: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:38:01.120071232Z [2024-04-12 00:38:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:38:01.237516819Z [2024-04-12 00:38:01,235: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:38:01.243453033Z [2024-04-12 00:38:01,243: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:38:01.305313760Z [2024-04-12 00:38:01,305: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:38:01.313292375Z [2024-04-12 00:38:01,313: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:38:01.313570455Z [2024-04-12 00:38:01,313: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:38:01.313714265Z [2024-04-12 00:38:01,313: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:38:01.313991693Z [2024-04-12 00:38:01,313: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:38:01.420907957Z [2024-04-12 00:38:01,420: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:38:01.490222046Z [2024-04-12 00:38:01,489: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:38:02.137144793Z [2024-04-12 00:38:02,135: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[80c932f6-b846-4456-b17f-df681cb01b07] succeeded in 1.5811346159989625s: None 2024-04-12T00:38:02.151339265Z [2024-04-12 00:38:02,150: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a28b0b10-2159-4c02-9713-c41f5497c842] succeeded in 1.5975384119992668s: None 2024-04-12T00:38:02.281272434Z [2024-04-12 00:38:02,280: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:38:02.284112526Z [2024-04-12 00:38:02,283: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:38:02.305778320Z [2024-04-12 00:38:02,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:38:02.307245282Z [2024-04-12 00:38:02,306: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:38:02.307262932Z [2024-04-12 00:38:02,307: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:38:02.307357395Z [2024-04-12 00:38:02,307: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:38:02.307374981Z [2024-04-12 00:38:02,307: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:38:02.307636822Z [2024-04-12 00:38:02,307: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:38:02.307645718Z [2024-04-12 00:38:02,307: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:38:02.367384319Z [2024-04-12 00:38:02,367: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:38:02.370712618Z [2024-04-12 00:38:02,370: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:38:02.389669702Z [2024-04-12 00:38:02,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:38:02.390664369Z [2024-04-12 00:38:02,390: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:38:02.390676030Z [2024-04-12 00:38:02,390: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:38:02.390878813Z [2024-04-12 00:38:02,390: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:38:02.391037773Z [2024-04-12 00:38:02,390: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:38:02.391248912Z [2024-04-12 00:38:02,391: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:38:02.391385074Z [2024-04-12 00:38:02,391: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:38:02.398596307Z [2024-04-12 00:38:02,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:38:02.501430512Z [2024-04-12 00:38:02,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:38:03.866887025Z [2024-04-12 00:38:03,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5efa6e90-71b5-49e2-afc6-cb7909c54cab] succeeded in 3.317753436000203s: None 2024-04-12T00:38:04.339502110Z [2024-04-12 00:38:04,338: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c30c19d6-5895-481a-83ad-e697b9a31259] succeeded in 3.789519840000139s: None 2024-04-12T00:39:00.974956155Z [2024-04-12 00:39:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bf75ead-0dd8-414d-b91a-c3ca1b02bff5] received 2024-04-12T00:39:00.981653965Z [2024-04-12 00:39:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26eaf0c8-5044-4150-a21a-b9ca86708e91] received 2024-04-12T00:39:00.982339259Z [2024-04-12 00:39:00,982: INFO/ForkPoolWorker-15] [7bf75ead-0dd8-414d-b91a-c3ca1b02bff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:39:00.985561305Z [2024-04-12 00:39:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f00c2d3c-2c03-48b4-90f3-b1f989a6ad3b] received 2024-04-12T00:39:00.993947862Z [2024-04-12 00:39:00,993: INFO/ForkPoolWorker-16] [26eaf0c8-5044-4150-a21a-b9ca86708e91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:39:00.998897097Z [2024-04-12 00:39:00,998: INFO/ForkPoolWorker-1] [f00c2d3c-2c03-48b4-90f3-b1f989a6ad3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:39:01.287375013Z [2024-04-12 00:39:01,284: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:39:01.315593474Z [2024-04-12 00:39:01,302: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:39:01.338157095Z [2024-04-12 00:39:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:39:01.441273937Z [2024-04-12 00:39:01,440: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:39:01.445303020Z [2024-04-12 00:39:01,444: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:39:01.471082889Z [2024-04-12 00:39:01,470: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:39:01.472970184Z [2024-04-12 00:39:01,472: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:39:01.473271464Z [2024-04-12 00:39:01,472: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:39:01.473514124Z [2024-04-12 00:39:01,473: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:39:01.474243054Z [2024-04-12 00:39:01,473: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:39:01.568856378Z [2024-04-12 00:39:01,568: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:39:02.148519581Z [2024-04-12 00:39:02,148: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f00c2d3c-2c03-48b4-90f3-b1f989a6ad3b] succeeded in 1.1610374709998723s: None 2024-04-12T00:39:02.362331398Z [2024-04-12 00:39:02,361: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:39:02.365065345Z [2024-04-12 00:39:02,364: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:39:02.387758500Z [2024-04-12 00:39:02,387: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:39:02.389297338Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:39:02.389309484Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:39:02.389476192Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:39:02.389486177Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:39:02.389880081Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:39:02.389920187Z [2024-04-12 00:39:02,389: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:39:02.409461597Z [2024-04-12 00:39:02,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:39:02.412705358Z [2024-04-12 00:39:02,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:39:02.431685690Z [2024-04-12 00:39:02,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:39:02.432930801Z [2024-04-12 00:39:02,432: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:39:02.433025764Z [2024-04-12 00:39:02,432: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:39:02.433224840Z [2024-04-12 00:39:02,432: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:39:02.433264993Z [2024-04-12 00:39:02,433: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:39:02.433484981Z [2024-04-12 00:39:02,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:39:02.433541071Z [2024-04-12 00:39:02,433: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:39:02.468540833Z [2024-04-12 00:39:02,468: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:39:02.529451915Z [2024-04-12 00:39:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:39:04.306918019Z [2024-04-12 00:39:04,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bf75ead-0dd8-414d-b91a-c3ca1b02bff5] succeeded in 3.329376759000297s: None 2024-04-12T00:39:04.833094298Z [2024-04-12 00:39:04,832: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26eaf0c8-5044-4150-a21a-b9ca86708e91] succeeded in 3.8484477050005808s: None 2024-04-12T00:40:00.882237272Z [2024-04-12 00:40:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2303851-3cbe-4ffb-9fdb-83360cac3c79] received 2024-04-12T00:40:00.885447978Z [2024-04-12 00:40:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63377980-86f5-45da-ad48-d9f3d1bfde46] received 2024-04-12T00:40:00.892457982Z [2024-04-12 00:40:00,892: INFO/ForkPoolWorker-15] [a2303851-3cbe-4ffb-9fdb-83360cac3c79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:00.893049600Z [2024-04-12 00:40:00,892: INFO/ForkPoolWorker-16] [63377980-86f5-45da-ad48-d9f3d1bfde46] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:40:00.896965220Z [2024-04-12 00:40:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f219815e-2be4-4bd6-8146-4c6ca87595ce] received 2024-04-12T00:40:00.899604094Z [2024-04-12 00:40:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08fcca63-6323-4c96-8017-b41a1f339c0c] received 2024-04-12T00:40:00.904796099Z [2024-04-12 00:40:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a19cfdfd-b17c-49d6-bfa7-3ac38114913a] received 2024-04-12T00:40:00.905573151Z [2024-04-12 00:40:00,905: INFO/ForkPoolWorker-2] [08fcca63-6323-4c96-8017-b41a1f339c0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:40:00.907250824Z [2024-04-12 00:40:00,907: INFO/ForkPoolWorker-1] [f219815e-2be4-4bd6-8146-4c6ca87595ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:40:00.927203829Z [2024-04-12 00:40:00,926: INFO/ForkPoolWorker-3] [a19cfdfd-b17c-49d6-bfa7-3ac38114913a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:40:01.179260571Z [2024-04-12 00:40:01,176: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:40:01.230411025Z [2024-04-12 00:40:01,227: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:40:01.268926372Z [2024-04-12 00:40:01,266: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:40:01.387630615Z [2024-04-12 00:40:01,384: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:40:01.414486104Z [2024-04-12 00:40:01,406: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:40:01.630078293Z [2024-04-12 00:40:01,629: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T00:40:01.633715490Z [2024-04-12 00:40:01,633: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:01.667339795Z [2024-04-12 00:40:01,665: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:40:01.668505024Z [2024-04-12 00:40:01,667: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:40:01.668517719Z [2024-04-12 00:40:01,667: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:40:01.668522370Z [2024-04-12 00:40:01,667: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T00:40:01.668525613Z [2024-04-12 00:40:01,667: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:40:01.810279993Z [2024-04-12 00:40:01,810: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:01.822324650Z [2024-04-12 00:40:01,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:02.408793314Z [2024-04-12 00:40:02,408: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a19cfdfd-b17c-49d6-bfa7-3ac38114913a] succeeded in 1.4904160759997467s: None 2024-04-12T00:40:02.430258088Z [2024-04-12 00:40:02,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63377980-86f5-45da-ad48-d9f3d1bfde46] succeeded in 1.5431224369986012s: None 2024-04-12T00:40:02.542317689Z [2024-04-12 00:40:02,542: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:40:02.545588103Z [2024-04-12 00:40:02,545: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:02.580624145Z [2024-04-12 00:40:02,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:40:02.582149159Z [2024-04-12 00:40:02,581: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:02.582283373Z [2024-04-12 00:40:02,582: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:02.582519078Z [2024-04-12 00:40:02,582: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:02.582644022Z [2024-04-12 00:40:02,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:40:02.582970997Z [2024-04-12 00:40:02,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:40:02.583391691Z [2024-04-12 00:40:02,583: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:02.588766652Z [2024-04-12 00:40:02,588: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:40:02.594738909Z [2024-04-12 00:40:02,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:02.615102117Z [2024-04-12 00:40:02,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:40:02.616068660Z [2024-04-12 00:40:02,615: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:02.616161048Z [2024-04-12 00:40:02,616: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:02.616295348Z [2024-04-12 00:40:02,616: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:02.616364997Z [2024-04-12 00:40:02,616: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:40:02.616686151Z [2024-04-12 00:40:02,616: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:40:02.616742950Z [2024-04-12 00:40:02,616: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:02.680925843Z [2024-04-12 00:40:02,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:02.687495166Z [2024-04-12 00:40:02,687: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:40:02.690627421Z [2024-04-12 00:40:02,690: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:02.706801028Z [2024-04-12 00:40:02,706: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:02.711325291Z [2024-04-12 00:40:02,711: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:40:02.714762136Z [2024-04-12 00:40:02,714: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:02.714780689Z [2024-04-12 00:40:02,714: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:02.714964313Z [2024-04-12 00:40:02,714: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:02.715043205Z [2024-04-12 00:40:02,714: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:40:02.715303898Z [2024-04-12 00:40:02,715: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:40:02.715350446Z [2024-04-12 00:40:02,715: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:02.806241569Z [2024-04-12 00:40:02,805: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:03.139109965Z [2024-04-12 00:40:03,138: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2303851-3cbe-4ffb-9fdb-83360cac3c79] succeeded in 2.2535258640000393s: None 2024-04-12T00:40:03.737429071Z [2024-04-12 00:40:03,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c3e3a5d-28a4-419c-8ded-3373e493af07] received 2024-04-12T00:40:03.748827833Z [2024-04-12 00:40:03,748: INFO/ForkPoolWorker-15] [8c3e3a5d-28a4-419c-8ded-3373e493af07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:04.039810043Z [2024-04-12 00:40:04,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:40:04.304218094Z [2024-04-12 00:40:04,303: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[08fcca63-6323-4c96-8017-b41a1f339c0c] succeeded in 3.402421462998973s: None 2024-04-12T00:40:05.056536967Z [2024-04-12 00:40:05,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:40:05.059808585Z [2024-04-12 00:40:05,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:05.084589241Z [2024-04-12 00:40:05,084: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:40:05.086014746Z [2024-04-12 00:40:05,085: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:05.086089337Z [2024-04-12 00:40:05,085: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:05.086361999Z [2024-04-12 00:40:05,086: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:05.086454938Z [2024-04-12 00:40:05,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:40:05.086812179Z [2024-04-12 00:40:05,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:40:05.086875895Z [2024-04-12 00:40:05,086: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:05.161479849Z [2024-04-12 00:40:05,160: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f219815e-2be4-4bd6-8146-4c6ca87595ce] succeeded in 4.259337131999928s: None 2024-04-12T00:40:05.167700039Z [2024-04-12 00:40:05,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:05.844435293Z [2024-04-12 00:40:05,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c3e3a5d-28a4-419c-8ded-3373e493af07] succeeded in 2.1045976619989233s: None 2024-04-12T00:40:06.312003360Z [2024-04-12 00:40:06,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31d5baf0-3e50-4762-9de9-4203a6530ea7] received 2024-04-12T00:40:06.320090153Z [2024-04-12 00:40:06,319: INFO/ForkPoolWorker-15] [31d5baf0-3e50-4762-9de9-4203a6530ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:40:06.574467569Z [2024-04-12 00:40:06,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:40:07.638867271Z [2024-04-12 00:40:07,638: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:40:07.642287142Z [2024-04-12 00:40:07,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:07.665399715Z [2024-04-12 00:40:07,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:40:07.666550496Z [2024-04-12 00:40:07,666: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:07.666594305Z [2024-04-12 00:40:07,666: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:07.666796529Z [2024-04-12 00:40:07,666: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:07.666920394Z [2024-04-12 00:40:07,666: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:40:07.668200096Z [2024-04-12 00:40:07,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:40:07.668316786Z [2024-04-12 00:40:07,668: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:07.773864563Z [2024-04-12 00:40:07,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:08.471782459Z [2024-04-12 00:40:08,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31d5baf0-3e50-4762-9de9-4203a6530ea7] succeeded in 2.15721013700022s: None 2024-04-12T00:40:08.815501244Z [2024-04-12 00:40:08,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6e4d77a-77cd-4a5d-b636-6354d347445f] received 2024-04-12T00:40:08.829328738Z [2024-04-12 00:40:08,828: INFO/ForkPoolWorker-15] [e6e4d77a-77cd-4a5d-b636-6354d347445f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:09.082692377Z [2024-04-12 00:40:09,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:40:10.076536839Z [2024-04-12 00:40:10,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:40:10.078568424Z [2024-04-12 00:40:10,078: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:40:10.119378880Z [2024-04-12 00:40:10,119: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:40:10.120512346Z [2024-04-12 00:40:10,120: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:40:10.120602035Z [2024-04-12 00:40:10,120: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:40:10.120732210Z [2024-04-12 00:40:10,120: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:40:10.120791680Z [2024-04-12 00:40:10,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:40:10.121041004Z [2024-04-12 00:40:10,120: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:40:10.121122776Z [2024-04-12 00:40:10,121: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:40:10.190414140Z [2024-04-12 00:40:10,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:40:10.770736289Z [2024-04-12 00:40:10,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6e4d77a-77cd-4a5d-b636-6354d347445f] succeeded in 1.9524078100002953s: None 2024-04-12T00:41:00.637824532Z [2024-04-12 00:41:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e389c27-98ca-4537-b111-d94dd0351535] received 2024-04-12T00:41:00.642394597Z [2024-04-12 00:41:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05fa5eca-c2c2-4cd3-a205-cf596f5fb88c] received 2024-04-12T00:41:00.645022988Z [2024-04-12 00:41:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5e489e3-63ad-4d64-ab1e-9badb61211d1] received 2024-04-12T00:41:00.648431470Z [2024-04-12 00:41:00,648: INFO/ForkPoolWorker-15] [0e389c27-98ca-4537-b111-d94dd0351535] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:41:00.658600793Z [2024-04-12 00:41:00,658: INFO/ForkPoolWorker-1] [e5e489e3-63ad-4d64-ab1e-9badb61211d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:41:00.659152033Z [2024-04-12 00:41:00,658: INFO/ForkPoolWorker-16] [05fa5eca-c2c2-4cd3-a205-cf596f5fb88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:41:00.902311186Z [2024-04-12 00:41:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:41:00.928017458Z [2024-04-12 00:41:00,925: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:41:00.941231454Z [2024-04-12 00:41:00,937: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:41:01.035612204Z [2024-04-12 00:41:01,035: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:41:01.038860070Z [2024-04-12 00:41:01,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:41:01.058471811Z [2024-04-12 00:41:01,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:41:01.059205471Z [2024-04-12 00:41:01,059: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:41:01.059318010Z [2024-04-12 00:41:01,059: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:41:01.059324902Z [2024-04-12 00:41:01,059: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:41:01.059476028Z [2024-04-12 00:41:01,059: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:41:01.137347264Z [2024-04-12 00:41:01,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:41:01.624845127Z [2024-04-12 00:41:01,624: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e389c27-98ca-4537-b111-d94dd0351535] succeeded in 0.9850049050000962s: None 2024-04-12T00:41:01.902551128Z [2024-04-12 00:41:01,902: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:41:01.905270556Z [2024-04-12 00:41:01,904: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:41:01.932223990Z [2024-04-12 00:41:01,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:41:01.936086853Z [2024-04-12 00:41:01,935: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:41:01.936118307Z [2024-04-12 00:41:01,935: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:41:01.936304576Z [2024-04-12 00:41:01,936: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:41:01.936474668Z [2024-04-12 00:41:01,936: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:41:01.936880061Z [2024-04-12 00:41:01,936: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:41:01.936995105Z [2024-04-12 00:41:01,936: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:41:02.018949653Z [2024-04-12 00:41:02,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:41:02.021874858Z [2024-04-12 00:41:02,021: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:41:02.032989737Z [2024-04-12 00:41:02,032: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:41:02.041430660Z [2024-04-12 00:41:02,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:41:02.042642556Z [2024-04-12 00:41:02,042: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:41:02.042703311Z [2024-04-12 00:41:02,042: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:41:02.042808347Z [2024-04-12 00:41:02,042: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:41:02.042865375Z [2024-04-12 00:41:02,042: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:41:02.043069181Z [2024-04-12 00:41:02,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:41:02.043111772Z [2024-04-12 00:41:02,043: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:41:02.143504251Z [2024-04-12 00:41:02,143: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:41:03.616137899Z [2024-04-12 00:41:03,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05fa5eca-c2c2-4cd3-a205-cf596f5fb88c] succeeded in 2.9723531719992025s: None 2024-04-12T00:41:04.050977976Z [2024-04-12 00:41:04,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5e489e3-63ad-4d64-ab1e-9badb61211d1] succeeded in 3.4039791880004486s: None 2024-04-12T00:42:00.684748608Z [2024-04-12 00:42:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e9aec99-64a3-4ee3-9861-54ab7ee51fa7] received 2024-04-12T00:42:00.688258878Z [2024-04-12 00:42:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e0ddc06-4484-4d21-a119-0cb0a0831c44] received 2024-04-12T00:42:00.698263687Z [2024-04-12 00:42:00,697: INFO/ForkPoolWorker-15] [6e9aec99-64a3-4ee3-9861-54ab7ee51fa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:42:00.703788737Z [2024-04-12 00:42:00,703: INFO/ForkPoolWorker-16] [6e0ddc06-4484-4d21-a119-0cb0a0831c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:42:00.705008955Z [2024-04-12 00:42:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d94b76a2-ebfb-45c3-b8af-be4500bbae2f] received 2024-04-12T00:42:00.710743264Z [2024-04-12 00:42:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5186b0-a6a9-451a-8125-7c65c2d724c9] received 2024-04-12T00:42:00.712781368Z [2024-04-12 00:42:00,712: INFO/ForkPoolWorker-1] [d94b76a2-ebfb-45c3-b8af-be4500bbae2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:42:00.730248297Z [2024-04-12 00:42:00,729: INFO/ForkPoolWorker-2] [aa5186b0-a6a9-451a-8125-7c65c2d724c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:42:01.015489108Z [2024-04-12 00:42:01,009: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:42:01.025851062Z [2024-04-12 00:42:01,022: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:42:01.045069729Z [2024-04-12 00:42:01,041: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:42:01.094948556Z [2024-04-12 00:42:01,090: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:42:01.215140261Z [2024-04-12 00:42:01,214: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:42:01.219115825Z [2024-04-12 00:42:01,218: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:42:01.239104737Z [2024-04-12 00:42:01,238: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:42:01.242416250Z [2024-04-12 00:42:01,242: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:42:01.242763244Z [2024-04-12 00:42:01,242: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:42:01.242931659Z [2024-04-12 00:42:01,242: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:42:01.243209837Z [2024-04-12 00:42:01,243: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:42:01.251293628Z [2024-04-12 00:42:01,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:42:01.355024361Z [2024-04-12 00:42:01,354: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:42:01.853468980Z [2024-04-12 00:42:01,853: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e9aec99-64a3-4ee3-9861-54ab7ee51fa7] succeeded in 1.1653872360002424s: None 2024-04-12T00:42:01.913907975Z [2024-04-12 00:42:01,913: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aa5186b0-a6a9-451a-8125-7c65c2d724c9] succeeded in 1.2000256320006883s: None 2024-04-12T00:42:02.183021346Z [2024-04-12 00:42:02,182: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:42:02.186228170Z [2024-04-12 00:42:02,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:42:02.206977659Z [2024-04-12 00:42:02,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:42:02.208413754Z [2024-04-12 00:42:02,208: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:42:02.208609137Z [2024-04-12 00:42:02,208: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:42:02.208796072Z [2024-04-12 00:42:02,208: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:42:02.208926724Z [2024-04-12 00:42:02,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:42:02.209201042Z [2024-04-12 00:42:02,209: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:42:02.209339697Z [2024-04-12 00:42:02,209: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:42:02.273832871Z [2024-04-12 00:42:02,273: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:42:02.353930865Z [2024-04-12 00:42:02,353: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:42:02.356903453Z [2024-04-12 00:42:02,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:42:02.375554425Z [2024-04-12 00:42:02,375: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:42:02.376852781Z [2024-04-12 00:42:02,376: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:42:02.376875259Z [2024-04-12 00:42:02,376: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:42:02.377040924Z [2024-04-12 00:42:02,376: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:42:02.377056262Z [2024-04-12 00:42:02,376: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:42:02.377307309Z [2024-04-12 00:42:02,377: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:42:02.377322308Z [2024-04-12 00:42:02,377: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:42:02.458453176Z [2024-04-12 00:42:02,458: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:42:04.023971095Z [2024-04-12 00:42:04,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d94b76a2-ebfb-45c3-b8af-be4500bbae2f] succeeded in 3.316931505998582s: None 2024-04-12T00:42:05.017740814Z [2024-04-12 00:42:05,017: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e0ddc06-4484-4d21-a119-0cb0a0831c44] succeeded in 4.3272955489992455s: None 2024-04-12T00:43:00.436675837Z [2024-04-12 00:43:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a26edb31-99d0-407d-a467-61a93cb2ddf7] received 2024-04-12T00:43:00.439308881Z [2024-04-12 00:43:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[562f33e3-c308-4a70-a5f1-efcab467e675] received 2024-04-12T00:43:00.446035270Z [2024-04-12 00:43:00,445: INFO/ForkPoolWorker-15] [a26edb31-99d0-407d-a467-61a93cb2ddf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:43:00.449276372Z [2024-04-12 00:43:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02afb84e-dfca-4a7b-9cb0-4344c5231eed] received 2024-04-12T00:43:00.449910189Z [2024-04-12 00:43:00,449: INFO/ForkPoolWorker-16] [562f33e3-c308-4a70-a5f1-efcab467e675] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:43:00.463515405Z [2024-04-12 00:43:00,463: INFO/ForkPoolWorker-1] [02afb84e-dfca-4a7b-9cb0-4344c5231eed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:43:00.722012694Z [2024-04-12 00:43:00,718: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:43:00.723436690Z [2024-04-12 00:43:00,719: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:43:00.733411881Z [2024-04-12 00:43:00,730: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:43:00.868581518Z [2024-04-12 00:43:00,868: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:43:00.872324398Z [2024-04-12 00:43:00,871: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:43:00.895318158Z [2024-04-12 00:43:00,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:43:00.896324225Z [2024-04-12 00:43:00,896: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:43:00.896526085Z [2024-04-12 00:43:00,896: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:43:00.896630378Z [2024-04-12 00:43:00,896: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:43:00.897173921Z [2024-04-12 00:43:00,897: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:43:01.002675046Z [2024-04-12 00:43:01,002: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:43:01.574127021Z [2024-04-12 00:43:01,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[562f33e3-c308-4a70-a5f1-efcab467e675] succeeded in 1.1325931689989375s: None 2024-04-12T00:43:01.883260317Z [2024-04-12 00:43:01,882: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:43:01.886614854Z [2024-04-12 00:43:01,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:43:01.898310198Z [2024-04-12 00:43:01,897: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:43:01.901329296Z [2024-04-12 00:43:01,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:43:01.911342862Z [2024-04-12 00:43:01,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:43:01.912821045Z [2024-04-12 00:43:01,912: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:43:01.913583616Z [2024-04-12 00:43:01,913: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:43:01.914240437Z [2024-04-12 00:43:01,913: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:43:01.914463582Z [2024-04-12 00:43:01,914: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:43:01.914909172Z [2024-04-12 00:43:01,914: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:43:01.915118890Z [2024-04-12 00:43:01,914: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:43:01.921385031Z [2024-04-12 00:43:01,921: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:43:01.922487677Z [2024-04-12 00:43:01,922: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:43:01.922509573Z [2024-04-12 00:43:01,922: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:43:01.922617704Z [2024-04-12 00:43:01,922: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:43:01.922629644Z [2024-04-12 00:43:01,922: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:43:01.923083033Z [2024-04-12 00:43:01,922: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:43:01.923103954Z [2024-04-12 00:43:01,923: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:43:01.987365800Z [2024-04-12 00:43:01,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:43:02.000790177Z [2024-04-12 00:43:02,000: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:43:03.419817517Z [2024-04-12 00:43:03,419: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02afb84e-dfca-4a7b-9cb0-4344c5231eed] succeeded in 2.968678204999378s: None 2024-04-12T00:43:03.855396662Z [2024-04-12 00:43:03,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a26edb31-99d0-407d-a467-61a93cb2ddf7] succeeded in 3.4165999069991813s: None 2024-04-12T00:44:00.837803928Z [2024-04-12 00:44:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f78967a-64c2-40fa-aa6c-162fcac28cf7] received 2024-04-12T00:44:00.839825646Z [2024-04-12 00:44:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[288491a7-a637-45bc-ad84-d43e31310842] received 2024-04-12T00:44:00.843890281Z [2024-04-12 00:44:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e47cb8e-d83f-4efb-89e5-96a0a40e49f2] received 2024-04-12T00:44:00.846645647Z [2024-04-12 00:44:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aca9cb1-efb8-4e17-a13b-e0edbb700df9] received 2024-04-12T00:44:00.856794526Z [2024-04-12 00:44:00,856: INFO/ForkPoolWorker-15] [4f78967a-64c2-40fa-aa6c-162fcac28cf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:44:00.858087162Z [2024-04-12 00:44:00,857: INFO/ForkPoolWorker-1] [8e47cb8e-d83f-4efb-89e5-96a0a40e49f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:44:00.864547318Z [2024-04-12 00:44:00,864: INFO/ForkPoolWorker-2] [5aca9cb1-efb8-4e17-a13b-e0edbb700df9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:44:00.865808139Z [2024-04-12 00:44:00,865: INFO/ForkPoolWorker-16] [288491a7-a637-45bc-ad84-d43e31310842] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:44:01.202354340Z [2024-04-12 00:44:01,194: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:44:01.245952167Z [2024-04-12 00:44:01,242: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:44:01.262689401Z [2024-04-12 00:44:01,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:44:01.332342786Z [2024-04-12 00:44:01,329: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:44:01.426657434Z [2024-04-12 00:44:01,426: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:44:01.436541802Z [2024-04-12 00:44:01,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:44:01.484017026Z [2024-04-12 00:44:01,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:44:01.485839363Z [2024-04-12 00:44:01,485: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:44:01.486386379Z [2024-04-12 00:44:01,485: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:44:01.486558196Z [2024-04-12 00:44:01,486: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:44:01.486788671Z [2024-04-12 00:44:01,486: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:44:01.615733578Z [2024-04-12 00:44:01,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:44:01.642502926Z [2024-04-12 00:44:01,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:44:02.292117496Z [2024-04-12 00:44:02,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f78967a-64c2-40fa-aa6c-162fcac28cf7] succeeded in 1.4517200239988597s: None 2024-04-12T00:44:02.298580705Z [2024-04-12 00:44:02,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[288491a7-a637-45bc-ad84-d43e31310842] succeeded in 1.4559188620005443s: None 2024-04-12T00:44:02.761745946Z [2024-04-12 00:44:02,761: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:44:02.767563219Z [2024-04-12 00:44:02,767: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:44:02.798252363Z [2024-04-12 00:44:02,798: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:44:02.799392721Z [2024-04-12 00:44:02,799: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:44:02.799614900Z [2024-04-12 00:44:02,799: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:44:02.799868674Z [2024-04-12 00:44:02,799: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:44:02.800030163Z [2024-04-12 00:44:02,799: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:44:02.800528148Z [2024-04-12 00:44:02,800: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:44:02.800690285Z [2024-04-12 00:44:02,800: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:44:02.832441147Z [2024-04-12 00:44:02,832: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:44:02.837783835Z [2024-04-12 00:44:02,837: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:44:02.856526274Z [2024-04-12 00:44:02,856: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:44:02.857941995Z [2024-04-12 00:44:02,857: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:44:02.857956491Z [2024-04-12 00:44:02,857: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:44:02.858069701Z [2024-04-12 00:44:02,857: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:44:02.858118065Z [2024-04-12 00:44:02,858: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:44:02.858705841Z [2024-04-12 00:44:02,858: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:44:02.858717711Z [2024-04-12 00:44:02,858: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:44:02.887552203Z [2024-04-12 00:44:02,887: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:44:02.933411272Z [2024-04-12 00:44:02,933: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:44:04.515030166Z [2024-04-12 00:44:04,514: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5aca9cb1-efb8-4e17-a13b-e0edbb700df9] succeeded in 3.6664936439992744s: None 2024-04-12T00:44:04.710340601Z [2024-04-12 00:44:04,709: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e47cb8e-d83f-4efb-89e5-96a0a40e49f2] succeeded in 3.8649635420006234s: None 2024-04-12T00:45:00.268833755Z [2024-04-12 00:45:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f03a115c-f12d-48e3-95c2-9f78ccaf93df] received 2024-04-12T00:45:00.272919681Z [2024-04-12 00:45:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4d33f1b-1eab-49a5-8611-17434eae46c1] received 2024-04-12T00:45:00.277168753Z [2024-04-12 00:45:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5df0cbe9-18a4-4627-8819-ac2051bd113b] received 2024-04-12T00:45:00.280018809Z [2024-04-12 00:45:00,279: INFO/ForkPoolWorker-15] [f03a115c-f12d-48e3-95c2-9f78ccaf93df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:00.282211661Z [2024-04-12 00:45:00,281: INFO/ForkPoolWorker-16] [a4d33f1b-1eab-49a5-8611-17434eae46c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:45:00.282561112Z [2024-04-12 00:45:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e6b7d45-eaca-444e-8772-2bf2ec834a59] received 2024-04-12T00:45:00.295486905Z [2024-04-12 00:45:00,295: INFO/ForkPoolWorker-2] [8e6b7d45-eaca-444e-8772-2bf2ec834a59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:45:00.295933006Z [2024-04-12 00:45:00,295: INFO/ForkPoolWorker-1] [5df0cbe9-18a4-4627-8819-ac2051bd113b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:45:00.540633605Z [2024-04-12 00:45:00,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:45:00.545210440Z [2024-04-12 00:45:00,541: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:45:00.595755765Z [2024-04-12 00:45:00,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:45:00.675336470Z [2024-04-12 00:45:00,670: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:45:00.682604917Z [2024-04-12 00:45:00,682: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:45:00.686562047Z [2024-04-12 00:45:00,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:00.710561291Z [2024-04-12 00:45:00,710: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:45:00.711351695Z [2024-04-12 00:45:00,711: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:45:00.711469738Z [2024-04-12 00:45:00,711: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:45:00.711698936Z [2024-04-12 00:45:00,711: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:45:00.711887946Z [2024-04-12 00:45:00,711: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:45:00.788508209Z [2024-04-12 00:45:00,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:01.313206489Z [2024-04-12 00:45:01,312: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4d33f1b-1eab-49a5-8611-17434eae46c1] succeeded in 1.0383309989992995s: None 2024-04-12T00:45:01.618382048Z [2024-04-12 00:45:01,617: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:45:01.621517251Z [2024-04-12 00:45:01,621: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:01.641980727Z [2024-04-12 00:45:01,641: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:45:01.643366289Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:01.643402686Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:01.643501656Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:01.643611638Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:45:01.643841872Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:45:01.643994514Z [2024-04-12 00:45:01,643: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:01.733033284Z [2024-04-12 00:45:01,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:01.803732062Z [2024-04-12 00:45:01,803: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:45:01.806219015Z [2024-04-12 00:45:01,805: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:45:01.809207734Z [2024-04-12 00:45:01,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:01.815855655Z [2024-04-12 00:45:01,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:01.831027267Z [2024-04-12 00:45:01,830: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:45:01.831999353Z [2024-04-12 00:45:01,831: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:01.832017890Z [2024-04-12 00:45:01,831: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:01.832100042Z [2024-04-12 00:45:01,831: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:01.832117283Z [2024-04-12 00:45:01,832: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:45:01.832655246Z [2024-04-12 00:45:01,832: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:45:01.832697617Z [2024-04-12 00:45:01,832: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:01.837071529Z [2024-04-12 00:45:01,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:45:01.838108473Z [2024-04-12 00:45:01,837: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:01.838128997Z [2024-04-12 00:45:01,838: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:01.838325134Z [2024-04-12 00:45:01,838: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:01.838388823Z [2024-04-12 00:45:01,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:45:01.838733551Z [2024-04-12 00:45:01,838: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:45:01.838768905Z [2024-04-12 00:45:01,838: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:01.908335052Z [2024-04-12 00:45:01,908: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:01.930597152Z [2024-04-12 00:45:01,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:02.291905269Z [2024-04-12 00:45:02,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f03a115c-f12d-48e3-95c2-9f78ccaf93df] succeeded in 2.0205346740003733s: None 2024-04-12T00:45:02.758899391Z [2024-04-12 00:45:02,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad37e5f-f686-4e89-a20b-778f7589b1f9] received 2024-04-12T00:45:02.766349737Z [2024-04-12 00:45:02,765: INFO/ForkPoolWorker-15] [5ad37e5f-f686-4e89-a20b-778f7589b1f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:03.067751189Z [2024-04-12 00:45:03,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:45:03.412776588Z [2024-04-12 00:45:03,406: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e6b7d45-eaca-444e-8772-2bf2ec834a59] succeeded in 3.122237176999988s: None 2024-04-12T00:45:03.878891573Z [2024-04-12 00:45:03,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5df0cbe9-18a4-4627-8819-ac2051bd113b] succeeded in 3.5939771450011904s: None 2024-04-12T00:45:04.389421016Z [2024-04-12 00:45:04,388: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:45:04.399112924Z [2024-04-12 00:45:04,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:04.418863526Z [2024-04-12 00:45:04,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:45:04.420234332Z [2024-04-12 00:45:04,419: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:04.420424331Z [2024-04-12 00:45:04,420: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:04.420628376Z [2024-04-12 00:45:04,420: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:04.420826628Z [2024-04-12 00:45:04,420: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:45:04.421344930Z [2024-04-12 00:45:04,421: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:45:04.421504022Z [2024-04-12 00:45:04,421: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:04.531791311Z [2024-04-12 00:45:04,531: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:05.210176148Z [2024-04-12 00:45:05,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0628e0a9-a5a3-448e-8f27-f5bf0550c321] received 2024-04-12T00:45:05.218860581Z [2024-04-12 00:45:05,218: INFO/ForkPoolWorker-16] [0628e0a9-a5a3-448e-8f27-f5bf0550c321] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:45:05.234566038Z [2024-04-12 00:45:05,234: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ad37e5f-f686-4e89-a20b-778f7589b1f9] succeeded in 2.473279960000582s: None 2024-04-12T00:45:05.463548770Z [2024-04-12 00:45:05,460: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:45:06.449120482Z [2024-04-12 00:45:06,448: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:45:06.451776632Z [2024-04-12 00:45:06,451: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:06.471725566Z [2024-04-12 00:45:06,471: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:45:06.473291896Z [2024-04-12 00:45:06,472: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:06.473320944Z [2024-04-12 00:45:06,472: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:06.473344011Z [2024-04-12 00:45:06,473: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:06.473354468Z [2024-04-12 00:45:06,473: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:45:06.473574758Z [2024-04-12 00:45:06,473: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:45:06.473590089Z [2024-04-12 00:45:06,473: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:06.578194184Z [2024-04-12 00:45:06,577: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:07.206835982Z [2024-04-12 00:45:07,206: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0628e0a9-a5a3-448e-8f27-f5bf0550c321] succeeded in 1.9938216859991371s: None 2024-04-12T00:45:07.882632887Z [2024-04-12 00:45:07,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95078a64-b174-42ae-af70-21b541794665] received 2024-04-12T00:45:07.894325549Z [2024-04-12 00:45:07,894: INFO/ForkPoolWorker-15] [95078a64-b174-42ae-af70-21b541794665] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:08.176279930Z [2024-04-12 00:45:08,173: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:45:09.136807566Z [2024-04-12 00:45:09,136: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:45:09.139710838Z [2024-04-12 00:45:09,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:45:09.158102218Z [2024-04-12 00:45:09,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:45:09.159481868Z [2024-04-12 00:45:09,159: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:45:09.159630161Z [2024-04-12 00:45:09,159: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:45:09.159829075Z [2024-04-12 00:45:09,159: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:45:09.159917455Z [2024-04-12 00:45:09,159: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:45:09.160197102Z [2024-04-12 00:45:09,160: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:45:09.160305460Z [2024-04-12 00:45:09,160: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:45:09.251123433Z [2024-04-12 00:45:09,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:45:09.930620448Z [2024-04-12 00:45:09,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95078a64-b174-42ae-af70-21b541794665] succeeded in 2.0457654839992756s: None 2024-04-12T00:46:00.672731262Z [2024-04-12 00:46:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2027fdf-781e-4d63-ae14-6f111659325e] received 2024-04-12T00:46:00.672771567Z [2024-04-12 00:46:00,670: INFO/ForkPoolWorker-15] [b2027fdf-781e-4d63-ae14-6f111659325e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:46:00.673185813Z [2024-04-12 00:46:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[944315b8-8c96-4ffa-b5e4-4eac54fd0160] received 2024-04-12T00:46:00.678587513Z [2024-04-12 00:46:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94db0d21-ebf9-4e48-ae77-d80d2bc1fd8e] received 2024-04-12T00:46:00.680963894Z [2024-04-12 00:46:00,680: INFO/ForkPoolWorker-16] [944315b8-8c96-4ffa-b5e4-4eac54fd0160] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:46:00.691587386Z [2024-04-12 00:46:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f57b13f4-a07f-4d90-8a8a-8e61e76ec9f5] received 2024-04-12T00:46:00.695368935Z [2024-04-12 00:46:00,695: INFO/ForkPoolWorker-1] [94db0d21-ebf9-4e48-ae77-d80d2bc1fd8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:46:00.702441565Z [2024-04-12 00:46:00,701: INFO/ForkPoolWorker-2] [f57b13f4-a07f-4d90-8a8a-8e61e76ec9f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:46:00.946839957Z [2024-04-12 00:46:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:46:00.969002735Z [2024-04-12 00:46:00,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:46:00.994207848Z [2024-04-12 00:46:00,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:46:01.025093630Z [2024-04-12 00:46:01,020: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:46:01.109733690Z [2024-04-12 00:46:01,109: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:46:01.113500718Z [2024-04-12 00:46:01,113: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:46:01.151427741Z [2024-04-12 00:46:01,151: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:46:01.157126641Z [2024-04-12 00:46:01,156: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:46:01.157538313Z [2024-04-12 00:46:01,157: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:46:01.157995140Z [2024-04-12 00:46:01,157: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:46:01.158261496Z [2024-04-12 00:46:01,158: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:46:01.191692810Z [2024-04-12 00:46:01,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:46:01.262993894Z [2024-04-12 00:46:01,262: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:46:01.927340520Z [2024-04-12 00:46:01,926: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94db0d21-ebf9-4e48-ae77-d80d2bc1fd8e] succeeded in 1.236467676000757s: None 2024-04-12T00:46:01.987056833Z [2024-04-12 00:46:01,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2027fdf-781e-4d63-ae14-6f111659325e] succeeded in 1.321253596999668s: None 2024-04-12T00:46:02.361725040Z [2024-04-12 00:46:02,361: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:46:02.364958579Z [2024-04-12 00:46:02,364: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:46:02.384709380Z [2024-04-12 00:46:02,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:46:02.386176983Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:46:02.386195764Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:46:02.386298985Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:46:02.386347110Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:46:02.386585488Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:46:02.386610797Z [2024-04-12 00:46:02,386: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:46:02.462570242Z [2024-04-12 00:46:02,462: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:46:02.538089630Z [2024-04-12 00:46:02,537: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:46:02.541490207Z [2024-04-12 00:46:02,541: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:46:02.565482912Z [2024-04-12 00:46:02,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:46:02.568181705Z [2024-04-12 00:46:02,567: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:46:02.568712589Z [2024-04-12 00:46:02,568: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:46:02.568940585Z [2024-04-12 00:46:02,568: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:46:02.569106764Z [2024-04-12 00:46:02,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:46:02.569742986Z [2024-04-12 00:46:02,569: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:46:02.569908679Z [2024-04-12 00:46:02,569: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:46:02.640051580Z [2024-04-12 00:46:02,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:46:03.961233828Z [2024-04-12 00:46:03,960: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f57b13f4-a07f-4d90-8a8a-8e61e76ec9f5] succeeded in 3.267661190999206s: None 2024-04-12T00:46:04.469365486Z [2024-04-12 00:46:04,468: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[944315b8-8c96-4ffa-b5e4-4eac54fd0160] succeeded in 3.794684360998872s: None 2024-04-12T00:47:01.059025986Z [2024-04-12 00:47:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c3fa0ec-9700-459b-8467-089c11ee1309] received 2024-04-12T00:47:01.062721129Z [2024-04-12 00:47:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af7abd9d-9427-4fd6-b480-f23e53440240] received 2024-04-12T00:47:01.065319821Z [2024-04-12 00:47:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[344f2635-6880-4fbe-ab27-031f94abf746] received 2024-04-12T00:47:01.070428229Z [2024-04-12 00:47:01,070: INFO/ForkPoolWorker-15] [7c3fa0ec-9700-459b-8467-089c11ee1309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:47:01.075108563Z [2024-04-12 00:47:01,074: INFO/ForkPoolWorker-16] [af7abd9d-9427-4fd6-b480-f23e53440240] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:47:01.081441444Z [2024-04-12 00:47:01,081: INFO/ForkPoolWorker-1] [344f2635-6880-4fbe-ab27-031f94abf746] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:47:01.353894192Z [2024-04-12 00:47:01,351: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:47:01.433326788Z [2024-04-12 00:47:01,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:47:01.456641901Z [2024-04-12 00:47:01,452: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:47:01.632159946Z [2024-04-12 00:47:01,631: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T00:47:01.637777347Z [2024-04-12 00:47:01,637: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:47:01.693180139Z [2024-04-12 00:47:01,684: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:47:01.693190033Z [2024-04-12 00:47:01,687: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:47:01.693195067Z [2024-04-12 00:47:01,688: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:47:01.693200172Z [2024-04-12 00:47:01,688: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T00:47:01.693204392Z [2024-04-12 00:47:01,688: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:47:01.813442072Z [2024-04-12 00:47:01,813: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:47:02.504315914Z [2024-04-12 00:47:02,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[344f2635-6880-4fbe-ab27-031f94abf746] succeeded in 1.43442279699957s: None 2024-04-12T00:47:02.526580641Z [2024-04-12 00:47:02,526: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:47:02.529832145Z [2024-04-12 00:47:02,529: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:47:02.557600564Z [2024-04-12 00:47:02,557: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:47:02.562424750Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:47:02.562441094Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:47:02.562555698Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:47:02.562570248Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:47:02.562759669Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:47:02.562786505Z [2024-04-12 00:47:02,562: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:47:02.638939859Z [2024-04-12 00:47:02,638: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:47:02.642025859Z [2024-04-12 00:47:02,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:47:02.670475143Z [2024-04-12 00:47:02,670: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:47:02.674013595Z [2024-04-12 00:47:02,673: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:47:02.674084254Z [2024-04-12 00:47:02,674: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:47:02.674212872Z [2024-04-12 00:47:02,674: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:47:02.674291172Z [2024-04-12 00:47:02,674: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:47:02.674491702Z [2024-04-12 00:47:02,674: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:47:02.674571106Z [2024-04-12 00:47:02,674: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:47:02.689442402Z [2024-04-12 00:47:02,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:47:02.755338313Z [2024-04-12 00:47:02,755: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:47:04.642461621Z [2024-04-12 00:47:04,641: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c3fa0ec-9700-459b-8467-089c11ee1309] succeeded in 3.5811567990003823s: None 2024-04-12T00:47:04.981947994Z [2024-04-12 00:47:04,981: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af7abd9d-9427-4fd6-b480-f23e53440240] succeeded in 3.917044645000715s: None 2024-04-12T00:48:00.483710260Z [2024-04-12 00:48:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72992077-a80b-4bce-bd93-a38954f4ce7e] received 2024-04-12T00:48:00.485801057Z [2024-04-12 00:48:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43555a8f-6fd8-468b-bbb4-34e4288d57a5] received 2024-04-12T00:48:00.494637778Z [2024-04-12 00:48:00,494: INFO/ForkPoolWorker-15] [72992077-a80b-4bce-bd93-a38954f4ce7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:48:00.503288893Z [2024-04-12 00:48:00,502: INFO/ForkPoolWorker-16] [43555a8f-6fd8-468b-bbb4-34e4288d57a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:48:00.516259399Z [2024-04-12 00:48:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1706c7c4-99c8-43f2-9dde-12ccaaefcb20] received 2024-04-12T00:48:00.523287958Z [2024-04-12 00:48:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab3b45a4-0492-42fc-9c4e-8e5173a06621] received 2024-04-12T00:48:00.529079402Z [2024-04-12 00:48:00,528: INFO/ForkPoolWorker-1] [1706c7c4-99c8-43f2-9dde-12ccaaefcb20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:48:00.538781643Z [2024-04-12 00:48:00,538: INFO/ForkPoolWorker-2] [ab3b45a4-0492-42fc-9c4e-8e5173a06621] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:48:00.805631477Z [2024-04-12 00:48:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:48:00.810998056Z [2024-04-12 00:48:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:48:00.828774824Z [2024-04-12 00:48:00,824: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:48:00.848966414Z [2024-04-12 00:48:00,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:48:00.958239169Z [2024-04-12 00:48:00,957: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:48:00.962202477Z [2024-04-12 00:48:00,961: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:48:01.007586410Z [2024-04-12 00:48:01,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:48:01.013959593Z [2024-04-12 00:48:01,013: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:48:01.014183044Z [2024-04-12 00:48:01,013: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:48:01.014335773Z [2024-04-12 00:48:01,014: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:48:01.014670888Z [2024-04-12 00:48:01,014: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:48:01.091583932Z [2024-04-12 00:48:01,091: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:48:01.102832796Z [2024-04-12 00:48:01,102: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:48:01.574727872Z [2024-04-12 00:48:01,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72992077-a80b-4bce-bd93-a38954f4ce7e] succeeded in 1.086327500999687s: None 2024-04-12T00:48:01.666202504Z [2024-04-12 00:48:01,665: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43555a8f-6fd8-468b-bbb4-34e4288d57a5] succeeded in 1.177696732998811s: None 2024-04-12T00:48:01.947335178Z [2024-04-12 00:48:01,946: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:48:01.950324890Z [2024-04-12 00:48:01,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:48:01.997584653Z [2024-04-12 00:48:01,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:48:01.998765081Z [2024-04-12 00:48:01,998: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:48:01.998791593Z [2024-04-12 00:48:01,998: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:48:01.999233121Z [2024-04-12 00:48:01,998: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:48:01.999256342Z [2024-04-12 00:48:01,998: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:48:01.999492427Z [2024-04-12 00:48:01,999: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:48:01.999500448Z [2024-04-12 00:48:01,999: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:48:02.081729775Z [2024-04-12 00:48:02,081: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:48:02.084839557Z [2024-04-12 00:48:02,084: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:48:02.095560344Z [2024-04-12 00:48:02,094: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:48:02.118033897Z [2024-04-12 00:48:02,117: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:48:02.119639154Z [2024-04-12 00:48:02,119: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:48:02.119668537Z [2024-04-12 00:48:02,119: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:48:02.119800415Z [2024-04-12 00:48:02,119: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:48:02.119843651Z [2024-04-12 00:48:02,119: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:48:02.120081222Z [2024-04-12 00:48:02,119: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:48:02.120124039Z [2024-04-12 00:48:02,120: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:48:02.193598368Z [2024-04-12 00:48:02,193: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:48:03.769943209Z [2024-04-12 00:48:03,765: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1706c7c4-99c8-43f2-9dde-12ccaaefcb20] succeeded in 3.246486598000047s: None 2024-04-12T00:48:04.077426330Z [2024-04-12 00:48:04,077: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ab3b45a4-0492-42fc-9c4e-8e5173a06621] succeeded in 3.546921259001465s: None 2024-04-12T00:49:00.269738400Z [2024-04-12 00:49:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ba6a6c9-03f1-4fb5-8393-7d9a8375a3d7] received 2024-04-12T00:49:00.279852605Z [2024-04-12 00:49:00,279: INFO/ForkPoolWorker-15] [5ba6a6c9-03f1-4fb5-8393-7d9a8375a3d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:49:00.285787924Z [2024-04-12 00:49:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82187c43-7686-4596-8001-c20b58d7b31a] received 2024-04-12T00:49:00.287191198Z [2024-04-12 00:49:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f9eb96b-19f9-4bd4-8f1e-c4053953cf43] received 2024-04-12T00:49:00.295007232Z [2024-04-12 00:49:00,294: INFO/ForkPoolWorker-16] [82187c43-7686-4596-8001-c20b58d7b31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:49:00.295594640Z [2024-04-12 00:49:00,295: INFO/ForkPoolWorker-1] [1f9eb96b-19f9-4bd4-8f1e-c4053953cf43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:49:00.593408728Z [2024-04-12 00:49:00,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:49:00.606821882Z [2024-04-12 00:49:00,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:49:00.612358667Z [2024-04-12 00:49:00,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:49:00.753788625Z [2024-04-12 00:49:00,753: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:49:00.758358467Z [2024-04-12 00:49:00,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:49:00.779678035Z [2024-04-12 00:49:00,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:49:00.780726229Z [2024-04-12 00:49:00,780: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:49:00.780896609Z [2024-04-12 00:49:00,780: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:49:00.780975772Z [2024-04-12 00:49:00,780: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:49:00.781142693Z [2024-04-12 00:49:00,781: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:49:00.856073693Z [2024-04-12 00:49:00,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:49:01.455907166Z [2024-04-12 00:49:01,455: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82187c43-7686-4596-8001-c20b58d7b31a] succeeded in 1.1667688210000051s: None 2024-04-12T00:49:01.771425930Z [2024-04-12 00:49:01,771: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:49:01.774994677Z [2024-04-12 00:49:01,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:49:01.816207071Z [2024-04-12 00:49:01,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:49:01.820520338Z [2024-04-12 00:49:01,820: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:49:01.822796631Z [2024-04-12 00:49:01,820: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:49:01.823133362Z [2024-04-12 00:49:01,822: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:49:01.823849299Z [2024-04-12 00:49:01,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:49:01.824738945Z [2024-04-12 00:49:01,824: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:49:01.824754239Z [2024-04-12 00:49:01,824: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:49:01.873873909Z [2024-04-12 00:49:01,873: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:49:01.876888300Z [2024-04-12 00:49:01,876: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:49:01.899420322Z [2024-04-12 00:49:01,899: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:49:01.900405164Z [2024-04-12 00:49:01,900: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:49:01.900615835Z [2024-04-12 00:49:01,900: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:49:01.900774073Z [2024-04-12 00:49:01,900: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:49:01.900944908Z [2024-04-12 00:49:01,900: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:49:01.901080878Z [2024-04-12 00:49:01,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:49:01.901372332Z [2024-04-12 00:49:01,901: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:49:01.901617364Z [2024-04-12 00:49:01,901: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:49:01.980668148Z [2024-04-12 00:49:01,980: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:49:03.308361012Z [2024-04-12 00:49:03,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ba6a6c9-03f1-4fb5-8393-7d9a8375a3d7] succeeded in 3.034618681998836s: None 2024-04-12T00:49:03.752885780Z [2024-04-12 00:49:03,752: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f9eb96b-19f9-4bd4-8f1e-c4053953cf43] succeeded in 3.461607492999974s: None 2024-04-12T00:50:00.302463718Z [2024-04-12 00:50:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d0b55d3-4f57-4de5-bd6b-d0953d155004] received 2024-04-12T00:50:00.304838176Z [2024-04-12 00:50:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbb88a92-a074-453b-85dd-ac526ac4ae30] received 2024-04-12T00:50:00.314645244Z [2024-04-12 00:50:00,314: INFO/ForkPoolWorker-15] [3d0b55d3-4f57-4de5-bd6b-d0953d155004] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:00.316664960Z [2024-04-12 00:50:00,315: INFO/ForkPoolWorker-16] [fbb88a92-a074-453b-85dd-ac526ac4ae30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:50:00.323297300Z [2024-04-12 00:50:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e181396d-67bf-4d9f-a6f7-2332ab442abb] received 2024-04-12T00:50:00.328204503Z [2024-04-12 00:50:00,328: INFO/ForkPoolWorker-1] [e181396d-67bf-4d9f-a6f7-2332ab442abb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:50:00.333366112Z [2024-04-12 00:50:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fc1c539-8089-41ec-89a4-b81fc6ce5eed] received 2024-04-12T00:50:00.338817359Z [2024-04-12 00:50:00,338: INFO/ForkPoolWorker-2] [6fc1c539-8089-41ec-89a4-b81fc6ce5eed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:50:00.358213155Z [2024-04-12 00:50:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[518b2459-b03b-42e6-83cf-377e2fcac114] received 2024-04-12T00:50:00.370435957Z [2024-04-12 00:50:00,370: INFO/ForkPoolWorker-3] [518b2459-b03b-42e6-83cf-377e2fcac114] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:50:00.640695737Z [2024-04-12 00:50:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:50:00.674051196Z [2024-04-12 00:50:00,671: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:50:00.699529107Z [2024-04-12 00:50:00,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:50:00.780466566Z [2024-04-12 00:50:00,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:50:00.843963596Z [2024-04-12 00:50:00,840: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:50:00.850056938Z [2024-04-12 00:50:00,849: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:50:00.854200258Z [2024-04-12 00:50:00,853: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:00.886570437Z [2024-04-12 00:50:00,886: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:50:00.887775228Z [2024-04-12 00:50:00,887: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:50:00.887960102Z [2024-04-12 00:50:00,887: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:50:00.888339102Z [2024-04-12 00:50:00,887: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:50:00.888683762Z [2024-04-12 00:50:00,888: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:50:00.945470484Z [2024-04-12 00:50:00,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:01.046094965Z [2024-04-12 00:50:01,045: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:01.585060337Z [2024-04-12 00:50:01,584: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fbb88a92-a074-453b-85dd-ac526ac4ae30] succeeded in 1.278698718000669s: None 2024-04-12T00:50:01.608441583Z [2024-04-12 00:50:01,607: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6fc1c539-8089-41ec-89a4-b81fc6ce5eed] succeeded in 1.2735696580002696s: None 2024-04-12T00:50:02.130467120Z [2024-04-12 00:50:02,130: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:50:02.134302599Z [2024-04-12 00:50:02,133: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:02.165775339Z [2024-04-12 00:50:02,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:50:02.166899773Z [2024-04-12 00:50:02,166: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:02.166947821Z [2024-04-12 00:50:02,166: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:02.167077043Z [2024-04-12 00:50:02,166: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:02.167115775Z [2024-04-12 00:50:02,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:50:02.167436376Z [2024-04-12 00:50:02,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:50:02.167483834Z [2024-04-12 00:50:02,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:02.199400765Z [2024-04-12 00:50:02,199: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:50:02.202371537Z [2024-04-12 00:50:02,202: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:02.227318205Z [2024-04-12 00:50:02,227: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:50:02.228338944Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:02.228491707Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:02.228618100Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:02.228677102Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:50:02.228955879Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:50:02.229249395Z [2024-04-12 00:50:02,228: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:02.238374123Z [2024-04-12 00:50:02,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:02.243267260Z [2024-04-12 00:50:02,242: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T00:50:02.246526774Z [2024-04-12 00:50:02,246: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:02.275539412Z [2024-04-12 00:50:02,275: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T00:50:02.276774293Z [2024-04-12 00:50:02,276: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:02.276949431Z [2024-04-12 00:50:02,276: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:02.277162458Z [2024-04-12 00:50:02,276: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:02.277320693Z [2024-04-12 00:50:02,277: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T00:50:02.277646090Z [2024-04-12 00:50:02,277: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:50:02.277838508Z [2024-04-12 00:50:02,277: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:02.295197757Z [2024-04-12 00:50:02,294: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:02.360620509Z [2024-04-12 00:50:02,360: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:02.729564350Z [2024-04-12 00:50:02,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d0b55d3-4f57-4de5-bd6b-d0953d155004] succeeded in 2.4244438559999253s: None 2024-04-12T00:50:03.117115676Z [2024-04-12 00:50:03,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20114081-3123-489e-ba8e-dd4c9dcdb246] received 2024-04-12T00:50:03.125093511Z [2024-04-12 00:50:03,124: INFO/ForkPoolWorker-15] [20114081-3123-489e-ba8e-dd4c9dcdb246] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:03.401481541Z [2024-04-12 00:50:03,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:50:03.838309106Z [2024-04-12 00:50:03,837: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e181396d-67bf-4d9f-a6f7-2332ab442abb] succeeded in 3.513589256999694s: None 2024-04-12T00:50:04.089483751Z [2024-04-12 00:50:04,089: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[518b2459-b03b-42e6-83cf-377e2fcac114] succeeded in 3.7293957820002106s: None 2024-04-12T00:50:04.529828705Z [2024-04-12 00:50:04,529: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:50:04.532653558Z [2024-04-12 00:50:04,532: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:04.548745831Z [2024-04-12 00:50:04,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:50:04.549970668Z [2024-04-12 00:50:04,549: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:04.550029017Z [2024-04-12 00:50:04,549: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:04.550153376Z [2024-04-12 00:50:04,550: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:04.550204186Z [2024-04-12 00:50:04,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:50:04.550450631Z [2024-04-12 00:50:04,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:50:04.550464569Z [2024-04-12 00:50:04,550: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:04.635405867Z [2024-04-12 00:50:04,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:05.303205400Z [2024-04-12 00:50:05,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20114081-3123-489e-ba8e-dd4c9dcdb246] succeeded in 2.183618466000553s: None 2024-04-12T00:50:05.519784633Z [2024-04-12 00:50:05,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00b33ed1-c6f7-42c6-a602-51d835d86803] received 2024-04-12T00:50:05.528788251Z [2024-04-12 00:50:05,528: INFO/ForkPoolWorker-15] [00b33ed1-c6f7-42c6-a602-51d835d86803] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:50:05.806503592Z [2024-04-12 00:50:05,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:50:06.783683102Z [2024-04-12 00:50:06,783: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:50:06.786676596Z [2024-04-12 00:50:06,786: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:06.806977010Z [2024-04-12 00:50:06,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:50:06.808337934Z [2024-04-12 00:50:06,808: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:06.808353693Z [2024-04-12 00:50:06,808: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:06.808534744Z [2024-04-12 00:50:06,808: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:06.808550975Z [2024-04-12 00:50:06,808: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:50:06.809989957Z [2024-04-12 00:50:06,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:50:06.810071103Z [2024-04-12 00:50:06,809: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:06.903643678Z [2024-04-12 00:50:06,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:07.548590012Z [2024-04-12 00:50:07,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00b33ed1-c6f7-42c6-a602-51d835d86803] succeeded in 2.02544530600062s: None 2024-04-12T00:50:08.308249868Z [2024-04-12 00:50:08,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9ced0a4-1a0e-463f-bbca-e0000f1dfcb9] received 2024-04-12T00:50:08.318331177Z [2024-04-12 00:50:08,318: INFO/ForkPoolWorker-15] [a9ced0a4-1a0e-463f-bbca-e0000f1dfcb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:08.611355149Z [2024-04-12 00:50:08,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:50:09.560628305Z [2024-04-12 00:50:09,560: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:50:09.563372990Z [2024-04-12 00:50:09,563: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:50:09.579700889Z [2024-04-12 00:50:09,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:50:09.580795249Z [2024-04-12 00:50:09,580: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:50:09.580806034Z [2024-04-12 00:50:09,580: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:50:09.580899081Z [2024-04-12 00:50:09,580: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:50:09.580906074Z [2024-04-12 00:50:09,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:50:09.581090942Z [2024-04-12 00:50:09,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:50:09.581097193Z [2024-04-12 00:50:09,581: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:50:09.647420431Z [2024-04-12 00:50:09,646: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:50:10.172348068Z [2024-04-12 00:50:10,171: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9ced0a4-1a0e-463f-bbca-e0000f1dfcb9] succeeded in 1.8613966789998813s: None 2024-04-12T00:51:00.513517953Z [2024-04-12 00:51:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba2aef84-4488-4ceb-b0a5-86ae8a643a21] received 2024-04-12T00:51:00.515502852Z [2024-04-12 00:51:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9dbd27b-7b98-4c20-bec6-10a2075a75f9] received 2024-04-12T00:51:00.522886871Z [2024-04-12 00:51:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b941fa9-1122-4870-8c31-c394491ef563] received 2024-04-12T00:51:00.529151114Z [2024-04-12 00:51:00,528: INFO/ForkPoolWorker-15] [ba2aef84-4488-4ceb-b0a5-86ae8a643a21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:51:00.533073146Z [2024-04-12 00:51:00,532: INFO/ForkPoolWorker-16] [e9dbd27b-7b98-4c20-bec6-10a2075a75f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:51:00.534071819Z [2024-04-12 00:51:00,533: INFO/ForkPoolWorker-1] [1b941fa9-1122-4870-8c31-c394491ef563] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:51:00.805336425Z [2024-04-12 00:51:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:51:00.811233165Z [2024-04-12 00:51:00,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:51:00.815522179Z [2024-04-12 00:51:00,809: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:51:00.945830167Z [2024-04-12 00:51:00,945: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:51:00.949495488Z [2024-04-12 00:51:00,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:51:00.968244728Z [2024-04-12 00:51:00,968: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:51:00.971376099Z [2024-04-12 00:51:00,971: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:51:00.971489933Z [2024-04-12 00:51:00,971: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:51:00.971564404Z [2024-04-12 00:51:00,971: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:51:00.971774159Z [2024-04-12 00:51:00,971: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:51:01.095583886Z [2024-04-12 00:51:01,095: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:51:01.722626154Z [2024-04-12 00:51:01,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba2aef84-4488-4ceb-b0a5-86ae8a643a21] succeeded in 1.2003670599988254s: None 2024-04-12T00:51:01.945521326Z [2024-04-12 00:51:01,945: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:51:01.948502428Z [2024-04-12 00:51:01,948: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:51:01.974967279Z [2024-04-12 00:51:01,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:51:01.977657095Z [2024-04-12 00:51:01,977: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:51:01.977894359Z [2024-04-12 00:51:01,977: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:51:01.978234273Z [2024-04-12 00:51:01,977: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:51:01.978455517Z [2024-04-12 00:51:01,978: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:51:01.979119482Z [2024-04-12 00:51:01,978: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:51:01.979360906Z [2024-04-12 00:51:01,979: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:51:02.029420180Z [2024-04-12 00:51:02,029: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:51:02.032689125Z [2024-04-12 00:51:02,032: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:51:02.053545316Z [2024-04-12 00:51:02,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:51:02.054952403Z [2024-04-12 00:51:02,054: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:51:02.055020506Z [2024-04-12 00:51:02,054: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:51:02.055149406Z [2024-04-12 00:51:02,055: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:51:02.055214234Z [2024-04-12 00:51:02,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:51:02.055468164Z [2024-04-12 00:51:02,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:51:02.055563433Z [2024-04-12 00:51:02,055: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:51:02.081406579Z [2024-04-12 00:51:02,081: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:51:02.128431963Z [2024-04-12 00:51:02,128: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:51:03.693842153Z [2024-04-12 00:51:03,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9dbd27b-7b98-4c20-bec6-10a2075a75f9] succeeded in 3.174338713999532s: None 2024-04-12T00:51:04.060778348Z [2024-04-12 00:51:04,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b941fa9-1122-4870-8c31-c394491ef563] succeeded in 3.531591140999808s: None 2024-04-12T00:52:00.446756136Z [2024-04-12 00:52:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d36e398-1199-45ad-a29c-2f736a3c50d2] received 2024-04-12T00:52:00.448645767Z [2024-04-12 00:52:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c13a8e2-c3cd-4787-8989-10b0030c8720] received 2024-04-12T00:52:00.452981658Z [2024-04-12 00:52:00,452: INFO/ForkPoolWorker-15] [8d36e398-1199-45ad-a29c-2f736a3c50d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:52:00.457565667Z [2024-04-12 00:52:00,457: INFO/ForkPoolWorker-16] [3c13a8e2-c3cd-4787-8989-10b0030c8720] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:52:00.468426185Z [2024-04-12 00:52:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d868f565-7d7e-4159-b266-b4e6ded49c82] received 2024-04-12T00:52:00.473184899Z [2024-04-12 00:52:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17278bda-c3d5-4af2-953a-fe076c3bdbf8] received 2024-04-12T00:52:00.481677702Z [2024-04-12 00:52:00,481: INFO/ForkPoolWorker-1] [d868f565-7d7e-4159-b266-b4e6ded49c82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:52:00.492673974Z [2024-04-12 00:52:00,492: INFO/ForkPoolWorker-2] [17278bda-c3d5-4af2-953a-fe076c3bdbf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:52:00.802251907Z [2024-04-12 00:52:00,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:52:00.850210904Z [2024-04-12 00:52:00,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:52:00.863654382Z [2024-04-12 00:52:00,861: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:52:00.925965091Z [2024-04-12 00:52:00,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:52:01.062777216Z [2024-04-12 00:52:01,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:52:01.068931005Z [2024-04-12 00:52:01,068: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:52:01.072215641Z [2024-04-12 00:52:01,071: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:52:01.100303788Z [2024-04-12 00:52:01,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:52:01.101752792Z [2024-04-12 00:52:01,101: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:52:01.101865342Z [2024-04-12 00:52:01,101: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:52:01.101934765Z [2024-04-12 00:52:01,101: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:52:01.102152559Z [2024-04-12 00:52:01,102: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:52:01.211292744Z [2024-04-12 00:52:01,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:52:01.548230747Z [2024-04-12 00:52:01,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d36e398-1199-45ad-a29c-2f736a3c50d2] succeeded in 1.0968949769994651s: None 2024-04-12T00:52:01.771587765Z [2024-04-12 00:52:01,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c13a8e2-c3cd-4787-8989-10b0030c8720] succeeded in 1.32073456299986s: None 2024-04-12T00:52:02.045414072Z [2024-04-12 00:52:02,045: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:52:02.048202266Z [2024-04-12 00:52:02,047: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:52:02.048580637Z [2024-04-12 00:52:02,048: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:52:02.057094656Z [2024-04-12 00:52:02,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:52:02.071546799Z [2024-04-12 00:52:02,071: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:52:02.074166227Z [2024-04-12 00:52:02,073: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:52:02.074177069Z [2024-04-12 00:52:02,074: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:52:02.074293748Z [2024-04-12 00:52:02,074: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:52:02.074308743Z [2024-04-12 00:52:02,074: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:52:02.074568100Z [2024-04-12 00:52:02,074: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:52:02.074626169Z [2024-04-12 00:52:02,074: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:52:02.079411131Z [2024-04-12 00:52:02,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:52:02.085210504Z [2024-04-12 00:52:02,085: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:52:02.085222702Z [2024-04-12 00:52:02,085: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:52:02.088798300Z [2024-04-12 00:52:02,085: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:52:02.088885178Z [2024-04-12 00:52:02,088: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:52:02.089131425Z [2024-04-12 00:52:02,089: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:52:02.089185211Z [2024-04-12 00:52:02,089: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:52:02.154002902Z [2024-04-12 00:52:02,153: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:52:02.189195149Z [2024-04-12 00:52:02,188: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:52:03.659318204Z [2024-04-12 00:52:03,658: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[17278bda-c3d5-4af2-953a-fe076c3bdbf8] succeeded in 3.173309691999748s: None 2024-04-12T00:52:04.854344854Z [2024-04-12 00:52:04,853: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d868f565-7d7e-4159-b266-b4e6ded49c82] succeeded in 4.383434834999207s: None 2024-04-12T00:53:01.138876283Z [2024-04-12 00:53:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1401c7a-d18a-44bd-8e6b-6e5a3c477c1f] received 2024-04-12T00:53:01.143011996Z [2024-04-12 00:53:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c112db5-d77e-42e4-bedf-2f0171321169] received 2024-04-12T00:53:01.150430530Z [2024-04-12 00:53:01,150: INFO/ForkPoolWorker-15] [f1401c7a-d18a-44bd-8e6b-6e5a3c477c1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:53:01.151374388Z [2024-04-12 00:53:01,151: INFO/ForkPoolWorker-16] [0c112db5-d77e-42e4-bedf-2f0171321169] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:53:01.157062006Z [2024-04-12 00:53:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d31dabd3-6903-492b-9a61-babacfdae6d0] received 2024-04-12T00:53:01.166466303Z [2024-04-12 00:53:01,166: INFO/ForkPoolWorker-1] [d31dabd3-6903-492b-9a61-babacfdae6d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:53:01.394796014Z [2024-04-12 00:53:01,391: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:53:01.419161778Z [2024-04-12 00:53:01,416: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:53:01.421598844Z [2024-04-12 00:53:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:53:01.578489109Z [2024-04-12 00:53:01,578: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:53:01.581968513Z [2024-04-12 00:53:01,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:53:01.606334990Z [2024-04-12 00:53:01,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:53:01.607777330Z [2024-04-12 00:53:01,607: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:53:01.607987647Z [2024-04-12 00:53:01,607: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:53:01.608113982Z [2024-04-12 00:53:01,607: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:53:01.608350767Z [2024-04-12 00:53:01,608: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:53:01.693122614Z [2024-04-12 00:53:01,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:53:02.268263063Z [2024-04-12 00:53:02,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c112db5-d77e-42e4-bedf-2f0171321169] succeeded in 1.123758790001375s: None 2024-04-12T00:53:02.431841721Z [2024-04-12 00:53:02,431: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:53:02.434834852Z [2024-04-12 00:53:02,434: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:53:02.459977502Z [2024-04-12 00:53:02,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:53:02.462626645Z [2024-04-12 00:53:02,462: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:53:02.462733564Z [2024-04-12 00:53:02,462: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:53:02.463018128Z [2024-04-12 00:53:02,462: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:53:02.463131565Z [2024-04-12 00:53:02,462: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:53:02.463558690Z [2024-04-12 00:53:02,463: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:53:02.463679974Z [2024-04-12 00:53:02,463: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:53:02.525323779Z [2024-04-12 00:53:02,524: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:53:02.528332157Z [2024-04-12 00:53:02,527: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:53:02.546703889Z [2024-04-12 00:53:02,546: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:53:02.548015169Z [2024-04-12 00:53:02,547: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:53:02.548143277Z [2024-04-12 00:53:02,547: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:53:02.548345321Z [2024-04-12 00:53:02,548: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:53:02.548489862Z [2024-04-12 00:53:02,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:53:02.549238972Z [2024-04-12 00:53:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:53:02.549335705Z [2024-04-12 00:53:02,549: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:53:02.569419726Z [2024-04-12 00:53:02,569: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:53:02.613421353Z [2024-04-12 00:53:02,613: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:53:04.357841596Z [2024-04-12 00:53:04,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1401c7a-d18a-44bd-8e6b-6e5a3c477c1f] succeeded in 3.2169921069998964s: None 2024-04-12T00:53:05.034865059Z [2024-04-12 00:53:05,034: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d31dabd3-6903-492b-9a61-babacfdae6d0] succeeded in 3.875354616999175s: None 2024-04-12T00:54:01.105898205Z [2024-04-12 00:54:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c511b7b6-ae6d-4903-9c59-185a1f80eb5d] received 2024-04-12T00:54:01.117466575Z [2024-04-12 00:54:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[347ca203-5302-4696-adf1-4dfca0d4df53] received 2024-04-12T00:54:01.117608119Z [2024-04-12 00:54:01,117: INFO/ForkPoolWorker-15] [c511b7b6-ae6d-4903-9c59-185a1f80eb5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:54:01.122749986Z [2024-04-12 00:54:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f4e824-b3aa-43b4-919b-1a9980537208] received 2024-04-12T00:54:01.129798249Z [2024-04-12 00:54:01,129: INFO/ForkPoolWorker-16] [347ca203-5302-4696-adf1-4dfca0d4df53] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:54:01.132025586Z [2024-04-12 00:54:01,131: INFO/ForkPoolWorker-1] [99f4e824-b3aa-43b4-919b-1a9980537208] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:54:01.140406871Z [2024-04-12 00:54:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b488eeb-812a-4a96-958c-86c1eb1ccae2] received 2024-04-12T00:54:01.154801732Z [2024-04-12 00:54:01,154: INFO/ForkPoolWorker-2] [7b488eeb-812a-4a96-958c-86c1eb1ccae2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:54:01.398962647Z [2024-04-12 00:54:01,396: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:54:01.461736574Z [2024-04-12 00:54:01,458: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:54:01.511179095Z [2024-04-12 00:54:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:54:01.514770263Z [2024-04-12 00:54:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:54:01.717590289Z [2024-04-12 00:54:01,717: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T00:54:01.721685986Z [2024-04-12 00:54:01,721: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:54:01.755705094Z [2024-04-12 00:54:01,755: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:54:01.756702392Z [2024-04-12 00:54:01,756: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:54:01.756858369Z [2024-04-12 00:54:01,756: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:54:01.756999666Z [2024-04-12 00:54:01,756: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T00:54:01.757358787Z [2024-04-12 00:54:01,757: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:54:01.822810735Z [2024-04-12 00:54:01,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:54:01.862092123Z [2024-04-12 00:54:01,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:54:02.345278372Z [2024-04-12 00:54:02,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c511b7b6-ae6d-4903-9c59-185a1f80eb5d] succeeded in 1.236039207000431s: None 2024-04-12T00:54:02.467191156Z [2024-04-12 00:54:02,464: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[347ca203-5302-4696-adf1-4dfca0d4df53] succeeded in 1.344525808999606s: None 2024-04-12T00:54:02.729132571Z [2024-04-12 00:54:02,728: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:54:02.732098224Z [2024-04-12 00:54:02,731: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:54:02.757830496Z [2024-04-12 00:54:02,757: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:54:02.759028738Z [2024-04-12 00:54:02,758: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:54:02.759156363Z [2024-04-12 00:54:02,759: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:54:02.759343784Z [2024-04-12 00:54:02,759: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:54:02.759436755Z [2024-04-12 00:54:02,759: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:54:02.759756909Z [2024-04-12 00:54:02,759: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:54:02.759878938Z [2024-04-12 00:54:02,759: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:54:02.839108734Z [2024-04-12 00:54:02,838: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:54:02.841546659Z [2024-04-12 00:54:02,841: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:54:02.844749569Z [2024-04-12 00:54:02,844: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:54:02.872857728Z [2024-04-12 00:54:02,872: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:54:02.873753223Z [2024-04-12 00:54:02,873: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:54:02.873763755Z [2024-04-12 00:54:02,873: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:54:02.873837235Z [2024-04-12 00:54:02,873: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:54:02.873864860Z [2024-04-12 00:54:02,873: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:54:02.874064108Z [2024-04-12 00:54:02,873: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:54:02.874067831Z [2024-04-12 00:54:02,874: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:54:02.952304595Z [2024-04-12 00:54:02,952: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:54:04.920444399Z [2024-04-12 00:54:04,919: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99f4e824-b3aa-43b4-919b-1a9980537208] succeeded in 3.7961991899992427s: None 2024-04-12T00:54:05.364837799Z [2024-04-12 00:54:05,364: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7b488eeb-812a-4a96-958c-86c1eb1ccae2] succeeded in 4.222177758001635s: None 2024-04-12T00:55:01.050290838Z [2024-04-12 00:55:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[333f5ebe-8346-4d24-b429-f00c61519e60] received 2024-04-12T00:55:01.052151496Z [2024-04-12 00:55:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30c1dbce-f288-4625-ab0c-f1782b113b98] received 2024-04-12T00:55:01.060067821Z [2024-04-12 00:55:01,059: INFO/ForkPoolWorker-15] [333f5ebe-8346-4d24-b429-f00c61519e60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:55:01.063562074Z [2024-04-12 00:55:01,063: INFO/ForkPoolWorker-16] [30c1dbce-f288-4625-ab0c-f1782b113b98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:55:01.066479015Z [2024-04-12 00:55:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78ab487a-0e97-4a31-acee-76150115bed3] received 2024-04-12T00:55:01.069428148Z [2024-04-12 00:55:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[639f0dd7-b0ee-4abc-9a34-b1b76d2d6f78] received 2024-04-12T00:55:01.075869957Z [2024-04-12 00:55:01,075: INFO/ForkPoolWorker-1] [78ab487a-0e97-4a31-acee-76150115bed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:01.082153550Z [2024-04-12 00:55:01,081: INFO/ForkPoolWorker-2] [639f0dd7-b0ee-4abc-9a34-b1b76d2d6f78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:55:01.390003421Z [2024-04-12 00:55:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:55:01.405697865Z [2024-04-12 00:55:01,402: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:55:01.410316799Z [2024-04-12 00:55:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:55:01.504490739Z [2024-04-12 00:55:01,501: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:55:01.582975201Z [2024-04-12 00:55:01,582: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:55:01.586679265Z [2024-04-12 00:55:01,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:01.612216025Z [2024-04-12 00:55:01,611: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:55:01.613422407Z [2024-04-12 00:55:01,613: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:55:01.613547459Z [2024-04-12 00:55:01,613: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:55:01.613698846Z [2024-04-12 00:55:01,613: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:55:01.613952838Z [2024-04-12 00:55:01,613: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:55:01.786851980Z [2024-04-12 00:55:01,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:02.371724135Z [2024-04-12 00:55:02,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[333f5ebe-8346-4d24-b429-f00c61519e60] succeeded in 1.3196745280001778s: None 2024-04-12T00:55:02.630948821Z [2024-04-12 00:55:02,630: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:55:02.633884693Z [2024-04-12 00:55:02,633: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:02.655353822Z [2024-04-12 00:55:02,654: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:55:02.656074902Z [2024-04-12 00:55:02,655: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:55:02.657291256Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:02.657402517Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:02.657549289Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:02.657685718Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:55:02.657934004Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:55:02.658087765Z [2024-04-12 00:55:02,657: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:02.659171732Z [2024-04-12 00:55:02,658: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:02.666499383Z [2024-04-12 00:55:02,666: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:55:02.669444569Z [2024-04-12 00:55:02,669: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:02.683832852Z [2024-04-12 00:55:02,683: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:55:02.686369973Z [2024-04-12 00:55:02,685: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:02.686439584Z [2024-04-12 00:55:02,686: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:02.686588643Z [2024-04-12 00:55:02,686: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:02.686663574Z [2024-04-12 00:55:02,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:55:02.686985959Z [2024-04-12 00:55:02,686: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:55:02.687298261Z [2024-04-12 00:55:02,687: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:02.690058262Z [2024-04-12 00:55:02,689: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:55:02.691246483Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:02.691261146Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:02.691428914Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:02.691510416Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:55:02.691814287Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:55:02.691912018Z [2024-04-12 00:55:02,691: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:02.759534280Z [2024-04-12 00:55:02,759: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:02.766427303Z [2024-04-12 00:55:02,766: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:02.771439878Z [2024-04-12 00:55:02,771: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:03.338315674Z [2024-04-12 00:55:03,337: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78ab487a-0e97-4a31-acee-76150115bed3] succeeded in 2.2673642989993823s: None 2024-04-12T00:55:03.601481729Z [2024-04-12 00:55:03,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aab0b9a-ed4d-4313-9c7d-c72487962987] received 2024-04-12T00:55:03.611303621Z [2024-04-12 00:55:03,611: INFO/ForkPoolWorker-15] [7aab0b9a-ed4d-4313-9c7d-c72487962987] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:03.894320792Z [2024-04-12 00:55:03,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:55:04.342589137Z [2024-04-12 00:55:04,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[639f0dd7-b0ee-4abc-9a34-b1b76d2d6f78] succeeded in 3.270888749000733s: None 2024-04-12T00:55:04.650142506Z [2024-04-12 00:55:04,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30c1dbce-f288-4625-ab0c-f1782b113b98] succeeded in 3.5961864040000364s: None 2024-04-12T00:55:04.937761227Z [2024-04-12 00:55:04,937: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:55:04.940794538Z [2024-04-12 00:55:04,940: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:04.965418528Z [2024-04-12 00:55:04,965: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:55:04.967083116Z [2024-04-12 00:55:04,966: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:04.967096162Z [2024-04-12 00:55:04,966: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:04.967338782Z [2024-04-12 00:55:04,967: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:04.967466917Z [2024-04-12 00:55:04,967: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:55:04.967779336Z [2024-04-12 00:55:04,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:55:04.967887062Z [2024-04-12 00:55:04,967: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:05.070996186Z [2024-04-12 00:55:05,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:05.837330401Z [2024-04-12 00:55:05,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7aab0b9a-ed4d-4313-9c7d-c72487962987] succeeded in 2.236543196000639s: None 2024-04-12T00:55:06.876064077Z [2024-04-12 00:55:06,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c1eb1dc-e360-4223-95b2-7d95efa6b9b9] received 2024-04-12T00:55:06.887647500Z [2024-04-12 00:55:06,887: INFO/ForkPoolWorker-15] [2c1eb1dc-e360-4223-95b2-7d95efa6b9b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:55:07.154149220Z [2024-04-12 00:55:07,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:55:08.283344429Z [2024-04-12 00:55:08,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:55:08.286666215Z [2024-04-12 00:55:08,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:08.311941731Z [2024-04-12 00:55:08,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:55:08.313497916Z [2024-04-12 00:55:08,313: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:08.313544854Z [2024-04-12 00:55:08,313: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:08.313859375Z [2024-04-12 00:55:08,313: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:08.313998131Z [2024-04-12 00:55:08,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:55:08.314275474Z [2024-04-12 00:55:08,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:55:08.314356751Z [2024-04-12 00:55:08,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:08.412699092Z [2024-04-12 00:55:08,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:09.064603590Z [2024-04-12 00:55:09,063: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c1eb1dc-e360-4223-95b2-7d95efa6b9b9] succeeded in 2.1855024069991487s: None 2024-04-12T00:55:09.845360535Z [2024-04-12 00:55:09,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37718ed2-dec4-4d9c-b6e8-2f89f953195c] received 2024-04-12T00:55:09.858822808Z [2024-04-12 00:55:09,858: INFO/ForkPoolWorker-15] [37718ed2-dec4-4d9c-b6e8-2f89f953195c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:10.150115481Z [2024-04-12 00:55:10,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T00:55:11.160228949Z [2024-04-12 00:55:11,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T00:55:11.164656418Z [2024-04-12 00:55:11,164: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:55:11.192931427Z [2024-04-12 00:55:11,192: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:55:11.194593134Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:55:11.194610126Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:55:11.194790127Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:55:11.194840161Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T00:55:11.195075307Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T00:55:11.195127304Z [2024-04-12 00:55:11,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:55:11.279368641Z [2024-04-12 00:55:11,278: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:55:11.882954320Z [2024-04-12 00:55:11,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37718ed2-dec4-4d9c-b6e8-2f89f953195c] succeeded in 2.0332637809988228s: None 2024-04-12T00:56:00.813376809Z [2024-04-12 00:56:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3f8ce66-ac70-4d38-9d23-ff2c0161cd0e] received 2024-04-12T00:56:00.816365346Z [2024-04-12 00:56:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80a645ff-5462-4fc7-80a8-f962f372209b] received 2024-04-12T00:56:00.823530619Z [2024-04-12 00:56:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0e071d-2bdc-4161-9dd6-6e1ec209f9a7] received 2024-04-12T00:56:00.826969145Z [2024-04-12 00:56:00,826: INFO/ForkPoolWorker-16] [80a645ff-5462-4fc7-80a8-f962f372209b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:56:00.832957299Z [2024-04-12 00:56:00,832: INFO/ForkPoolWorker-15] [b3f8ce66-ac70-4d38-9d23-ff2c0161cd0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:56:00.834173920Z [2024-04-12 00:56:00,833: INFO/ForkPoolWorker-1] [8f0e071d-2bdc-4161-9dd6-6e1ec209f9a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:56:00.840881386Z [2024-04-12 00:56:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[635aeb5f-6c83-48ed-b840-a2472a0718be] received 2024-04-12T00:56:00.847267023Z [2024-04-12 00:56:00,847: INFO/ForkPoolWorker-2] [635aeb5f-6c83-48ed-b840-a2472a0718be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:56:01.134085991Z [2024-04-12 00:56:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:56:01.286231783Z [2024-04-12 00:56:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:56:01.367161261Z [2024-04-12 00:56:01,363: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:56:01.465266587Z [2024-04-12 00:56:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:56:01.509068979Z [2024-04-12 00:56:01,508: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:56:01.512747391Z [2024-04-12 00:56:01,512: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:56:01.560980421Z [2024-04-12 00:56:01,560: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:56:01.564874092Z [2024-04-12 00:56:01,564: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:56:01.566038685Z [2024-04-12 00:56:01,565: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:56:01.566178476Z [2024-04-12 00:56:01,566: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:56:01.566482045Z [2024-04-12 00:56:01,566: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:56:01.715724037Z [2024-04-12 00:56:01,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:56:01.809547391Z [2024-04-12 00:56:01,809: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:56:02.705544233Z [2024-04-12 00:56:02,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f0e071d-2bdc-4161-9dd6-6e1ec209f9a7] succeeded in 1.879865109000093s: None 2024-04-12T00:56:02.720625108Z [2024-04-12 00:56:02,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3f8ce66-ac70-4d38-9d23-ff2c0161cd0e] succeeded in 1.9031967509999959s: None 2024-04-12T00:56:02.885683165Z [2024-04-12 00:56:02,885: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T00:56:02.889117101Z [2024-04-12 00:56:02,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:56:02.914463005Z [2024-04-12 00:56:02,914: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:56:02.915876293Z [2024-04-12 00:56:02,915: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:56:02.916046187Z [2024-04-12 00:56:02,915: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:56:02.916271843Z [2024-04-12 00:56:02,916: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:56:02.916517999Z [2024-04-12 00:56:02,916: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T00:56:02.916829447Z [2024-04-12 00:56:02,916: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:56:02.917612638Z [2024-04-12 00:56:02,917: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:56:02.992812269Z [2024-04-12 00:56:02,992: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:56:03.026306178Z [2024-04-12 00:56:03,025: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:56:03.029469143Z [2024-04-12 00:56:03,029: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:56:03.046787856Z [2024-04-12 00:56:03,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:56:03.047785096Z [2024-04-12 00:56:03,047: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:56:03.047802777Z [2024-04-12 00:56:03,047: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:56:03.047939032Z [2024-04-12 00:56:03,047: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:56:03.047952251Z [2024-04-12 00:56:03,047: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:56:03.048144536Z [2024-04-12 00:56:03,048: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:56:03.048176136Z [2024-04-12 00:56:03,048: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:56:03.139426733Z [2024-04-12 00:56:03,139: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:56:04.797466476Z [2024-04-12 00:56:04,796: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[635aeb5f-6c83-48ed-b840-a2472a0718be] succeeded in 3.955103169000722s: None 2024-04-12T00:56:05.474299336Z [2024-04-12 00:56:05,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80a645ff-5462-4fc7-80a8-f962f372209b] succeeded in 4.656377916000565s: None 2024-04-12T00:57:00.701089593Z [2024-04-12 00:57:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95ae62fa-3261-46cb-ac08-0bf651d8373d] received 2024-04-12T00:57:00.705526562Z [2024-04-12 00:57:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[335f89a5-d53d-4e4a-ac82-5c6fb8d1bcba] received 2024-04-12T00:57:00.706759426Z [2024-04-12 00:57:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dde1bb20-2017-4443-9cc7-da932a984111] received 2024-04-12T00:57:00.712625709Z [2024-04-12 00:57:00,712: INFO/ForkPoolWorker-15] [95ae62fa-3261-46cb-ac08-0bf651d8373d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:57:00.713885019Z [2024-04-12 00:57:00,713: INFO/ForkPoolWorker-16] [335f89a5-d53d-4e4a-ac82-5c6fb8d1bcba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:57:00.720875297Z [2024-04-12 00:57:00,720: INFO/ForkPoolWorker-1] [dde1bb20-2017-4443-9cc7-da932a984111] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:57:00.974830871Z [2024-04-12 00:57:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:57:00.975139156Z [2024-04-12 00:57:00,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:57:01.040495423Z [2024-04-12 00:57:01,036: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:57:01.112386544Z [2024-04-12 00:57:01,111: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:57:01.115950686Z [2024-04-12 00:57:01,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:57:01.141393966Z [2024-04-12 00:57:01,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:57:01.142809106Z [2024-04-12 00:57:01,142: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:57:01.142962632Z [2024-04-12 00:57:01,142: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:57:01.143042493Z [2024-04-12 00:57:01,142: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:57:01.143406160Z [2024-04-12 00:57:01,143: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:57:01.239273930Z [2024-04-12 00:57:01,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:57:01.770733571Z [2024-04-12 00:57:01,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95ae62fa-3261-46cb-ac08-0bf651d8373d] succeeded in 1.0672441480000998s: None 2024-04-12T00:57:02.088848550Z [2024-04-12 00:57:02,088: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:57:02.092403823Z [2024-04-12 00:57:02,091: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:57:02.108712750Z [2024-04-12 00:57:02,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:57:02.109682787Z [2024-04-12 00:57:02,109: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:57:02.109692733Z [2024-04-12 00:57:02,109: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:57:02.109863883Z [2024-04-12 00:57:02,109: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:57:02.109937022Z [2024-04-12 00:57:02,109: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:57:02.110259302Z [2024-04-12 00:57:02,110: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:57:02.110397506Z [2024-04-12 00:57:02,110: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:57:02.186712583Z [2024-04-12 00:57:02,186: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:57:02.217014009Z [2024-04-12 00:57:02,216: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:57:02.220209793Z [2024-04-12 00:57:02,219: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:57:02.240611579Z [2024-04-12 00:57:02,240: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:57:02.241826837Z [2024-04-12 00:57:02,241: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:57:02.241964982Z [2024-04-12 00:57:02,241: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:57:02.242200583Z [2024-04-12 00:57:02,241: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:57:02.242313235Z [2024-04-12 00:57:02,242: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:57:02.242539024Z [2024-04-12 00:57:02,242: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:57:02.242644098Z [2024-04-12 00:57:02,242: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:57:02.311322678Z [2024-04-12 00:57:02,311: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:57:03.929459531Z [2024-04-12 00:57:03,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[335f89a5-d53d-4e4a-ac82-5c6fb8d1bcba] succeeded in 3.2210349119995954s: None 2024-04-12T00:57:04.354943008Z [2024-04-12 00:57:04,354: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dde1bb20-2017-4443-9cc7-da932a984111] succeeded in 3.6405161790007696s: None 2024-04-12T00:58:01.127122323Z [2024-04-12 00:58:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07a4a909-736b-460f-ad0a-dcf8e0d88d79] received 2024-04-12T00:58:01.133296863Z [2024-04-12 00:58:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[212eb899-7991-4337-8446-1aa657229eef] received 2024-04-12T00:58:01.137587830Z [2024-04-12 00:58:01,137: INFO/ForkPoolWorker-15] [07a4a909-736b-460f-ad0a-dcf8e0d88d79] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:58:01.141504384Z [2024-04-12 00:58:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdc03127-c556-4865-b07c-a82183764f06] received 2024-04-12T00:58:01.142928973Z [2024-04-12 00:58:01,142: INFO/ForkPoolWorker-16] [212eb899-7991-4337-8446-1aa657229eef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:58:01.150970848Z [2024-04-12 00:58:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52feced8-8851-4692-abdf-93339dc0baf5] received 2024-04-12T00:58:01.156573064Z [2024-04-12 00:58:01,156: INFO/ForkPoolWorker-1] [cdc03127-c556-4865-b07c-a82183764f06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:58:01.160943612Z [2024-04-12 00:58:01,160: INFO/ForkPoolWorker-2] [52feced8-8851-4692-abdf-93339dc0baf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:58:01.441108294Z [2024-04-12 00:58:01,438: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:58:01.455441415Z [2024-04-12 00:58:01,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T00:58:01.500859687Z [2024-04-12 00:58:01,497: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:58:01.597956701Z [2024-04-12 00:58:01,595: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:58:01.651289225Z [2024-04-12 00:58:01,650: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T00:58:01.654881131Z [2024-04-12 00:58:01,654: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:58:01.720346497Z [2024-04-12 00:58:01,720: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:58:01.726750835Z [2024-04-12 00:58:01,726: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T00:58:01.728442929Z [2024-04-12 00:58:01,728: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:58:01.728677541Z [2024-04-12 00:58:01,728: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:58:01.728862431Z [2024-04-12 00:58:01,728: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T00:58:01.729165233Z [2024-04-12 00:58:01,729: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:58:01.879530407Z [2024-04-12 00:58:01,879: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:58:02.245434642Z [2024-04-12 00:58:02,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07a4a909-736b-460f-ad0a-dcf8e0d88d79] succeeded in 1.1161366600008478s: None 2024-04-12T00:58:02.419416199Z [2024-04-12 00:58:02,418: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[52feced8-8851-4692-abdf-93339dc0baf5] succeeded in 1.2661661620004452s: None 2024-04-12T00:58:02.661769798Z [2024-04-12 00:58:02,661: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:58:02.664635162Z [2024-04-12 00:58:02,664: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:58:02.692010500Z [2024-04-12 00:58:02,691: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:58:02.693185606Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:58:02.693397389Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:58:02.693576125Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:58:02.693748406Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:58:02.693935062Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:58:02.694358913Z [2024-04-12 00:58:02,693: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:58:02.767045146Z [2024-04-12 00:58:02,766: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:58:02.775053273Z [2024-04-12 00:58:02,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:58:02.778305172Z [2024-04-12 00:58:02,777: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:58:02.796487638Z [2024-04-12 00:58:02,796: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:58:02.797652959Z [2024-04-12 00:58:02,797: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:58:02.797778914Z [2024-04-12 00:58:02,797: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:58:02.797964651Z [2024-04-12 00:58:02,797: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:58:02.798069631Z [2024-04-12 00:58:02,797: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:58:02.798345035Z [2024-04-12 00:58:02,798: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:58:02.798465505Z [2024-04-12 00:58:02,798: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:58:02.862414323Z [2024-04-12 00:58:02,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:58:04.669848658Z [2024-04-12 00:58:04,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[212eb899-7991-4337-8446-1aa657229eef] succeeded in 3.5341583530007483s: None 2024-04-12T00:58:05.305195712Z [2024-04-12 00:58:05,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cdc03127-c556-4865-b07c-a82183764f06] succeeded in 4.154954911999084s: None 2024-04-12T00:59:01.103408118Z [2024-04-12 00:59:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802a27cd-943a-40f5-bb93-b563f6c0fe88] received 2024-04-12T00:59:01.109421499Z [2024-04-12 00:59:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[837f88d6-3195-410c-ab39-dae7524e7402] received 2024-04-12T00:59:01.111403267Z [2024-04-12 00:59:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[761e9a1d-565d-4c4b-a704-9721265dd960] received 2024-04-12T00:59:01.117520468Z [2024-04-12 00:59:01,117: INFO/ForkPoolWorker-15] [802a27cd-943a-40f5-bb93-b563f6c0fe88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:59:01.118006250Z [2024-04-12 00:59:01,117: INFO/ForkPoolWorker-1] [761e9a1d-565d-4c4b-a704-9721265dd960] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:59:01.120145933Z [2024-04-12 00:59:01,119: INFO/ForkPoolWorker-16] [837f88d6-3195-410c-ab39-dae7524e7402] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:59:01.392513651Z [2024-04-12 00:59:01,389: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T00:59:01.394189770Z [2024-04-12 00:59:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T00:59:01.401125765Z [2024-04-12 00:59:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T00:59:01.548700744Z [2024-04-12 00:59:01,546: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T00:59:01.552077223Z [2024-04-12 00:59:01,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:59:01.575156321Z [2024-04-12 00:59:01,574: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T00:59:01.576466772Z [2024-04-12 00:59:01,576: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T00:59:01.576668771Z [2024-04-12 00:59:01,576: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T00:59:01.576752338Z [2024-04-12 00:59:01,576: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T00:59:01.577239026Z [2024-04-12 00:59:01,577: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T00:59:01.678065027Z [2024-04-12 00:59:01,677: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:59:02.232771032Z [2024-04-12 00:59:02,232: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[802a27cd-943a-40f5-bb93-b563f6c0fe88] succeeded in 1.1253917739995813s: None 2024-04-12T00:59:02.409402665Z [2024-04-12 00:59:02,409: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T00:59:02.412272971Z [2024-04-12 00:59:02,411: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:59:02.427947120Z [2024-04-12 00:59:02,427: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T00:59:02.429013221Z [2024-04-12 00:59:02,428: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:59:02.429100815Z [2024-04-12 00:59:02,428: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:59:02.429260813Z [2024-04-12 00:59:02,429: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:59:02.429332573Z [2024-04-12 00:59:02,429: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T00:59:02.429576860Z [2024-04-12 00:59:02,429: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T00:59:02.429641034Z [2024-04-12 00:59:02,429: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:59:02.498042347Z [2024-04-12 00:59:02,497: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T00:59:02.498140691Z [2024-04-12 00:59:02,497: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:59:02.501403300Z [2024-04-12 00:59:02,501: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T00:59:02.516450851Z [2024-04-12 00:59:02,516: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T00:59:02.518045399Z [2024-04-12 00:59:02,517: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T00:59:02.518160559Z [2024-04-12 00:59:02,517: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T00:59:02.518350283Z [2024-04-12 00:59:02,518: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T00:59:02.518456134Z [2024-04-12 00:59:02,518: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T00:59:02.518786957Z [2024-04-12 00:59:02,518: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T00:59:02.518912406Z [2024-04-12 00:59:02,518: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T00:59:02.594802273Z [2024-04-12 00:59:02,594: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T00:59:03.939131851Z [2024-04-12 00:59:03,938: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[837f88d6-3195-410c-ab39-dae7524e7402] succeeded in 2.82821072400111s: None 2024-04-12T00:59:04.628262605Z [2024-04-12 00:59:04,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[761e9a1d-565d-4c4b-a704-9721265dd960] succeeded in 3.514596322000216s: None 2024-04-12T01:00:01.047637586Z [2024-04-12 01:00:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8053b77e-69b4-4b39-b992-764cbfe8b69e] received 2024-04-12T01:00:01.053954567Z [2024-04-12 01:00:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54587fb1-0465-4f39-989a-f2262e6b9d8f] received 2024-04-12T01:00:01.058805543Z [2024-04-12 01:00:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1d38c06-6a1b-4bfe-9162-70f8d0df5de9] received 2024-04-12T01:00:01.061679033Z [2024-04-12 01:00:01,061: INFO/ForkPoolWorker-15] [8053b77e-69b4-4b39-b992-764cbfe8b69e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:01.062083440Z [2024-04-12 01:00:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[611cf1fd-e0a1-4d73-a125-28ae7a0dd706] received 2024-04-12T01:00:01.068343680Z [2024-04-12 01:00:01,068: INFO/ForkPoolWorker-1] [d1d38c06-6a1b-4bfe-9162-70f8d0df5de9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:00:01.068757046Z [2024-04-12 01:00:01,068: INFO/ForkPoolWorker-16] [54587fb1-0465-4f39-989a-f2262e6b9d8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:00:01.069247307Z [2024-04-12 01:00:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5404a4b-58a0-4c89-97a1-04d69c6aca71] received 2024-04-12T01:00:01.074153941Z [2024-04-12 01:00:01,073: INFO/ForkPoolWorker-2] [611cf1fd-e0a1-4d73-a125-28ae7a0dd706] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:00:01.087320218Z [2024-04-12 01:00:01,086: INFO/ForkPoolWorker-3] [d5404a4b-58a0-4c89-97a1-04d69c6aca71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:00:01.354244653Z [2024-04-12 01:00:01,351: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:00:01.419971572Z [2024-04-12 01:00:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:00:01.452777606Z [2024-04-12 01:00:01,449: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:00:01.526678940Z [2024-04-12 01:00:01,523: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:00:01.749270612Z [2024-04-12 01:00:01,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:00:01.772249332Z [2024-04-12 01:00:01,771: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:00:01.776535567Z [2024-04-12 01:00:01,775: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:01.794841963Z [2024-04-12 01:00:01,794: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:00:01.796210357Z [2024-04-12 01:00:01,795: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:00:01.796471507Z [2024-04-12 01:00:01,796: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:00:01.796641536Z [2024-04-12 01:00:01,796: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:00:01.796917071Z [2024-04-12 01:00:01,796: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:00:01.886679797Z [2024-04-12 01:00:01,886: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:02.067784094Z [2024-04-12 01:00:02,067: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:02.577515608Z [2024-04-12 01:00:02,577: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[611cf1fd-e0a1-4d73-a125-28ae7a0dd706] succeeded in 1.5134161109999695s: None 2024-04-12T01:00:02.643832156Z [2024-04-12 01:00:02,643: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54587fb1-0465-4f39-989a-f2262e6b9d8f] succeeded in 1.5832442629998695s: None 2024-04-12T01:00:02.857810196Z [2024-04-12 01:00:02,857: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:00:02.860925461Z [2024-04-12 01:00:02,860: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:02.913600978Z [2024-04-12 01:00:02,913: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:00:02.917787456Z [2024-04-12 01:00:02,917: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:02.918229999Z [2024-04-12 01:00:02,917: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:02.918620351Z [2024-04-12 01:00:02,918: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:02.918952448Z [2024-04-12 01:00:02,918: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:00:02.919565408Z [2024-04-12 01:00:02,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:00:02.920114620Z [2024-04-12 01:00:02,919: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:02.938216452Z [2024-04-12 01:00:02,937: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T01:00:02.941188424Z [2024-04-12 01:00:02,940: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:02.971221274Z [2024-04-12 01:00:02,970: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:00:02.972835517Z [2024-04-12 01:00:02,972: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:02.973092648Z [2024-04-12 01:00:02,972: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:02.973311090Z [2024-04-12 01:00:02,973: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:02.973461028Z [2024-04-12 01:00:02,973: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T01:00:02.973903549Z [2024-04-12 01:00:02,973: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:00:02.975761596Z [2024-04-12 01:00:02,975: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:03.001203309Z [2024-04-12 01:00:03,000: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:03.055791666Z [2024-04-12 01:00:03,055: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:03.113792595Z [2024-04-12 01:00:03,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:00:03.116971483Z [2024-04-12 01:00:03,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:03.144090958Z [2024-04-12 01:00:03,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:00:03.147376167Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:03.147434178Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:03.147500864Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:03.147548931Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:00:03.147775963Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:00:03.147832144Z [2024-04-12 01:00:03,147: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:03.242967384Z [2024-04-12 01:00:03,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:03.764531304Z [2024-04-12 01:00:03,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e4370bf-9e8c-4d7f-a71f-bbdb6944967d] received 2024-04-12T01:00:03.781202754Z [2024-04-12 01:00:03,780: INFO/ForkPoolWorker-16] [9e4370bf-9e8c-4d7f-a71f-bbdb6944967d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:03.839235848Z [2024-04-12 01:00:03,838: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8053b77e-69b4-4b39-b992-764cbfe8b69e] succeeded in 2.7900129669997114s: None 2024-04-12T01:00:04.080343975Z [2024-04-12 01:00:04,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:00:04.611431547Z [2024-04-12 01:00:04,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d1d38c06-6a1b-4bfe-9162-70f8d0df5de9] succeeded in 3.5492293749994133s: None 2024-04-12T01:00:04.931934070Z [2024-04-12 01:00:04,931: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d5404a4b-58a0-4c89-97a1-04d69c6aca71] succeeded in 3.859570316999452s: None 2024-04-12T01:00:05.176512299Z [2024-04-12 01:00:05,176: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:00:05.179687522Z [2024-04-12 01:00:05,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:05.199222119Z [2024-04-12 01:00:05,198: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:00:05.201272408Z [2024-04-12 01:00:05,201: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:05.201383628Z [2024-04-12 01:00:05,201: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:05.201593187Z [2024-04-12 01:00:05,201: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:05.201688506Z [2024-04-12 01:00:05,201: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:00:05.202621848Z [2024-04-12 01:00:05,202: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:00:05.202637867Z [2024-04-12 01:00:05,202: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:05.265227491Z [2024-04-12 01:00:05,264: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:05.825948187Z [2024-04-12 01:00:05,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e4370bf-9e8c-4d7f-a71f-bbdb6944967d] succeeded in 2.0570111310007633s: None 2024-04-12T01:00:06.203036025Z [2024-04-12 01:00:06,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa9d5f2-7c42-4829-a670-dde1754ec67b] received 2024-04-12T01:00:06.216962441Z [2024-04-12 01:00:06,216: INFO/ForkPoolWorker-15] [0aa9d5f2-7c42-4829-a670-dde1754ec67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:00:06.478040408Z [2024-04-12 01:00:06,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:00:07.500614120Z [2024-04-12 01:00:07,500: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:00:07.503459241Z [2024-04-12 01:00:07,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:07.528236158Z [2024-04-12 01:00:07,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:00:07.530478782Z [2024-04-12 01:00:07,530: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:07.530631073Z [2024-04-12 01:00:07,530: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:07.531018537Z [2024-04-12 01:00:07,530: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:07.531265695Z [2024-04-12 01:00:07,530: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:00:07.531737768Z [2024-04-12 01:00:07,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:00:07.531953899Z [2024-04-12 01:00:07,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:07.617312999Z [2024-04-12 01:00:07,616: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:08.197762392Z [2024-04-12 01:00:08,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0aa9d5f2-7c42-4829-a670-dde1754ec67b] succeeded in 1.9915165859983972s: None 2024-04-12T01:00:08.929125495Z [2024-04-12 01:00:08,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41a63caf-9b6f-4b82-a8cc-19edea2e62d9] received 2024-04-12T01:00:08.936523505Z [2024-04-12 01:00:08,936: INFO/ForkPoolWorker-15] [41a63caf-9b6f-4b82-a8cc-19edea2e62d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:09.161166974Z [2024-04-12 01:00:09,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:00:10.158097584Z [2024-04-12 01:00:10,157: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:00:10.162001597Z [2024-04-12 01:00:10,161: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:00:10.182012320Z [2024-04-12 01:00:10,181: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:00:10.183703978Z [2024-04-12 01:00:10,183: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:00:10.183976641Z [2024-04-12 01:00:10,183: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:00:10.184183648Z [2024-04-12 01:00:10,183: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:00:10.184301573Z [2024-04-12 01:00:10,184: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:00:10.184671077Z [2024-04-12 01:00:10,184: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:00:10.184758358Z [2024-04-12 01:00:10,184: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:00:10.274867849Z [2024-04-12 01:00:10,274: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:00:10.834161924Z [2024-04-12 01:00:10,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41a63caf-9b6f-4b82-a8cc-19edea2e62d9] succeeded in 1.903274740998313s: None 2024-04-12T01:01:01.063595385Z [2024-04-12 01:01:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[371bc972-c507-43fa-9810-9ded3e38776e] received 2024-04-12T01:01:01.069433588Z [2024-04-12 01:01:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56416991-0985-4d54-938e-d2c0280d3a3d] received 2024-04-12T01:01:01.075732886Z [2024-04-12 01:01:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b71ff42-7f9e-4959-8779-217bc395d779] received 2024-04-12T01:01:01.076478488Z [2024-04-12 01:01:01,076: INFO/ForkPoolWorker-15] [371bc972-c507-43fa-9810-9ded3e38776e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:01:01.076571713Z [2024-04-12 01:01:01,076: INFO/ForkPoolWorker-16] [56416991-0985-4d54-938e-d2c0280d3a3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:01:01.088522737Z [2024-04-12 01:01:01,087: INFO/ForkPoolWorker-1] [2b71ff42-7f9e-4959-8779-217bc395d779] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:01:01.360327417Z [2024-04-12 01:01:01,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:01:01.381919121Z [2024-04-12 01:01:01,378: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:01:01.432246069Z [2024-04-12 01:01:01,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:01:01.588069554Z [2024-04-12 01:01:01,587: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:01:01.591861244Z [2024-04-12 01:01:01,591: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:01:01.618295688Z [2024-04-12 01:01:01,618: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:01:01.620247038Z [2024-04-12 01:01:01,619: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:01:01.620456114Z [2024-04-12 01:01:01,620: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:01:01.620763823Z [2024-04-12 01:01:01,620: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:01:01.621364488Z [2024-04-12 01:01:01,621: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:01:01.734678110Z [2024-04-12 01:01:01,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:01:02.368603572Z [2024-04-12 01:01:02,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[371bc972-c507-43fa-9810-9ded3e38776e] succeeded in 1.302495990999887s: None 2024-04-12T01:01:02.453764956Z [2024-04-12 01:01:02,453: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:01:02.456844463Z [2024-04-12 01:01:02,456: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:01:02.470694806Z [2024-04-12 01:01:02,470: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:01:02.473898381Z [2024-04-12 01:01:02,473: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:01:02.478330471Z [2024-04-12 01:01:02,478: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:01:02.480455445Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:01:02.480492851Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:01:02.480636042Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:01:02.480655830Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:01:02.480914414Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:01:02.480936800Z [2024-04-12 01:01:02,480: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:01:02.498596283Z [2024-04-12 01:01:02,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:01:02.500853855Z [2024-04-12 01:01:02,500: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:01:02.500866559Z [2024-04-12 01:01:02,500: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:01:02.500977050Z [2024-04-12 01:01:02,500: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:01:02.501060521Z [2024-04-12 01:01:02,500: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:01:02.501267858Z [2024-04-12 01:01:02,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:01:02.501334170Z [2024-04-12 01:01:02,501: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:01:02.551208609Z [2024-04-12 01:01:02,550: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:01:02.585179798Z [2024-04-12 01:01:02,584: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:01:04.057251763Z [2024-04-12 01:01:04,056: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56416991-0985-4d54-938e-d2c0280d3a3d] succeeded in 2.9862674350006273s: None 2024-04-12T01:01:04.507641916Z [2024-04-12 01:01:04,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b71ff42-7f9e-4959-8779-217bc395d779] succeeded in 3.427122701999906s: None 2024-04-12T01:02:00.999651549Z [2024-04-12 01:02:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3bef326-ad6c-4cc0-a534-056dbbacff35] received 2024-04-12T01:02:01.004023436Z [2024-04-12 01:02:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb498231-8039-4a75-9b80-09297e2ee610] received 2024-04-12T01:02:01.010986324Z [2024-04-12 01:02:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dabb236a-4f4e-419f-ac73-7cf465a8b13c] received 2024-04-12T01:02:01.011814161Z [2024-04-12 01:02:01,011: INFO/ForkPoolWorker-16] [fb498231-8039-4a75-9b80-09297e2ee610] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:02:01.019817984Z [2024-04-12 01:02:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b506ce0-6fb4-4a6a-93a2-0abf98de3e90] received 2024-04-12T01:02:01.020912378Z [2024-04-12 01:02:01,020: INFO/ForkPoolWorker-1] [dabb236a-4f4e-419f-ac73-7cf465a8b13c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:02:01.021026513Z [2024-04-12 01:02:01,020: INFO/ForkPoolWorker-15] [d3bef326-ad6c-4cc0-a534-056dbbacff35] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:02:01.027525824Z [2024-04-12 01:02:01,027: INFO/ForkPoolWorker-2] [5b506ce0-6fb4-4a6a-93a2-0abf98de3e90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:02:01.339377562Z [2024-04-12 01:02:01,336: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:02:01.394777277Z [2024-04-12 01:02:01,390: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:02:01.431934593Z [2024-04-12 01:02:01,428: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:02:01.446003913Z [2024-04-12 01:02:01,442: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:02:01.567011519Z [2024-04-12 01:02:01,566: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:02:01.571406014Z [2024-04-12 01:02:01,570: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:02:01.596874589Z [2024-04-12 01:02:01,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:02:01.615196059Z [2024-04-12 01:02:01,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:02:01.616420847Z [2024-04-12 01:02:01,616: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:02:01.616626992Z [2024-04-12 01:02:01,616: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:02:01.616747188Z [2024-04-12 01:02:01,616: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:02:01.617019986Z [2024-04-12 01:02:01,616: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:02:01.781926078Z [2024-04-12 01:02:01,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:02:02.194887009Z [2024-04-12 01:02:02,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3bef326-ad6c-4cc0-a534-056dbbacff35] succeeded in 1.1908407430000807s: None 2024-04-12T01:02:02.271993839Z [2024-04-12 01:02:02,271: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dabb236a-4f4e-419f-ac73-7cf465a8b13c] succeeded in 1.2591851479992329s: None 2024-04-12T01:02:02.610704078Z [2024-04-12 01:02:02,610: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:02:02.613721025Z [2024-04-12 01:02:02,613: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:02:02.635509542Z [2024-04-12 01:02:02,635: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:02:02.636744956Z [2024-04-12 01:02:02,636: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:02:02.636789638Z [2024-04-12 01:02:02,636: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:02:02.636906095Z [2024-04-12 01:02:02,636: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:02:02.636959501Z [2024-04-12 01:02:02,636: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:02:02.637175664Z [2024-04-12 01:02:02,636: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:02:02.637277545Z [2024-04-12 01:02:02,637: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:02:02.663851915Z [2024-04-12 01:02:02,663: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:02:02.667057028Z [2024-04-12 01:02:02,666: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:02:02.697336230Z [2024-04-12 01:02:02,697: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:02:02.698780085Z [2024-04-12 01:02:02,698: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:02:02.698805517Z [2024-04-12 01:02:02,698: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:02:02.699016012Z [2024-04-12 01:02:02,698: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:02:02.699135497Z [2024-04-12 01:02:02,698: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:02:02.699529197Z [2024-04-12 01:02:02,699: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:02:02.699606676Z [2024-04-12 01:02:02,699: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:02:02.721634275Z [2024-04-12 01:02:02,721: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:02:02.776021893Z [2024-04-12 01:02:02,775: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:02:04.244206564Z [2024-04-12 01:02:04,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb498231-8039-4a75-9b80-09297e2ee610] succeeded in 3.2385198669999227s: None 2024-04-12T01:02:04.689717628Z [2024-04-12 01:02:04,689: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5b506ce0-6fb4-4a6a-93a2-0abf98de3e90] succeeded in 3.6681973689992446s: None 2024-04-12T01:03:00.400917294Z [2024-04-12 01:03:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b82daf9-602c-4e37-b2df-7090f8b1eebe] received 2024-04-12T01:03:00.405910594Z [2024-04-12 01:03:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2f19b8f-735e-4928-9eb6-e32636184b60] received 2024-04-12T01:03:00.407564905Z [2024-04-12 01:03:00,406: INFO/ForkPoolWorker-15] [3b82daf9-602c-4e37-b2df-7090f8b1eebe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:03:00.416580272Z [2024-04-12 01:03:00,416: INFO/ForkPoolWorker-16] [d2f19b8f-735e-4928-9eb6-e32636184b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:03:00.416895376Z [2024-04-12 01:03:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4b10f9e-99c2-49ea-af9f-b0b7253df43b] received 2024-04-12T01:03:00.424571300Z [2024-04-12 01:03:00,423: INFO/ForkPoolWorker-1] [f4b10f9e-99c2-49ea-af9f-b0b7253df43b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:03:00.660318865Z [2024-04-12 01:03:00,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:03:00.661717694Z [2024-04-12 01:03:00,659: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:03:00.706451950Z [2024-04-12 01:03:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:03:00.786269640Z [2024-04-12 01:03:00,785: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:03:00.789440389Z [2024-04-12 01:03:00,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:03:00.825490710Z [2024-04-12 01:03:00,825: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:03:00.829001912Z [2024-04-12 01:03:00,828: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:03:00.829099222Z [2024-04-12 01:03:00,828: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:03:00.829110896Z [2024-04-12 01:03:00,828: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:03:00.829257339Z [2024-04-12 01:03:00,829: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:03:00.896811105Z [2024-04-12 01:03:00,896: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:03:01.416174398Z [2024-04-12 01:03:01,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2f19b8f-735e-4928-9eb6-e32636184b60] succeeded in 1.0062820019993524s: None 2024-04-12T01:03:01.685597861Z [2024-04-12 01:03:01,684: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:03:01.687343271Z [2024-04-12 01:03:01,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:03:01.749226693Z [2024-04-12 01:03:01,749: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:03:01.750383657Z [2024-04-12 01:03:01,750: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:03:01.750546228Z [2024-04-12 01:03:01,750: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:03:01.750730563Z [2024-04-12 01:03:01,750: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:03:01.750830505Z [2024-04-12 01:03:01,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:03:01.751522957Z [2024-04-12 01:03:01,751: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:03:01.751594619Z [2024-04-12 01:03:01,751: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:03:01.771851884Z [2024-04-12 01:03:01,771: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:03:01.774808542Z [2024-04-12 01:03:01,774: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:03:01.803038974Z [2024-04-12 01:03:01,802: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:03:01.804823716Z [2024-04-12 01:03:01,804: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:03:01.804862064Z [2024-04-12 01:03:01,804: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:03:01.805065958Z [2024-04-12 01:03:01,804: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:03:01.805111094Z [2024-04-12 01:03:01,805: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:03:01.805451624Z [2024-04-12 01:03:01,805: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:03:01.805685651Z [2024-04-12 01:03:01,805: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:03:01.824295712Z [2024-04-12 01:03:01,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:03:01.884593202Z [2024-04-12 01:03:01,884: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:03:03.226638159Z [2024-04-12 01:03:03,226: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b82daf9-602c-4e37-b2df-7090f8b1eebe] succeeded in 2.8241010990004725s: None 2024-04-12T01:03:03.637557385Z [2024-04-12 01:03:03,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4b10f9e-99c2-49ea-af9f-b0b7253df43b] succeeded in 3.218329625999104s: None 2024-04-12T01:04:00.793307364Z [2024-04-12 01:04:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25385cf7-cfbd-423e-b3ab-24881618ffc0] received 2024-04-12T01:04:00.795881047Z [2024-04-12 01:04:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30e053af-2272-4b64-b7e9-a7d335527f82] received 2024-04-12T01:04:00.807095259Z [2024-04-12 01:04:00,806: INFO/ForkPoolWorker-15] [25385cf7-cfbd-423e-b3ab-24881618ffc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:04:00.810477718Z [2024-04-12 01:04:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dbe238f-5f6d-4ede-b48c-e951322355ec] received 2024-04-12T01:04:00.811645366Z [2024-04-12 01:04:00,811: INFO/ForkPoolWorker-16] [30e053af-2272-4b64-b7e9-a7d335527f82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:04:00.821224923Z [2024-04-12 01:04:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abe8ed69-c5a2-4bc5-bd04-e546494ddbc9] received 2024-04-12T01:04:00.842132324Z [2024-04-12 01:04:00,841: INFO/ForkPoolWorker-1] [8dbe238f-5f6d-4ede-b48c-e951322355ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:04:00.845864958Z [2024-04-12 01:04:00,841: INFO/ForkPoolWorker-2] [abe8ed69-c5a2-4bc5-bd04-e546494ddbc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:04:01.137113053Z [2024-04-12 01:04:01,134: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:04:01.165726626Z [2024-04-12 01:04:01,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:04:01.174866735Z [2024-04-12 01:04:01,167: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:04:01.245761300Z [2024-04-12 01:04:01,242: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:04:01.333778933Z [2024-04-12 01:04:01,333: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:04:01.338055249Z [2024-04-12 01:04:01,337: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:04:01.364990174Z [2024-04-12 01:04:01,364: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:04:01.366159530Z [2024-04-12 01:04:01,365: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:04:01.366387851Z [2024-04-12 01:04:01,366: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:04:01.366536909Z [2024-04-12 01:04:01,366: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:04:01.366818247Z [2024-04-12 01:04:01,366: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:04:01.404722126Z [2024-04-12 01:04:01,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:04:01.505216712Z [2024-04-12 01:04:01,504: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:04:01.965880347Z [2024-04-12 01:04:01,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25385cf7-cfbd-423e-b3ab-24881618ffc0] succeeded in 1.1684024250007496s: None 2024-04-12T01:04:02.043876603Z [2024-04-12 01:04:02,043: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30e053af-2272-4b64-b7e9-a7d335527f82] succeeded in 1.2386835029992653s: None 2024-04-12T01:04:02.532259957Z [2024-04-12 01:04:02,531: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:04:02.535651606Z [2024-04-12 01:04:02,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:04:02.549248738Z [2024-04-12 01:04:02,548: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:04:02.552556382Z [2024-04-12 01:04:02,551: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:04:02.558856054Z [2024-04-12 01:04:02,558: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:04:02.561490208Z [2024-04-12 01:04:02,561: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:04:02.561673399Z [2024-04-12 01:04:02,561: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:04:02.561883631Z [2024-04-12 01:04:02,561: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:04:02.562067710Z [2024-04-12 01:04:02,561: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:04:02.562392626Z [2024-04-12 01:04:02,562: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:04:02.562972140Z [2024-04-12 01:04:02,562: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:04:02.571047157Z [2024-04-12 01:04:02,570: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:04:02.572267103Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:04:02.572320863Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:04:02.572531299Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:04:02.572585367Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:04:02.572786473Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:04:02.572850693Z [2024-04-12 01:04:02,572: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:04:02.638961141Z [2024-04-12 01:04:02,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:04:02.653873122Z [2024-04-12 01:04:02,653: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:04:04.375576391Z [2024-04-12 01:04:04,374: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[abe8ed69-c5a2-4bc5-bd04-e546494ddbc9] succeeded in 3.5500218359993596s: None 2024-04-12T01:04:05.133031955Z [2024-04-12 01:04:05,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8dbe238f-5f6d-4ede-b48c-e951322355ec] succeeded in 4.314974849999999s: None 2024-04-12T01:05:00.484056599Z [2024-04-12 01:05:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bda42d0-df33-402c-afb9-ba0885e8de9f] received 2024-04-12T01:05:00.489900785Z [2024-04-12 01:05:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[316eed2b-209f-4a5a-9397-5e9761a14172] received 2024-04-12T01:05:00.492636546Z [2024-04-12 01:05:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd88cb5-51d5-493d-95b7-bde0384db3b3] received 2024-04-12T01:05:00.499493738Z [2024-04-12 01:05:00,498: INFO/ForkPoolWorker-16] [316eed2b-209f-4a5a-9397-5e9761a14172] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:05:00.500085352Z [2024-04-12 01:05:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18a81403-9079-4e2e-bac0-6ac715fbd7d9] received 2024-04-12T01:05:00.500636132Z [2024-04-12 01:05:00,500: INFO/ForkPoolWorker-15] [5bda42d0-df33-402c-afb9-ba0885e8de9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:00.504912611Z [2024-04-12 01:05:00,504: INFO/ForkPoolWorker-1] [8bd88cb5-51d5-493d-95b7-bde0384db3b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:05:00.509544147Z [2024-04-12 01:05:00,509: INFO/ForkPoolWorker-2] [18a81403-9079-4e2e-bac0-6ac715fbd7d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:05:00.818515420Z [2024-04-12 01:05:00,814: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:05:00.846309385Z [2024-04-12 01:05:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:05:01.130163747Z [2024-04-12 01:05:01,127: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:05:01.233454491Z [2024-04-12 01:05:01,223: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:05:01.272934966Z [2024-04-12 01:05:01,272: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:05:01.276574498Z [2024-04-12 01:05:01,276: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:01.325120993Z [2024-04-12 01:05:01,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:05:01.326541221Z [2024-04-12 01:05:01,326: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:05:01.326672344Z [2024-04-12 01:05:01,326: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:05:01.326803547Z [2024-04-12 01:05:01,326: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:05:01.327057885Z [2024-04-12 01:05:01,326: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:05:01.435375528Z [2024-04-12 01:05:01,435: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:02.260963807Z [2024-04-12 01:05:02,260: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[316eed2b-209f-4a5a-9397-5e9761a14172] succeeded in 1.7671910179997212s: None 2024-04-12T01:05:02.275281989Z [2024-04-12 01:05:02,274: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:05:02.279077033Z [2024-04-12 01:05:02,278: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:02.309902175Z [2024-04-12 01:05:02,309: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:05:02.311291557Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:02.311335694Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:02.311488032Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:02.311557041Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:05:02.311953293Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:05:02.312111073Z [2024-04-12 01:05:02,311: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:02.391904439Z [2024-04-12 01:05:02,391: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:02.474534739Z [2024-04-12 01:05:02,472: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:05:02.477276474Z [2024-04-12 01:05:02,476: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:02.497530737Z [2024-04-12 01:05:02,497: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:05:02.498644978Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:02.498673166Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:02.498774281Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:02.498800931Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:05:02.498956898Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:05:02.498982466Z [2024-04-12 01:05:02,498: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:02.587138659Z [2024-04-12 01:05:02,586: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:02.766075960Z [2024-04-12 01:05:02,765: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:05:02.770929943Z [2024-04-12 01:05:02,770: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:02.805340287Z [2024-04-12 01:05:02,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:05:02.808753827Z [2024-04-12 01:05:02,808: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:02.809004397Z [2024-04-12 01:05:02,808: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:02.809187438Z [2024-04-12 01:05:02,809: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:02.809330249Z [2024-04-12 01:05:02,809: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:05:02.809584562Z [2024-04-12 01:05:02,809: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:05:02.809759843Z [2024-04-12 01:05:02,809: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:02.883273498Z [2024-04-12 01:05:02,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:03.478248743Z [2024-04-12 01:05:03,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bda42d0-df33-402c-afb9-ba0885e8de9f] succeeded in 2.988818682000783s: None 2024-04-12T01:05:03.511071700Z [2024-04-12 01:05:03,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[576ee761-30cf-41e7-80ff-7056f1ea309e] received 2024-04-12T01:05:03.518742316Z [2024-04-12 01:05:03,518: INFO/ForkPoolWorker-15] [576ee761-30cf-41e7-80ff-7056f1ea309e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:03.769092523Z [2024-04-12 01:05:03,766: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:05:04.160152739Z [2024-04-12 01:05:04,159: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bd88cb5-51d5-493d-95b7-bde0384db3b3] succeeded in 3.665983879000123s: None 2024-04-12T01:05:04.216659750Z [2024-04-12 01:05:04,216: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[18a81403-9079-4e2e-bac0-6ac715fbd7d9] succeeded in 3.71454939600153s: None 2024-04-12T01:05:04.805835292Z [2024-04-12 01:05:04,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:05:04.808887869Z [2024-04-12 01:05:04,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:04.832596396Z [2024-04-12 01:05:04,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:05:04.833870483Z [2024-04-12 01:05:04,833: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:04.834003523Z [2024-04-12 01:05:04,833: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:04.834213331Z [2024-04-12 01:05:04,833: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:04.834312216Z [2024-04-12 01:05:04,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:05:04.834615974Z [2024-04-12 01:05:04,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:05:04.834735957Z [2024-04-12 01:05:04,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:04.913627282Z [2024-04-12 01:05:04,913: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:05.577502899Z [2024-04-12 01:05:05,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[576ee761-30cf-41e7-80ff-7056f1ea309e] succeeded in 2.062679967999429s: None 2024-04-12T01:05:06.606342599Z [2024-04-12 01:05:06,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[747e70b0-2661-49ce-8695-7ec0cf4b1b74] received 2024-04-12T01:05:06.617848450Z [2024-04-12 01:05:06,617: INFO/ForkPoolWorker-15] [747e70b0-2661-49ce-8695-7ec0cf4b1b74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:05:06.864993482Z [2024-04-12 01:05:06,861: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:05:07.966493110Z [2024-04-12 01:05:07,966: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:05:07.970022341Z [2024-04-12 01:05:07,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:07.990275053Z [2024-04-12 01:05:07,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:05:07.992755709Z [2024-04-12 01:05:07,992: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:07.992908136Z [2024-04-12 01:05:07,992: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:07.993216692Z [2024-04-12 01:05:07,992: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:07.993344418Z [2024-04-12 01:05:07,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:05:07.993904323Z [2024-04-12 01:05:07,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:05:07.993912811Z [2024-04-12 01:05:07,993: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:08.090510113Z [2024-04-12 01:05:08,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:08.658741469Z [2024-04-12 01:05:08,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[747e70b0-2661-49ce-8695-7ec0cf4b1b74] succeeded in 2.0493256589998055s: None 2024-04-12T01:05:09.058289055Z [2024-04-12 01:05:09,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4750043c-5764-4e2f-9040-df7f95310dbc] received 2024-04-12T01:05:09.066638856Z [2024-04-12 01:05:09,066: INFO/ForkPoolWorker-15] [4750043c-5764-4e2f-9040-df7f95310dbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:09.327920512Z [2024-04-12 01:05:09,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:05:10.304202241Z [2024-04-12 01:05:10,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:05:10.306990780Z [2024-04-12 01:05:10,306: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:05:10.329152362Z [2024-04-12 01:05:10,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:05:10.331898575Z [2024-04-12 01:05:10,331: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:05:10.332071697Z [2024-04-12 01:05:10,331: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:05:10.332287528Z [2024-04-12 01:05:10,332: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:05:10.332442099Z [2024-04-12 01:05:10,332: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:05:10.332757786Z [2024-04-12 01:05:10,332: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:05:10.332905438Z [2024-04-12 01:05:10,332: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:05:10.406406136Z [2024-04-12 01:05:10,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:05:11.016502775Z [2024-04-12 01:05:11,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4750043c-5764-4e2f-9040-df7f95310dbc] succeeded in 1.9561675700006163s: None 2024-04-12T01:06:00.525256169Z [2024-04-12 01:06:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[098b6e0a-9280-4971-a17e-4e65304e1d06] received 2024-04-12T01:06:00.526911385Z [2024-04-12 01:06:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a237944b-700c-4527-a552-2533adc4148c] received 2024-04-12T01:06:00.537385590Z [2024-04-12 01:06:00,536: INFO/ForkPoolWorker-15] [098b6e0a-9280-4971-a17e-4e65304e1d06] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:06:00.538606452Z [2024-04-12 01:06:00,538: INFO/ForkPoolWorker-16] [a237944b-700c-4527-a552-2533adc4148c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:06:00.539258179Z [2024-04-12 01:06:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac0a819f-0e0c-4095-952a-6be9d3ad9095] received 2024-04-12T01:06:00.547348292Z [2024-04-12 01:06:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4d75ff7-d805-4cbe-8c26-4cc5eaaf67d6] received 2024-04-12T01:06:00.555322866Z [2024-04-12 01:06:00,555: INFO/ForkPoolWorker-1] [ac0a819f-0e0c-4095-952a-6be9d3ad9095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:06:00.561998458Z [2024-04-12 01:06:00,561: INFO/ForkPoolWorker-2] [a4d75ff7-d805-4cbe-8c26-4cc5eaaf67d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:06:00.832031473Z [2024-04-12 01:06:00,829: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:06:00.833842362Z [2024-04-12 01:06:00,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:06:00.842336590Z [2024-04-12 01:06:00,838: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:06:00.915492085Z [2024-04-12 01:06:00,912: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:06:00.978788375Z [2024-04-12 01:06:00,978: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:06:00.982217429Z [2024-04-12 01:06:00,981: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:06:01.014638475Z [2024-04-12 01:06:01,014: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:06:01.016205443Z [2024-04-12 01:06:01,015: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:06:01.016740934Z [2024-04-12 01:06:01,016: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:06:01.016895751Z [2024-04-12 01:06:01,016: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:06:01.017165400Z [2024-04-12 01:06:01,017: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:06:01.093837049Z [2024-04-12 01:06:01,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:06:01.138681933Z [2024-04-12 01:06:01,138: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:06:01.681306427Z [2024-04-12 01:06:01,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[098b6e0a-9280-4971-a17e-4e65304e1d06] succeeded in 1.1542307840009016s: None 2024-04-12T01:06:01.796091566Z [2024-04-12 01:06:01,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a237944b-700c-4527-a552-2533adc4148c] succeeded in 1.2677018699996552s: None 2024-04-12T01:06:01.938299740Z [2024-04-12 01:06:01,937: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:06:01.941701739Z [2024-04-12 01:06:01,941: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:06:01.965363139Z [2024-04-12 01:06:01,965: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:06:01.966778471Z [2024-04-12 01:06:01,966: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:06:01.966800581Z [2024-04-12 01:06:01,966: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:06:01.967089759Z [2024-04-12 01:06:01,966: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:06:01.967263141Z [2024-04-12 01:06:01,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:06:01.967858023Z [2024-04-12 01:06:01,967: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:06:01.967933721Z [2024-04-12 01:06:01,967: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:06:02.061612209Z [2024-04-12 01:06:02,061: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:06:02.219081757Z [2024-04-12 01:06:02,218: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:06:02.222055619Z [2024-04-12 01:06:02,221: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:06:02.242535521Z [2024-04-12 01:06:02,242: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:06:02.243989597Z [2024-04-12 01:06:02,243: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:06:02.244119403Z [2024-04-12 01:06:02,243: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:06:02.244326350Z [2024-04-12 01:06:02,244: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:06:02.244483951Z [2024-04-12 01:06:02,244: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:06:02.244785581Z [2024-04-12 01:06:02,244: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:06:02.244929795Z [2024-04-12 01:06:02,244: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:06:02.333393458Z [2024-04-12 01:06:02,333: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:06:03.438777459Z [2024-04-12 01:06:03,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac0a819f-0e0c-4095-952a-6be9d3ad9095] succeeded in 2.8977451699993253s: None 2024-04-12T01:06:04.120593860Z [2024-04-12 01:06:04,120: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4d75ff7-d805-4cbe-8c26-4cc5eaaf67d6] succeeded in 3.5640443120009877s: None 2024-04-12T01:07:01.120956000Z [2024-04-12 01:07:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86854b43-551b-437f-93a5-0ae9a1a41099] received 2024-04-12T01:07:01.123146138Z [2024-04-12 01:07:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32fa6b2a-93af-4070-be11-37ca7e85f54b] received 2024-04-12T01:07:01.129693602Z [2024-04-12 01:07:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b4f87bf-5cbd-494a-9277-29d73bc08e87] received 2024-04-12T01:07:01.132138288Z [2024-04-12 01:07:01,131: INFO/ForkPoolWorker-16] [32fa6b2a-93af-4070-be11-37ca7e85f54b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:07:01.137298755Z [2024-04-12 01:07:01,136: INFO/ForkPoolWorker-15] [86854b43-551b-437f-93a5-0ae9a1a41099] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:07:01.148309700Z [2024-04-12 01:07:01,147: INFO/ForkPoolWorker-1] [6b4f87bf-5cbd-494a-9277-29d73bc08e87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:07:01.411995836Z [2024-04-12 01:07:01,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:07:01.453602323Z [2024-04-12 01:07:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:07:01.467721244Z [2024-04-12 01:07:01,463: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:07:01.641999552Z [2024-04-12 01:07:01,641: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:07:01.645995703Z [2024-04-12 01:07:01,645: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:07:01.717125893Z [2024-04-12 01:07:01,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:07:01.724490015Z [2024-04-12 01:07:01,720: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:07:01.724505331Z [2024-04-12 01:07:01,720: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:07:01.724509403Z [2024-04-12 01:07:01,720: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:07:01.724512404Z [2024-04-12 01:07:01,721: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:07:01.845903581Z [2024-04-12 01:07:01,845: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:07:02.390715747Z [2024-04-12 01:07:02,390: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32fa6b2a-93af-4070-be11-37ca7e85f54b] succeeded in 1.2663993500009383s: None 2024-04-12T01:07:02.472003290Z [2024-04-12 01:07:02,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:07:02.474838562Z [2024-04-12 01:07:02,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:07:02.495868361Z [2024-04-12 01:07:02,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:07:02.497450426Z [2024-04-12 01:07:02,497: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:07:02.497839651Z [2024-04-12 01:07:02,497: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:07:02.498072586Z [2024-04-12 01:07:02,497: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:07:02.498255957Z [2024-04-12 01:07:02,498: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:07:02.498668727Z [2024-04-12 01:07:02,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:07:02.498825688Z [2024-04-12 01:07:02,498: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:07:02.553670375Z [2024-04-12 01:07:02,553: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:07:02.556242542Z [2024-04-12 01:07:02,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:07:02.587361994Z [2024-04-12 01:07:02,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:07:02.597355697Z [2024-04-12 01:07:02,597: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:07:02.598579741Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:07:02.598621652Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:07:02.598692094Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:07:02.598725372Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:07:02.598920088Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:07:02.598954952Z [2024-04-12 01:07:02,598: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:07:02.727832484Z [2024-04-12 01:07:02,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:07:04.352501657Z [2024-04-12 01:07:04,351: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86854b43-551b-437f-93a5-0ae9a1a41099] succeeded in 3.2274794789991574s: None 2024-04-12T01:07:05.335178076Z [2024-04-12 01:07:05,334: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b4f87bf-5cbd-494a-9277-29d73bc08e87] succeeded in 4.203418117000183s: None 2024-04-12T01:08:00.455534082Z [2024-04-12 01:08:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6be285a9-68df-4062-afaa-90475624be7c] received 2024-04-12T01:08:00.458313413Z [2024-04-12 01:08:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af497616-6b9c-46d4-9e5f-cf0e4bed8756] received 2024-04-12T01:08:00.461781724Z [2024-04-12 01:08:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac4e8e64-0e0c-459c-91e7-28de7ca4761d] received 2024-04-12T01:08:00.464364639Z [2024-04-12 01:08:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69ba1957-00e9-42fa-827a-8984fa1e2fe6] received 2024-04-12T01:08:00.468183144Z [2024-04-12 01:08:00,467: INFO/ForkPoolWorker-16] [af497616-6b9c-46d4-9e5f-cf0e4bed8756] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:08:00.472057864Z [2024-04-12 01:08:00,471: INFO/ForkPoolWorker-15] [6be285a9-68df-4062-afaa-90475624be7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:08:00.473197342Z [2024-04-12 01:08:00,472: INFO/ForkPoolWorker-1] [ac4e8e64-0e0c-459c-91e7-28de7ca4761d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:08:00.475045915Z [2024-04-12 01:08:00,474: INFO/ForkPoolWorker-2] [69ba1957-00e9-42fa-827a-8984fa1e2fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:08:00.725742073Z [2024-04-12 01:08:00,722: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:08:00.740055901Z [2024-04-12 01:08:00,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:08:00.828081137Z [2024-04-12 01:08:00,825: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:08:00.863968219Z [2024-04-12 01:08:00,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:08:00.889616692Z [2024-04-12 01:08:00,889: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:08:00.895233745Z [2024-04-12 01:08:00,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:08:00.920061091Z [2024-04-12 01:08:00,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:08:00.921116634Z [2024-04-12 01:08:00,920: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:08:00.921219688Z [2024-04-12 01:08:00,921: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:08:00.921280599Z [2024-04-12 01:08:00,921: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:08:00.921447213Z [2024-04-12 01:08:00,921: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:08:00.984579326Z [2024-04-12 01:08:00,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:08:01.012832824Z [2024-04-12 01:08:01,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:08:01.415700285Z [2024-04-12 01:08:01,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6be285a9-68df-4062-afaa-90475624be7c] succeeded in 0.9580040749988257s: None 2024-04-12T01:08:01.585905231Z [2024-04-12 01:08:01,585: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af497616-6b9c-46d4-9e5f-cf0e4bed8756] succeeded in 1.126025646999551s: None 2024-04-12T01:08:01.908366870Z [2024-04-12 01:08:01,908: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:08:01.911288841Z [2024-04-12 01:08:01,910: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:08:01.933252152Z [2024-04-12 01:08:01,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:08:01.933276936Z [2024-04-12 01:08:01,932: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:08:01.933282338Z [2024-04-12 01:08:01,932: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:08:01.933292362Z [2024-04-12 01:08:01,932: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:08:01.933298247Z [2024-04-12 01:08:01,932: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:08:01.933302975Z [2024-04-12 01:08:01,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:08:01.933307951Z [2024-04-12 01:08:01,933: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:08:01.934256863Z [2024-04-12 01:08:01,933: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:08:01.937988383Z [2024-04-12 01:08:01,937: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:08:01.961282324Z [2024-04-12 01:08:01,961: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:08:01.963614918Z [2024-04-12 01:08:01,963: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:08:01.963790114Z [2024-04-12 01:08:01,963: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:08:01.964001806Z [2024-04-12 01:08:01,963: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:08:01.964211145Z [2024-04-12 01:08:01,963: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:08:01.964552728Z [2024-04-12 01:08:01,964: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:08:01.964680124Z [2024-04-12 01:08:01,964: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:08:01.998610782Z [2024-04-12 01:08:01,998: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:08:02.058398608Z [2024-04-12 01:08:02,057: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:08:03.365640614Z [2024-04-12 01:08:03,364: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac4e8e64-0e0c-459c-91e7-28de7ca4761d] succeeded in 2.9014485870011413s: None 2024-04-12T01:08:03.884153030Z [2024-04-12 01:08:03,883: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69ba1957-00e9-42fa-827a-8984fa1e2fe6] succeeded in 3.4175717340003757s: None 2024-04-12T01:09:00.933758055Z [2024-04-12 01:09:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd35f3c0-f705-4781-a39c-b5ca1837652c] received 2024-04-12T01:09:00.939786672Z [2024-04-12 01:09:00,939: INFO/ForkPoolWorker-15] [cd35f3c0-f705-4781-a39c-b5ca1837652c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:09:00.942591855Z [2024-04-12 01:09:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93387c39-310e-4edb-9107-6a676cc3f28b] received 2024-04-12T01:09:00.944003337Z [2024-04-12 01:09:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1250cbd-fbc5-4402-b167-7978843f796f] received 2024-04-12T01:09:00.952836706Z [2024-04-12 01:09:00,952: INFO/ForkPoolWorker-16] [93387c39-310e-4edb-9107-6a676cc3f28b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:09:00.953929069Z [2024-04-12 01:09:00,953: INFO/ForkPoolWorker-1] [e1250cbd-fbc5-4402-b167-7978843f796f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:09:01.191012092Z [2024-04-12 01:09:01,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:09:01.217112460Z [2024-04-12 01:09:01,213: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:09:01.229450964Z [2024-04-12 01:09:01,226: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:09:01.349867626Z [2024-04-12 01:09:01,349: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:09:01.353392773Z [2024-04-12 01:09:01,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:09:01.373594386Z [2024-04-12 01:09:01,373: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:09:01.374556051Z [2024-04-12 01:09:01,374: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:09:01.374676900Z [2024-04-12 01:09:01,374: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:09:01.374747596Z [2024-04-12 01:09:01,374: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:09:01.375209627Z [2024-04-12 01:09:01,375: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:09:01.455902609Z [2024-04-12 01:09:01,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:09:02.007005457Z [2024-04-12 01:09:02,006: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93387c39-310e-4edb-9107-6a676cc3f28b] succeeded in 1.0605346169995755s: None 2024-04-12T01:09:02.216678827Z [2024-04-12 01:09:02,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:09:02.220503065Z [2024-04-12 01:09:02,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:09:02.250980901Z [2024-04-12 01:09:02,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:09:02.252126463Z [2024-04-12 01:09:02,251: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:09:02.252209201Z [2024-04-12 01:09:02,252: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:09:02.252345527Z [2024-04-12 01:09:02,252: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:09:02.252472600Z [2024-04-12 01:09:02,252: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:09:02.253167542Z [2024-04-12 01:09:02,253: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:09:02.253242962Z [2024-04-12 01:09:02,253: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:09:02.331757207Z [2024-04-12 01:09:02,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:09:02.393755535Z [2024-04-12 01:09:02,393: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:09:02.396788270Z [2024-04-12 01:09:02,396: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:09:02.418908691Z [2024-04-12 01:09:02,418: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:09:02.420334911Z [2024-04-12 01:09:02,420: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:09:02.420481696Z [2024-04-12 01:09:02,420: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:09:02.420671309Z [2024-04-12 01:09:02,420: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:09:02.420754051Z [2024-04-12 01:09:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:09:02.421090489Z [2024-04-12 01:09:02,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:09:02.421185674Z [2024-04-12 01:09:02,421: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:09:02.497211217Z [2024-04-12 01:09:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:09:04.290906262Z [2024-04-12 01:09:04,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd35f3c0-f705-4781-a39c-b5ca1837652c] succeeded in 3.3554148059993167s: None 2024-04-12T01:09:05.008248175Z [2024-04-12 01:09:05,007: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1250cbd-fbc5-4402-b167-7978843f796f] succeeded in 4.059775903000627s: None 2024-04-12T01:09:38.614130685Z [2024-04-12 01:09:38,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48adbb5d-4951-4772-8d56-02980f79b841] received 2024-04-12T01:09:38.628448558Z [2024-04-12 01:09:38,628: INFO/ForkPoolWorker-15] [48adbb5d-4951-4772-8d56-02980f79b841] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240412010937_060190', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-12T01:09:38.920520206Z [2024-04-12 01:09:38,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-12T01:09:39.197727024Z [2024-04-12 01:09:39,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:09:39.832836784Z [2024-04-12 01:09:39,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48adbb5d-4951-4772-8d56-02980f79b841] succeeded in 1.2115165639988845s: None 2024-04-12T01:10:00.991718873Z [2024-04-12 01:10:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a3ab2d4-3116-4c14-bb65-05462624d502] received 2024-04-12T01:10:00.994387434Z [2024-04-12 01:10:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3629e9c-c027-4c78-8a07-06e89dd02ee9] received 2024-04-12T01:10:00.999872246Z [2024-04-12 01:10:00,999: INFO/ForkPoolWorker-15] [1a3ab2d4-3116-4c14-bb65-05462624d502] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:01.003007101Z [2024-04-12 01:10:01,002: INFO/ForkPoolWorker-16] [b3629e9c-c027-4c78-8a07-06e89dd02ee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:10:01.004920217Z [2024-04-12 01:10:01,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34daa642-d722-492d-917b-da9aadf3a42e] received 2024-04-12T01:10:01.012183080Z [2024-04-12 01:10:01,011: INFO/ForkPoolWorker-1] [34daa642-d722-492d-917b-da9aadf3a42e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:10:01.013649436Z [2024-04-12 01:10:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b51ceea4-3b95-4a4d-b093-c83dd10df92f] received 2024-04-12T01:10:01.016991575Z [2024-04-12 01:10:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5037846-88c5-4ef7-8747-97f7565f1d40] received 2024-04-12T01:10:01.025650952Z [2024-04-12 01:10:01,025: INFO/ForkPoolWorker-3] [b5037846-88c5-4ef7-8747-97f7565f1d40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:10:01.034637673Z [2024-04-12 01:10:01,034: INFO/ForkPoolWorker-2] [b51ceea4-3b95-4a4d-b093-c83dd10df92f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:10:01.344487148Z [2024-04-12 01:10:01,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:10:01.382659119Z [2024-04-12 01:10:01,379: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:10:01.399914696Z [2024-04-12 01:10:01,396: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:10:01.413249213Z [2024-04-12 01:10:01,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:10:01.519140871Z [2024-04-12 01:10:01,515: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:10:01.531653231Z [2024-04-12 01:10:01,531: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T01:10:01.535267248Z [2024-04-12 01:10:01,534: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:01.558813046Z [2024-04-12 01:10:01,558: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:10:01.559691242Z [2024-04-12 01:10:01,559: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:10:01.560167379Z [2024-04-12 01:10:01,560: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:10:01.562485530Z [2024-04-12 01:10:01,562: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T01:10:01.563022466Z [2024-04-12 01:10:01,562: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:10:01.768504017Z [2024-04-12 01:10:01,768: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:01.833863687Z [2024-04-12 01:10:01,833: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:02.318395102Z [2024-04-12 01:10:02,318: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b5037846-88c5-4ef7-8747-97f7565f1d40] succeeded in 1.299654255999485s: None 2024-04-12T01:10:02.386505491Z [2024-04-12 01:10:02,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3629e9c-c027-4c78-8a07-06e89dd02ee9] succeeded in 1.3905011450005986s: None 2024-04-12T01:10:02.693507207Z [2024-04-12 01:10:02,693: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:10:02.696544475Z [2024-04-12 01:10:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:02.717467075Z [2024-04-12 01:10:02,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:10:02.720191881Z [2024-04-12 01:10:02,719: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:02.720456024Z [2024-04-12 01:10:02,720: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:02.720766962Z [2024-04-12 01:10:02,720: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:02.721008821Z [2024-04-12 01:10:02,720: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:10:02.721455862Z [2024-04-12 01:10:02,721: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:10:02.721653464Z [2024-04-12 01:10:02,721: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:02.828239724Z [2024-04-12 01:10:02,827: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:02.832916860Z [2024-04-12 01:10:02,832: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:10:02.835975240Z [2024-04-12 01:10:02,835: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:02.865613512Z [2024-04-12 01:10:02,865: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:10:02.867832232Z [2024-04-12 01:10:02,867: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:02.867962087Z [2024-04-12 01:10:02,867: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:02.868204377Z [2024-04-12 01:10:02,868: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:02.868427775Z [2024-04-12 01:10:02,868: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:10:02.868760099Z [2024-04-12 01:10:02,868: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:10:02.869003341Z [2024-04-12 01:10:02,868: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:02.905125619Z [2024-04-12 01:10:02,904: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:10:02.907888753Z [2024-04-12 01:10:02,907: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:02.925856321Z [2024-04-12 01:10:02,925: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:10:02.926923560Z [2024-04-12 01:10:02,926: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:02.926957165Z [2024-04-12 01:10:02,926: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:02.927166863Z [2024-04-12 01:10:02,926: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:02.927219971Z [2024-04-12 01:10:02,927: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:10:02.927452168Z [2024-04-12 01:10:02,927: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:10:02.927502375Z [2024-04-12 01:10:02,927: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:02.952113298Z [2024-04-12 01:10:02,951: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:03.015727549Z [2024-04-12 01:10:03,015: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:03.386406860Z [2024-04-12 01:10:03,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a3ab2d4-3116-4c14-bb65-05462624d502] succeeded in 2.393029935001323s: None 2024-04-12T01:10:04.137726736Z [2024-04-12 01:10:04,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac03ffc6-450a-47a0-a640-b3d1879c3606] received 2024-04-12T01:10:04.145553744Z [2024-04-12 01:10:04,145: INFO/ForkPoolWorker-15] [ac03ffc6-450a-47a0-a640-b3d1879c3606] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:04.422996758Z [2024-04-12 01:10:04,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:10:04.583237757Z [2024-04-12 01:10:04,582: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b51ceea4-3b95-4a4d-b093-c83dd10df92f] succeeded in 3.5633140320005623s: None 2024-04-12T01:10:04.961380373Z [2024-04-12 01:10:04,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34daa642-d722-492d-917b-da9aadf3a42e] succeeded in 3.954510825999023s: None 2024-04-12T01:10:05.377654066Z [2024-04-12 01:10:05,377: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:10:05.380351479Z [2024-04-12 01:10:05,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:05.399112310Z [2024-04-12 01:10:05,398: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:10:05.400476433Z [2024-04-12 01:10:05,400: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:05.400631856Z [2024-04-12 01:10:05,400: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:05.400894955Z [2024-04-12 01:10:05,400: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:05.400923554Z [2024-04-12 01:10:05,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:10:05.401308731Z [2024-04-12 01:10:05,401: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:10:05.401323041Z [2024-04-12 01:10:05,401: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:05.483176190Z [2024-04-12 01:10:05,482: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:06.049543898Z [2024-04-12 01:10:06,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd1bf8a8-6483-4d70-9eea-58d35dcd707d] received 2024-04-12T01:10:06.059399686Z [2024-04-12 01:10:06,059: INFO/ForkPoolWorker-16] [dd1bf8a8-6483-4d70-9eea-58d35dcd707d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:10:06.095623251Z [2024-04-12 01:10:06,095: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac03ffc6-450a-47a0-a640-b3d1879c3606] succeeded in 1.9562560569993366s: None 2024-04-12T01:10:06.320759703Z [2024-04-12 01:10:06,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:10:07.339017250Z [2024-04-12 01:10:07,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:10:07.342106167Z [2024-04-12 01:10:07,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:07.364021710Z [2024-04-12 01:10:07,363: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:10:07.366052152Z [2024-04-12 01:10:07,365: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:07.366260988Z [2024-04-12 01:10:07,366: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:07.366539029Z [2024-04-12 01:10:07,366: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:07.366746561Z [2024-04-12 01:10:07,366: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:10:07.367161607Z [2024-04-12 01:10:07,366: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:10:07.367354346Z [2024-04-12 01:10:07,367: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:07.471035275Z [2024-04-12 01:10:07,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:08.075534244Z [2024-04-12 01:10:08,074: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd1bf8a8-6483-4d70-9eea-58d35dcd707d] succeeded in 2.0233542089990806s: None 2024-04-12T01:10:08.403743407Z [2024-04-12 01:10:08,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98b65ad1-cb47-4bf9-bbd3-e29376df128f] received 2024-04-12T01:10:08.416759288Z [2024-04-12 01:10:08,416: INFO/ForkPoolWorker-15] [98b65ad1-cb47-4bf9-bbd3-e29376df128f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:08.682655925Z [2024-04-12 01:10:08,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:10:09.635553892Z [2024-04-12 01:10:09,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:10:09.638296751Z [2024-04-12 01:10:09,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:10:09.658895695Z [2024-04-12 01:10:09,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:10:09.660205973Z [2024-04-12 01:10:09,659: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:10:09.660272007Z [2024-04-12 01:10:09,660: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:10:09.660562920Z [2024-04-12 01:10:09,660: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:10:09.660673380Z [2024-04-12 01:10:09,660: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:10:09.660992157Z [2024-04-12 01:10:09,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:10:09.661010398Z [2024-04-12 01:10:09,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:10:09.727229728Z [2024-04-12 01:10:09,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:10:10.339355910Z [2024-04-12 01:10:10,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98b65ad1-cb47-4bf9-bbd3-e29376df128f] succeeded in 1.9317213449994597s: None 2024-04-12T01:11:00.347141294Z [2024-04-12 01:11:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d82d99f0-4ee5-4ff4-919b-a84bc4627248] received 2024-04-12T01:11:00.349184395Z [2024-04-12 01:11:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62f7ea9b-a77f-40b7-b881-ea0c2a07ba5e] received 2024-04-12T01:11:00.350843234Z [2024-04-12 01:11:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca38d14-1753-45fb-b75a-58bd91d9e1df] received 2024-04-12T01:11:00.357335479Z [2024-04-12 01:11:00,357: INFO/ForkPoolWorker-1] [1ca38d14-1753-45fb-b75a-58bd91d9e1df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:11:00.358101036Z [2024-04-12 01:11:00,357: INFO/ForkPoolWorker-16] [62f7ea9b-a77f-40b7-b881-ea0c2a07ba5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:11:00.362431616Z [2024-04-12 01:11:00,362: INFO/ForkPoolWorker-15] [d82d99f0-4ee5-4ff4-919b-a84bc4627248] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:11:00.633758874Z [2024-04-12 01:11:00,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:11:00.644897549Z [2024-04-12 01:11:00,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:11:00.659123744Z [2024-04-12 01:11:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:11:00.780323775Z [2024-04-12 01:11:00,779: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:11:00.783702423Z [2024-04-12 01:11:00,783: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:00.808736302Z [2024-04-12 01:11:00,808: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:11:00.809926947Z [2024-04-12 01:11:00,809: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:11:00.810139527Z [2024-04-12 01:11:00,809: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:11:00.810255455Z [2024-04-12 01:11:00,810: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:11:00.810615343Z [2024-04-12 01:11:00,810: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:11:00.901548650Z [2024-04-12 01:11:00,901: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:01.492101558Z [2024-04-12 01:11:01,491: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d82d99f0-4ee5-4ff4-919b-a84bc4627248] succeeded in 1.1415310059983312s: None 2024-04-12T01:11:01.595859753Z [2024-04-12 01:11:01,595: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:11:01.598952270Z [2024-04-12 01:11:01,598: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:01.620924898Z [2024-04-12 01:11:01,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:11:01.622174841Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:01.622256358Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:01.622426801Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:11:01.622482650Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:11:01.622722377Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:11:01.622988005Z [2024-04-12 01:11:01,622: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:01.676506064Z [2024-04-12 01:11:01,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:11:01.676527959Z [2024-04-12 01:11:01,675: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:01.722209068Z [2024-04-12 01:11:01,720: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:11:01.728197167Z [2024-04-12 01:11:01,724: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:01.728213434Z [2024-04-12 01:11:01,725: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:01.728229560Z [2024-04-12 01:11:01,727: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:11:01.728234077Z [2024-04-12 01:11:01,727: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:11:01.728237621Z [2024-04-12 01:11:01,727: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:11:01.728561329Z [2024-04-12 01:11:01,728: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:01.745767040Z [2024-04-12 01:11:01,745: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:01.809163046Z [2024-04-12 01:11:01,808: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:03.180579722Z [2024-04-12 01:11:03,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[62f7ea9b-a77f-40b7-b881-ea0c2a07ba5e] succeeded in 2.829622018000009s: None 2024-04-12T01:11:03.450260316Z [2024-04-12 01:11:03,449: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1ca38d14-1753-45fb-b75a-58bd91d9e1df] succeeded in 3.0981644820003567s: None 2024-04-12T01:11:20.112775440Z [2024-04-12 01:11:20,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[053a986b-f8f4-4775-9ba8-8f9a771ffe40] received 2024-04-12T01:11:20.124786760Z [2024-04-12 01:11:20,123: INFO/ForkPoolWorker-15] [053a986b-f8f4-4775-9ba8-8f9a771ffe40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:11:20.298709507Z [2024-04-12 01:11:20,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46f8920f-4260-430b-a01c-56a9cfc08afa] received 2024-04-12T01:11:20.315887957Z [2024-04-12 01:11:20,315: INFO/ForkPoolWorker-16] [46f8920f-4260-430b-a01c-56a9cfc08afa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:11:20.403913579Z [2024-04-12 01:11:20,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:11:20.593016260Z [2024-04-12 01:11:20,589: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:11:21.418384047Z [2024-04-12 01:11:21,418: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:11:21.421491844Z [2024-04-12 01:11:21,421: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:21.442826422Z [2024-04-12 01:11:21,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:11:21.443893214Z [2024-04-12 01:11:21,443: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:21.443928158Z [2024-04-12 01:11:21,443: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:21.444012046Z [2024-04-12 01:11:21,443: INFO/ForkPoolWorker-15] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:21.444237222Z [2024-04-12 01:11:21,444: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:21.444456271Z [2024-04-12 01:11:21,444: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:11:21.444942748Z [2024-04-12 01:11:21,444: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:11:21.444995595Z [2024-04-12 01:11:21,444: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:21.448922936Z [2024-04-12 01:11:21,448: INFO/ForkPoolWorker-15] Creating DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:21.518336415Z [2024-04-12 01:11:21,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:21.601541543Z [2024-04-12 01:11:21,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:11:21.605180318Z [2024-04-12 01:11:21,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:21.623092731Z [2024-04-12 01:11:21,622: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:11:21.624278504Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:21.624424812Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:21.624565083Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:21.624721572Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:21.624798177Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:11:21.625007629Z [2024-04-12 01:11:21,624: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:11:21.625100137Z [2024-04-12 01:11:21,625: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:21.629189741Z [2024-04-12 01:11:21,629: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:21.750549043Z [2024-04-12 01:11:21,750: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:23.085170885Z [2024-04-12 01:11:23,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[053a986b-f8f4-4775-9ba8-8f9a771ffe40] succeeded in 2.9703347019985813s: None 2024-04-12T01:11:23.559719380Z [2024-04-12 01:11:23,559: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46f8920f-4260-430b-a01c-56a9cfc08afa] succeeded in 3.258699981999598s: None 2024-04-12T01:11:24.478121186Z [2024-04-12 01:11:24,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed262e3b-17b8-403b-8541-44b261284d23] received 2024-04-12T01:11:24.489512448Z [2024-04-12 01:11:24,489: INFO/ForkPoolWorker-15] [ed262e3b-17b8-403b-8541-44b261284d23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:24.727227113Z [2024-04-12 01:11:24,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:11:25.650773547Z [2024-04-12 01:11:25,650: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:11:25.653612196Z [2024-04-12 01:11:25,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:25.678781607Z [2024-04-12 01:11:25,678: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:11:25.680334278Z [2024-04-12 01:11:25,680: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:25.680349109Z [2024-04-12 01:11:25,680: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:25.680558677Z [2024-04-12 01:11:25,680: INFO/ForkPoolWorker-15] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:25.680874375Z [2024-04-12 01:11:25,680: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:25.680927889Z [2024-04-12 01:11:25,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:11:25.681495238Z [2024-04-12 01:11:25,681: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:11:25.681639115Z [2024-04-12 01:11:25,681: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:25.687744560Z [2024-04-12 01:11:25,687: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:25.772864267Z [2024-04-12 01:11:25,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:26.384482247Z [2024-04-12 01:11:26,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed262e3b-17b8-403b-8541-44b261284d23] succeeded in 1.9035818850006763s: None 2024-04-12T01:11:27.176484146Z [2024-04-12 01:11:27,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f32b416-de1f-48aa-b0ec-648fbbc3e600] received 2024-04-12T01:11:27.182661537Z [2024-04-12 01:11:27,182: INFO/ForkPoolWorker-15] [4f32b416-de1f-48aa-b0ec-648fbbc3e600] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'split_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:27.422516296Z [2024-04-12 01:11:27,418: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:11:28.471648093Z [2024-04-12 01:11:28,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:11:28.474533588Z [2024-04-12 01:11:28,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:28.497562717Z [2024-04-12 01:11:28,497: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:11:28.498799307Z [2024-04-12 01:11:28,498: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:28.498819476Z [2024-04-12 01:11:28,498: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:28.498859699Z [2024-04-12 01:11:28,498: INFO/ForkPoolWorker-15] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:28.498995530Z [2024-04-12 01:11:28,498: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:28.499028152Z [2024-04-12 01:11:28,498: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:11:28.499241621Z [2024-04-12 01:11:28,499: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:11:28.499352350Z [2024-04-12 01:11:28,499: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:28.505349495Z [2024-04-12 01:11:28,505: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:28.560906289Z [2024-04-12 01:11:28,560: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:29.073317105Z [2024-04-12 01:11:29,072: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f32b416-de1f-48aa-b0ec-648fbbc3e600] succeeded in 1.8991712050010392s: None 2024-04-12T01:11:29.245340344Z [2024-04-12 01:11:29,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2091d140-ab67-4897-8304-75ddf0483362] received 2024-04-12T01:11:29.260223442Z [2024-04-12 01:11:29,259: INFO/ForkPoolWorker-15] [2091d140-ab67-4897-8304-75ddf0483362] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'collect_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:11:29.526700928Z [2024-04-12 01:11:29,523: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:11:30.579339203Z [2024-04-12 01:11:30,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:11:30.582344475Z [2024-04-12 01:11:30,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:30.602400539Z [2024-04-12 01:11:30,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:11:30.603674665Z [2024-04-12 01:11:30,603: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:30.603819611Z [2024-04-12 01:11:30,603: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:30.603840485Z [2024-04-12 01:11:30,603: INFO/ForkPoolWorker-15] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:30.604168546Z [2024-04-12 01:11:30,603: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:30.604181261Z [2024-04-12 01:11:30,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:11:30.604564354Z [2024-04-12 01:11:30,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:11:30.604581321Z [2024-04-12 01:11:30,604: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:30.610935479Z [2024-04-12 01:11:30,610: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:30.699571706Z [2024-04-12 01:11:30,699: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:31.183200190Z [2024-04-12 01:11:31,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fee1ae1-8e56-4f0c-b24d-d61152af9c6e] received 2024-04-12T01:11:31.192450613Z [2024-04-12 01:11:31,191: INFO/ForkPoolWorker-16] [9fee1ae1-8e56-4f0c-b24d-d61152af9c6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'send_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:31.209310157Z [2024-04-12 01:11:31,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2091d140-ab67-4897-8304-75ddf0483362] succeeded in 1.9562863999999536s: None 2024-04-12T01:11:31.462367655Z [2024-04-12 01:11:31,459: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:11:32.559811033Z [2024-04-12 01:11:32,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:11:32.562913810Z [2024-04-12 01:11:32,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:11:32.584636528Z [2024-04-12 01:11:32,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:11:32.585992978Z [2024-04-12 01:11:32,585: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:11:32.586035959Z [2024-04-12 01:11:32,585: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:11:32.586052443Z [2024-04-12 01:11:32,585: INFO/ForkPoolWorker-16] Read VIM f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 (basic01_968636) 2024-04-12T01:11:32.586314894Z [2024-04-12 01:11:32,586: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'name': 'basic01_968636', 'vim_type': 'openstack'}] 2024-04-12T01:11:32.586328748Z [2024-04-12 01:11:32,586: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:11:32.586658542Z [2024-04-12 01:11:32,586: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:11:32.586744312Z [2024-04-12 01:11:32,586: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:11:32.592662004Z [2024-04-12 01:11:32,592: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 2024-04-12T01:11:32.672672023Z [2024-04-12 01:11:32,672: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:33.237934541Z [2024-04-12 01:11:33,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fee1ae1-8e56-4f0c-b24d-d61152af9c6e] succeeded in 2.0513790610002616s: None 2024-04-12T01:11:38.481315971Z [2024-04-12 01:11:38,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3279cde1-1984-4100-be7e-16d05070f23f] received 2024-04-12T01:11:38.492466086Z [2024-04-12 01:11:38,491: INFO/ForkPoolWorker-15] [3279cde1-1984-4100-be7e-16d05070f23f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240412011137_289887', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-12T01:11:38.741346301Z [2024-04-12 01:11:38,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-12T01:11:39.042694229Z [2024-04-12 01:11:39,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:11:39.653774841Z [2024-04-12 01:11:39,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3279cde1-1984-4100-be7e-16d05070f23f] succeeded in 1.1701559040011489s: None 2024-04-12T01:12:00.673619183Z [2024-04-12 01:12:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a881d14-c86d-4ff1-93c8-823c087fd1dc] received 2024-04-12T01:12:00.679419401Z [2024-04-12 01:12:00,679: INFO/ForkPoolWorker-15] [3a881d14-c86d-4ff1-93c8-823c087fd1dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:12:00.680749929Z [2024-04-12 01:12:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[297dcdb4-0b87-4c46-91ed-82ddf7a2e6d0] received 2024-04-12T01:12:00.683067270Z [2024-04-12 01:12:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03b9a6c8-f186-46ce-b549-a5133328738c] received 2024-04-12T01:12:00.688331434Z [2024-04-12 01:12:00,688: INFO/ForkPoolWorker-16] [297dcdb4-0b87-4c46-91ed-82ddf7a2e6d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:00.695353720Z [2024-04-12 01:12:00,695: INFO/ForkPoolWorker-1] [03b9a6c8-f186-46ce-b549-a5133328738c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:00.700806543Z [2024-04-12 01:12:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e9115f8-b5c0-4ca8-80bf-d316582cbad7] received 2024-04-12T01:12:00.704645804Z [2024-04-12 01:12:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c629dede-c5fb-471b-9b48-e86185292888] received 2024-04-12T01:12:00.708824156Z [2024-04-12 01:12:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[141097a2-fc6a-461a-b1a8-e382cf9392ef] received 2024-04-12T01:12:00.709440733Z [2024-04-12 01:12:00,709: INFO/ForkPoolWorker-2] [8e9115f8-b5c0-4ca8-80bf-d316582cbad7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:00.712230823Z [2024-04-12 01:12:00,711: INFO/ForkPoolWorker-3] [c629dede-c5fb-471b-9b48-e86185292888] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:12:00.731427250Z [2024-04-12 01:12:00,731: INFO/ForkPoolWorker-4] [141097a2-fc6a-461a-b1a8-e382cf9392ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:01.027062642Z [2024-04-12 01:12:01,023: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:01.054565734Z [2024-04-12 01:12:01,050: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:12:01.100703551Z [2024-04-12 01:12:01,081: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:12:01.166329706Z [2024-04-12 01:12:01,163: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:01.183998655Z [2024-04-12 01:12:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:01.210750457Z [2024-04-12 01:12:01,210: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T01:12:01.214285587Z [2024-04-12 01:12:01,213: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:01.245558626Z [2024-04-12 01:12:01,245: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:12:01.250017244Z [2024-04-12 01:12:01,249: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:12:01.250134459Z [2024-04-12 01:12:01,249: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:12:01.250183022Z [2024-04-12 01:12:01,250: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T01:12:01.250378836Z [2024-04-12 01:12:01,250: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:12:01.369205534Z [2024-04-12 01:12:01,368: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:12:01.412405081Z [2024-04-12 01:12:01,401: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:01.525264634Z [2024-04-12 01:12:01,525: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:12:02.106187466Z [2024-04-12 01:12:02,105: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c629dede-c5fb-471b-9b48-e86185292888] succeeded in 1.4001830160013924s: None 2024-04-12T01:12:02.312718975Z [2024-04-12 01:12:02,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a881d14-c86d-4ff1-93c8-823c087fd1dc] succeeded in 1.637845011000536s: None 2024-04-12T01:12:02.520105522Z [2024-04-12 01:12:02,519: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:12:02.522863694Z [2024-04-12 01:12:02,522: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.541579700Z [2024-04-12 01:12:02,541: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:12:02.553545037Z [2024-04-12 01:12:02,552: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.562187319Z [2024-04-12 01:12:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:12:02.565729007Z [2024-04-12 01:12:02,565: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.570521348Z [2024-04-12 01:12:02,570: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:12:02.572191921Z [2024-04-12 01:12:02,571: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.572334920Z [2024-04-12 01:12:02,572: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.572540660Z [2024-04-12 01:12:02,572: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.572636558Z [2024-04-12 01:12:02,572: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:12:02.572884435Z [2024-04-12 01:12:02,572: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:12:02.572980744Z [2024-04-12 01:12:02,572: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.578743885Z [2024-04-12 01:12:02,578: WARNING/ForkPoolWorker-2] Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:02.579814815Z [2024-04-12 01:12:02,578: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:02.580689576Z [2024-04-12 01:12:02,580: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:12:02.582939998Z [2024-04-12 01:12:02,582: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.590907352Z [2024-04-12 01:12:02,590: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:12:02.591866411Z [2024-04-12 01:12:02,591: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.591947946Z [2024-04-12 01:12:02,591: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.592189665Z [2024-04-12 01:12:02,591: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.592220519Z [2024-04-12 01:12:02,592: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:12:02.592593157Z [2024-04-12 01:12:02,592: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:12:02.592669308Z [2024-04-12 01:12:02,592: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.606735313Z [2024-04-12 01:12:02,606: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:12:02.608186116Z [2024-04-12 01:12:02,607: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.608204198Z [2024-04-12 01:12:02,608: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.608456963Z [2024-04-12 01:12:02,608: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.610376908Z [2024-04-12 01:12:02,608: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:12:02.611266222Z [2024-04-12 01:12:02,611: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:12:02.614175527Z [2024-04-12 01:12:02,611: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.617059259Z [2024-04-12 01:12:02,616: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:12:02.619101498Z [2024-04-12 01:12:02,618: ERROR/ForkPoolWorker-2] [8e9115f8-b5c0-4ca8-80bf-d316582cbad7] Failed to execute task Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:12:02.619111863Z Traceback (most recent call last): 2024-04-12T01:12:02.619115821Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:12:02.619119099Z args.func(args) 2024-04-12T01:12:02.619122896Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:12:02.619126760Z return func(*args, **kwargs) 2024-04-12T01:12:02.619129784Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:12:02.619132480Z return f(*args, **kwargs) 2024-04-12T01:12:02.619135174Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:12:02.619138128Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:12:02.619140975Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:12:02.619143653Z raise AirflowException( 2024-04-12T01:12:02.619147022Z airflow.exceptions.AirflowException: Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:12:02.621283336Z [2024-04-12 01:12:02,620: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.622514096Z [2024-04-12 01:12:02,622: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.622678574Z [2024-04-12 01:12:02,622: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.622797951Z [2024-04-12 01:12:02,622: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:12:02.623043347Z [2024-04-12 01:12:02,622: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:12:02.623135195Z [2024-04-12 01:12:02,623: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.658630193Z [2024-04-12 01:12:02,658: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e9115f8-b5c0-4ca8-80bf-d316582cbad7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8e9115f8-b5c0-4ca8-80bf-d316582cbad7') 2024-04-12T01:12:02.658644169Z Traceback (most recent call last): 2024-04-12T01:12:02.658648016Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:12:02.658651083Z R = retval = fun(*args, **kwargs) 2024-04-12T01:12:02.658654061Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:12:02.658657091Z return self.run(*args, **kwargs) 2024-04-12T01:12:02.658661159Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:12:02.658664756Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:12:02.658668030Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:12:02.658671719Z raise AirflowException(msg) 2024-04-12T01:12:02.658694754Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8e9115f8-b5c0-4ca8-80bf-d316582cbad7 2024-04-12T01:12:02.660945024Z [2024-04-12 01:12:02,660: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:12:02.706993473Z [2024-04-12 01:12:02,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:12:02.911230636Z [2024-04-12 01:12:02,910: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-12T01:12:02.914218746Z [2024-04-12 01:12:02,913: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.939618027Z [2024-04-12 01:12:02,939: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-12T01:12:02.940590462Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.940644405Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.940810222Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.940851318Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-12T01:12:02.941043247Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:12:02.941084419Z [2024-04-12 01:12:02,940: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.946444213Z [2024-04-12 01:12:02,946: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:02.947067937Z [2024-04-12 01:12:02,946: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:02.947773615Z [2024-04-12 01:12:02,947: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-12T01:12:02.950155694Z [2024-04-12 01:12:02,949: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:02.966676813Z [2024-04-12 01:12:02,966: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-12T01:12:02.968073297Z [2024-04-12 01:12:02,967: INFO/ForkPoolWorker-4] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:02.968154156Z [2024-04-12 01:12:02,967: INFO/ForkPoolWorker-4] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:02.968294507Z [2024-04-12 01:12:02,968: INFO/ForkPoolWorker-4] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:02.968346893Z [2024-04-12 01:12:02,968: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-12T01:12:02.968603970Z [2024-04-12 01:12:02,968: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:12:02.970641670Z [2024-04-12 01:12:02,968: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:02.974057402Z [2024-04-12 01:12:02,973: ERROR/ForkPoolWorker-4] [141097a2-fc6a-461a-b1a8-e382cf9392ef] Failed to execute task Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:12:02.974066617Z Traceback (most recent call last): 2024-04-12T01:12:02.974070547Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:12:02.974074306Z args.func(args) 2024-04-12T01:12:02.974078243Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:12:02.974082050Z return func(*args, **kwargs) 2024-04-12T01:12:02.974085167Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:12:02.974088241Z return f(*args, **kwargs) 2024-04-12T01:12:02.974091312Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:12:02.974094489Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:12:02.974109671Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:12:02.974112782Z raise AirflowException( 2024-04-12T01:12:02.974116503Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:12:03.004589768Z [2024-04-12 01:12:03,003: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[141097a2-fc6a-461a-b1a8-e382cf9392ef] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 141097a2-fc6a-461a-b1a8-e382cf9392ef') 2024-04-12T01:12:03.004607317Z Traceback (most recent call last): 2024-04-12T01:12:03.004611881Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:12:03.004615241Z R = retval = fun(*args, **kwargs) 2024-04-12T01:12:03.004618523Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:12:03.004622314Z return self.run(*args, **kwargs) 2024-04-12T01:12:03.004626324Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:12:03.004630631Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:12:03.004633865Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:12:03.004638741Z raise AirflowException(msg) 2024-04-12T01:12:03.004643037Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 141097a2-fc6a-461a-b1a8-e382cf9392ef 2024-04-12T01:12:04.195431804Z [2024-04-12 01:12:04,194: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03b9a6c8-f186-46ce-b549-a5133328738c] succeeded in 3.5101672879991384s: None 2024-04-12T01:12:04.563396154Z [2024-04-12 01:12:04,562: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[297dcdb4-0b87-4c46-91ed-82ddf7a2e6d0] succeeded in 3.8807123879996652s: None 2024-04-12T01:12:14.570374722Z [2024-04-12 01:12:14,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[417c9c43-6618-4ad1-a32c-e4cf1e52eca3] received 2024-04-12T01:12:14.577022246Z [2024-04-12 01:12:14,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdded477-3f8f-471d-8cdf-38afd815b72f] received 2024-04-12T01:12:14.582472433Z [2024-04-12 01:12:14,582: INFO/ForkPoolWorker-15] [417c9c43-6618-4ad1-a32c-e4cf1e52eca3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:14.585472583Z [2024-04-12 01:12:14,585: INFO/ForkPoolWorker-16] [cdded477-3f8f-471d-8cdf-38afd815b72f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:14.838211350Z [2024-04-12 01:12:14,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:14.838419029Z [2024-04-12 01:12:14,835: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:15.870113244Z [2024-04-12 01:12:15,869: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:12:15.873398940Z [2024-04-12 01:12:15,873: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:15.895823980Z [2024-04-12 01:12:15,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:12:15.897192547Z [2024-04-12 01:12:15,896: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:15.897311930Z [2024-04-12 01:12:15,897: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:15.897512273Z [2024-04-12 01:12:15,897: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:15.897634927Z [2024-04-12 01:12:15,897: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:12:15.899551566Z [2024-04-12 01:12:15,899: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:12:15.899659281Z [2024-04-12 01:12:15,899: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:15.900682173Z [2024-04-12 01:12:15,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:12:15.903444913Z [2024-04-12 01:12:15,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:15.907066839Z [2024-04-12 01:12:15,906: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:15.907807374Z [2024-04-12 01:12:15,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:12:15.908606240Z [2024-04-12 01:12:15,908: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:12:15.911553286Z [2024-04-12 01:12:15,911: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:15.918905745Z [2024-04-12 01:12:15,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:12:15.920734354Z [2024-04-12 01:12:15,920: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:15.920906495Z [2024-04-12 01:12:15,920: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:15.921137752Z [2024-04-12 01:12:15,920: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:15.921450299Z [2024-04-12 01:12:15,921: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:12:15.921806525Z [2024-04-12 01:12:15,921: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:12:15.921983174Z [2024-04-12 01:12:15,921: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:15.923130814Z [2024-04-12 01:12:15,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:12:15.925326845Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:15.925367042Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:15.925499242Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:15.925550502Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:12:15.925780528Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:12:15.925839995Z [2024-04-12 01:12:15,925: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:15.927931982Z [2024-04-12 01:12:15,927: WARNING/ForkPoolWorker-15] Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:15.928678013Z [2024-04-12 01:12:15,928: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:12:15.929494333Z [2024-04-12 01:12:15,929: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:12:15.929930799Z [2024-04-12 01:12:15,929: ERROR/ForkPoolWorker-16] [cdded477-3f8f-471d-8cdf-38afd815b72f] Failed to execute task Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:12:15.929939471Z Traceback (most recent call last): 2024-04-12T01:12:15.929943298Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:12:15.929947141Z args.func(args) 2024-04-12T01:12:15.929950382Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:12:15.929953923Z return func(*args, **kwargs) 2024-04-12T01:12:15.929956834Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:12:15.929962373Z return f(*args, **kwargs) 2024-04-12T01:12:15.929965722Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:12:15.929968577Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:12:15.929971455Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:12:15.929974340Z raise AirflowException( 2024-04-12T01:12:15.929977637Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:12:15.932107715Z [2024-04-12 01:12:15,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:12:15.942454078Z [2024-04-12 01:12:15,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:12:15.943475812Z [2024-04-12 01:12:15,943: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:12:15.943651288Z [2024-04-12 01:12:15,943: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:12:15.943863781Z [2024-04-12 01:12:15,943: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:12:15.944006926Z [2024-04-12 01:12:15,943: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:12:15.944334524Z [2024-04-12 01:12:15,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:12:15.944678927Z [2024-04-12 01:12:15,944: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:12:15.947374879Z [2024-04-12 01:12:15,946: ERROR/ForkPoolWorker-15] [417c9c43-6618-4ad1-a32c-e4cf1e52eca3] Failed to execute task Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:12:15.947384928Z Traceback (most recent call last): 2024-04-12T01:12:15.947388498Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:12:15.947391845Z args.func(args) 2024-04-12T01:12:15.947394832Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:12:15.947397902Z return func(*args, **kwargs) 2024-04-12T01:12:15.947400560Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:12:15.947403486Z return f(*args, **kwargs) 2024-04-12T01:12:15.947406049Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:12:15.947408628Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:12:15.947411286Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:12:15.947413862Z raise AirflowException( 2024-04-12T01:12:15.947417001Z airflow.exceptions.AirflowException: Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:12:15.970353477Z [2024-04-12 01:12:15,969: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cdded477-3f8f-471d-8cdf-38afd815b72f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cdded477-3f8f-471d-8cdf-38afd815b72f') 2024-04-12T01:12:15.970369685Z Traceback (most recent call last): 2024-04-12T01:12:15.970374944Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:12:15.970379296Z R = retval = fun(*args, **kwargs) 2024-04-12T01:12:15.970383488Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:12:15.970387759Z return self.run(*args, **kwargs) 2024-04-12T01:12:15.970392695Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:12:15.970397504Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:12:15.970401679Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:12:15.970407027Z raise AirflowException(msg) 2024-04-12T01:12:15.970412406Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cdded477-3f8f-471d-8cdf-38afd815b72f 2024-04-12T01:12:15.975712118Z [2024-04-12 01:12:15,975: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[417c9c43-6618-4ad1-a32c-e4cf1e52eca3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 417c9c43-6618-4ad1-a32c-e4cf1e52eca3') 2024-04-12T01:12:15.975745018Z Traceback (most recent call last): 2024-04-12T01:12:15.975750988Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:12:15.975755681Z R = retval = fun(*args, **kwargs) 2024-04-12T01:12:15.975760276Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:12:15.975764766Z return self.run(*args, **kwargs) 2024-04-12T01:12:15.975769872Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:12:15.975775540Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:12:15.975780202Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:12:15.975790363Z raise AirflowException(msg) 2024-04-12T01:12:15.975795571Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 417c9c43-6618-4ad1-a32c-e4cf1e52eca3 2024-04-12T01:13:00.977988776Z [2024-04-12 01:13:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67c6a86a-505d-4c67-ae18-56466175c671] received 2024-04-12T01:13:00.983360369Z [2024-04-12 01:13:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3eec745c-8c0c-4b99-ba35-4657f849de1c] received 2024-04-12T01:13:00.989624534Z [2024-04-12 01:13:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d] received 2024-04-12T01:13:00.990952454Z [2024-04-12 01:13:00,990: INFO/ForkPoolWorker-16] [3eec745c-8c0c-4b99-ba35-4657f849de1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:00.993091652Z [2024-04-12 01:13:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d2c3f5c-e972-4c3d-8cdb-17bd6183f876] received 2024-04-12T01:13:00.994701862Z [2024-04-12 01:13:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9d3c8d6-52c4-4c82-95d3-8ffdd3227c17] received 2024-04-12T01:13:01.005125795Z [2024-04-12 01:13:01,004: INFO/ForkPoolWorker-1] [d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:01.009473598Z [2024-04-12 01:13:01,009: INFO/ForkPoolWorker-15] [67c6a86a-505d-4c67-ae18-56466175c671] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:01.010604891Z [2024-04-12 01:13:01,009: INFO/ForkPoolWorker-2] [6d2c3f5c-e972-4c3d-8cdb-17bd6183f876] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:01.010785188Z [2024-04-12 01:13:01,010: INFO/ForkPoolWorker-3] [f9d3c8d6-52c4-4c82-95d3-8ffdd3227c17] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:13:01.321584907Z [2024-04-12 01:13:01,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:01.360167797Z [2024-04-12 01:13:01,353: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:13:01.386750255Z [2024-04-12 01:13:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:01.396338984Z [2024-04-12 01:13:01,393: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:01.446638464Z [2024-04-12 01:13:01,443: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:01.581365653Z [2024-04-12 01:13:01,580: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T01:13:01.584959014Z [2024-04-12 01:13:01,584: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:01.609151035Z [2024-04-12 01:13:01,608: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:13:01.610818231Z [2024-04-12 01:13:01,610: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:13:01.610922703Z [2024-04-12 01:13:01,610: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:13:01.611000936Z [2024-04-12 01:13:01,610: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T01:13:01.611427625Z [2024-04-12 01:13:01,611: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:13:01.738142541Z [2024-04-12 01:13:01,727: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:13:02.325373332Z [2024-04-12 01:13:02,324: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f9d3c8d6-52c4-4c82-95d3-8ffdd3227c17] succeeded in 1.3265950579989294s: None 2024-04-12T01:13:02.557405427Z [2024-04-12 01:13:02,557: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:13:02.560305793Z [2024-04-12 01:13:02,559: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.581204556Z [2024-04-12 01:13:02,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:13:02.585237289Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.585290644Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.585481338Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.585572239Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:13:02.585877507Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:13:02.586000415Z [2024-04-12 01:13:02,585: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.592697327Z [2024-04-12 01:13:02,592: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:02.593538121Z [2024-04-12 01:13:02,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:02.594444433Z [2024-04-12 01:13:02,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:13:02.596973878Z [2024-04-12 01:13:02,596: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.613427516Z [2024-04-12 01:13:02,613: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:13:02.614612247Z [2024-04-12 01:13:02,614: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.614676325Z [2024-04-12 01:13:02,614: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.615420842Z [2024-04-12 01:13:02,614: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.615552423Z [2024-04-12 01:13:02,615: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:13:02.615790621Z [2024-04-12 01:13:02,615: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:13:02.615865352Z [2024-04-12 01:13:02,615: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.618928843Z [2024-04-12 01:13:02,618: ERROR/ForkPoolWorker-15] [67c6a86a-505d-4c67-ae18-56466175c671] Failed to execute task Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:13:02.618939016Z Traceback (most recent call last): 2024-04-12T01:13:02.618942186Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:13:02.618945521Z args.func(args) 2024-04-12T01:13:02.618948947Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:13:02.618952651Z return func(*args, **kwargs) 2024-04-12T01:13:02.618955699Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:13:02.618958330Z return f(*args, **kwargs) 2024-04-12T01:13:02.618961240Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:13:02.618963967Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:13:02.618966651Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:13:02.618985711Z raise AirflowException( 2024-04-12T01:13:02.618991187Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:13:02.642649639Z [2024-04-12 01:13:02,642: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67c6a86a-505d-4c67-ae18-56466175c671] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 67c6a86a-505d-4c67-ae18-56466175c671') 2024-04-12T01:13:02.642662760Z Traceback (most recent call last): 2024-04-12T01:13:02.642666575Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:13:02.642669658Z R = retval = fun(*args, **kwargs) 2024-04-12T01:13:02.642672529Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:13:02.642675368Z return self.run(*args, **kwargs) 2024-04-12T01:13:02.642678700Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:13:02.642682240Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:13:02.642685235Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:13:02.642688517Z raise AirflowException(msg) 2024-04-12T01:13:02.642703050Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 67c6a86a-505d-4c67-ae18-56466175c671 2024-04-12T01:13:02.664123681Z [2024-04-12 01:13:02,663: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:13:02.667136785Z [2024-04-12 01:13:02,666: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.686905235Z [2024-04-12 01:13:02,686: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:13:02.688097854Z [2024-04-12 01:13:02,687: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.688290729Z [2024-04-12 01:13:02,688: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.688503433Z [2024-04-12 01:13:02,688: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.688623755Z [2024-04-12 01:13:02,688: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:13:02.688928806Z [2024-04-12 01:13:02,688: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:13:02.689031047Z [2024-04-12 01:13:02,688: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.758119183Z [2024-04-12 01:13:02,757: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:13:02.792479299Z [2024-04-12 01:13:02,792: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:13:02.796173784Z [2024-04-12 01:13:02,795: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.821050481Z [2024-04-12 01:13:02,820: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:13:02.824900735Z [2024-04-12 01:13:02,824: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.824990291Z [2024-04-12 01:13:02,824: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.825128192Z [2024-04-12 01:13:02,824: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.825204268Z [2024-04-12 01:13:02,825: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:13:02.825426039Z [2024-04-12 01:13:02,825: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:13:02.825485735Z [2024-04-12 01:13:02,825: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.833201332Z [2024-04-12 01:13:02,832: WARNING/ForkPoolWorker-1] Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:02.833881032Z [2024-04-12 01:13:02,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:02.834611169Z [2024-04-12 01:13:02,834: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:13:02.837203716Z [2024-04-12 01:13:02,836: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.849127187Z [2024-04-12 01:13:02,848: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:13:02.850085417Z [2024-04-12 01:13:02,849: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.850196044Z [2024-04-12 01:13:02,850: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.850365776Z [2024-04-12 01:13:02,850: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.850418829Z [2024-04-12 01:13:02,850: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:13:02.850628344Z [2024-04-12 01:13:02,850: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:13:02.850748500Z [2024-04-12 01:13:02,850: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.853890558Z [2024-04-12 01:13:02,853: ERROR/ForkPoolWorker-1] [d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d] Failed to execute task Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:13:02.853906242Z Traceback (most recent call last): 2024-04-12T01:13:02.853910851Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:13:02.853915050Z args.func(args) 2024-04-12T01:13:02.853919125Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:13:02.853923105Z return func(*args, **kwargs) 2024-04-12T01:13:02.853940422Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:13:02.853944134Z return f(*args, **kwargs) 2024-04-12T01:13:02.853947767Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:13:02.853951309Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:13:02.853954815Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:13:02.853958213Z raise AirflowException( 2024-04-12T01:13:02.853962300Z airflow.exceptions.AirflowException: Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:13:02.855738912Z [2024-04-12 01:13:02,855: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:13:02.861182533Z [2024-04-12 01:13:02,860: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:02.885077373Z [2024-04-12 01:13:02,884: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d') 2024-04-12T01:13:02.885091580Z Traceback (most recent call last): 2024-04-12T01:13:02.885095775Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:13:02.885098963Z R = retval = fun(*args, **kwargs) 2024-04-12T01:13:02.885102029Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:13:02.885105180Z return self.run(*args, **kwargs) 2024-04-12T01:13:02.885108803Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:13:02.885112535Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:13:02.885115512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:13:02.885118929Z raise AirflowException(msg) 2024-04-12T01:13:02.885122757Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d 2024-04-12T01:13:02.889065438Z [2024-04-12 01:13:02,888: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:13:02.893380169Z [2024-04-12 01:13:02,893: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:02.893496690Z [2024-04-12 01:13:02,893: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:02.893628180Z [2024-04-12 01:13:02,893: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:02.893726295Z [2024-04-12 01:13:02,893: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:13:02.894066563Z [2024-04-12 01:13:02,893: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:13:02.894115111Z [2024-04-12 01:13:02,894: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:02.967680433Z [2024-04-12 01:13:02,967: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:13:04.146278092Z [2024-04-12 01:13:04,145: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6d2c3f5c-e972-4c3d-8cdb-17bd6183f876] succeeded in 3.150753796000572s: None 2024-04-12T01:13:04.807387799Z [2024-04-12 01:13:04,806: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3eec745c-8c0c-4b99-ba35-4657f849de1c] succeeded in 3.8214999529991474s: None 2024-04-12T01:13:13.198714732Z [2024-04-12 01:13:13,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8847e7a4-3a0d-4346-a1d8-ac241e372de8] received 2024-04-12T01:13:13.202384720Z [2024-04-12 01:13:13,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a09518e-1dbc-4858-8ee2-6796ab13d493] received 2024-04-12T01:13:13.207770344Z [2024-04-12 01:13:13,205: INFO/ForkPoolWorker-15] [8847e7a4-3a0d-4346-a1d8-ac241e372de8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:13.216665658Z [2024-04-12 01:13:13,216: INFO/ForkPoolWorker-16] [4a09518e-1dbc-4858-8ee2-6796ab13d493] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:13.491997385Z [2024-04-12 01:13:13,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:13.518950013Z [2024-04-12 01:13:13,515: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:14.492736514Z [2024-04-12 01:13:14,492: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:13:14.495399300Z [2024-04-12 01:13:14,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:14.525364594Z [2024-04-12 01:13:14,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:13:14.527132297Z [2024-04-12 01:13:14,526: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:14.527343582Z [2024-04-12 01:13:14,527: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:14.527639495Z [2024-04-12 01:13:14,527: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:14.527857853Z [2024-04-12 01:13:14,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:13:14.528364636Z [2024-04-12 01:13:14,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:13:14.528549343Z [2024-04-12 01:13:14,528: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:14.536595250Z [2024-04-12 01:13:14,536: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:14.537289750Z [2024-04-12 01:13:14,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:13:14.538198793Z [2024-04-12 01:13:14,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:13:14.541147172Z [2024-04-12 01:13:14,540: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:14.570885023Z [2024-04-12 01:13:14,570: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:13:14.572411955Z [2024-04-12 01:13:14,572: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:14.572638626Z [2024-04-12 01:13:14,572: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:14.572848290Z [2024-04-12 01:13:14,572: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:14.572970403Z [2024-04-12 01:13:14,572: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:13:14.573358572Z [2024-04-12 01:13:14,573: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:13:14.573500775Z [2024-04-12 01:13:14,573: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:14.576644565Z [2024-04-12 01:13:14,576: ERROR/ForkPoolWorker-15] [8847e7a4-3a0d-4346-a1d8-ac241e372de8] Failed to execute task Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:13:14.576656453Z Traceback (most recent call last): 2024-04-12T01:13:14.576660357Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:13:14.576663846Z args.func(args) 2024-04-12T01:13:14.576667167Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:13:14.576671045Z return func(*args, **kwargs) 2024-04-12T01:13:14.576673897Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:13:14.576676718Z return f(*args, **kwargs) 2024-04-12T01:13:14.576679625Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:13:14.576682599Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:13:14.576685538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:13:14.576688348Z raise AirflowException( 2024-04-12T01:13:14.576691675Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:13:14.586782129Z [2024-04-12 01:13:14,586: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:13:14.589938818Z [2024-04-12 01:13:14,589: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:14.619846320Z [2024-04-12 01:13:14,619: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:13:14.621245256Z [2024-04-12 01:13:14,620: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:14.621297857Z [2024-04-12 01:13:14,621: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:14.621521827Z [2024-04-12 01:13:14,621: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:14.621668326Z [2024-04-12 01:13:14,621: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:13:14.622129664Z [2024-04-12 01:13:14,621: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:13:14.622887555Z [2024-04-12 01:13:14,622: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:14.628522018Z [2024-04-12 01:13:14,627: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8847e7a4-3a0d-4346-a1d8-ac241e372de8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8847e7a4-3a0d-4346-a1d8-ac241e372de8') 2024-04-12T01:13:14.628542401Z Traceback (most recent call last): 2024-04-12T01:13:14.628551538Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:13:14.628558803Z R = retval = fun(*args, **kwargs) 2024-04-12T01:13:14.628566716Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:13:14.628573690Z return self.run(*args, **kwargs) 2024-04-12T01:13:14.628580879Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:13:14.628588786Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:13:14.628595652Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:13:14.628603183Z raise AirflowException(msg) 2024-04-12T01:13:14.628610741Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8847e7a4-3a0d-4346-a1d8-ac241e372de8 2024-04-12T01:13:14.632450499Z [2024-04-12 01:13:14,632: WARNING/ForkPoolWorker-16] Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:14.633730901Z [2024-04-12 01:13:14,632: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:13:14.634922934Z [2024-04-12 01:13:14,634: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:13:14.637393451Z [2024-04-12 01:13:14,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:13:14.652539536Z [2024-04-12 01:13:14,651: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:13:14.653434983Z [2024-04-12 01:13:14,653: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:13:14.653594971Z [2024-04-12 01:13:14,653: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:13:14.653708926Z [2024-04-12 01:13:14,653: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:13:14.653878978Z [2024-04-12 01:13:14,653: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:13:14.654203110Z [2024-04-12 01:13:14,653: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:13:14.654235221Z [2024-04-12 01:13:14,654: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:13:14.656930367Z [2024-04-12 01:13:14,656: ERROR/ForkPoolWorker-16] [4a09518e-1dbc-4858-8ee2-6796ab13d493] Failed to execute task Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse.. 2024-04-12T01:13:14.656953378Z Traceback (most recent call last): 2024-04-12T01:13:14.656960932Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-12T01:13:14.656967937Z args.func(args) 2024-04-12T01:13:14.656974767Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-12T01:13:14.656981761Z return func(*args, **kwargs) 2024-04-12T01:13:14.656988420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-12T01:13:14.656994378Z return f(*args, **kwargs) 2024-04-12T01:13:14.657000102Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-12T01:13:14.657006482Z dag = get_dag(args.subdir, args.dag_id) 2024-04-12T01:13:14.657012363Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-12T01:13:14.657018097Z raise AirflowException( 2024-04-12T01:13:14.657025426Z airflow.exceptions.AirflowException: Dag 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689' could not be found; either it does not exist or it failed to parse. 2024-04-12T01:13:14.697461687Z [2024-04-12 01:13:14,696: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a09518e-1dbc-4858-8ee2-6796ab13d493] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a09518e-1dbc-4858-8ee2-6796ab13d493') 2024-04-12T01:13:14.697489928Z Traceback (most recent call last): 2024-04-12T01:13:14.697498336Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-12T01:13:14.697504992Z R = retval = fun(*args, **kwargs) 2024-04-12T01:13:14.697511133Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-12T01:13:14.697517302Z return self.run(*args, **kwargs) 2024-04-12T01:13:14.697524006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-12T01:13:14.697530722Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-12T01:13:14.697536670Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-12T01:13:14.697543613Z raise AirflowException(msg) 2024-04-12T01:13:14.697550937Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a09518e-1dbc-4858-8ee2-6796ab13d493 2024-04-12T01:14:01.232367115Z [2024-04-12 01:14:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87ee2a37-6b39-411a-abe2-e51558aaf9b7] received 2024-04-12T01:14:01.240342076Z [2024-04-12 01:14:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42893569-37fa-423b-96c3-1ca96dc30db8] received 2024-04-12T01:14:01.242857496Z [2024-04-12 01:14:01,242: INFO/ForkPoolWorker-15] [87ee2a37-6b39-411a-abe2-e51558aaf9b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:14:01.248733345Z [2024-04-12 01:14:01,248: INFO/ForkPoolWorker-16] [42893569-37fa-423b-96c3-1ca96dc30db8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:14:01.254988465Z [2024-04-12 01:14:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[213f2d08-8bc1-4f43-9332-cc0878593dcd] received 2024-04-12T01:14:01.256787121Z [2024-04-12 01:14:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc468418-6b78-442a-a062-bfe8939aa9a1] received 2024-04-12T01:14:01.260610063Z [2024-04-12 01:14:01,260: INFO/ForkPoolWorker-1] [213f2d08-8bc1-4f43-9332-cc0878593dcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:14:01.264034052Z [2024-04-12 01:14:01,263: INFO/ForkPoolWorker-2] [fc468418-6b78-442a-a062-bfe8939aa9a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:14:01.536945712Z [2024-04-12 01:14:01,534: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:14:01.570193692Z [2024-04-12 01:14:01,566: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:14:01.573405258Z [2024-04-12 01:14:01,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:14:01.598718795Z [2024-04-12 01:14:01,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:14:01.861621213Z [2024-04-12 01:14:01,861: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:14:01.923947728Z [2024-04-12 01:14:01,923: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:14:01.928062815Z [2024-04-12 01:14:01,927: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:14:01.962123859Z [2024-04-12 01:14:01,961: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:14:01.963378928Z [2024-04-12 01:14:01,963: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:14:01.963576121Z [2024-04-12 01:14:01,963: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:14:01.963683892Z [2024-04-12 01:14:01,963: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:14:01.963945937Z [2024-04-12 01:14:01,963: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:14:02.079600375Z [2024-04-12 01:14:02,079: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:14:02.518119503Z [2024-04-12 01:14:02,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87ee2a37-6b39-411a-abe2-e51558aaf9b7] succeeded in 1.2837070570003561s: None 2024-04-12T01:14:02.620537252Z [2024-04-12 01:14:02,620: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[213f2d08-8bc1-4f43-9332-cc0878593dcd] succeeded in 1.3641494759995112s: None 2024-04-12T01:14:02.757796984Z [2024-04-12 01:14:02,757: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:14:02.760604964Z [2024-04-12 01:14:02,760: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:14:02.786551217Z [2024-04-12 01:14:02,786: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:14:02.787880870Z [2024-04-12 01:14:02,787: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:14:02.788034524Z [2024-04-12 01:14:02,787: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:14:02.788293193Z [2024-04-12 01:14:02,788: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:14:02.788528162Z [2024-04-12 01:14:02,788: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:14:02.788987350Z [2024-04-12 01:14:02,788: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:14:02.789025255Z [2024-04-12 01:14:02,788: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:14:02.806396694Z [2024-04-12 01:14:02,806: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:14:02.809267076Z [2024-04-12 01:14:02,808: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:14:02.827929579Z [2024-04-12 01:14:02,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:14:02.829013651Z [2024-04-12 01:14:02,828: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:14:02.829153843Z [2024-04-12 01:14:02,829: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:14:02.829237496Z [2024-04-12 01:14:02,829: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:14:02.829284772Z [2024-04-12 01:14:02,829: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:14:02.829954131Z [2024-04-12 01:14:02,829: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:14:02.829964326Z [2024-04-12 01:14:02,829: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:14:02.858834390Z [2024-04-12 01:14:02,858: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:14:02.918511186Z [2024-04-12 01:14:02,918: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:14:04.406374375Z [2024-04-12 01:14:04,405: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc468418-6b78-442a-a062-bfe8939aa9a1] succeeded in 3.1478602909992333s: None 2024-04-12T01:14:05.240978248Z [2024-04-12 01:14:05,240: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42893569-37fa-423b-96c3-1ca96dc30db8] succeeded in 3.997912169999836s: None 2024-04-12T01:15:01.141178105Z [2024-04-12 01:15:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3acb5fe7-1dae-45c1-a830-18dd9ae1dde6] received 2024-04-12T01:15:01.143501290Z [2024-04-12 01:15:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f065f47e-877c-450b-8831-4fc69f61e762] received 2024-04-12T01:15:01.150265995Z [2024-04-12 01:15:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95e710b7-78cb-4a83-b213-11c8bddea783] received 2024-04-12T01:15:01.151630019Z [2024-04-12 01:15:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[010dcb3a-3d21-4c71-a28c-a4d01895219c] received 2024-04-12T01:15:01.152886073Z [2024-04-12 01:15:01,152: INFO/ForkPoolWorker-15] [3acb5fe7-1dae-45c1-a830-18dd9ae1dde6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:01.158581963Z [2024-04-12 01:15:01,158: INFO/ForkPoolWorker-2] [010dcb3a-3d21-4c71-a28c-a4d01895219c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:15:01.160577024Z [2024-04-12 01:15:01,160: INFO/ForkPoolWorker-1] [95e710b7-78cb-4a83-b213-11c8bddea783] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:15:01.165430090Z [2024-04-12 01:15:01,165: INFO/ForkPoolWorker-16] [f065f47e-877c-450b-8831-4fc69f61e762] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:15:01.431825870Z [2024-04-12 01:15:01,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:15:01.467120145Z [2024-04-12 01:15:01,463: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:15:01.503621559Z [2024-04-12 01:15:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:15:01.503847610Z [2024-04-12 01:15:01,499: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:15:01.658496022Z [2024-04-12 01:15:01,654: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:15:01.665123794Z [2024-04-12 01:15:01,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:01.745636517Z [2024-04-12 01:15:01,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:15:01.766754929Z [2024-04-12 01:15:01,766: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:15:01.766909167Z [2024-04-12 01:15:01,766: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:15:01.766972925Z [2024-04-12 01:15:01,766: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:15:01.767243665Z [2024-04-12 01:15:01,767: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:15:01.867421056Z [2024-04-12 01:15:01,867: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:02.434815516Z [2024-04-12 01:15:02,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95e710b7-78cb-4a83-b213-11c8bddea783] succeeded in 1.2830108549987926s: None 2024-04-12T01:15:02.532145917Z [2024-04-12 01:15:02,531: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:15:02.535189601Z [2024-04-12 01:15:02,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:02.558282324Z [2024-04-12 01:15:02,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:15:02.559350760Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:02.559429781Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:02.559585219Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:02.559620382Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:15:02.559861949Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:15:02.559926405Z [2024-04-12 01:15:02,559: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:02.633411650Z [2024-04-12 01:15:02,633: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:02.740830021Z [2024-04-12 01:15:02,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:15:02.743578450Z [2024-04-12 01:15:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:02.764640348Z [2024-04-12 01:15:02,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:15:02.766181224Z [2024-04-12 01:15:02,765: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:02.766206554Z [2024-04-12 01:15:02,765: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:02.766268525Z [2024-04-12 01:15:02,766: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:02.766497646Z [2024-04-12 01:15:02,766: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:15:02.766936543Z [2024-04-12 01:15:02,766: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:15:02.766992546Z [2024-04-12 01:15:02,766: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:02.844320039Z [2024-04-12 01:15:02,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:03.005601042Z [2024-04-12 01:15:03,005: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:15:03.009228151Z [2024-04-12 01:15:03,008: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:03.035412421Z [2024-04-12 01:15:03,035: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:15:03.037050552Z [2024-04-12 01:15:03,036: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:03.037179046Z [2024-04-12 01:15:03,037: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:03.037364375Z [2024-04-12 01:15:03,037: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:03.037467087Z [2024-04-12 01:15:03,037: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:15:03.037774825Z [2024-04-12 01:15:03,037: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:15:03.037884524Z [2024-04-12 01:15:03,037: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:03.163780722Z [2024-04-12 01:15:03,163: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:03.196688395Z [2024-04-12 01:15:03,196: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3acb5fe7-1dae-45c1-a830-18dd9ae1dde6] succeeded in 2.0516754879990913s: None 2024-04-12T01:15:03.933447574Z [2024-04-12 01:15:03,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6245b3f-e929-4a68-8782-aa7370e9a0dd] received 2024-04-12T01:15:03.942325728Z [2024-04-12 01:15:03,942: INFO/ForkPoolWorker-15] [e6245b3f-e929-4a68-8782-aa7370e9a0dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:04.233980454Z [2024-04-12 01:15:04,230: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:15:04.705934685Z [2024-04-12 01:15:04,704: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[010dcb3a-3d21-4c71-a28c-a4d01895219c] succeeded in 3.5511936630009586s: None 2024-04-12T01:15:04.713314730Z [2024-04-12 01:15:04,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f065f47e-877c-450b-8831-4fc69f61e762] succeeded in 3.567443909998474s: None 2024-04-12T01:15:05.275757907Z [2024-04-12 01:15:05,275: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:15:05.278607275Z [2024-04-12 01:15:05,278: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:05.299025487Z [2024-04-12 01:15:05,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:15:05.300205650Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:05.300457568Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:05.300561049Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:05.300625620Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:15:05.301024007Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:15:05.301036045Z [2024-04-12 01:15:05,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:05.404967387Z [2024-04-12 01:15:05,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:06.100878998Z [2024-04-12 01:15:06,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d341a06-bc0c-4f7a-a26c-e545550816ea] received 2024-04-12T01:15:06.114100078Z [2024-04-12 01:15:06,112: INFO/ForkPoolWorker-16] [9d341a06-bc0c-4f7a-a26c-e545550816ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:15:06.144251899Z [2024-04-12 01:15:06,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6245b3f-e929-4a68-8782-aa7370e9a0dd] succeeded in 2.2075021939999715s: None 2024-04-12T01:15:06.359590959Z [2024-04-12 01:15:06,356: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:15:07.453562246Z [2024-04-12 01:15:07,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:15:07.456918194Z [2024-04-12 01:15:07,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:07.483790704Z [2024-04-12 01:15:07,483: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:15:07.485412252Z [2024-04-12 01:15:07,485: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:07.485644752Z [2024-04-12 01:15:07,485: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:07.486060743Z [2024-04-12 01:15:07,485: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:07.486248220Z [2024-04-12 01:15:07,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:15:07.486648846Z [2024-04-12 01:15:07,486: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:15:07.486789947Z [2024-04-12 01:15:07,486: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:07.603815758Z [2024-04-12 01:15:07,603: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:08.221537269Z [2024-04-12 01:15:08,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d341a06-bc0c-4f7a-a26c-e545550816ea] succeeded in 2.116920164000476s: None 2024-04-12T01:15:08.450083262Z [2024-04-12 01:15:08,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0acc310a-3749-4187-9ea0-5bfc757502e0] received 2024-04-12T01:15:08.472519474Z [2024-04-12 01:15:08,472: INFO/ForkPoolWorker-15] [0acc310a-3749-4187-9ea0-5bfc757502e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:08.726377981Z [2024-04-12 01:15:08,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:15:09.606033089Z [2024-04-12 01:15:09,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:15:09.608614068Z [2024-04-12 01:15:09,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:15:09.631931813Z [2024-04-12 01:15:09,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:15:09.633955209Z [2024-04-12 01:15:09,633: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:15:09.634131499Z [2024-04-12 01:15:09,633: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:15:09.634380780Z [2024-04-12 01:15:09,634: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:15:09.634517566Z [2024-04-12 01:15:09,634: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:15:09.634850908Z [2024-04-12 01:15:09,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:15:09.635022063Z [2024-04-12 01:15:09,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:15:09.727183081Z [2024-04-12 01:15:09,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:15:10.361676743Z [2024-04-12 01:15:10,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0acc310a-3749-4187-9ea0-5bfc757502e0] succeeded in 1.8975107969999954s: None 2024-04-12T01:16:00.626865783Z [2024-04-12 01:16:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deb2c074-256d-451e-886d-3faa5ea426d0] received 2024-04-12T01:16:00.629105909Z [2024-04-12 01:16:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d3aff9a-4c93-4b47-b4e7-a7f5e5439be6] received 2024-04-12T01:16:00.635266685Z [2024-04-12 01:16:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da3560be-e92b-4c2a-94f8-69288f5addbe] received 2024-04-12T01:16:00.642335467Z [2024-04-12 01:16:00,642: INFO/ForkPoolWorker-16] [4d3aff9a-4c93-4b47-b4e7-a7f5e5439be6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:16:00.643034826Z [2024-04-12 01:16:00,642: INFO/ForkPoolWorker-15] [deb2c074-256d-451e-886d-3faa5ea426d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:16:00.647963521Z [2024-04-12 01:16:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0f620b4-87cd-4467-bdaa-c3ecb46fc6a0] received 2024-04-12T01:16:00.653333252Z [2024-04-12 01:16:00,652: INFO/ForkPoolWorker-1] [da3560be-e92b-4c2a-94f8-69288f5addbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:16:00.662498624Z [2024-04-12 01:16:00,662: INFO/ForkPoolWorker-2] [b0f620b4-87cd-4467-bdaa-c3ecb46fc6a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:16:00.936957701Z [2024-04-12 01:16:00,933: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:16:00.959628862Z [2024-04-12 01:16:00,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:16:00.970353798Z [2024-04-12 01:16:00,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:16:00.987340270Z [2024-04-12 01:16:00,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:16:01.074980062Z [2024-04-12 01:16:01,074: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:16:01.080981036Z [2024-04-12 01:16:01,080: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:16:01.106945036Z [2024-04-12 01:16:01,106: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:16:01.107765258Z [2024-04-12 01:16:01,107: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:16:01.107987975Z [2024-04-12 01:16:01,107: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:16:01.108137660Z [2024-04-12 01:16:01,108: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:16:01.108349744Z [2024-04-12 01:16:01,108: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:16:01.180820087Z [2024-04-12 01:16:01,180: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:16:01.224184165Z [2024-04-12 01:16:01,223: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:16:01.798502267Z [2024-04-12 01:16:01,798: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b0f620b4-87cd-4467-bdaa-c3ecb46fc6a0] succeeded in 1.1474139649999415s: None 2024-04-12T01:16:01.904584103Z [2024-04-12 01:16:01,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[deb2c074-256d-451e-886d-3faa5ea426d0] succeeded in 1.275256550999984s: None 2024-04-12T01:16:02.147622568Z [2024-04-12 01:16:02,147: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:16:02.150619552Z [2024-04-12 01:16:02,150: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:16:02.176414316Z [2024-04-12 01:16:02,176: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:16:02.178392595Z [2024-04-12 01:16:02,178: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:16:02.178593588Z [2024-04-12 01:16:02,178: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:16:02.178798765Z [2024-04-12 01:16:02,178: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:16:02.178902733Z [2024-04-12 01:16:02,178: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:16:02.179220220Z [2024-04-12 01:16:02,179: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:16:02.179307651Z [2024-04-12 01:16:02,179: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:16:02.211564047Z [2024-04-12 01:16:02,211: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:16:02.215161522Z [2024-04-12 01:16:02,214: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:16:02.234688552Z [2024-04-12 01:16:02,234: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:16:02.235915238Z [2024-04-12 01:16:02,235: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:16:02.236088312Z [2024-04-12 01:16:02,235: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:16:02.236363933Z [2024-04-12 01:16:02,236: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:16:02.236583138Z [2024-04-12 01:16:02,236: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:16:02.236940944Z [2024-04-12 01:16:02,236: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:16:02.237060832Z [2024-04-12 01:16:02,236: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:16:02.249145654Z [2024-04-12 01:16:02,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:16:02.328860118Z [2024-04-12 01:16:02,328: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:16:03.816316780Z [2024-04-12 01:16:03,815: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da3560be-e92b-4c2a-94f8-69288f5addbe] succeeded in 3.1777320340006554s: None 2024-04-12T01:16:04.320649059Z [2024-04-12 01:16:04,320: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d3aff9a-4c93-4b47-b4e7-a7f5e5439be6] succeeded in 3.690100005000204s: None 2024-04-12T01:17:00.893190794Z [2024-04-12 01:17:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b31af1b-9037-4734-bb05-b6c57bc40880] received 2024-04-12T01:17:00.898378501Z [2024-04-12 01:17:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d9517ae-3dd5-4bb0-a044-aa000415bbb7] received 2024-04-12T01:17:00.899387215Z [2024-04-12 01:17:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8645bd16-2fed-4771-a2c1-957a8f295a90] received 2024-04-12T01:17:00.904680558Z [2024-04-12 01:17:00,904: INFO/ForkPoolWorker-15] [8b31af1b-9037-4734-bb05-b6c57bc40880] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:17:00.908160595Z [2024-04-12 01:17:00,907: INFO/ForkPoolWorker-16] [1d9517ae-3dd5-4bb0-a044-aa000415bbb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:17:00.909703430Z [2024-04-12 01:17:00,909: INFO/ForkPoolWorker-1] [8645bd16-2fed-4771-a2c1-957a8f295a90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:17:01.151500497Z [2024-04-12 01:17:01,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:17:01.163380649Z [2024-04-12 01:17:01,159: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:17:01.236057894Z [2024-04-12 01:17:01,232: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:17:01.312000557Z [2024-04-12 01:17:01,311: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:17:01.324562250Z [2024-04-12 01:17:01,315: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:17:01.341520079Z [2024-04-12 01:17:01,341: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:17:01.342258093Z [2024-04-12 01:17:01,342: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:17:01.342380202Z [2024-04-12 01:17:01,342: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:17:01.342478019Z [2024-04-12 01:17:01,342: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:17:01.342723171Z [2024-04-12 01:17:01,342: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:17:01.414878324Z [2024-04-12 01:17:01,414: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:17:01.907897106Z [2024-04-12 01:17:01,907: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8645bd16-2fed-4771-a2c1-957a8f295a90] succeeded in 1.0065080839995062s: None 2024-04-12T01:17:02.221009794Z [2024-04-12 01:17:02,220: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:17:02.223578257Z [2024-04-12 01:17:02,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:17:02.242661851Z [2024-04-12 01:17:02,242: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:17:02.244635213Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:17:02.244651417Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:17:02.244773499Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:17:02.244785344Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:17:02.245043677Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:17:02.245134713Z [2024-04-12 01:17:02,244: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:17:02.288691841Z [2024-04-12 01:17:02,288: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:17:02.291494097Z [2024-04-12 01:17:02,291: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:17:02.319213665Z [2024-04-12 01:17:02,318: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:17:02.320445272Z [2024-04-12 01:17:02,320: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:17:02.320509956Z [2024-04-12 01:17:02,320: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:17:02.320713926Z [2024-04-12 01:17:02,320: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:17:02.320782922Z [2024-04-12 01:17:02,320: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:17:02.321110594Z [2024-04-12 01:17:02,320: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:17:02.321232484Z [2024-04-12 01:17:02,321: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:17:02.324437653Z [2024-04-12 01:17:02,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:17:02.414312733Z [2024-04-12 01:17:02,414: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:17:04.079789483Z [2024-04-12 01:17:04,079: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d9517ae-3dd5-4bb0-a044-aa000415bbb7] succeeded in 3.178516589001447s: None 2024-04-12T01:17:04.710330368Z [2024-04-12 01:17:04,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b31af1b-9037-4734-bb05-b6c57bc40880] succeeded in 3.815198619000512s: None 2024-04-12T01:18:01.174547693Z [2024-04-12 01:18:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab201c1c-5701-4ce2-84a2-7673e592e8cf] received 2024-04-12T01:18:01.179593250Z [2024-04-12 01:18:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[498dc8c1-0c3e-4c64-84a1-a98b899be570] received 2024-04-12T01:18:01.183944153Z [2024-04-12 01:18:01,183: INFO/ForkPoolWorker-15] [ab201c1c-5701-4ce2-84a2-7673e592e8cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:18:01.187752351Z [2024-04-12 01:18:01,187: INFO/ForkPoolWorker-16] [498dc8c1-0c3e-4c64-84a1-a98b899be570] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:18:01.188283111Z [2024-04-12 01:18:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22195b1e-1db5-46f4-a349-6a499330195a] received 2024-04-12T01:18:01.190918216Z [2024-04-12 01:18:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2729f12-a6f8-4c16-9b0b-9fdaff99d2c3] received 2024-04-12T01:18:01.202417810Z [2024-04-12 01:18:01,202: INFO/ForkPoolWorker-2] [c2729f12-a6f8-4c16-9b0b-9fdaff99d2c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:18:01.205529603Z [2024-04-12 01:18:01,205: INFO/ForkPoolWorker-1] [22195b1e-1db5-46f4-a349-6a499330195a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:18:01.476927075Z [2024-04-12 01:18:01,474: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:18:01.484886284Z [2024-04-12 01:18:01,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:18:01.491261207Z [2024-04-12 01:18:01,487: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:18:01.631581057Z [2024-04-12 01:18:01,631: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:18:01.636235781Z [2024-04-12 01:18:01,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:18:01.692550533Z [2024-04-12 01:18:01,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:18:01.693888823Z [2024-04-12 01:18:01,693: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:18:01.693902400Z [2024-04-12 01:18:01,693: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:18:01.693907176Z [2024-04-12 01:18:01,693: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:18:01.693910374Z [2024-04-12 01:18:01,693: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:18:01.769693503Z [2024-04-12 01:18:01,766: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:18:01.817784870Z [2024-04-12 01:18:01,817: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:18:01.822368686Z [2024-04-12 01:18:01,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:18:02.357485360Z [2024-04-12 01:18:02,357: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22195b1e-1db5-46f4-a349-6a499330195a] succeeded in 1.1676324580002984s: None 2024-04-12T01:18:02.527497468Z [2024-04-12 01:18:02,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab201c1c-5701-4ce2-84a2-7673e592e8cf] succeeded in 1.3506649219998508s: None 2024-04-12T01:18:02.747835207Z [2024-04-12 01:18:02,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:18:02.750817612Z [2024-04-12 01:18:02,750: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:18:02.770914028Z [2024-04-12 01:18:02,770: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:18:02.772170509Z [2024-04-12 01:18:02,771: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:18:02.772411085Z [2024-04-12 01:18:02,772: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:18:02.772685741Z [2024-04-12 01:18:02,772: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:18:02.772868389Z [2024-04-12 01:18:02,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:18:02.773190160Z [2024-04-12 01:18:02,773: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:18:02.773397707Z [2024-04-12 01:18:02,773: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:18:02.864085926Z [2024-04-12 01:18:02,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:18:02.946674830Z [2024-04-12 01:18:02,946: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:18:02.949747374Z [2024-04-12 01:18:02,949: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:18:02.974079433Z [2024-04-12 01:18:02,973: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:18:02.975171974Z [2024-04-12 01:18:02,975: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:18:02.975341950Z [2024-04-12 01:18:02,975: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:18:02.975523432Z [2024-04-12 01:18:02,975: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:18:02.975663975Z [2024-04-12 01:18:02,975: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:18:02.976041005Z [2024-04-12 01:18:02,975: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:18:02.976193986Z [2024-04-12 01:18:02,976: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:18:03.049991299Z [2024-04-12 01:18:03,049: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:18:04.239441525Z [2024-04-12 01:18:04,239: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[498dc8c1-0c3e-4c64-84a1-a98b899be570] succeeded in 3.05808238300051s: None 2024-04-12T01:18:05.350027048Z [2024-04-12 01:18:05,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c2729f12-a6f8-4c16-9b0b-9fdaff99d2c3] succeeded in 4.155363166000825s: None 2024-04-12T01:19:00.331575067Z [2024-04-12 01:19:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb72010c-2be5-4ab8-a0e6-df7fcdcfcbd2] received 2024-04-12T01:19:00.336066295Z [2024-04-12 01:19:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a47dd90-3475-4113-bada-4bf4760fc891] received 2024-04-12T01:19:00.349721820Z [2024-04-12 01:19:00,349: INFO/ForkPoolWorker-16] [6a47dd90-3475-4113-bada-4bf4760fc891] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:19:00.351154020Z [2024-04-12 01:19:00,350: INFO/ForkPoolWorker-15] [bb72010c-2be5-4ab8-a0e6-df7fcdcfcbd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:19:00.360873409Z [2024-04-12 01:19:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca6545ed-abb6-49eb-858a-a4d7e12daece] received 2024-04-12T01:19:00.382983695Z [2024-04-12 01:19:00,382: INFO/ForkPoolWorker-1] [ca6545ed-abb6-49eb-858a-a4d7e12daece] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:19:00.720672382Z [2024-04-12 01:19:00,715: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:19:00.726457876Z [2024-04-12 01:19:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:19:00.783193162Z [2024-04-12 01:19:00,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:19:00.911985392Z [2024-04-12 01:19:00,911: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:19:00.918548527Z [2024-04-12 01:19:00,918: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:19:00.944025926Z [2024-04-12 01:19:00,943: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:19:00.944998962Z [2024-04-12 01:19:00,944: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:19:00.945088249Z [2024-04-12 01:19:00,944: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:19:00.945129024Z [2024-04-12 01:19:00,945: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:19:00.945340858Z [2024-04-12 01:19:00,945: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:19:01.130935503Z [2024-04-12 01:19:01,130: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:19:01.930745208Z [2024-04-12 01:19:01,930: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca6545ed-abb6-49eb-858a-a4d7e12daece] succeeded in 1.5534793569986505s: None 2024-04-12T01:19:02.109713251Z [2024-04-12 01:19:02,108: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:19:02.117247460Z [2024-04-12 01:19:02,116: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:19:02.148076482Z [2024-04-12 01:19:02,147: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:19:02.153613860Z [2024-04-12 01:19:02,153: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:19:02.153888560Z [2024-04-12 01:19:02,153: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:19:02.154183265Z [2024-04-12 01:19:02,153: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:19:02.154386915Z [2024-04-12 01:19:02,154: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:19:02.154855819Z [2024-04-12 01:19:02,154: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:19:02.155062358Z [2024-04-12 01:19:02,154: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:19:02.226493417Z [2024-04-12 01:19:02,226: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:19:02.236853983Z [2024-04-12 01:19:02,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:19:02.247739083Z [2024-04-12 01:19:02,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:19:02.313739118Z [2024-04-12 01:19:02,313: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:19:02.317538834Z [2024-04-12 01:19:02,317: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:19:02.317978858Z [2024-04-12 01:19:02,317: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:19:02.318224824Z [2024-04-12 01:19:02,318: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:19:02.318351864Z [2024-04-12 01:19:02,318: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:19:02.318765606Z [2024-04-12 01:19:02,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:19:02.318814102Z [2024-04-12 01:19:02,318: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:19:02.486126321Z [2024-04-12 01:19:02,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:19:04.195486358Z [2024-04-12 01:19:04,195: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb72010c-2be5-4ab8-a0e6-df7fcdcfcbd2] succeeded in 3.860256759000549s: None 2024-04-12T01:19:04.698166446Z [2024-04-12 01:19:04,697: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a47dd90-3475-4113-bada-4bf4760fc891] succeeded in 4.358780810998724s: None 2024-04-12T01:20:01.072190852Z [2024-04-12 01:20:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eaef4a0-6d69-4093-b58f-6a1ab20c8ba4] received 2024-04-12T01:20:01.074989030Z [2024-04-12 01:20:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[123c3c01-2cd9-47af-89b5-3004eba8fbc9] received 2024-04-12T01:20:01.078109824Z [2024-04-12 01:20:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49c723d9-51d7-4e17-9b1e-3e6847506385] received 2024-04-12T01:20:01.079124431Z [2024-04-12 01:20:01,078: INFO/ForkPoolWorker-15] [6eaef4a0-6d69-4093-b58f-6a1ab20c8ba4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:01.079139192Z [2024-04-12 01:20:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc59789d-1514-484f-b583-5c561de33e48] received 2024-04-12T01:20:01.086348600Z [2024-04-12 01:20:01,086: INFO/ForkPoolWorker-16] [123c3c01-2cd9-47af-89b5-3004eba8fbc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:20:01.087666924Z [2024-04-12 01:20:01,087: INFO/ForkPoolWorker-1] [49c723d9-51d7-4e17-9b1e-3e6847506385] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:20:01.093063109Z [2024-04-12 01:20:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4986bb79-0f59-4902-8bbf-48ea8421b9aa] received 2024-04-12T01:20:01.098460278Z [2024-04-12 01:20:01,098: INFO/ForkPoolWorker-2] [bc59789d-1514-484f-b583-5c561de33e48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:20:01.121228079Z [2024-04-12 01:20:01,120: INFO/ForkPoolWorker-3] [4986bb79-0f59-4902-8bbf-48ea8421b9aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:20:01.341043274Z [2024-04-12 01:20:01,338: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:20:01.445610266Z [2024-04-12 01:20:01,442: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:20:01.500528211Z [2024-04-12 01:20:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:20:01.527883221Z [2024-04-12 01:20:01,524: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:20:01.536799561Z [2024-04-12 01:20:01,536: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:20:01.540408266Z [2024-04-12 01:20:01,540: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:01.549576293Z [2024-04-12 01:20:01,540: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:20:01.574451436Z [2024-04-12 01:20:01,574: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:20:01.577062592Z [2024-04-12 01:20:01,576: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:20:01.577154032Z [2024-04-12 01:20:01,577: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:20:01.577190666Z [2024-04-12 01:20:01,577: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:20:01.577381936Z [2024-04-12 01:20:01,577: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:20:01.686480726Z [2024-04-12 01:20:01,684: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:01.784765323Z [2024-04-12 01:20:01,784: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:02.211528910Z [2024-04-12 01:20:02,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49c723d9-51d7-4e17-9b1e-3e6847506385] succeeded in 1.131270919000599s: None 2024-04-12T01:20:02.275511663Z [2024-04-12 01:20:02,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[123c3c01-2cd9-47af-89b5-3004eba8fbc9] succeeded in 1.1992686569992657s: None 2024-04-12T01:20:02.806013364Z [2024-04-12 01:20:02,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:20:02.809120281Z [2024-04-12 01:20:02,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:02.838426384Z [2024-04-12 01:20:02,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:20:02.840333106Z [2024-04-12 01:20:02,840: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:02.840511850Z [2024-04-12 01:20:02,840: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:02.840689749Z [2024-04-12 01:20:02,840: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:02.840831706Z [2024-04-12 01:20:02,840: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:20:02.841126831Z [2024-04-12 01:20:02,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:20:02.841230602Z [2024-04-12 01:20:02,841: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:02.859884962Z [2024-04-12 01:20:02,859: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:20:02.862561174Z [2024-04-12 01:20:02,862: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:02.881246027Z [2024-04-12 01:20:02,880: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T01:20:02.884062947Z [2024-04-12 01:20:02,883: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:02.885525404Z [2024-04-12 01:20:02,885: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:20:02.886887576Z [2024-04-12 01:20:02,886: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:02.886905245Z [2024-04-12 01:20:02,886: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:02.887021730Z [2024-04-12 01:20:02,886: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:02.887030382Z [2024-04-12 01:20:02,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:20:02.887385216Z [2024-04-12 01:20:02,887: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:20:02.887393359Z [2024-04-12 01:20:02,887: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:02.907318487Z [2024-04-12 01:20:02,907: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:20:02.908353786Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:02.908365912Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:02.908550779Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:02.908563065Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T01:20:02.908702687Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:20:02.908777358Z [2024-04-12 01:20:02,908: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:02.929201197Z [2024-04-12 01:20:02,928: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:02.960491842Z [2024-04-12 01:20:02,960: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:03.002000110Z [2024-04-12 01:20:03,001: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:03.558279736Z [2024-04-12 01:20:03,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6eaef4a0-6d69-4093-b58f-6a1ab20c8ba4] succeeded in 2.482622454999728s: None 2024-04-12T01:20:03.880514280Z [2024-04-12 01:20:03,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8565f39-529d-4e9e-9dc4-c1bcd5634128] received 2024-04-12T01:20:03.889056939Z [2024-04-12 01:20:03,888: INFO/ForkPoolWorker-15] [c8565f39-529d-4e9e-9dc4-c1bcd5634128] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:04.163606490Z [2024-04-12 01:20:04,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:20:04.476979789Z [2024-04-12 01:20:04,476: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4986bb79-0f59-4902-8bbf-48ea8421b9aa] succeeded in 3.381798370000979s: None 2024-04-12T01:20:04.829536935Z [2024-04-12 01:20:04,828: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bc59789d-1514-484f-b583-5c561de33e48] succeeded in 3.7404348889995163s: None 2024-04-12T01:20:05.237157002Z [2024-04-12 01:20:05,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:20:05.240212800Z [2024-04-12 01:20:05,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:05.259865382Z [2024-04-12 01:20:05,259: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:20:05.261153136Z [2024-04-12 01:20:05,260: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:05.261293269Z [2024-04-12 01:20:05,261: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:05.261555029Z [2024-04-12 01:20:05,261: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:05.261643224Z [2024-04-12 01:20:05,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:20:05.262391069Z [2024-04-12 01:20:05,262: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:20:05.262526057Z [2024-04-12 01:20:05,262: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:05.331831843Z [2024-04-12 01:20:05,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:05.964896342Z [2024-04-12 01:20:05,964: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8565f39-529d-4e9e-9dc4-c1bcd5634128] succeeded in 2.0823519099994883s: None 2024-04-12T01:20:06.044203167Z [2024-04-12 01:20:06,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5816f965-85f0-4ee4-95e9-2229e0ec794d] received 2024-04-12T01:20:06.068979510Z [2024-04-12 01:20:06,068: INFO/ForkPoolWorker-15] [5816f965-85f0-4ee4-95e9-2229e0ec794d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:20:06.415114810Z [2024-04-12 01:20:06,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:20:07.371452513Z [2024-04-12 01:20:07,371: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:20:07.374305079Z [2024-04-12 01:20:07,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:07.395557031Z [2024-04-12 01:20:07,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:20:07.396892619Z [2024-04-12 01:20:07,396: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:07.397068751Z [2024-04-12 01:20:07,396: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:07.397285290Z [2024-04-12 01:20:07,397: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:07.397428975Z [2024-04-12 01:20:07,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:20:07.397879369Z [2024-04-12 01:20:07,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:20:07.398025039Z [2024-04-12 01:20:07,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:07.473730279Z [2024-04-12 01:20:07,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:08.132583408Z [2024-04-12 01:20:08,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5816f965-85f0-4ee4-95e9-2229e0ec794d] succeeded in 2.079186753000613s: None 2024-04-12T01:20:08.911669711Z [2024-04-12 01:20:08,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[903831fb-c738-4785-a18f-a1c5733c3c27] received 2024-04-12T01:20:08.921473611Z [2024-04-12 01:20:08,921: INFO/ForkPoolWorker-15] [903831fb-c738-4785-a18f-a1c5733c3c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:09.177775798Z [2024-04-12 01:20:09,174: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:20:10.099727383Z [2024-04-12 01:20:10,098: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:20:10.102091236Z [2024-04-12 01:20:10,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:20:10.125148106Z [2024-04-12 01:20:10,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:20:10.126086136Z [2024-04-12 01:20:10,125: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:20:10.126106447Z [2024-04-12 01:20:10,126: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:20:10.126175547Z [2024-04-12 01:20:10,126: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:20:10.126220619Z [2024-04-12 01:20:10,126: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:20:10.126407495Z [2024-04-12 01:20:10,126: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:20:10.126445421Z [2024-04-12 01:20:10,126: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:20:10.197235893Z [2024-04-12 01:20:10,196: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:20:10.798660202Z [2024-04-12 01:20:10,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[903831fb-c738-4785-a18f-a1c5733c3c27] succeeded in 1.883973114001492s: None 2024-04-12T01:21:00.433437410Z [2024-04-12 01:21:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff403a9-5166-47d2-a040-bedd3641dc67] received 2024-04-12T01:21:00.434948720Z [2024-04-12 01:21:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e219dca-afb1-4bfc-8577-d0c95496b767] received 2024-04-12T01:21:00.445373674Z [2024-04-12 01:21:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c1d7251-07bf-4531-bc01-568c150afc92] received 2024-04-12T01:21:00.448720750Z [2024-04-12 01:21:00,448: INFO/ForkPoolWorker-15] [7ff403a9-5166-47d2-a040-bedd3641dc67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:21:00.450904790Z [2024-04-12 01:21:00,450: INFO/ForkPoolWorker-16] [5e219dca-afb1-4bfc-8577-d0c95496b767] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:21:00.459830766Z [2024-04-12 01:21:00,456: INFO/ForkPoolWorker-1] [8c1d7251-07bf-4531-bc01-568c150afc92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:21:00.692049758Z [2024-04-12 01:21:00,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:21:00.710722039Z [2024-04-12 01:21:00,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:21:00.778994977Z [2024-04-12 01:21:00,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:21:00.824520767Z [2024-04-12 01:21:00,823: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:21:00.827142964Z [2024-04-12 01:21:00,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:21:00.861195466Z [2024-04-12 01:21:00,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:21:00.865043483Z [2024-04-12 01:21:00,864: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:21:00.865257657Z [2024-04-12 01:21:00,864: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:21:00.865683338Z [2024-04-12 01:21:00,865: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:21:00.866234127Z [2024-04-12 01:21:00,866: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:21:00.952759414Z [2024-04-12 01:21:00,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:21:01.506260828Z [2024-04-12 01:21:01,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ff403a9-5166-47d2-a040-bedd3641dc67] succeeded in 1.0699876099988614s: None 2024-04-12T01:21:01.759372476Z [2024-04-12 01:21:01,751: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:21:01.759396808Z [2024-04-12 01:21:01,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:21:01.795647479Z [2024-04-12 01:21:01,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:21:01.797004001Z [2024-04-12 01:21:01,796: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:21:01.797113556Z [2024-04-12 01:21:01,796: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:21:01.797295215Z [2024-04-12 01:21:01,797: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:21:01.797369615Z [2024-04-12 01:21:01,797: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:21:01.797691190Z [2024-04-12 01:21:01,797: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:21:01.797787703Z [2024-04-12 01:21:01,797: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:21:01.816450835Z [2024-04-12 01:21:01,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:21:01.819168280Z [2024-04-12 01:21:01,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:21:01.841670258Z [2024-04-12 01:21:01,841: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:21:01.845050930Z [2024-04-12 01:21:01,844: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:21:01.845071231Z [2024-04-12 01:21:01,844: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:21:01.845174787Z [2024-04-12 01:21:01,844: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:21:01.845241247Z [2024-04-12 01:21:01,845: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:21:01.845471812Z [2024-04-12 01:21:01,845: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:21:01.845479938Z [2024-04-12 01:21:01,845: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:21:01.872840758Z [2024-04-12 01:21:01,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:21:01.925069164Z [2024-04-12 01:21:01,924: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:21:03.326833703Z [2024-04-12 01:21:03,326: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e219dca-afb1-4bfc-8577-d0c95496b767] succeeded in 2.8888312870003574s: None 2024-04-12T01:21:03.849473949Z [2024-04-12 01:21:03,848: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c1d7251-07bf-4531-bc01-568c150afc92] succeeded in 3.4012692699998297s: None 2024-04-12T01:22:00.823233537Z [2024-04-12 01:22:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9524c3d-81c3-450e-b2cd-11d83d03f715] received 2024-04-12T01:22:00.828758532Z [2024-04-12 01:22:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfbb2a8a-7c86-422e-adcc-93075f85dbed] received 2024-04-12T01:22:00.832020619Z [2024-04-12 01:22:00,831: INFO/ForkPoolWorker-15] [b9524c3d-81c3-450e-b2cd-11d83d03f715] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:22:00.836162643Z [2024-04-12 01:22:00,835: INFO/ForkPoolWorker-16] [dfbb2a8a-7c86-422e-adcc-93075f85dbed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:22:00.842948231Z [2024-04-12 01:22:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[155f2de0-69bf-421b-a2e5-15d9a1d8da86] received 2024-04-12T01:22:00.844893945Z [2024-04-12 01:22:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e026c86-fe67-4d6a-9b31-08bf5f83beef] received 2024-04-12T01:22:00.856713816Z [2024-04-12 01:22:00,856: INFO/ForkPoolWorker-1] [155f2de0-69bf-421b-a2e5-15d9a1d8da86] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:22:00.866181307Z [2024-04-12 01:22:00,865: INFO/ForkPoolWorker-2] [9e026c86-fe67-4d6a-9b31-08bf5f83beef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:22:01.089006654Z [2024-04-12 01:22:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:22:01.124062582Z [2024-04-12 01:22:01,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:22:01.220175938Z [2024-04-12 01:22:01,217: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:22:01.235428645Z [2024-04-12 01:22:01,232: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:22:01.239240938Z [2024-04-12 01:22:01,238: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:22:01.242713568Z [2024-04-12 01:22:01,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:22:01.272960058Z [2024-04-12 01:22:01,272: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:22:01.276794822Z [2024-04-12 01:22:01,276: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:22:01.276856436Z [2024-04-12 01:22:01,276: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:22:01.276897285Z [2024-04-12 01:22:01,276: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:22:01.277122335Z [2024-04-12 01:22:01,276: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:22:01.376932256Z [2024-04-12 01:22:01,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:22:01.533157245Z [2024-04-12 01:22:01,532: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:22:02.020969913Z [2024-04-12 01:22:02,020: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfbb2a8a-7c86-422e-adcc-93075f85dbed] succeeded in 1.1901543249987299s: None 2024-04-12T01:22:02.134246873Z [2024-04-12 01:22:02,133: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[155f2de0-69bf-421b-a2e5-15d9a1d8da86] succeeded in 1.2883365810012037s: None 2024-04-12T01:22:02.267447851Z [2024-04-12 01:22:02,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:22:02.270404881Z [2024-04-12 01:22:02,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:22:02.288288549Z [2024-04-12 01:22:02,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:22:02.289659080Z [2024-04-12 01:22:02,289: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:22:02.289829671Z [2024-04-12 01:22:02,289: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:22:02.290025944Z [2024-04-12 01:22:02,289: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:22:02.290309969Z [2024-04-12 01:22:02,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:22:02.290928344Z [2024-04-12 01:22:02,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:22:02.291392360Z [2024-04-12 01:22:02,291: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:22:02.381486409Z [2024-04-12 01:22:02,381: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:22:02.392637978Z [2024-04-12 01:22:02,392: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:22:02.395487055Z [2024-04-12 01:22:02,395: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:22:02.431416915Z [2024-04-12 01:22:02,431: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:22:02.432416576Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:22:02.432472708Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:22:02.432652019Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:22:02.432675893Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:22:02.432951593Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:22:02.433027679Z [2024-04-12 01:22:02,432: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:22:02.495514036Z [2024-04-12 01:22:02,495: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:22:03.781847135Z [2024-04-12 01:22:03,781: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9524c3d-81c3-450e-b2cd-11d83d03f715] succeeded in 2.956988990999889s: None 2024-04-12T01:22:05.100992326Z [2024-04-12 01:22:05,100: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e026c86-fe67-4d6a-9b31-08bf5f83beef] succeeded in 4.250868469000125s: None 2024-04-12T01:23:01.185865492Z [2024-04-12 01:23:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b0d43a7-60b9-4e42-9c2d-b533317695eb] received 2024-04-12T01:23:01.192312551Z [2024-04-12 01:23:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b56d4ec-f524-4047-a753-d9e2318a275e] received 2024-04-12T01:23:01.194154914Z [2024-04-12 01:23:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6214ce79-f0c8-4b7d-9e1d-41340e8ee312] received 2024-04-12T01:23:01.202471139Z [2024-04-12 01:23:01,202: INFO/ForkPoolWorker-15] [1b0d43a7-60b9-4e42-9c2d-b533317695eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:23:01.203635660Z [2024-04-12 01:23:01,203: INFO/ForkPoolWorker-1] [6214ce79-f0c8-4b7d-9e1d-41340e8ee312] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:23:01.205389727Z [2024-04-12 01:23:01,205: INFO/ForkPoolWorker-16] [0b56d4ec-f524-4047-a753-d9e2318a275e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:23:01.460464159Z [2024-04-12 01:23:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:23:01.473228345Z [2024-04-12 01:23:01,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:23:01.501638457Z [2024-04-12 01:23:01,497: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:23:01.688489870Z [2024-04-12 01:23:01,687: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:23:01.698270852Z [2024-04-12 01:23:01,691: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:23:01.720925171Z [2024-04-12 01:23:01,720: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:23:01.725237880Z [2024-04-12 01:23:01,724: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:23:01.727896845Z [2024-04-12 01:23:01,726: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:23:01.727906734Z [2024-04-12 01:23:01,726: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:23:01.727910796Z [2024-04-12 01:23:01,726: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:23:01.811430109Z [2024-04-12 01:23:01,811: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:23:02.392494349Z [2024-04-12 01:23:02,392: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6214ce79-f0c8-4b7d-9e1d-41340e8ee312] succeeded in 1.1970014960006665s: None 2024-04-12T01:23:02.499834945Z [2024-04-12 01:23:02,499: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:23:02.502773525Z [2024-04-12 01:23:02,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:23:02.525565874Z [2024-04-12 01:23:02,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:23:02.527076081Z [2024-04-12 01:23:02,526: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:23:02.527275400Z [2024-04-12 01:23:02,527: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:23:02.527496588Z [2024-04-12 01:23:02,527: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:23:02.527690064Z [2024-04-12 01:23:02,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:23:02.528003481Z [2024-04-12 01:23:02,527: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:23:02.528179831Z [2024-04-12 01:23:02,528: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:23:02.616185386Z [2024-04-12 01:23:02,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:23:02.622560179Z [2024-04-12 01:23:02,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:23:02.625652693Z [2024-04-12 01:23:02,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:23:02.649615296Z [2024-04-12 01:23:02,649: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:23:02.650783552Z [2024-04-12 01:23:02,650: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:23:02.650961872Z [2024-04-12 01:23:02,650: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:23:02.651229940Z [2024-04-12 01:23:02,651: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:23:02.651415577Z [2024-04-12 01:23:02,651: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:23:02.651753444Z [2024-04-12 01:23:02,651: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:23:02.651917715Z [2024-04-12 01:23:02,651: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:23:02.739873317Z [2024-04-12 01:23:02,739: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:23:04.684945753Z [2024-04-12 01:23:04,684: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b56d4ec-f524-4047-a753-d9e2318a275e] succeeded in 3.4901466659994185s: None 2024-04-12T01:23:04.890920320Z [2024-04-12 01:23:04,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b0d43a7-60b9-4e42-9c2d-b533317695eb] succeeded in 3.6998872679996566s: None 2024-04-12T01:24:01.075261930Z [2024-04-12 01:24:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e365c7f5-c25b-4561-8378-ab2136a8ae42] received 2024-04-12T01:24:01.077434814Z [2024-04-12 01:24:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3138f411-de18-439e-9046-e974a7b30786] received 2024-04-12T01:24:01.083914945Z [2024-04-12 01:24:01,083: INFO/ForkPoolWorker-15] [e365c7f5-c25b-4561-8378-ab2136a8ae42] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:24:01.088575179Z [2024-04-12 01:24:01,088: INFO/ForkPoolWorker-16] [3138f411-de18-439e-9046-e974a7b30786] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:24:01.099202203Z [2024-04-12 01:24:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21e01d53-80ac-44d9-8054-05d817a67b58] received 2024-04-12T01:24:01.105150106Z [2024-04-12 01:24:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63b5e651-cf17-4ac0-8cb6-45a4b1bdd5fc] received 2024-04-12T01:24:01.108717901Z [2024-04-12 01:24:01,108: INFO/ForkPoolWorker-1] [21e01d53-80ac-44d9-8054-05d817a67b58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:24:01.177945559Z [2024-04-12 01:24:01,177: INFO/ForkPoolWorker-2] [63b5e651-cf17-4ac0-8cb6-45a4b1bdd5fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:24:01.520019150Z [2024-04-12 01:24:01,512: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:24:01.658569299Z [2024-04-12 01:24:01,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:24:01.785098241Z [2024-04-12 01:24:01,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:24:01.828652916Z [2024-04-12 01:24:01,806: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:24:02.094847988Z [2024-04-12 01:24:02,067: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:24:02.128806739Z [2024-04-12 01:24:02,128: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:24:02.241225193Z [2024-04-12 01:24:02,241: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:24:02.244546801Z [2024-04-12 01:24:02,244: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:24:02.245452435Z [2024-04-12 01:24:02,244: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:24:02.245467800Z [2024-04-12 01:24:02,245: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:24:02.245617799Z [2024-04-12 01:24:02,245: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:24:02.380631833Z [2024-04-12 01:24:02,371: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:24:02.483710202Z [2024-04-12 01:24:02,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:24:03.601057904Z [2024-04-12 01:24:03,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e365c7f5-c25b-4561-8378-ab2136a8ae42] succeeded in 2.5242569029996957s: None 2024-04-12T01:24:03.625733169Z [2024-04-12 01:24:03,624: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21e01d53-80ac-44d9-8054-05d817a67b58] succeeded in 2.5240923080000357s: None 2024-04-12T01:24:03.683256810Z [2024-04-12 01:24:03,682: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:24:03.686436893Z [2024-04-12 01:24:03,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:24:03.722703728Z [2024-04-12 01:24:03,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:24:03.725345534Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:24:03.725371832Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:24:03.725450135Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:24:03.725464967Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:24:03.725684234Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:24:03.725694186Z [2024-04-12 01:24:03,725: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:24:03.809404205Z [2024-04-12 01:24:03,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:24:03.844564961Z [2024-04-12 01:24:03,844: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:24:03.849819499Z [2024-04-12 01:24:03,849: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:24:03.899995569Z [2024-04-12 01:24:03,899: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:24:03.906097613Z [2024-04-12 01:24:03,905: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:24:03.906195818Z [2024-04-12 01:24:03,906: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:24:03.906367279Z [2024-04-12 01:24:03,906: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:24:03.906438354Z [2024-04-12 01:24:03,906: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:24:03.906728903Z [2024-04-12 01:24:03,906: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:24:03.906801683Z [2024-04-12 01:24:03,906: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:24:04.022277264Z [2024-04-12 01:24:04,022: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:24:05.591683307Z [2024-04-12 01:24:05,591: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[63b5e651-cf17-4ac0-8cb6-45a4b1bdd5fc] succeeded in 4.4817699560007895s: None 2024-04-12T01:24:05.756703169Z [2024-04-12 01:24:05,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3138f411-de18-439e-9046-e974a7b30786] succeeded in 4.675525427999673s: None 2024-04-12T01:25:01.062614900Z [2024-04-12 01:25:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e20c36f0-0e84-43e8-8c41-3f59a02048d0] received 2024-04-12T01:25:01.067745812Z [2024-04-12 01:25:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c64e8ea6-02b7-4359-b82e-5b9713c4206e] received 2024-04-12T01:25:01.069904294Z [2024-04-12 01:25:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9efceeb1-aee6-48c5-99ef-9ddcb04a5e81] received 2024-04-12T01:25:01.072019607Z [2024-04-12 01:25:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dccaa452-31d2-44f3-8814-8f1539dcaf39] received 2024-04-12T01:25:01.077912049Z [2024-04-12 01:25:01,077: INFO/ForkPoolWorker-16] [c64e8ea6-02b7-4359-b82e-5b9713c4206e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:25:01.078537653Z [2024-04-12 01:25:01,078: INFO/ForkPoolWorker-1] [9efceeb1-aee6-48c5-99ef-9ddcb04a5e81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:25:01.080968901Z [2024-04-12 01:25:01,080: INFO/ForkPoolWorker-2] [dccaa452-31d2-44f3-8814-8f1539dcaf39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:25:01.083713310Z [2024-04-12 01:25:01,080: INFO/ForkPoolWorker-15] [e20c36f0-0e84-43e8-8c41-3f59a02048d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:01.372257854Z [2024-04-12 01:25:01,369: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:25:01.382490903Z [2024-04-12 01:25:01,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:25:01.421469081Z [2024-04-12 01:25:01,417: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:25:01.800603863Z [2024-04-12 01:25:01,796: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:25:01.961528840Z [2024-04-12 01:25:01,961: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:25:01.965496504Z [2024-04-12 01:25:01,965: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:01.991256938Z [2024-04-12 01:25:01,991: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:25:01.998492795Z [2024-04-12 01:25:01,998: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:25:01.998530506Z [2024-04-12 01:25:01,998: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:25:01.998576156Z [2024-04-12 01:25:01,998: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:25:01.998748544Z [2024-04-12 01:25:01,998: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:25:02.090738979Z [2024-04-12 01:25:02,090: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:02.646101724Z [2024-04-12 01:25:02,645: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:25:02.651194880Z [2024-04-12 01:25:02,650: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:02.685179488Z [2024-04-12 01:25:02,684: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:25:02.686346573Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:02.686457565Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:02.686511915Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:02.686569999Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:25:02.686779041Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:25:02.686821417Z [2024-04-12 01:25:02,686: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:02.724998505Z [2024-04-12 01:25:02,724: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:25:02.727965436Z [2024-04-12 01:25:02,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:02.760937400Z [2024-04-12 01:25:02,760: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:02.763805920Z [2024-04-12 01:25:02,763: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:25:02.764835905Z [2024-04-12 01:25:02,764: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:02.764926743Z [2024-04-12 01:25:02,764: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:02.765306712Z [2024-04-12 01:25:02,764: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:02.765316837Z [2024-04-12 01:25:02,765: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:25:02.765910427Z [2024-04-12 01:25:02,765: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:25:02.766043579Z [2024-04-12 01:25:02,765: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:02.794037681Z [2024-04-12 01:25:02,793: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dccaa452-31d2-44f3-8814-8f1539dcaf39] succeeded in 1.7202194049987156s: None 2024-04-12T01:25:02.854944275Z [2024-04-12 01:25:02,854: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:02.986139861Z [2024-04-12 01:25:02,985: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:25:02.989713689Z [2024-04-12 01:25:02,989: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:03.029463129Z [2024-04-12 01:25:03,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:25:03.031169895Z [2024-04-12 01:25:03,030: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:03.031495684Z [2024-04-12 01:25:03,031: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:03.031829870Z [2024-04-12 01:25:03,031: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:03.032116071Z [2024-04-12 01:25:03,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:25:03.033098773Z [2024-04-12 01:25:03,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:25:03.033412335Z [2024-04-12 01:25:03,033: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:03.169828008Z [2024-04-12 01:25:03,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:03.785363367Z [2024-04-12 01:25:03,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e20c36f0-0e84-43e8-8c41-3f59a02048d0] succeeded in 2.716667497999879s: None 2024-04-12T01:25:04.522436065Z [2024-04-12 01:25:04,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2ca59ef-7ed2-4a16-96f4-0892a77e8243] received 2024-04-12T01:25:04.555690008Z [2024-04-12 01:25:04,554: INFO/ForkPoolWorker-15] [e2ca59ef-7ed2-4a16-96f4-0892a77e8243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:04.601390193Z [2024-04-12 01:25:04,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c64e8ea6-02b7-4359-b82e-5b9713c4206e] succeeded in 3.531455932999961s: None 2024-04-12T01:25:04.693092219Z [2024-04-12 01:25:04,692: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9efceeb1-aee6-48c5-99ef-9ddcb04a5e81] succeeded in 3.6216347469999164s: None 2024-04-12T01:25:04.825857781Z [2024-04-12 01:25:04,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:25:05.811605456Z [2024-04-12 01:25:05,811: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:25:05.814448308Z [2024-04-12 01:25:05,814: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:05.831616119Z [2024-04-12 01:25:05,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:25:05.832687370Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:05.832750340Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:05.832776143Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:05.832836432Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:25:05.833142839Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:25:05.833160342Z [2024-04-12 01:25:05,832: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:05.931257519Z [2024-04-12 01:25:05,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:06.667943721Z [2024-04-12 01:25:06,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2ca59ef-7ed2-4a16-96f4-0892a77e8243] succeeded in 2.140455798000403s: None 2024-04-12T01:25:07.130320248Z [2024-04-12 01:25:07,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[779bc609-177b-46b9-bcb1-c005541b5668] received 2024-04-12T01:25:07.140569915Z [2024-04-12 01:25:07,140: INFO/ForkPoolWorker-15] [779bc609-177b-46b9-bcb1-c005541b5668] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:25:07.409621554Z [2024-04-12 01:25:07,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:25:08.447565788Z [2024-04-12 01:25:08,447: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:25:08.450512339Z [2024-04-12 01:25:08,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:08.472506268Z [2024-04-12 01:25:08,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:25:08.473841018Z [2024-04-12 01:25:08,473: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:08.474024891Z [2024-04-12 01:25:08,473: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:08.474263295Z [2024-04-12 01:25:08,474: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:08.474420084Z [2024-04-12 01:25:08,474: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:25:08.474758451Z [2024-04-12 01:25:08,474: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:25:08.474955667Z [2024-04-12 01:25:08,474: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:08.583918237Z [2024-04-12 01:25:08,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:09.108203422Z [2024-04-12 01:25:09,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[779bc609-177b-46b9-bcb1-c005541b5668] succeeded in 1.9756453879999754s: None 2024-04-12T01:25:09.927398259Z [2024-04-12 01:25:09,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c79f57d-338c-495e-adee-d1753a1ba72a] received 2024-04-12T01:25:09.938037381Z [2024-04-12 01:25:09,937: INFO/ForkPoolWorker-15] [5c79f57d-338c-495e-adee-d1753a1ba72a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:10.223561019Z [2024-04-12 01:25:10,220: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:25:11.156290590Z [2024-04-12 01:25:11,155: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:25:11.160104822Z [2024-04-12 01:25:11,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:25:11.184483660Z [2024-04-12 01:25:11,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:25:11.185727340Z [2024-04-12 01:25:11,185: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:25:11.185737744Z [2024-04-12 01:25:11,185: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:25:11.185929228Z [2024-04-12 01:25:11,185: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:25:11.185936712Z [2024-04-12 01:25:11,185: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:25:11.186278801Z [2024-04-12 01:25:11,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:25:11.186391957Z [2024-04-12 01:25:11,186: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:25:11.242837288Z [2024-04-12 01:25:11,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:25:11.773457063Z [2024-04-12 01:25:11,773: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c79f57d-338c-495e-adee-d1753a1ba72a] succeeded in 1.8437955879999208s: None 2024-04-12T01:26:00.387241280Z [2024-04-12 01:26:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0268b652-5c71-4b6a-8762-25d1efa3f943] received 2024-04-12T01:26:00.391309048Z [2024-04-12 01:26:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6f9ee6-c453-47b3-b285-e869c9c1b681] received 2024-04-12T01:26:00.400605269Z [2024-04-12 01:26:00,400: INFO/ForkPoolWorker-15] [0268b652-5c71-4b6a-8762-25d1efa3f943] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:26:00.401327787Z [2024-04-12 01:26:00,401: INFO/ForkPoolWorker-16] [ce6f9ee6-c453-47b3-b285-e869c9c1b681] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:26:00.401848979Z [2024-04-12 01:26:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[874fb000-552b-475c-b44a-65a46695b709] received 2024-04-12T01:26:00.404225139Z [2024-04-12 01:26:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36612e66-6eca-4209-ba93-f875d786ba7c] received 2024-04-12T01:26:00.415894898Z [2024-04-12 01:26:00,415: INFO/ForkPoolWorker-2] [36612e66-6eca-4209-ba93-f875d786ba7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:26:00.427836294Z [2024-04-12 01:26:00,427: INFO/ForkPoolWorker-1] [874fb000-552b-475c-b44a-65a46695b709] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:26:00.672971469Z [2024-04-12 01:26:00,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:26:00.692814130Z [2024-04-12 01:26:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:26:00.714111975Z [2024-04-12 01:26:00,710: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:26:00.799215892Z [2024-04-12 01:26:00,794: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:26:00.857562146Z [2024-04-12 01:26:00,857: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:26:00.861634869Z [2024-04-12 01:26:00,861: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:26:00.902152420Z [2024-04-12 01:26:00,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:26:00.904199083Z [2024-04-12 01:26:00,903: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:26:00.904278314Z [2024-04-12 01:26:00,904: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:26:00.904285589Z [2024-04-12 01:26:00,904: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:26:00.904458365Z [2024-04-12 01:26:00,904: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:26:00.910842787Z [2024-04-12 01:26:00,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:26:00.986375333Z [2024-04-12 01:26:00,986: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:26:01.452880622Z [2024-04-12 01:26:01,452: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[874fb000-552b-475c-b44a-65a46695b709] succeeded in 1.048702243999287s: None 2024-04-12T01:26:01.457817965Z [2024-04-12 01:26:01,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0268b652-5c71-4b6a-8762-25d1efa3f943] succeeded in 1.065862940999068s: None 2024-04-12T01:26:01.954243094Z [2024-04-12 01:26:01,953: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:26:01.957459562Z [2024-04-12 01:26:01,957: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:26:01.989246536Z [2024-04-12 01:26:01,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:26:01.990910653Z [2024-04-12 01:26:01,990: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:26:01.991308093Z [2024-04-12 01:26:01,991: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:26:01.991692790Z [2024-04-12 01:26:01,991: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:26:01.991895907Z [2024-04-12 01:26:01,991: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:26:01.992322727Z [2024-04-12 01:26:01,992: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:26:01.992645431Z [2024-04-12 01:26:01,992: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:26:02.028048619Z [2024-04-12 01:26:02,027: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:26:02.033875014Z [2024-04-12 01:26:02,033: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:26:02.050776895Z [2024-04-12 01:26:02,050: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:26:02.051729316Z [2024-04-12 01:26:02,051: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:26:02.051796510Z [2024-04-12 01:26:02,051: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:26:02.051940864Z [2024-04-12 01:26:02,051: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:26:02.051986716Z [2024-04-12 01:26:02,051: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:26:02.052337404Z [2024-04-12 01:26:02,052: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:26:02.052428342Z [2024-04-12 01:26:02,052: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:26:02.066093268Z [2024-04-12 01:26:02,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:26:02.119015436Z [2024-04-12 01:26:02,118: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:26:03.554487499Z [2024-04-12 01:26:03,554: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[36612e66-6eca-4209-ba93-f875d786ba7c] succeeded in 3.1469661720002478s: None 2024-04-12T01:26:03.922008652Z [2024-04-12 01:26:03,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ce6f9ee6-c453-47b3-b285-e869c9c1b681] succeeded in 3.525999346999015s: None 2024-04-12T01:27:00.851201442Z [2024-04-12 01:27:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e8543a4-d12e-45ae-a83c-1a7603c691fa] received 2024-04-12T01:27:00.853014816Z [2024-04-12 01:27:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98ba4e88-fd6c-4f36-96b5-81bef123df89] received 2024-04-12T01:27:00.860069881Z [2024-04-12 01:27:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2041b691-9a46-4084-82a7-3b48544cb268] received 2024-04-12T01:27:00.869389883Z [2024-04-12 01:27:00,869: INFO/ForkPoolWorker-1] [2041b691-9a46-4084-82a7-3b48544cb268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:27:00.873249749Z [2024-04-12 01:27:00,872: INFO/ForkPoolWorker-15] [7e8543a4-d12e-45ae-a83c-1a7603c691fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:27:00.876753128Z [2024-04-12 01:27:00,876: INFO/ForkPoolWorker-16] [98ba4e88-fd6c-4f36-96b5-81bef123df89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:27:01.155235132Z [2024-04-12 01:27:01,151: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:27:01.188063268Z [2024-04-12 01:27:01,185: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:27:01.197468442Z [2024-04-12 01:27:01,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:27:01.351930935Z [2024-04-12 01:27:01,351: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:27:01.356043902Z [2024-04-12 01:27:01,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:27:01.383252312Z [2024-04-12 01:27:01,382: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:27:01.384488956Z [2024-04-12 01:27:01,384: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:27:01.384529480Z [2024-04-12 01:27:01,384: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:27:01.384607974Z [2024-04-12 01:27:01,384: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:27:01.384808292Z [2024-04-12 01:27:01,384: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:27:01.499880171Z [2024-04-12 01:27:01,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:27:02.147736107Z [2024-04-12 01:27:02,147: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e8543a4-d12e-45ae-a83c-1a7603c691fa] succeeded in 1.2928225890009344s: None 2024-04-12T01:27:02.297619869Z [2024-04-12 01:27:02,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:27:02.300492140Z [2024-04-12 01:27:02,300: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:27:02.323162622Z [2024-04-12 01:27:02,322: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:27:02.324367147Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:27:02.324432341Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:27:02.324613478Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:27:02.324636489Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:27:02.324861262Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:27:02.324870001Z [2024-04-12 01:27:02,324: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:27:02.421127676Z [2024-04-12 01:27:02,420: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:27:02.602615307Z [2024-04-12 01:27:02,602: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:27:02.606119524Z [2024-04-12 01:27:02,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:27:02.629074735Z [2024-04-12 01:27:02,628: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:27:02.630357566Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:27:02.630473871Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:27:02.630638619Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:27:02.630709660Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:27:02.630941931Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:27:02.631032101Z [2024-04-12 01:27:02,630: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:27:02.734217866Z [2024-04-12 01:27:02,733: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:27:04.606659663Z [2024-04-12 01:27:04,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2041b691-9a46-4084-82a7-3b48544cb268] succeeded in 3.744462886999827s: None 2024-04-12T01:27:04.830634031Z [2024-04-12 01:27:04,830: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98ba4e88-fd6c-4f36-96b5-81bef123df89] succeeded in 3.9690751460002502s: None 2024-04-12T01:28:01.266771260Z [2024-04-12 01:28:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffe08aa0-ada5-4ed6-81b5-65a6ab633208] received 2024-04-12T01:28:01.269650082Z [2024-04-12 01:28:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3698ef80-3a61-425f-987b-c88979ac1472] received 2024-04-12T01:28:01.275793996Z [2024-04-12 01:28:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42ddb032-ce18-4414-be92-1a501f0731c9] received 2024-04-12T01:28:01.278856111Z [2024-04-12 01:28:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[611717a7-34cc-49cc-b589-75ab09b1819a] received 2024-04-12T01:28:01.279357781Z [2024-04-12 01:28:01,279: INFO/ForkPoolWorker-15] [ffe08aa0-ada5-4ed6-81b5-65a6ab633208] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:28:01.283706723Z [2024-04-12 01:28:01,283: INFO/ForkPoolWorker-16] [3698ef80-3a61-425f-987b-c88979ac1472] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:28:01.302999123Z [2024-04-12 01:28:01,302: INFO/ForkPoolWorker-1] [42ddb032-ce18-4414-be92-1a501f0731c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:28:01.305251897Z [2024-04-12 01:28:01,304: INFO/ForkPoolWorker-2] [611717a7-34cc-49cc-b589-75ab09b1819a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:28:01.628425951Z [2024-04-12 01:28:01,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:28:01.684492117Z [2024-04-12 01:28:01,680: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:28:01.734479342Z [2024-04-12 01:28:01,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:28:01.842951838Z [2024-04-12 01:28:01,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:28:01.861539341Z [2024-04-12 01:28:01,861: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:28:01.865513762Z [2024-04-12 01:28:01,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:28:01.905539771Z [2024-04-12 01:28:01,905: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:28:01.907791560Z [2024-04-12 01:28:01,907: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:28:01.908134216Z [2024-04-12 01:28:01,907: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:28:01.908611770Z [2024-04-12 01:28:01,908: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:28:01.909082123Z [2024-04-12 01:28:01,908: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:28:02.004442750Z [2024-04-12 01:28:02,004: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:28:02.143430636Z [2024-04-12 01:28:02,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:28:02.675730395Z [2024-04-12 01:28:02,675: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3698ef80-3a61-425f-987b-c88979ac1472] succeeded in 1.403974995999306s: None 2024-04-12T01:28:02.709580409Z [2024-04-12 01:28:02,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffe08aa0-ada5-4ed6-81b5-65a6ab633208] succeeded in 1.4414356059987767s: None 2024-04-12T01:28:03.031755826Z [2024-04-12 01:28:03,031: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:28:03.035111289Z [2024-04-12 01:28:03,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:28:03.043674286Z [2024-04-12 01:28:03,043: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:28:03.047728665Z [2024-04-12 01:28:03,046: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:28:03.061537505Z [2024-04-12 01:28:03,061: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:28:03.063175331Z [2024-04-12 01:28:03,062: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:28:03.063274463Z [2024-04-12 01:28:03,063: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:28:03.063527396Z [2024-04-12 01:28:03,063: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:28:03.063533753Z [2024-04-12 01:28:03,063: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:28:03.064268903Z [2024-04-12 01:28:03,063: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:28:03.064277219Z [2024-04-12 01:28:03,063: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:28:03.101716380Z [2024-04-12 01:28:03,101: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:28:03.103614414Z [2024-04-12 01:28:03,103: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:28:03.103630093Z [2024-04-12 01:28:03,103: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:28:03.103843737Z [2024-04-12 01:28:03,103: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:28:03.103891440Z [2024-04-12 01:28:03,103: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:28:03.104509851Z [2024-04-12 01:28:03,104: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:28:03.104585823Z [2024-04-12 01:28:03,104: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:28:03.141728709Z [2024-04-12 01:28:03,141: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:28:03.232060090Z [2024-04-12 01:28:03,231: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:28:05.165573111Z [2024-04-12 01:28:05,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42ddb032-ce18-4414-be92-1a501f0731c9] succeeded in 3.8812417120007012s: None 2024-04-12T01:28:05.559688763Z [2024-04-12 01:28:05,558: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[611717a7-34cc-49cc-b589-75ab09b1819a] succeeded in 4.277632024000923s: None 2024-04-12T01:29:00.620039895Z [2024-04-12 01:29:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[765f2aa1-4926-40b4-87f1-b4798cb946e0] received 2024-04-12T01:29:00.622327448Z [2024-04-12 01:29:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3bc77bf-6b90-46cd-9f85-e50791e5e0d4] received 2024-04-12T01:29:00.623983103Z [2024-04-12 01:29:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7c01a45-2588-4c21-ba9f-c2030c65bd08] received 2024-04-12T01:29:00.631967295Z [2024-04-12 01:29:00,631: INFO/ForkPoolWorker-15] [765f2aa1-4926-40b4-87f1-b4798cb946e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:29:00.632816050Z [2024-04-12 01:29:00,632: INFO/ForkPoolWorker-16] [b3bc77bf-6b90-46cd-9f85-e50791e5e0d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:29:00.637481482Z [2024-04-12 01:29:00,637: INFO/ForkPoolWorker-1] [f7c01a45-2588-4c21-ba9f-c2030c65bd08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:29:00.871635165Z [2024-04-12 01:29:00,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:29:00.919803641Z [2024-04-12 01:29:00,917: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:29:00.946171057Z [2024-04-12 01:29:00,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:29:01.107143339Z [2024-04-12 01:29:01,106: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:29:01.111288190Z [2024-04-12 01:29:01,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:29:01.136928527Z [2024-04-12 01:29:01,136: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:29:01.138123766Z [2024-04-12 01:29:01,137: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:29:01.138340211Z [2024-04-12 01:29:01,138: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:29:01.138523876Z [2024-04-12 01:29:01,138: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:29:01.138884440Z [2024-04-12 01:29:01,138: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:29:01.237600875Z [2024-04-12 01:29:01,237: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:29:01.825390457Z [2024-04-12 01:29:01,824: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3bc77bf-6b90-46cd-9f85-e50791e5e0d4] succeeded in 1.1999726740014012s: None 2024-04-12T01:29:01.945031823Z [2024-04-12 01:29:01,944: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:29:01.947920962Z [2024-04-12 01:29:01,947: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:29:01.963579321Z [2024-04-12 01:29:01,963: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:29:01.964710095Z [2024-04-12 01:29:01,964: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:29:01.964796871Z [2024-04-12 01:29:01,964: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:29:01.964873918Z [2024-04-12 01:29:01,964: INFO/ForkPoolWorker-1] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:29:01.965036669Z [2024-04-12 01:29:01,964: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:29:01.965107850Z [2024-04-12 01:29:01,965: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:29:01.965361578Z [2024-04-12 01:29:01,965: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:29:01.965413664Z [2024-04-12 01:29:01,965: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:29:01.969367473Z [2024-04-12 01:29:01,969: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:29:01.982773339Z [2024-04-12 01:29:01,982: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:29:01.985721118Z [2024-04-12 01:29:01,985: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:29:02.006492529Z [2024-04-12 01:29:02,006: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:29:02.009464299Z [2024-04-12 01:29:02,009: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:29:02.009711420Z [2024-04-12 01:29:02,009: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:29:02.010003310Z [2024-04-12 01:29:02,009: INFO/ForkPoolWorker-15] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:29:02.010515918Z [2024-04-12 01:29:02,010: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:29:02.010858896Z [2024-04-12 01:29:02,010: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:29:02.011436559Z [2024-04-12 01:29:02,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:29:02.011813661Z [2024-04-12 01:29:02,011: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:29:02.017805714Z [2024-04-12 01:29:02,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:29:02.033407652Z [2024-04-12 01:29:02,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:29:02.107385921Z [2024-04-12 01:29:02,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:29:03.468530659Z [2024-04-12 01:29:03,467: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7c01a45-2588-4c21-ba9f-c2030c65bd08] succeeded in 2.8403367580012855s: None 2024-04-12T01:29:03.904031482Z [2024-04-12 01:29:03,903: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[765f2aa1-4926-40b4-87f1-b4798cb946e0] succeeded in 3.2817921259993454s: None 2024-04-12T01:30:00.967223717Z [2024-04-12 01:30:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfe2a18f-6c73-4667-b101-cb60bd8c723a] received 2024-04-12T01:30:00.978942037Z [2024-04-12 01:30:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b16ff1f-76e5-4c48-b91f-9f6e5cfa3eff] received 2024-04-12T01:30:00.979575509Z [2024-04-12 01:30:00,978: INFO/ForkPoolWorker-15] [bfe2a18f-6c73-4667-b101-cb60bd8c723a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:00.981087389Z [2024-04-12 01:30:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56601fe6-eb30-49a4-91c0-29a45b7bd392] received 2024-04-12T01:30:00.982689304Z [2024-04-12 01:30:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ec7f24a-889b-4606-8a43-3481f6512c6c] received 2024-04-12T01:30:00.984966800Z [2024-04-12 01:30:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05d86b9e-f122-41da-aef3-137ee3b83178] received 2024-04-12T01:30:00.996759785Z [2024-04-12 01:30:00,996: INFO/ForkPoolWorker-16] [0b16ff1f-76e5-4c48-b91f-9f6e5cfa3eff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:30:01.015218678Z [2024-04-12 01:30:01,014: INFO/ForkPoolWorker-1] [56601fe6-eb30-49a4-91c0-29a45b7bd392] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:30:01.015435089Z [2024-04-12 01:30:01,014: INFO/ForkPoolWorker-2] [0ec7f24a-889b-4606-8a43-3481f6512c6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:30:01.024496654Z [2024-04-12 01:30:01,024: INFO/ForkPoolWorker-3] [05d86b9e-f122-41da-aef3-137ee3b83178] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:30:01.284163013Z [2024-04-12 01:30:01,279: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:30:01.345198449Z [2024-04-12 01:30:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:30:01.420909412Z [2024-04-12 01:30:01,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:30:01.533680342Z [2024-04-12 01:30:01,529: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:30:01.602287901Z [2024-04-12 01:30:01,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:30:01.710448133Z [2024-04-12 01:30:01,710: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T01:30:01.717345048Z [2024-04-12 01:30:01,716: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:01.743112270Z [2024-04-12 01:30:01,742: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:30:01.744459229Z [2024-04-12 01:30:01,744: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:30:01.744593606Z [2024-04-12 01:30:01,744: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:30:01.744674627Z [2024-04-12 01:30:01,744: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T01:30:01.744880345Z [2024-04-12 01:30:01,744: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:30:01.856017210Z [2024-04-12 01:30:01,855: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:02.123972733Z [2024-04-12 01:30:02,123: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:02.490348814Z [2024-04-12 01:30:02,489: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[05d86b9e-f122-41da-aef3-137ee3b83178] succeeded in 1.5021797879999212s: None 2024-04-12T01:30:02.683526180Z [2024-04-12 01:30:02,683: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:30:02.683843540Z [2024-04-12 01:30:02,683: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56601fe6-eb30-49a4-91c0-29a45b7bd392] succeeded in 1.6889715130000695s: None 2024-04-12T01:30:02.688308959Z [2024-04-12 01:30:02,687: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:02.709242066Z [2024-04-12 01:30:02,709: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:30:02.710510750Z [2024-04-12 01:30:02,710: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:02.710549987Z [2024-04-12 01:30:02,710: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:02.710610260Z [2024-04-12 01:30:02,710: INFO/ForkPoolWorker-2] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:02.710753947Z [2024-04-12 01:30:02,710: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:02.710798009Z [2024-04-12 01:30:02,710: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:30:02.711469579Z [2024-04-12 01:30:02,711: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:30:02.711519829Z [2024-04-12 01:30:02,711: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:02.716160225Z [2024-04-12 01:30:02,716: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:30:02.785470680Z [2024-04-12 01:30:02,785: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:02.937687217Z [2024-04-12 01:30:02,937: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:30:02.940743436Z [2024-04-12 01:30:02,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:02.946437137Z [2024-04-12 01:30:02,946: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:30:02.949632846Z [2024-04-12 01:30:02,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:02.966842132Z [2024-04-12 01:30:02,966: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:30:02.968240621Z [2024-04-12 01:30:02,968: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:02.968481983Z [2024-04-12 01:30:02,968: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:02.968607149Z [2024-04-12 01:30:02,968: INFO/ForkPoolWorker-16] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:02.968957992Z [2024-04-12 01:30:02,968: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:02.969168486Z [2024-04-12 01:30:02,968: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:30:02.969621527Z [2024-04-12 01:30:02,969: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:30:02.969745576Z [2024-04-12 01:30:02,969: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:02.970148901Z [2024-04-12 01:30:02,969: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:30:02.971390492Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:02.971551226Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:02.971631239Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:02.971781304Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:02.971854760Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:30:02.972078760Z [2024-04-12 01:30:02,971: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:02.972171710Z [2024-04-12 01:30:02,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:02.975144508Z [2024-04-12 01:30:02,974: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:30:02.977449325Z [2024-04-12 01:30:02,977: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:03.041334375Z [2024-04-12 01:30:03,041: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:03.057728960Z [2024-04-12 01:30:03,057: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:03.608151251Z [2024-04-12 01:30:03,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfe2a18f-6c73-4667-b101-cb60bd8c723a] succeeded in 2.6381169080013933s: None 2024-04-12T01:30:03.990478679Z [2024-04-12 01:30:03,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3632d5ea-eff8-47b9-a440-830d723493f7] received 2024-04-12T01:30:03.998944985Z [2024-04-12 01:30:03,998: INFO/ForkPoolWorker-15] [3632d5ea-eff8-47b9-a440-830d723493f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:04.311357596Z [2024-04-12 01:30:04,310: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0ec7f24a-889b-4606-8a43-3481f6512c6c] succeeded in 3.3241909010012023s: None 2024-04-12T01:30:04.360700409Z [2024-04-12 01:30:04,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:30:04.739302313Z [2024-04-12 01:30:04,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b16ff1f-76e5-4c48-b91f-9f6e5cfa3eff] succeeded in 3.757662091999009s: None 2024-04-12T01:30:05.342319492Z [2024-04-12 01:30:05,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:30:05.345611299Z [2024-04-12 01:30:05,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:05.372892814Z [2024-04-12 01:30:05,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:30:05.374711567Z [2024-04-12 01:30:05,374: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:05.374761522Z [2024-04-12 01:30:05,374: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:05.374819512Z [2024-04-12 01:30:05,374: INFO/ForkPoolWorker-15] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:05.375144711Z [2024-04-12 01:30:05,374: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:05.375288686Z [2024-04-12 01:30:05,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:30:05.375674526Z [2024-04-12 01:30:05,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:05.375876662Z [2024-04-12 01:30:05,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:05.383706039Z [2024-04-12 01:30:05,383: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:05.475772635Z [2024-04-12 01:30:05,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:06.165996308Z [2024-04-12 01:30:06,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3632d5ea-eff8-47b9-a440-830d723493f7] succeeded in 2.172798960000364s: None 2024-04-12T01:30:07.003195725Z [2024-04-12 01:30:07,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de492f39-65d0-4e01-a532-ec1dc9b4eca8] received 2024-04-12T01:30:07.013810908Z [2024-04-12 01:30:07,013: INFO/ForkPoolWorker-15] [de492f39-65d0-4e01-a532-ec1dc9b4eca8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:30:07.254916392Z [2024-04-12 01:30:07,251: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:30:08.365502728Z [2024-04-12 01:30:08,365: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:30:08.368176068Z [2024-04-12 01:30:08,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:08.388827668Z [2024-04-12 01:30:08,388: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:30:08.390674126Z [2024-04-12 01:30:08,390: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:08.390796602Z [2024-04-12 01:30:08,390: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:08.390937596Z [2024-04-12 01:30:08,390: INFO/ForkPoolWorker-15] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:08.391147222Z [2024-04-12 01:30:08,390: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:08.391251886Z [2024-04-12 01:30:08,391: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:30:08.391587579Z [2024-04-12 01:30:08,391: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:08.391828964Z [2024-04-12 01:30:08,391: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:08.398041389Z [2024-04-12 01:30:08,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:08.497622254Z [2024-04-12 01:30:08,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:09.108809381Z [2024-04-12 01:30:09,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de492f39-65d0-4e01-a532-ec1dc9b4eca8] succeeded in 2.101638362999438s: None 2024-04-12T01:30:09.415500273Z [2024-04-12 01:30:09,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca218920-fb8d-4733-9c13-48d146b85255] received 2024-04-12T01:30:09.424772104Z [2024-04-12 01:30:09,424: INFO/ForkPoolWorker-15] [ca218920-fb8d-4733-9c13-48d146b85255] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:09.665340337Z [2024-04-12 01:30:09,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:30:10.592037817Z [2024-04-12 01:30:10,591: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:30:10.594719952Z [2024-04-12 01:30:10,594: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:30:10.618559142Z [2024-04-12 01:30:10,618: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:30:10.620363096Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:30:10.620473255Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:30:10.620604825Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] Read VIM 1c512681-7415-4a15-8d71-b3c20ca64b18 (k8s07_dummy) 2024-04-12T01:30:10.620753055Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c512681-7415-4a15-8d71-b3c20ca64b18', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-12T01:30:10.620767811Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:30:10.620975623Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:10.621041278Z [2024-04-12 01:30:10,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:30:10.628600952Z [2024-04-12 01:30:10,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:30:10.709001665Z [2024-04-12 01:30:10,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:30:11.294647705Z [2024-04-12 01:30:11,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca218920-fb8d-4733-9c13-48d146b85255] succeeded in 1.8762269350008864s: None 2024-04-12T01:31:00.890203443Z [2024-04-12 01:31:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c47b5060-fab4-4f50-b8c4-a1a02c16dabb] received 2024-04-12T01:31:00.896765450Z [2024-04-12 01:31:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cf1aff2-fe30-4e42-a1b0-3d68a1c42237] received 2024-04-12T01:31:00.902851134Z [2024-04-12 01:31:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7938c28e-807c-4d81-bb16-08043257e7bb] received 2024-04-12T01:31:00.906050088Z [2024-04-12 01:31:00,905: INFO/ForkPoolWorker-15] [c47b5060-fab4-4f50-b8c4-a1a02c16dabb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:31:00.910209370Z [2024-04-12 01:31:00,909: INFO/ForkPoolWorker-16] [3cf1aff2-fe30-4e42-a1b0-3d68a1c42237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:31:00.915917076Z [2024-04-12 01:31:00,915: INFO/ForkPoolWorker-1] [7938c28e-807c-4d81-bb16-08043257e7bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:31:01.147265574Z [2024-04-12 01:31:01,144: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:31:01.168453164Z [2024-04-12 01:31:01,165: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:31:01.205433687Z [2024-04-12 01:31:01,202: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:31:01.360401637Z [2024-04-12 01:31:01,359: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:31:01.365705320Z [2024-04-12 01:31:01,365: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:31:01.397234839Z [2024-04-12 01:31:01,397: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:31:01.401073012Z [2024-04-12 01:31:01,400: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:31:01.401493315Z [2024-04-12 01:31:01,401: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:31:01.401593566Z [2024-04-12 01:31:01,401: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:31:01.401840114Z [2024-04-12 01:31:01,401: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:31:01.503773764Z [2024-04-12 01:31:01,503: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:31:02.052305077Z [2024-04-12 01:31:02,051: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7938c28e-807c-4d81-bb16-08043257e7bb] succeeded in 1.147767673999624s: None 2024-04-12T01:31:02.154217191Z [2024-04-12 01:31:02,153: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:31:02.157109494Z [2024-04-12 01:31:02,156: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:31:02.180364061Z [2024-04-12 01:31:02,180: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:31:02.181917081Z [2024-04-12 01:31:02,181: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:31:02.182143236Z [2024-04-12 01:31:02,182: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:31:02.182363478Z [2024-04-12 01:31:02,182: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:31:02.182534471Z [2024-04-12 01:31:02,182: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:31:02.182845162Z [2024-04-12 01:31:02,182: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:31:02.183366829Z [2024-04-12 01:31:02,183: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:31:02.256520644Z [2024-04-12 01:31:02,256: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:31:02.270205408Z [2024-04-12 01:31:02,269: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:31:02.272882370Z [2024-04-12 01:31:02,272: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:31:02.289233904Z [2024-04-12 01:31:02,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:31:02.290589708Z [2024-04-12 01:31:02,290: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:31:02.290712910Z [2024-04-12 01:31:02,290: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:31:02.290871941Z [2024-04-12 01:31:02,290: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:31:02.290937826Z [2024-04-12 01:31:02,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:31:02.291123820Z [2024-04-12 01:31:02,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:31:02.291200894Z [2024-04-12 01:31:02,291: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:31:02.367059024Z [2024-04-12 01:31:02,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:31:03.659053386Z [2024-04-12 01:31:03,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cf1aff2-fe30-4e42-a1b0-3d68a1c42237] succeeded in 2.760407779000161s: None 2024-04-12T01:31:04.285595277Z [2024-04-12 01:31:04,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c47b5060-fab4-4f50-b8c4-a1a02c16dabb] succeeded in 3.391464698999698s: None 2024-04-12T01:32:00.345681143Z [2024-04-12 01:32:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[366be342-f597-42fb-813d-b2ecd6391dcc] received 2024-04-12T01:32:00.351881910Z [2024-04-12 01:32:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e642260-6861-49fa-bd10-5a501757cf06] received 2024-04-12T01:32:00.355206242Z [2024-04-12 01:32:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b5a3621-1db1-4dc3-b432-9e168d05063b] received 2024-04-12T01:32:00.360092097Z [2024-04-12 01:32:00,359: INFO/ForkPoolWorker-15] [366be342-f597-42fb-813d-b2ecd6391dcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:32:00.362579976Z [2024-04-12 01:32:00,362: INFO/ForkPoolWorker-16] [3e642260-6861-49fa-bd10-5a501757cf06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:32:00.365300701Z [2024-04-12 01:32:00,365: INFO/ForkPoolWorker-1] [5b5a3621-1db1-4dc3-b432-9e168d05063b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:32:00.370794429Z [2024-04-12 01:32:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[456d8f19-255e-469c-8b7d-920652ab7f19] received 2024-04-12T01:32:00.379293464Z [2024-04-12 01:32:00,379: INFO/ForkPoolWorker-2] [456d8f19-255e-469c-8b7d-920652ab7f19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:32:00.651601093Z [2024-04-12 01:32:00,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:32:00.674524030Z [2024-04-12 01:32:00,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:32:00.676351194Z [2024-04-12 01:32:00,672: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:32:00.727246309Z [2024-04-12 01:32:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:32:00.817966328Z [2024-04-12 01:32:00,817: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:32:00.821389821Z [2024-04-12 01:32:00,821: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:32:00.845556002Z [2024-04-12 01:32:00,845: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:32:00.849082871Z [2024-04-12 01:32:00,848: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:32:00.849140170Z [2024-04-12 01:32:00,849: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:32:00.849197652Z [2024-04-12 01:32:00,849: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:32:00.849390173Z [2024-04-12 01:32:00,849: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:32:00.949568388Z [2024-04-12 01:32:00,949: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:32:01.008784696Z [2024-04-12 01:32:01,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:32:01.470043377Z [2024-04-12 01:32:01,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[366be342-f597-42fb-813d-b2ecd6391dcc] succeeded in 1.1169404850006686s: None 2024-04-12T01:32:01.557223261Z [2024-04-12 01:32:01,556: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[456d8f19-255e-469c-8b7d-920652ab7f19] succeeded in 1.1843720070010022s: None 2024-04-12T01:32:01.769574011Z [2024-04-12 01:32:01,769: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:32:01.772457131Z [2024-04-12 01:32:01,772: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:32:01.808601148Z [2024-04-12 01:32:01,808: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:32:01.810127648Z [2024-04-12 01:32:01,809: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:32:01.810206716Z [2024-04-12 01:32:01,810: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:32:01.810347553Z [2024-04-12 01:32:01,810: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:32:01.810418673Z [2024-04-12 01:32:01,810: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:32:01.810684834Z [2024-04-12 01:32:01,810: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:32:01.810736572Z [2024-04-12 01:32:01,810: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:32:01.834499678Z [2024-04-12 01:32:01,834: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:32:01.837206954Z [2024-04-12 01:32:01,836: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:32:01.863615061Z [2024-04-12 01:32:01,863: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:32:01.865301834Z [2024-04-12 01:32:01,865: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:32:01.865369363Z [2024-04-12 01:32:01,865: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:32:01.865835345Z [2024-04-12 01:32:01,865: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:32:01.865927515Z [2024-04-12 01:32:01,865: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:32:01.868532156Z [2024-04-12 01:32:01,866: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:32:01.868588706Z [2024-04-12 01:32:01,868: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:32:01.914753082Z [2024-04-12 01:32:01,914: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:32:01.943517209Z [2024-04-12 01:32:01,943: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:32:03.374914909Z [2024-04-12 01:32:03,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b5a3621-1db1-4dc3-b432-9e168d05063b] succeeded in 3.0174114079982246s: None 2024-04-12T01:32:03.724214846Z [2024-04-12 01:32:03,723: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e642260-6861-49fa-bd10-5a501757cf06] succeeded in 3.3699479710012383s: None 2024-04-12T01:33:00.302707046Z [2024-04-12 01:33:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4733727-3412-445e-8511-4ab1b1168d79] received 2024-04-12T01:33:00.304782056Z [2024-04-12 01:33:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dfc263a-e08b-459a-8792-ef4d210951b8] received 2024-04-12T01:33:00.313029140Z [2024-04-12 01:33:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20de6c7c-7871-4734-bedf-1821f0066480] received 2024-04-12T01:33:00.313568956Z [2024-04-12 01:33:00,313: INFO/ForkPoolWorker-15] [f4733727-3412-445e-8511-4ab1b1168d79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:33:00.313939863Z [2024-04-12 01:33:00,313: INFO/ForkPoolWorker-16] [3dfc263a-e08b-459a-8792-ef4d210951b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:33:00.338221294Z [2024-04-12 01:33:00,337: INFO/ForkPoolWorker-1] [20de6c7c-7871-4734-bedf-1821f0066480] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:33:00.647140757Z [2024-04-12 01:33:00,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:33:00.673375861Z [2024-04-12 01:33:00,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:33:00.675601041Z [2024-04-12 01:33:00,672: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:33:00.930043315Z [2024-04-12 01:33:00,929: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:33:00.934571477Z [2024-04-12 01:33:00,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:33:00.969172366Z [2024-04-12 01:33:00,968: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:33:00.972950690Z [2024-04-12 01:33:00,972: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:33:00.973004642Z [2024-04-12 01:33:00,972: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:33:00.973060215Z [2024-04-12 01:33:00,972: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:33:00.973232451Z [2024-04-12 01:33:00,973: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:33:01.053187480Z [2024-04-12 01:33:01,052: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:33:01.731708926Z [2024-04-12 01:33:01,731: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20de6c7c-7871-4734-bedf-1821f0066480] succeeded in 1.4052339930003654s: None 2024-04-12T01:33:01.835000869Z [2024-04-12 01:33:01,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:33:01.838095769Z [2024-04-12 01:33:01,837: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:33:01.860123107Z [2024-04-12 01:33:01,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:33:01.861609514Z [2024-04-12 01:33:01,861: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:33:01.861835213Z [2024-04-12 01:33:01,861: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:33:01.862059568Z [2024-04-12 01:33:01,861: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:33:01.862229212Z [2024-04-12 01:33:01,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:33:01.862561822Z [2024-04-12 01:33:01,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:33:01.862720311Z [2024-04-12 01:33:01,862: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:33:01.902153730Z [2024-04-12 01:33:01,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:33:01.905115289Z [2024-04-12 01:33:01,904: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:33:01.923924725Z [2024-04-12 01:33:01,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:33:01.925178260Z [2024-04-12 01:33:01,924: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:33:01.925189694Z [2024-04-12 01:33:01,925: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:33:01.925341542Z [2024-04-12 01:33:01,925: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:33:01.925383683Z [2024-04-12 01:33:01,925: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:33:01.925679248Z [2024-04-12 01:33:01,925: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:33:01.925752394Z [2024-04-12 01:33:01,925: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:33:01.982049365Z [2024-04-12 01:33:01,981: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:33:02.013628816Z [2024-04-12 01:33:02,013: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:33:03.505085651Z [2024-04-12 01:33:03,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3dfc263a-e08b-459a-8792-ef4d210951b8] succeeded in 3.1980728959988483s: None 2024-04-12T01:33:04.021024194Z [2024-04-12 01:33:04,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4733727-3412-445e-8511-4ab1b1168d79] succeeded in 3.7148577719999594s: None 2024-04-12T01:34:00.286899140Z [2024-04-12 01:34:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90afa01c-90fc-4fe6-bfa4-8bc734921b58] received 2024-04-12T01:34:00.288526944Z [2024-04-12 01:34:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bc15aba-18bd-4279-8e0f-544a708fa7f2] received 2024-04-12T01:34:00.289807594Z [2024-04-12 01:34:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[181a11a6-dbeb-4d0f-b64e-8b22ed0fd1a3] received 2024-04-12T01:34:00.297148037Z [2024-04-12 01:34:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e71f810b-c659-4250-b2f8-41286b5c9bf4] received 2024-04-12T01:34:00.298038133Z [2024-04-12 01:34:00,297: INFO/ForkPoolWorker-16] [9bc15aba-18bd-4279-8e0f-544a708fa7f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:34:00.309528015Z [2024-04-12 01:34:00,309: INFO/ForkPoolWorker-15] [90afa01c-90fc-4fe6-bfa4-8bc734921b58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:34:00.313885849Z [2024-04-12 01:34:00,313: INFO/ForkPoolWorker-2] [e71f810b-c659-4250-b2f8-41286b5c9bf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:34:00.318699918Z [2024-04-12 01:34:00,318: INFO/ForkPoolWorker-1] [181a11a6-dbeb-4d0f-b64e-8b22ed0fd1a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:34:00.625004798Z [2024-04-12 01:34:00,621: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:34:00.691695803Z [2024-04-12 01:34:00,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:34:00.792437474Z [2024-04-12 01:34:00,792: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:34:00.796482410Z [2024-04-12 01:34:00,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:34:00.833282409Z [2024-04-12 01:34:00,832: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:34:00.839160697Z [2024-04-12 01:34:00,836: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:34:00.840033731Z [2024-04-12 01:34:00,839: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:34:00.840423242Z [2024-04-12 01:34:00,840: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:34:00.840659081Z [2024-04-12 01:34:00,840: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:34:00.841059997Z [2024-04-12 01:34:00,840: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:34:00.851269518Z [2024-04-12 01:34:00,848: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:34:00.931982095Z [2024-04-12 01:34:00,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:34:00.932615140Z [2024-04-12 01:34:00,932: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:34:01.429393137Z [2024-04-12 01:34:01,428: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[181a11a6-dbeb-4d0f-b64e-8b22ed0fd1a3] succeeded in 1.133409717000177s: None 2024-04-12T01:34:01.437685157Z [2024-04-12 01:34:01,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90afa01c-90fc-4fe6-bfa4-8bc734921b58] succeeded in 1.1438527810005326s: None 2024-04-12T01:34:01.996416342Z [2024-04-12 01:34:01,996: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:34:01.999327751Z [2024-04-12 01:34:01,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:34:02.013804618Z [2024-04-12 01:34:02,013: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:34:02.014833591Z [2024-04-12 01:34:02,014: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:34:02.014946357Z [2024-04-12 01:34:02,014: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:34:02.015087408Z [2024-04-12 01:34:02,014: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:34:02.015120999Z [2024-04-12 01:34:02,015: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:34:02.015335046Z [2024-04-12 01:34:02,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:34:02.015421027Z [2024-04-12 01:34:02,015: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:34:02.092209795Z [2024-04-12 01:34:02,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:34:02.132290027Z [2024-04-12 01:34:02,131: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:34:02.135274649Z [2024-04-12 01:34:02,134: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:34:02.157989683Z [2024-04-12 01:34:02,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:34:02.159180110Z [2024-04-12 01:34:02,158: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:34:02.159213978Z [2024-04-12 01:34:02,159: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:34:02.159335923Z [2024-04-12 01:34:02,159: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:34:02.159405022Z [2024-04-12 01:34:02,159: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:34:02.159726843Z [2024-04-12 01:34:02,159: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:34:02.159744031Z [2024-04-12 01:34:02,159: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:34:02.255032940Z [2024-04-12 01:34:02,254: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:34:03.749548947Z [2024-04-12 01:34:03,749: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e71f810b-c659-4250-b2f8-41286b5c9bf4] succeeded in 3.445027792999099s: None 2024-04-12T01:34:03.923751611Z [2024-04-12 01:34:03,923: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bc15aba-18bd-4279-8e0f-544a708fa7f2] succeeded in 3.632513933000155s: None 2024-04-12T01:35:01.275069988Z [2024-04-12 01:35:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e98bd132-266a-4a32-99f7-d01350191195] received 2024-04-12T01:35:01.282975098Z [2024-04-12 01:35:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15239b08-dc40-4b77-94d4-5a31fd9c405d] received 2024-04-12T01:35:01.285114905Z [2024-04-12 01:35:01,284: INFO/ForkPoolWorker-15] [e98bd132-266a-4a32-99f7-d01350191195] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:35:01.286166162Z [2024-04-12 01:35:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b213df93-ef3a-45d3-8b21-7198f46f0605] received 2024-04-12T01:35:01.288140272Z [2024-04-12 01:35:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48ac67f6-f1bc-4231-a280-29a00235bd6e] received 2024-04-12T01:35:01.312840663Z [2024-04-12 01:35:01,312: INFO/ForkPoolWorker-16] [15239b08-dc40-4b77-94d4-5a31fd9c405d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:01.318909169Z [2024-04-12 01:35:01,318: INFO/ForkPoolWorker-2] [48ac67f6-f1bc-4231-a280-29a00235bd6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:35:01.322480542Z [2024-04-12 01:35:01,322: INFO/ForkPoolWorker-1] [b213df93-ef3a-45d3-8b21-7198f46f0605] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:35:01.826427927Z [2024-04-12 01:35:01,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:35:01.856866178Z [2024-04-12 01:35:01,854: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:35:01.987067850Z [2024-04-12 01:35:01,982: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:35:02.170349295Z [2024-04-12 01:35:02,157: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:35:02.283766680Z [2024-04-12 01:35:02,283: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:35:02.287168541Z [2024-04-12 01:35:02,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:02.309924916Z [2024-04-12 01:35:02,309: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:35:02.310840914Z [2024-04-12 01:35:02,310: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:35:02.311001710Z [2024-04-12 01:35:02,310: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:35:02.311136176Z [2024-04-12 01:35:02,310: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:35:02.311881449Z [2024-04-12 01:35:02,311: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:35:02.411725554Z [2024-04-12 01:35:02,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:03.182079564Z [2024-04-12 01:35:03,181: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e98bd132-266a-4a32-99f7-d01350191195] succeeded in 1.905403100001422s: None 2024-04-12T01:35:03.329318475Z [2024-04-12 01:35:03,328: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:35:03.332153389Z [2024-04-12 01:35:03,331: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:03.368344840Z [2024-04-12 01:35:03,368: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:35:03.369805456Z [2024-04-12 01:35:03,369: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:03.369877617Z [2024-04-12 01:35:03,369: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:03.370037308Z [2024-04-12 01:35:03,369: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:03.370119200Z [2024-04-12 01:35:03,369: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:35:03.370338142Z [2024-04-12 01:35:03,370: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:35:03.370412679Z [2024-04-12 01:35:03,370: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:03.455334510Z [2024-04-12 01:35:03,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:03.490106766Z [2024-04-12 01:35:03,489: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:35:03.493924631Z [2024-04-12 01:35:03,493: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:03.514242600Z [2024-04-12 01:35:03,513: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:35:03.516146354Z [2024-04-12 01:35:03,515: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:03.516368328Z [2024-04-12 01:35:03,516: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:03.516690051Z [2024-04-12 01:35:03,516: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:03.517126934Z [2024-04-12 01:35:03,516: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:35:03.517678456Z [2024-04-12 01:35:03,517: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:35:03.517842470Z [2024-04-12 01:35:03,517: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:03.639275686Z [2024-04-12 01:35:03,639: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:04.026621467Z [2024-04-12 01:35:04,026: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:35:04.034357982Z [2024-04-12 01:35:04,033: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:04.060711938Z [2024-04-12 01:35:04,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:35:04.068980148Z [2024-04-12 01:35:04,068: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:04.068997593Z [2024-04-12 01:35:04,068: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:04.069116073Z [2024-04-12 01:35:04,068: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:04.069129116Z [2024-04-12 01:35:04,069: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:35:04.069360983Z [2024-04-12 01:35:04,069: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:35:04.069374630Z [2024-04-12 01:35:04,069: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:04.192618901Z [2024-04-12 01:35:04,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15239b08-dc40-4b77-94d4-5a31fd9c405d] succeeded in 2.9009845860000496s: None 2024-04-12T01:35:04.201761835Z [2024-04-12 01:35:04,201: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:05.150397672Z [2024-04-12 01:35:05,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27ca0652-7c0c-4755-8c8c-d70fe401f093] received 2024-04-12T01:35:05.162921190Z [2024-04-12 01:35:05,162: INFO/ForkPoolWorker-15] [27ca0652-7c0c-4755-8c8c-d70fe401f093] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:05.484525650Z [2024-04-12 01:35:05,481: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:35:06.059078587Z [2024-04-12 01:35:06,058: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b213df93-ef3a-45d3-8b21-7198f46f0605] succeeded in 4.7674039590001485s: None 2024-04-12T01:35:06.276199952Z [2024-04-12 01:35:06,275: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[48ac67f6-f1bc-4231-a280-29a00235bd6e] succeeded in 4.976661632001196s: None 2024-04-12T01:35:06.570367660Z [2024-04-12 01:35:06,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:35:06.573903447Z [2024-04-12 01:35:06,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:06.597434374Z [2024-04-12 01:35:06,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:35:06.599141653Z [2024-04-12 01:35:06,598: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:06.599185902Z [2024-04-12 01:35:06,599: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:06.599523715Z [2024-04-12 01:35:06,599: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:06.599718460Z [2024-04-12 01:35:06,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:35:06.600067383Z [2024-04-12 01:35:06,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:35:06.600261537Z [2024-04-12 01:35:06,600: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:06.739140038Z [2024-04-12 01:35:06,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:07.431050880Z [2024-04-12 01:35:07,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27ca0652-7c0c-4755-8c8c-d70fe401f093] succeeded in 2.277902001998882s: None 2024-04-12T01:35:08.434270003Z [2024-04-12 01:35:08,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c14d86a-b0d4-4038-850b-236c71db1207] received 2024-04-12T01:35:08.443562129Z [2024-04-12 01:35:08,443: INFO/ForkPoolWorker-15] [4c14d86a-b0d4-4038-850b-236c71db1207] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:35:08.692512066Z [2024-04-12 01:35:08,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:35:09.623684523Z [2024-04-12 01:35:09,623: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:35:09.626446406Z [2024-04-12 01:35:09,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:09.651735621Z [2024-04-12 01:35:09,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:35:09.654164523Z [2024-04-12 01:35:09,653: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:09.654411138Z [2024-04-12 01:35:09,654: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:09.654725194Z [2024-04-12 01:35:09,654: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:09.654930057Z [2024-04-12 01:35:09,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:35:09.655327798Z [2024-04-12 01:35:09,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:35:09.655666137Z [2024-04-12 01:35:09,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:09.759968724Z [2024-04-12 01:35:09,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:10.295579713Z [2024-04-12 01:35:10,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5768adf2-572b-473d-aa70-55cfd67a4c4f] received 2024-04-12T01:35:10.305206152Z [2024-04-12 01:35:10,304: INFO/ForkPoolWorker-16] [5768adf2-572b-473d-aa70-55cfd67a4c4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:10.347005429Z [2024-04-12 01:35:10,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c14d86a-b0d4-4038-850b-236c71db1207] succeeded in 1.9105338389999815s: None 2024-04-12T01:35:10.563182286Z [2024-04-12 01:35:10,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:35:11.482170188Z [2024-04-12 01:35:11,481: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:35:11.485101561Z [2024-04-12 01:35:11,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:35:11.504268375Z [2024-04-12 01:35:11,504: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:35:11.505267763Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:35:11.505315101Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:35:11.505453790Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:35:11.505495404Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:35:11.505697905Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:35:11.505743445Z [2024-04-12 01:35:11,505: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:35:11.585067235Z [2024-04-12 01:35:11,584: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:35:12.178802877Z [2024-04-12 01:35:12,178: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5768adf2-572b-473d-aa70-55cfd67a4c4f] succeeded in 1.8811611159999302s: None 2024-04-12T01:36:00.481397401Z [2024-04-12 01:36:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f10d9dc-f652-4ad2-bee5-34dedc35eb5a] received 2024-04-12T01:36:00.487800964Z [2024-04-12 01:36:00,487: INFO/ForkPoolWorker-15] [4f10d9dc-f652-4ad2-bee5-34dedc35eb5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:36:00.488192290Z [2024-04-12 01:36:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac69fa4-cdb2-4a23-bac2-17ed52186569] received 2024-04-12T01:36:00.494571623Z [2024-04-12 01:36:00,494: INFO/ForkPoolWorker-16] [0ac69fa4-cdb2-4a23-bac2-17ed52186569] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:36:00.507641663Z [2024-04-12 01:36:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[627c15d8-b499-4a7a-a7e6-bc93718c7a68] received 2024-04-12T01:36:00.509004978Z [2024-04-12 01:36:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ca176e6-7585-4565-9d95-fdc52a241970] received 2024-04-12T01:36:00.522695538Z [2024-04-12 01:36:00,522: INFO/ForkPoolWorker-2] [4ca176e6-7585-4565-9d95-fdc52a241970] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:36:00.525090585Z [2024-04-12 01:36:00,524: INFO/ForkPoolWorker-1] [627c15d8-b499-4a7a-a7e6-bc93718c7a68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:36:00.760999403Z [2024-04-12 01:36:00,757: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:36:00.787338246Z [2024-04-12 01:36:00,783: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:36:00.919802600Z [2024-04-12 01:36:00,919: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:36:00.923298836Z [2024-04-12 01:36:00,922: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:36:00.926595742Z [2024-04-12 01:36:00,923: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:36:00.953236548Z [2024-04-12 01:36:00,953: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:36:00.953894853Z [2024-04-12 01:36:00,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:36:00.954268297Z [2024-04-12 01:36:00,954: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:36:00.954489739Z [2024-04-12 01:36:00,954: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:36:00.954574579Z [2024-04-12 01:36:00,954: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:36:00.954878270Z [2024-04-12 01:36:00,954: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:36:01.025884012Z [2024-04-12 01:36:01,025: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:36:01.314679079Z [2024-04-12 01:36:01,314: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:36:01.564186818Z [2024-04-12 01:36:01,563: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ca176e6-7585-4565-9d95-fdc52a241970] succeeded in 1.0528753090002283s: None 2024-04-12T01:36:01.852027540Z [2024-04-12 01:36:01,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f10d9dc-f652-4ad2-bee5-34dedc35eb5a] succeeded in 1.369191896999837s: None 2024-04-12T01:36:01.956541128Z [2024-04-12 01:36:01,956: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:36:01.959920691Z [2024-04-12 01:36:01,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:36:01.993273565Z [2024-04-12 01:36:01,993: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:36:01.997457262Z [2024-04-12 01:36:01,997: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:36:01.998035841Z [2024-04-12 01:36:01,997: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:36:01.998317675Z [2024-04-12 01:36:01,998: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:36:01.998500681Z [2024-04-12 01:36:01,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:36:01.998909680Z [2024-04-12 01:36:01,998: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:36:01.999132452Z [2024-04-12 01:36:01,998: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:36:02.107803126Z [2024-04-12 01:36:02,107: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:36:02.110684971Z [2024-04-12 01:36:02,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:36:02.123812696Z [2024-04-12 01:36:02,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:36:02.131849377Z [2024-04-12 01:36:02,131: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:36:02.134869117Z [2024-04-12 01:36:02,134: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:36:02.134999558Z [2024-04-12 01:36:02,134: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:36:02.135196503Z [2024-04-12 01:36:02,134: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:36:02.135323979Z [2024-04-12 01:36:02,135: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:36:02.135587250Z [2024-04-12 01:36:02,135: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:36:02.135736877Z [2024-04-12 01:36:02,135: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:36:02.226731220Z [2024-04-12 01:36:02,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:36:03.793972117Z [2024-04-12 01:36:03,792: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[627c15d8-b499-4a7a-a7e6-bc93718c7a68] succeeded in 3.2825888249990385s: None 2024-04-12T01:36:04.339733189Z [2024-04-12 01:36:04,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ac69fa4-cdb2-4a23-bac2-17ed52186569] succeeded in 3.849974721999388s: None 2024-04-12T01:37:00.407914809Z [2024-04-12 01:37:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35891c42-5ce4-46f8-8bef-06b72759dcbf] received 2024-04-12T01:37:00.413688569Z [2024-04-12 01:37:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[657cf843-80b2-4496-ba56-ac127ddc4f5a] received 2024-04-12T01:37:00.417950214Z [2024-04-12 01:37:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8215a990-0609-4424-96cd-582d64fa87ae] received 2024-04-12T01:37:00.425411368Z [2024-04-12 01:37:00,425: INFO/ForkPoolWorker-1] [8215a990-0609-4424-96cd-582d64fa87ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:37:00.427311987Z [2024-04-12 01:37:00,426: INFO/ForkPoolWorker-16] [657cf843-80b2-4496-ba56-ac127ddc4f5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:37:00.432665649Z [2024-04-12 01:37:00,432: INFO/ForkPoolWorker-15] [35891c42-5ce4-46f8-8bef-06b72759dcbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:37:00.717061390Z [2024-04-12 01:37:00,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:37:00.720681247Z [2024-04-12 01:37:00,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:37:00.765341318Z [2024-04-12 01:37:00,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:37:00.910828760Z [2024-04-12 01:37:00,910: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:37:00.914960509Z [2024-04-12 01:37:00,914: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:37:00.939044757Z [2024-04-12 01:37:00,938: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:37:00.939986694Z [2024-04-12 01:37:00,939: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:37:00.940187398Z [2024-04-12 01:37:00,939: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:37:00.940361855Z [2024-04-12 01:37:00,940: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:37:00.941000177Z [2024-04-12 01:37:00,940: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:37:01.021669093Z [2024-04-12 01:37:01,019: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:37:01.580412885Z [2024-04-12 01:37:01,579: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8215a990-0609-4424-96cd-582d64fa87ae] succeeded in 1.160948405000454s: None 2024-04-12T01:37:01.841515572Z [2024-04-12 01:37:01,841: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:37:01.844497521Z [2024-04-12 01:37:01,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:37:01.863225690Z [2024-04-12 01:37:01,863: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:37:01.864449138Z [2024-04-12 01:37:01,864: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:37:01.864539967Z [2024-04-12 01:37:01,864: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:37:01.864741380Z [2024-04-12 01:37:01,864: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:37:01.864800345Z [2024-04-12 01:37:01,864: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:37:01.865071996Z [2024-04-12 01:37:01,864: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:37:01.865168680Z [2024-04-12 01:37:01,865: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:37:01.920623379Z [2024-04-12 01:37:01,920: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:37:01.923764694Z [2024-04-12 01:37:01,923: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:37:01.941534104Z [2024-04-12 01:37:01,941: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:37:01.942477576Z [2024-04-12 01:37:01,942: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:37:01.942538130Z [2024-04-12 01:37:01,942: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:37:01.942684919Z [2024-04-12 01:37:01,942: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:37:01.942772622Z [2024-04-12 01:37:01,942: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:37:01.943098187Z [2024-04-12 01:37:01,942: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:37:01.943174540Z [2024-04-12 01:37:01,943: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:37:01.949344434Z [2024-04-12 01:37:01,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:37:02.012837853Z [2024-04-12 01:37:02,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:37:03.472674562Z [2024-04-12 01:37:03,471: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[657cf843-80b2-4496-ba56-ac127ddc4f5a] succeeded in 3.056793633999405s: None 2024-04-12T01:37:03.813399952Z [2024-04-12 01:37:03,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35891c42-5ce4-46f8-8bef-06b72759dcbf] succeeded in 3.394479385999148s: None 2024-04-12T01:38:00.368238617Z [2024-04-12 01:38:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ec2cc06-3695-4b20-a15e-6edac6937167] received 2024-04-12T01:38:00.378135801Z [2024-04-12 01:38:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fea624f-2276-4db3-a77a-9bd5cc6cc319] received 2024-04-12T01:38:00.378416429Z [2024-04-12 01:38:00,378: INFO/ForkPoolWorker-15] [0ec2cc06-3695-4b20-a15e-6edac6937167] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:38:00.380530053Z [2024-04-12 01:38:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca900d9e-cc7a-461f-81f9-5fd3df69cba7] received 2024-04-12T01:38:00.395209002Z [2024-04-12 01:38:00,394: INFO/ForkPoolWorker-16] [1fea624f-2276-4db3-a77a-9bd5cc6cc319] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:38:00.400586831Z [2024-04-12 01:38:00,400: INFO/ForkPoolWorker-1] [ca900d9e-cc7a-461f-81f9-5fd3df69cba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:38:00.404227582Z [2024-04-12 01:38:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5639e3d-8a45-43cd-9808-9de8665f9b7f] received 2024-04-12T01:38:00.416791298Z [2024-04-12 01:38:00,416: INFO/ForkPoolWorker-2] [d5639e3d-8a45-43cd-9808-9de8665f9b7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:38:00.798860683Z [2024-04-12 01:38:00,795: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:38:00.828957891Z [2024-04-12 01:38:00,823: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:38:00.893476580Z [2024-04-12 01:38:00,884: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:38:00.902424890Z [2024-04-12 01:38:00,899: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:38:01.048302323Z [2024-04-12 01:38:01,047: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:38:01.052332200Z [2024-04-12 01:38:01,051: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:38:01.079126930Z [2024-04-12 01:38:01,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:38:01.080172843Z [2024-04-12 01:38:01,079: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:38:01.080334229Z [2024-04-12 01:38:01,080: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:38:01.080500179Z [2024-04-12 01:38:01,080: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:38:01.080734555Z [2024-04-12 01:38:01,080: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:38:01.151548059Z [2024-04-12 01:38:01,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:38:01.192404275Z [2024-04-12 01:38:01,192: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:38:01.798103869Z [2024-04-12 01:38:01,797: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ec2cc06-3695-4b20-a15e-6edac6937167] succeeded in 1.4279891129990574s: None 2024-04-12T01:38:01.810188418Z [2024-04-12 01:38:01,809: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5639e3d-8a45-43cd-9808-9de8665f9b7f] succeeded in 1.3997529620010027s: None 2024-04-12T01:38:02.122346778Z [2024-04-12 01:38:02,121: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:38:02.127320410Z [2024-04-12 01:38:02,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:38:02.151677643Z [2024-04-12 01:38:02,151: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:38:02.153036195Z [2024-04-12 01:38:02,152: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:38:02.153059658Z [2024-04-12 01:38:02,152: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:38:02.153264666Z [2024-04-12 01:38:02,153: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:38:02.153326237Z [2024-04-12 01:38:02,153: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:38:02.153628925Z [2024-04-12 01:38:02,153: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:38:02.153650957Z [2024-04-12 01:38:02,153: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:38:02.242848997Z [2024-04-12 01:38:02,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:38:02.305011635Z [2024-04-12 01:38:02,304: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:38:02.308332516Z [2024-04-12 01:38:02,307: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:38:02.336044426Z [2024-04-12 01:38:02,335: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:38:02.340365003Z [2024-04-12 01:38:02,340: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:38:02.340392319Z [2024-04-12 01:38:02,340: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:38:02.340661411Z [2024-04-12 01:38:02,340: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:38:02.340705585Z [2024-04-12 01:38:02,340: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:38:02.341083878Z [2024-04-12 01:38:02,340: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:38:02.341099099Z [2024-04-12 01:38:02,341: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:38:02.427185420Z [2024-04-12 01:38:02,426: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:38:03.855120733Z [2024-04-12 01:38:03,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca900d9e-cc7a-461f-81f9-5fd3df69cba7] succeeded in 3.4615718069999275s: None 2024-04-12T01:38:04.141371870Z [2024-04-12 01:38:04,140: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fea624f-2276-4db3-a77a-9bd5cc6cc319] succeeded in 3.757611711998834s: None 2024-04-12T01:39:01.205184723Z [2024-04-12 01:39:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[714040b6-8bc5-4b6a-a652-7ca7f0c0b23c] received 2024-04-12T01:39:01.206589184Z [2024-04-12 01:39:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d021068-07a3-4d0d-8945-a51b35994b9d] received 2024-04-12T01:39:01.214319644Z [2024-04-12 01:39:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d14774c-3c9f-4e09-995f-69c9955a9ea3] received 2024-04-12T01:39:01.217160383Z [2024-04-12 01:39:01,216: INFO/ForkPoolWorker-16] [2d021068-07a3-4d0d-8945-a51b35994b9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:39:01.217850788Z [2024-04-12 01:39:01,217: INFO/ForkPoolWorker-15] [714040b6-8bc5-4b6a-a652-7ca7f0c0b23c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:39:01.224976477Z [2024-04-12 01:39:01,224: INFO/ForkPoolWorker-1] [4d14774c-3c9f-4e09-995f-69c9955a9ea3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:39:01.478493823Z [2024-04-12 01:39:01,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:39:01.506541972Z [2024-04-12 01:39:01,503: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:39:01.524003617Z [2024-04-12 01:39:01,519: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:39:01.658286164Z [2024-04-12 01:39:01,655: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:39:01.664486608Z [2024-04-12 01:39:01,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:39:01.681875757Z [2024-04-12 01:39:01,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:39:01.682970477Z [2024-04-12 01:39:01,681: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:39:01.682996372Z [2024-04-12 01:39:01,682: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:39:01.683002021Z [2024-04-12 01:39:01,682: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:39:01.683006903Z [2024-04-12 01:39:01,682: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:39:01.800069335Z [2024-04-12 01:39:01,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:39:02.332472398Z [2024-04-12 01:39:02,331: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d021068-07a3-4d0d-8945-a51b35994b9d] succeeded in 1.124634085001162s: None 2024-04-12T01:39:02.583763267Z [2024-04-12 01:39:02,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:39:02.586715133Z [2024-04-12 01:39:02,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:39:02.614621069Z [2024-04-12 01:39:02,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:39:02.616807670Z [2024-04-12 01:39:02,616: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:39:02.617262017Z [2024-04-12 01:39:02,616: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:39:02.617708418Z [2024-04-12 01:39:02,617: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:39:02.617960407Z [2024-04-12 01:39:02,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:39:02.618683867Z [2024-04-12 01:39:02,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:39:02.618834691Z [2024-04-12 01:39:02,618: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:39:02.728417449Z [2024-04-12 01:39:02,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:39:02.776567085Z [2024-04-12 01:39:02,776: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:39:02.779800664Z [2024-04-12 01:39:02,779: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:39:02.807668949Z [2024-04-12 01:39:02,807: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:39:02.810159474Z [2024-04-12 01:39:02,809: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:39:02.810510699Z [2024-04-12 01:39:02,810: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:39:02.810962941Z [2024-04-12 01:39:02,810: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:39:02.811286533Z [2024-04-12 01:39:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:39:02.812094956Z [2024-04-12 01:39:02,811: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:39:02.812440924Z [2024-04-12 01:39:02,812: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:39:02.930533236Z [2024-04-12 01:39:02,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:39:05.114713906Z [2024-04-12 01:39:05,114: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d14774c-3c9f-4e09-995f-69c9955a9ea3] succeeded in 3.8986238460001914s: None 2024-04-12T01:39:05.447908976Z [2024-04-12 01:39:05,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[714040b6-8bc5-4b6a-a652-7ca7f0c0b23c] succeeded in 4.239158185000633s: None 2024-04-12T01:40:01.259473146Z [2024-04-12 01:40:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e7c6bbe-2cdc-4491-8673-bd605fef06e7] received 2024-04-12T01:40:01.263417120Z [2024-04-12 01:40:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e3c42ad-b778-4a2a-bf04-f89ee8dc2da0] received 2024-04-12T01:40:01.267096864Z [2024-04-12 01:40:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42b0d4a6-fa1f-44d8-b77e-751ef12ef2c1] received 2024-04-12T01:40:01.268645456Z [2024-04-12 01:40:01,268: INFO/ForkPoolWorker-15] [4e7c6bbe-2cdc-4491-8673-bd605fef06e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:01.269024158Z [2024-04-12 01:40:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25401f8e-d49f-4eb6-9713-53d72bfe16fb] received 2024-04-12T01:40:01.277417841Z [2024-04-12 01:40:01,277: INFO/ForkPoolWorker-16] [4e3c42ad-b778-4a2a-bf04-f89ee8dc2da0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:40:01.278182423Z [2024-04-12 01:40:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21894d1d-df7d-4dac-b349-5fdc473a8449] received 2024-04-12T01:40:01.315170460Z [2024-04-12 01:40:01,314: INFO/ForkPoolWorker-3] [21894d1d-df7d-4dac-b349-5fdc473a8449] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:40:01.340052693Z [2024-04-12 01:40:01,339: INFO/ForkPoolWorker-2] [25401f8e-d49f-4eb6-9713-53d72bfe16fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:40:01.340906279Z [2024-04-12 01:40:01,340: INFO/ForkPoolWorker-1] [42b0d4a6-fa1f-44d8-b77e-751ef12ef2c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:40:01.704578530Z [2024-04-12 01:40:01,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:40:01.892522281Z [2024-04-12 01:40:01,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:40:02.056537169Z [2024-04-12 01:40:02,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:40:02.231741143Z [2024-04-12 01:40:02,224: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:40:02.232316681Z [2024-04-12 01:40:02,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:02.251016517Z [2024-04-12 01:40:02,244: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:40:02.511818873Z [2024-04-12 01:40:02,511: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:40:02.521206635Z [2024-04-12 01:40:02,520: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:02.557355660Z [2024-04-12 01:40:02,557: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:40:02.558687512Z [2024-04-12 01:40:02,558: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:40:02.558856053Z [2024-04-12 01:40:02,558: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:40:02.558981575Z [2024-04-12 01:40:02,558: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:40:02.559316407Z [2024-04-12 01:40:02,559: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:40:02.642710835Z [2024-04-12 01:40:02,642: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:02.970607450Z [2024-04-12 01:40:02,970: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e3c42ad-b778-4a2a-bf04-f89ee8dc2da0] succeeded in 1.7041073760010477s: None 2024-04-12T01:40:03.297152070Z [2024-04-12 01:40:03,296: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25401f8e-d49f-4eb6-9713-53d72bfe16fb] succeeded in 2.0175122839991673s: None 2024-04-12T01:40:03.487624932Z [2024-04-12 01:40:03,487: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:40:03.490959587Z [2024-04-12 01:40:03,490: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:03.515257763Z [2024-04-12 01:40:03,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:40:03.517424416Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:03.517443214Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:03.517534144Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:03.517570835Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:40:03.517766260Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:40:03.517852167Z [2024-04-12 01:40:03,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:03.627254091Z [2024-04-12 01:40:03,626: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T01:40:03.630485368Z [2024-04-12 01:40:03,630: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:03.637460072Z [2024-04-12 01:40:03,637: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:40:03.641046067Z [2024-04-12 01:40:03,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:03.641966743Z [2024-04-12 01:40:03,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:03.652960374Z [2024-04-12 01:40:03,652: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:40:03.654002600Z [2024-04-12 01:40:03,653: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:03.654119773Z [2024-04-12 01:40:03,653: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:03.654346458Z [2024-04-12 01:40:03,654: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:03.654513761Z [2024-04-12 01:40:03,654: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T01:40:03.654951352Z [2024-04-12 01:40:03,654: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:40:03.655082096Z [2024-04-12 01:40:03,654: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:03.671681986Z [2024-04-12 01:40:03,671: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:40:03.672840297Z [2024-04-12 01:40:03,672: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:03.672966227Z [2024-04-12 01:40:03,672: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:03.673107986Z [2024-04-12 01:40:03,672: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:03.673160051Z [2024-04-12 01:40:03,673: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:40:03.673386971Z [2024-04-12 01:40:03,673: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:40:03.673713395Z [2024-04-12 01:40:03,673: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:03.726984307Z [2024-04-12 01:40:03,726: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:03.747290048Z [2024-04-12 01:40:03,747: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:04.290981589Z [2024-04-12 01:40:04,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e7c6bbe-2cdc-4491-8673-bd605fef06e7] succeeded in 3.028677984000751s: None 2024-04-12T01:40:04.362086964Z [2024-04-12 01:40:04,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27cd3c41-373c-407f-be1f-c48a4c9e11f8] received 2024-04-12T01:40:04.367465199Z [2024-04-12 01:40:04,367: INFO/ForkPoolWorker-15] [27cd3c41-373c-407f-be1f-c48a4c9e11f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:04.656454501Z [2024-04-12 01:40:04,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:40:05.345050196Z [2024-04-12 01:40:05,344: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[21894d1d-df7d-4dac-b349-5fdc473a8449] succeeded in 4.06077651600026s: None 2024-04-12T01:40:05.728441156Z [2024-04-12 01:40:05,727: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42b0d4a6-fa1f-44d8-b77e-751ef12ef2c1] succeeded in 4.453360634999626s: None 2024-04-12T01:40:05.750180604Z [2024-04-12 01:40:05,749: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:40:05.753354796Z [2024-04-12 01:40:05,752: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:05.777140394Z [2024-04-12 01:40:05,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:40:05.778488190Z [2024-04-12 01:40:05,778: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:05.778513957Z [2024-04-12 01:40:05,778: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:05.778724345Z [2024-04-12 01:40:05,778: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:05.778757760Z [2024-04-12 01:40:05,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:40:05.779078991Z [2024-04-12 01:40:05,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:40:05.779102405Z [2024-04-12 01:40:05,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:05.895718304Z [2024-04-12 01:40:05,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:06.515682254Z [2024-04-12 01:40:06,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27cd3c41-373c-407f-be1f-c48a4c9e11f8] succeeded in 2.1519574300000386s: None 2024-04-12T01:40:07.345983141Z [2024-04-12 01:40:07,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60163d7b-349e-48a7-a628-e58ada785847] received 2024-04-12T01:40:07.355662867Z [2024-04-12 01:40:07,355: INFO/ForkPoolWorker-15] [60163d7b-349e-48a7-a628-e58ada785847] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:40:07.631293514Z [2024-04-12 01:40:07,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:40:08.760704385Z [2024-04-12 01:40:08,760: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:40:08.763510310Z [2024-04-12 01:40:08,763: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:08.785805404Z [2024-04-12 01:40:08,785: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:40:08.786856089Z [2024-04-12 01:40:08,786: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:08.787068962Z [2024-04-12 01:40:08,786: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:08.787223272Z [2024-04-12 01:40:08,786: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:08.787238534Z [2024-04-12 01:40:08,787: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:40:08.788337496Z [2024-04-12 01:40:08,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:40:08.788351918Z [2024-04-12 01:40:08,788: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:08.880170484Z [2024-04-12 01:40:08,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:09.500628019Z [2024-04-12 01:40:09,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60163d7b-349e-48a7-a628-e58ada785847] succeeded in 2.151814230999662s: None 2024-04-12T01:40:10.031171854Z [2024-04-12 01:40:10,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1267536d-3daa-4e39-b957-4d6e3abf45fa] received 2024-04-12T01:40:10.039309627Z [2024-04-12 01:40:10,039: INFO/ForkPoolWorker-15] [1267536d-3daa-4e39-b957-4d6e3abf45fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:10.299175204Z [2024-04-12 01:40:10,296: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:40:11.274104496Z [2024-04-12 01:40:11,273: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:40:11.276661018Z [2024-04-12 01:40:11,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:40:11.296509706Z [2024-04-12 01:40:11,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:40:11.298649617Z [2024-04-12 01:40:11,298: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:40:11.298675660Z [2024-04-12 01:40:11,298: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:40:11.298743971Z [2024-04-12 01:40:11,298: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:40:11.298891960Z [2024-04-12 01:40:11,298: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:40:11.299184896Z [2024-04-12 01:40:11,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:40:11.299310654Z [2024-04-12 01:40:11,299: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:40:11.399496723Z [2024-04-12 01:40:11,399: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:40:12.059524917Z [2024-04-12 01:40:12,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1267536d-3daa-4e39-b957-4d6e3abf45fa] succeeded in 2.024587485999291s: None 2024-04-12T01:41:00.987401794Z [2024-04-12 01:41:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7e1abbb-16c3-41d5-b734-a84c357974a8] received 2024-04-12T01:41:00.989416774Z [2024-04-12 01:41:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ce102ae-6be9-411f-8c4d-74791b3e576c] received 2024-04-12T01:41:00.993866411Z [2024-04-12 01:41:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24033a99-cc5e-430b-95e8-a3c31fb01fd1] received 2024-04-12T01:41:00.999885423Z [2024-04-12 01:41:00,999: INFO/ForkPoolWorker-16] [6ce102ae-6be9-411f-8c4d-74791b3e576c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:41:01.002567871Z [2024-04-12 01:41:01,002: INFO/ForkPoolWorker-1] [24033a99-cc5e-430b-95e8-a3c31fb01fd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:41:01.010578327Z [2024-04-12 01:41:01,010: INFO/ForkPoolWorker-15] [d7e1abbb-16c3-41d5-b734-a84c357974a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:41:01.259458211Z [2024-04-12 01:41:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:41:01.274785357Z [2024-04-12 01:41:01,271: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:41:01.321207566Z [2024-04-12 01:41:01,317: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:41:01.418438987Z [2024-04-12 01:41:01,418: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:41:01.422449824Z [2024-04-12 01:41:01,422: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:41:01.449241507Z [2024-04-12 01:41:01,448: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:41:01.450360969Z [2024-04-12 01:41:01,450: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:41:01.450497989Z [2024-04-12 01:41:01,450: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:41:01.450568963Z [2024-04-12 01:41:01,450: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:41:01.450804797Z [2024-04-12 01:41:01,450: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:41:01.533321684Z [2024-04-12 01:41:01,533: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:41:02.162060613Z [2024-04-12 01:41:02,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ce102ae-6be9-411f-8c4d-74791b3e576c] succeeded in 1.1702539249999973s: None 2024-04-12T01:41:02.358389431Z [2024-04-12 01:41:02,358: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:41:02.361510268Z [2024-04-12 01:41:02,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:41:02.380771926Z [2024-04-12 01:41:02,380: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:41:02.381901825Z [2024-04-12 01:41:02,381: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:41:02.381916595Z [2024-04-12 01:41:02,381: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:41:02.382080225Z [2024-04-12 01:41:02,381: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:41:02.382108976Z [2024-04-12 01:41:02,382: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:41:02.382343656Z [2024-04-12 01:41:02,382: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:41:02.382404297Z [2024-04-12 01:41:02,382: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:41:02.466607228Z [2024-04-12 01:41:02,466: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:41:02.480275669Z [2024-04-12 01:41:02,479: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:41:02.483646822Z [2024-04-12 01:41:02,483: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:41:02.506249117Z [2024-04-12 01:41:02,506: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:41:02.507828862Z [2024-04-12 01:41:02,507: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:41:02.507995202Z [2024-04-12 01:41:02,507: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:41:02.508218723Z [2024-04-12 01:41:02,508: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:41:02.508453266Z [2024-04-12 01:41:02,508: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:41:02.508790765Z [2024-04-12 01:41:02,508: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:41:02.508980964Z [2024-04-12 01:41:02,508: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:41:02.594865194Z [2024-04-12 01:41:02,594: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:41:04.630834503Z [2024-04-12 01:41:04,630: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24033a99-cc5e-430b-95e8-a3c31fb01fd1] succeeded in 3.63545841999985s: None 2024-04-12T01:41:05.328551953Z [2024-04-12 01:41:05,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7e1abbb-16c3-41d5-b734-a84c357974a8] succeeded in 4.335737696999786s: None 2024-04-12T01:42:00.373363000Z [2024-04-12 01:42:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2826283d-143c-42a7-8f7f-453f2026ec25] received 2024-04-12T01:42:00.378561715Z [2024-04-12 01:42:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c94e7c4-4538-4e2d-9886-6b8d79cfc335] received 2024-04-12T01:42:00.384429811Z [2024-04-12 01:42:00,384: INFO/ForkPoolWorker-15] [2826283d-143c-42a7-8f7f-453f2026ec25] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:42:00.384449670Z [2024-04-12 01:42:00,384: INFO/ForkPoolWorker-16] [2c94e7c4-4538-4e2d-9886-6b8d79cfc335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:42:00.387104778Z [2024-04-12 01:42:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58d64e86-3bd8-4306-8d3e-b0fed905c6f6] received 2024-04-12T01:42:00.389342735Z [2024-04-12 01:42:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b21263e-3be7-4209-a260-000ce47f670c] received 2024-04-12T01:42:00.396504584Z [2024-04-12 01:42:00,396: INFO/ForkPoolWorker-1] [58d64e86-3bd8-4306-8d3e-b0fed905c6f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:42:00.398690526Z [2024-04-12 01:42:00,398: INFO/ForkPoolWorker-2] [2b21263e-3be7-4209-a260-000ce47f670c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:42:00.702709947Z [2024-04-12 01:42:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:42:00.709751190Z [2024-04-12 01:42:00,706: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:42:00.725018740Z [2024-04-12 01:42:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:42:00.762541499Z [2024-04-12 01:42:00,759: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:42:00.905834666Z [2024-04-12 01:42:00,904: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:42:00.910732671Z [2024-04-12 01:42:00,910: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:42:00.944691110Z [2024-04-12 01:42:00,944: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:42:00.947183484Z [2024-04-12 01:42:00,946: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:42:00.947758159Z [2024-04-12 01:42:00,947: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:42:00.947988449Z [2024-04-12 01:42:00,947: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:42:00.948251881Z [2024-04-12 01:42:00,948: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:42:00.966612337Z [2024-04-12 01:42:00,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:42:01.066658820Z [2024-04-12 01:42:01,066: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:42:01.512887317Z [2024-04-12 01:42:01,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2826283d-143c-42a7-8f7f-453f2026ec25] succeeded in 1.1376138390005508s: None 2024-04-12T01:42:01.662608037Z [2024-04-12 01:42:01,662: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b21263e-3be7-4209-a260-000ce47f670c] succeeded in 1.2717722340003093s: None 2024-04-12T01:42:01.952481653Z [2024-04-12 01:42:01,952: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:42:01.955812731Z [2024-04-12 01:42:01,955: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:42:01.976239963Z [2024-04-12 01:42:01,976: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:42:01.977439937Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:42:01.977565919Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:42:01.977584102Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:42:01.977653204Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:42:01.977816856Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:42:01.977906476Z [2024-04-12 01:42:01,977: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:42:02.020166428Z [2024-04-12 01:42:02,019: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:42:02.023342694Z [2024-04-12 01:42:02,022: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:42:02.047183812Z [2024-04-12 01:42:02,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:42:02.048588241Z [2024-04-12 01:42:02,048: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:42:02.048792326Z [2024-04-12 01:42:02,048: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:42:02.049128390Z [2024-04-12 01:42:02,048: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:42:02.049333036Z [2024-04-12 01:42:02,049: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:42:02.049710381Z [2024-04-12 01:42:02,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:42:02.049907776Z [2024-04-12 01:42:02,049: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:42:02.075095491Z [2024-04-12 01:42:02,074: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:42:02.159923316Z [2024-04-12 01:42:02,159: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:42:03.617806789Z [2024-04-12 01:42:03,617: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58d64e86-3bd8-4306-8d3e-b0fed905c6f6] succeeded in 3.228706895999494s: None 2024-04-12T01:42:04.009447383Z [2024-04-12 01:42:04,008: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c94e7c4-4538-4e2d-9886-6b8d79cfc335] succeeded in 3.628485721999823s: None 2024-04-12T01:43:01.208129477Z [2024-04-12 01:43:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08b2f664-821c-407c-9ef0-537dbd39b32a] received 2024-04-12T01:43:01.217213732Z [2024-04-12 01:43:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5453d63-1e61-4fa5-9704-18a4ede4c7a1] received 2024-04-12T01:43:01.221168410Z [2024-04-12 01:43:01,219: INFO/ForkPoolWorker-15] [08b2f664-821c-407c-9ef0-537dbd39b32a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:43:01.225603464Z [2024-04-12 01:43:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a075daa-9086-4cb6-9011-74c23b542f30] received 2024-04-12T01:43:01.227891774Z [2024-04-12 01:43:01,226: INFO/ForkPoolWorker-16] [b5453d63-1e61-4fa5-9704-18a4ede4c7a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:43:01.234759684Z [2024-04-12 01:43:01,234: INFO/ForkPoolWorker-1] [7a075daa-9086-4cb6-9011-74c23b542f30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:43:01.483627108Z [2024-04-12 01:43:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:43:01.517621704Z [2024-04-12 01:43:01,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:43:01.548730867Z [2024-04-12 01:43:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:43:01.620454802Z [2024-04-12 01:43:01,620: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:43:01.624352720Z [2024-04-12 01:43:01,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:43:01.642815946Z [2024-04-12 01:43:01,642: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:43:01.653408957Z [2024-04-12 01:43:01,653: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:43:01.656456219Z [2024-04-12 01:43:01,653: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:43:01.656468323Z [2024-04-12 01:43:01,653: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:43:01.656472339Z [2024-04-12 01:43:01,653: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:43:01.744823855Z [2024-04-12 01:43:01,744: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:43:02.275541906Z [2024-04-12 01:43:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08b2f664-821c-407c-9ef0-537dbd39b32a] succeeded in 1.0659304710006836s: None 2024-04-12T01:43:02.537307590Z [2024-04-12 01:43:02,536: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:43:02.540494968Z [2024-04-12 01:43:02,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:43:02.560098460Z [2024-04-12 01:43:02,559: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:43:02.561198102Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:43:02.561320080Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:43:02.561551242Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:43:02.561655062Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:43:02.561928255Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:43:02.562059489Z [2024-04-12 01:43:02,561: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:43:02.582675768Z [2024-04-12 01:43:02,582: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:43:02.585736814Z [2024-04-12 01:43:02,585: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:43:02.605129313Z [2024-04-12 01:43:02,604: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:43:02.606423347Z [2024-04-12 01:43:02,606: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:43:02.606467459Z [2024-04-12 01:43:02,606: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:43:02.606721920Z [2024-04-12 01:43:02,606: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:43:02.606781288Z [2024-04-12 01:43:02,606: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:43:02.607107415Z [2024-04-12 01:43:02,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:43:02.607147098Z [2024-04-12 01:43:02,607: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:43:02.647986314Z [2024-04-12 01:43:02,647: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:43:02.684451964Z [2024-04-12 01:43:02,684: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:43:04.418902866Z [2024-04-12 01:43:04,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a075daa-9086-4cb6-9011-74c23b542f30] succeeded in 3.1914200270002766s: None 2024-04-12T01:43:04.775620104Z [2024-04-12 01:43:04,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5453d63-1e61-4fa5-9704-18a4ede4c7a1] succeeded in 3.5540340959996684s: None 2024-04-12T01:44:01.107780061Z [2024-04-12 01:44:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be63c0a-7df5-4e46-b968-b4385a41e73a] received 2024-04-12T01:44:01.113130025Z [2024-04-12 01:44:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ad3aba1-d9d1-4b65-8800-47f1c472e07d] received 2024-04-12T01:44:01.114610236Z [2024-04-12 01:44:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c38ade9-735d-410d-8d1a-aa8b97a4c9e0] received 2024-04-12T01:44:01.115736722Z [2024-04-12 01:44:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6fb5e9c-cb0b-4848-964a-78e9cb7997a3] received 2024-04-12T01:44:01.128684384Z [2024-04-12 01:44:01,128: INFO/ForkPoolWorker-16] [9ad3aba1-d9d1-4b65-8800-47f1c472e07d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:44:01.131394213Z [2024-04-12 01:44:01,130: INFO/ForkPoolWorker-15] [5be63c0a-7df5-4e46-b968-b4385a41e73a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:44:01.131650386Z [2024-04-12 01:44:01,131: INFO/ForkPoolWorker-2] [b6fb5e9c-cb0b-4848-964a-78e9cb7997a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:44:01.132247103Z [2024-04-12 01:44:01,132: INFO/ForkPoolWorker-1] [7c38ade9-735d-410d-8d1a-aa8b97a4c9e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:44:01.382638907Z [2024-04-12 01:44:01,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:44:01.454789240Z [2024-04-12 01:44:01,451: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:44:01.511338366Z [2024-04-12 01:44:01,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:44:01.790040357Z [2024-04-12 01:44:01,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:44:01.824556691Z [2024-04-12 01:44:01,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:44:01.976800889Z [2024-04-12 01:44:01,976: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:44:01.988126998Z [2024-04-12 01:44:01,987: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:44:02.075661923Z [2024-04-12 01:44:02,074: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:44:02.078483516Z [2024-04-12 01:44:02,078: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:44:02.080345378Z [2024-04-12 01:44:02,080: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:44:02.080503134Z [2024-04-12 01:44:02,080: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:44:02.080846627Z [2024-04-12 01:44:02,080: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:44:02.224403475Z [2024-04-12 01:44:02,224: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:44:02.600009800Z [2024-04-12 01:44:02,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5be63c0a-7df5-4e46-b968-b4385a41e73a] succeeded in 1.4823915769993619s: None 2024-04-12T01:44:02.701756040Z [2024-04-12 01:44:02,701: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:44:02.704705069Z [2024-04-12 01:44:02,704: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:44:02.733215599Z [2024-04-12 01:44:02,733: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:44:02.734396820Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:44:02.734418719Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:44:02.734607400Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:44:02.734683284Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:44:02.734934147Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:44:02.735426309Z [2024-04-12 01:44:02,734: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:44:02.800611441Z [2024-04-12 01:44:02,800: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:44:02.938197795Z [2024-04-12 01:44:02,937: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b6fb5e9c-cb0b-4848-964a-78e9cb7997a3] succeeded in 1.8165632200016262s: None 2024-04-12T01:44:03.371254056Z [2024-04-12 01:44:03,370: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:44:03.374334831Z [2024-04-12 01:44:03,373: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:44:03.403177728Z [2024-04-12 01:44:03,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:44:03.409037727Z [2024-04-12 01:44:03,408: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:44:03.409083341Z [2024-04-12 01:44:03,408: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:44:03.409596859Z [2024-04-12 01:44:03,409: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:44:03.409755811Z [2024-04-12 01:44:03,409: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:44:03.410146186Z [2024-04-12 01:44:03,409: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:44:03.410733937Z [2024-04-12 01:44:03,410: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:44:03.488686159Z [2024-04-12 01:44:03,488: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:44:05.400899387Z [2024-04-12 01:44:05,400: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c38ade9-735d-410d-8d1a-aa8b97a4c9e0] succeeded in 4.2821489950001705s: None 2024-04-12T01:44:05.889277338Z [2024-04-12 01:44:05,888: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ad3aba1-d9d1-4b65-8800-47f1c472e07d] succeeded in 4.771949948999463s: None 2024-04-12T01:45:00.945035220Z [2024-04-12 01:45:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef161515-5053-456a-93e9-c7a0c596502b] received 2024-04-12T01:45:00.947042746Z [2024-04-12 01:45:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[532223c8-fd80-4dfc-b71b-c5a153bd65d3] received 2024-04-12T01:45:00.948788603Z [2024-04-12 01:45:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e9e435-beac-421c-b4ec-4fcedb936912] received 2024-04-12T01:45:00.950149309Z [2024-04-12 01:45:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2276ca95-4a76-4596-a616-50e6f6058fdd] received 2024-04-12T01:45:00.957914711Z [2024-04-12 01:45:00,957: INFO/ForkPoolWorker-16] [532223c8-fd80-4dfc-b71b-c5a153bd65d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:45:00.958488582Z [2024-04-12 01:45:00,958: INFO/ForkPoolWorker-2] [2276ca95-4a76-4596-a616-50e6f6058fdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:45:00.991625343Z [2024-04-12 01:45:00,991: INFO/ForkPoolWorker-1] [d3e9e435-beac-421c-b4ec-4fcedb936912] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:45:00.996471225Z [2024-04-12 01:45:00,996: INFO/ForkPoolWorker-15] [ef161515-5053-456a-93e9-c7a0c596502b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:01.247200805Z [2024-04-12 01:45:01,243: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:45:01.403178292Z [2024-04-12 01:45:01,402: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:45:01.413075938Z [2024-04-12 01:45:01,412: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:01.454203543Z [2024-04-12 01:45:01,453: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:45:01.455359531Z [2024-04-12 01:45:01,455: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:45:01.455542385Z [2024-04-12 01:45:01,455: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:45:01.455632371Z [2024-04-12 01:45:01,455: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:45:01.456175636Z [2024-04-12 01:45:01,456: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:45:01.475037702Z [2024-04-12 01:45:01,472: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:45:01.570044494Z [2024-04-12 01:45:01,569: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:01.651850168Z [2024-04-12 01:45:01,648: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:45:01.729656267Z [2024-04-12 01:45:01,726: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:45:02.774717943Z [2024-04-12 01:45:02,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[532223c8-fd80-4dfc-b71b-c5a153bd65d3] succeeded in 1.8249688479991164s: None 2024-04-12T01:45:03.154500745Z [2024-04-12 01:45:03,154: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:45:03.158183567Z [2024-04-12 01:45:03,157: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:03.216481068Z [2024-04-12 01:45:03,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:45:03.217659429Z [2024-04-12 01:45:03,217: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:03.217856134Z [2024-04-12 01:45:03,217: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:03.218120883Z [2024-04-12 01:45:03,217: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:03.218326828Z [2024-04-12 01:45:03,218: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:45:03.218641507Z [2024-04-12 01:45:03,218: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:45:03.219245830Z [2024-04-12 01:45:03,219: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:03.234395106Z [2024-04-12 01:45:03,233: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:45:03.237158617Z [2024-04-12 01:45:03,236: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:03.261779416Z [2024-04-12 01:45:03,261: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:45:03.262897913Z [2024-04-12 01:45:03,262: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:03.263007474Z [2024-04-12 01:45:03,262: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:03.263168430Z [2024-04-12 01:45:03,262: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:03.263285729Z [2024-04-12 01:45:03,263: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:45:03.263634389Z [2024-04-12 01:45:03,263: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:45:03.263747030Z [2024-04-12 01:45:03,263: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:03.310549106Z [2024-04-12 01:45:03,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:03.461714662Z [2024-04-12 01:45:03,461: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:03.672194059Z [2024-04-12 01:45:03,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:45:03.675929901Z [2024-04-12 01:45:03,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:03.741900385Z [2024-04-12 01:45:03,741: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:45:03.742992530Z [2024-04-12 01:45:03,742: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:03.743750191Z [2024-04-12 01:45:03,742: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:03.743982024Z [2024-04-12 01:45:03,743: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:03.744096269Z [2024-04-12 01:45:03,743: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:45:03.745033368Z [2024-04-12 01:45:03,744: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:45:03.745174992Z [2024-04-12 01:45:03,745: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:03.875971687Z [2024-04-12 01:45:03,875: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:04.583538667Z [2024-04-12 01:45:04,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef161515-5053-456a-93e9-c7a0c596502b] succeeded in 3.6357867360002274s: None 2024-04-12T01:45:04.808533238Z [2024-04-12 01:45:04,808: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3e9e435-beac-421c-b4ec-4fcedb936912] succeeded in 3.8542463970006793s: None 2024-04-12T01:45:04.868170688Z [2024-04-12 01:45:04,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e930f99f-1faa-4f33-aad3-00c5747121e1] received 2024-04-12T01:45:04.893822173Z [2024-04-12 01:45:04,893: INFO/ForkPoolWorker-15] [e930f99f-1faa-4f33-aad3-00c5747121e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:05.210291868Z [2024-04-12 01:45:05,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:45:05.445440814Z [2024-04-12 01:45:05,445: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2276ca95-4a76-4596-a616-50e6f6058fdd] succeeded in 4.493694532999143s: None 2024-04-12T01:45:06.485730682Z [2024-04-12 01:45:06,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:45:06.488931126Z [2024-04-12 01:45:06,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:06.514720281Z [2024-04-12 01:45:06,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:45:06.516031755Z [2024-04-12 01:45:06,515: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:06.516279863Z [2024-04-12 01:45:06,516: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:06.516639879Z [2024-04-12 01:45:06,516: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:06.516843618Z [2024-04-12 01:45:06,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:45:06.517289648Z [2024-04-12 01:45:06,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:45:06.517455738Z [2024-04-12 01:45:06,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:06.600383491Z [2024-04-12 01:45:06,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:07.237800555Z [2024-04-12 01:45:07,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e930f99f-1faa-4f33-aad3-00c5747121e1] succeeded in 2.3577276579999307s: None 2024-04-12T01:45:07.277128673Z [2024-04-12 01:45:07,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53b56ee0-864a-44da-93ad-f42400ef7d2a] received 2024-04-12T01:45:07.304287151Z [2024-04-12 01:45:07,304: INFO/ForkPoolWorker-15] [53b56ee0-864a-44da-93ad-f42400ef7d2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:45:07.636703964Z [2024-04-12 01:45:07,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:45:08.760888960Z [2024-04-12 01:45:08,760: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:45:08.763862574Z [2024-04-12 01:45:08,763: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:08.780166638Z [2024-04-12 01:45:08,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:45:08.781235339Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:08.781253182Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:08.781365452Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:08.781400262Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:45:08.781570806Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:45:08.781605020Z [2024-04-12 01:45:08,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:08.847145926Z [2024-04-12 01:45:08,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:09.441013862Z [2024-04-12 01:45:09,440: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53b56ee0-864a-44da-93ad-f42400ef7d2a] succeeded in 2.151672176001739s: None 2024-04-12T01:45:10.100485581Z [2024-04-12 01:45:10,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b33e681-368a-464c-83fa-bd846751b486] received 2024-04-12T01:45:10.105875116Z [2024-04-12 01:45:10,105: INFO/ForkPoolWorker-15] [2b33e681-368a-464c-83fa-bd846751b486] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:10.355709164Z [2024-04-12 01:45:10,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:45:11.347401214Z [2024-04-12 01:45:11,347: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:45:11.350288524Z [2024-04-12 01:45:11,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:45:11.374305748Z [2024-04-12 01:45:11,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:45:11.375101994Z [2024-04-12 01:45:11,374: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:45:11.375119394Z [2024-04-12 01:45:11,375: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:45:11.375204345Z [2024-04-12 01:45:11,375: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:45:11.375222583Z [2024-04-12 01:45:11,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:45:11.375506039Z [2024-04-12 01:45:11,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:45:11.375514673Z [2024-04-12 01:45:11,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:45:11.450790077Z [2024-04-12 01:45:11,450: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:45:11.988899988Z [2024-04-12 01:45:11,988: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b33e681-368a-464c-83fa-bd846751b486] succeeded in 1.8870332360002067s: None 2024-04-12T01:46:00.952245546Z [2024-04-12 01:46:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[041a0f1c-99c2-4d22-9d1e-993963b0b992] received 2024-04-12T01:46:00.953605902Z [2024-04-12 01:46:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0092aa5d-6943-4b93-96af-23139c3c8ea3] received 2024-04-12T01:46:00.956250733Z [2024-04-12 01:46:00,956: INFO/ForkPoolWorker-15] [041a0f1c-99c2-4d22-9d1e-993963b0b992] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:46:00.957316056Z [2024-04-12 01:46:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5981b725-3191-47c7-bdcd-f3e204ac71a5] received 2024-04-12T01:46:00.962284869Z [2024-04-12 01:46:00,962: INFO/ForkPoolWorker-1] [5981b725-3191-47c7-bdcd-f3e204ac71a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:46:00.966266966Z [2024-04-12 01:46:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86fbccfd-10b9-404c-8299-df5b81aed3f8] received 2024-04-12T01:46:00.974077884Z [2024-04-12 01:46:00,973: INFO/ForkPoolWorker-2] [86fbccfd-10b9-404c-8299-df5b81aed3f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:46:00.981131485Z [2024-04-12 01:46:00,980: INFO/ForkPoolWorker-16] [0092aa5d-6943-4b93-96af-23139c3c8ea3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:46:01.293815550Z [2024-04-12 01:46:01,290: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:46:01.348618553Z [2024-04-12 01:46:01,345: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:46:01.394498073Z [2024-04-12 01:46:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:46:01.410590934Z [2024-04-12 01:46:01,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:46:01.467770106Z [2024-04-12 01:46:01,467: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:46:01.472425528Z [2024-04-12 01:46:01,471: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:46:01.551856404Z [2024-04-12 01:46:01,551: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:46:01.555114306Z [2024-04-12 01:46:01,554: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:46:01.555322840Z [2024-04-12 01:46:01,555: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:46:01.555435595Z [2024-04-12 01:46:01,555: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:46:01.555767548Z [2024-04-12 01:46:01,555: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:46:01.656472862Z [2024-04-12 01:46:01,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:46:01.748649569Z [2024-04-12 01:46:01,748: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:46:02.413589958Z [2024-04-12 01:46:02,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5981b725-3191-47c7-bdcd-f3e204ac71a5] succeeded in 1.4551320230002602s: None 2024-04-12T01:46:02.567597242Z [2024-04-12 01:46:02,567: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0092aa5d-6943-4b93-96af-23139c3c8ea3] succeeded in 1.6070601800001896s: None 2024-04-12T01:46:02.763662473Z [2024-04-12 01:46:02,763: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:46:02.766647158Z [2024-04-12 01:46:02,766: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:46:02.784208907Z [2024-04-12 01:46:02,784: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:46:02.785413628Z [2024-04-12 01:46:02,785: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:46:02.785533491Z [2024-04-12 01:46:02,785: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:46:02.785710259Z [2024-04-12 01:46:02,785: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:46:02.785931867Z [2024-04-12 01:46:02,785: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:46:02.786450418Z [2024-04-12 01:46:02,786: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:46:02.786870292Z [2024-04-12 01:46:02,786: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:46:02.828032114Z [2024-04-12 01:46:02,827: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:46:02.830789248Z [2024-04-12 01:46:02,830: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:46:02.848020592Z [2024-04-12 01:46:02,847: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:46:02.849119311Z [2024-04-12 01:46:02,848: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:46:02.849208572Z [2024-04-12 01:46:02,849: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:46:02.849401766Z [2024-04-12 01:46:02,849: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:46:02.849517653Z [2024-04-12 01:46:02,849: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:46:02.849814442Z [2024-04-12 01:46:02,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:46:02.849938549Z [2024-04-12 01:46:02,849: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:46:02.878872731Z [2024-04-12 01:46:02,878: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:46:02.924644865Z [2024-04-12 01:46:02,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:46:05.051864359Z [2024-04-12 01:46:05,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[041a0f1c-99c2-4d22-9d1e-993963b0b992] succeeded in 4.100928472000305s: None 2024-04-12T01:46:05.579269106Z [2024-04-12 01:46:05,578: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[86fbccfd-10b9-404c-8299-df5b81aed3f8] succeeded in 4.610288142001082s: None 2024-04-12T01:47:00.328910997Z [2024-04-12 01:47:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7f40d1e-4a80-4dfb-b178-d29fed43704d] received 2024-04-12T01:47:00.334080001Z [2024-04-12 01:47:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35aaa577-d3c5-4b9a-9699-f74ca0bb99b6] received 2024-04-12T01:47:00.335086575Z [2024-04-12 01:47:00,334: INFO/ForkPoolWorker-15] [e7f40d1e-4a80-4dfb-b178-d29fed43704d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:47:00.339085667Z [2024-04-12 01:47:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d19c60d6-9830-4685-84eb-9fa46a83e0c6] received 2024-04-12T01:47:00.344625068Z [2024-04-12 01:47:00,344: INFO/ForkPoolWorker-16] [35aaa577-d3c5-4b9a-9699-f74ca0bb99b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:47:00.351418760Z [2024-04-12 01:47:00,351: INFO/ForkPoolWorker-1] [d19c60d6-9830-4685-84eb-9fa46a83e0c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:47:00.632710451Z [2024-04-12 01:47:00,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:47:00.639104432Z [2024-04-12 01:47:00,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:47:00.646091278Z [2024-04-12 01:47:00,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:47:00.801721366Z [2024-04-12 01:47:00,801: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:47:00.805321936Z [2024-04-12 01:47:00,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:47:00.829882479Z [2024-04-12 01:47:00,829: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:47:00.830924109Z [2024-04-12 01:47:00,830: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:47:00.831175776Z [2024-04-12 01:47:00,830: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:47:00.831350157Z [2024-04-12 01:47:00,831: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:47:00.831693935Z [2024-04-12 01:47:00,831: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:47:00.915107225Z [2024-04-12 01:47:00,914: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:47:01.600685684Z [2024-04-12 01:47:01,600: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d19c60d6-9830-4685-84eb-9fa46a83e0c6] succeeded in 1.2601957619990571s: None 2024-04-12T01:47:01.787482481Z [2024-04-12 01:47:01,787: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:47:01.790666521Z [2024-04-12 01:47:01,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:47:01.819721515Z [2024-04-12 01:47:01,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:47:01.821430463Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:47:01.821463285Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:47:01.821627625Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:47:01.821650492Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:47:01.821969877Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:47:01.821987527Z [2024-04-12 01:47:01,821: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:47:01.898361531Z [2024-04-12 01:47:01,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:47:01.976327607Z [2024-04-12 01:47:01,973: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:47:01.983145201Z [2024-04-12 01:47:01,982: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:47:02.022281432Z [2024-04-12 01:47:02,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:47:02.023601813Z [2024-04-12 01:47:02,023: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:47:02.023727922Z [2024-04-12 01:47:02,023: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:47:02.023919023Z [2024-04-12 01:47:02,023: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:47:02.024029134Z [2024-04-12 01:47:02,023: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:47:02.024299719Z [2024-04-12 01:47:02,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:47:02.024495809Z [2024-04-12 01:47:02,024: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:47:02.105972016Z [2024-04-12 01:47:02,105: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:47:03.536438352Z [2024-04-12 01:47:03,536: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35aaa577-d3c5-4b9a-9699-f74ca0bb99b6] succeeded in 3.199615273000745s: None 2024-04-12T01:47:03.854894873Z [2024-04-12 01:47:03,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7f40d1e-4a80-4dfb-b178-d29fed43704d] succeeded in 3.523755357000482s: None 2024-04-12T01:48:00.794720462Z [2024-04-12 01:48:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac017ba5-34da-4389-bebd-cb3d38c22259] received 2024-04-12T01:48:00.798886369Z [2024-04-12 01:48:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f194ee3a-dd86-474f-b521-22d804ad3463] received 2024-04-12T01:48:00.807232226Z [2024-04-12 01:48:00,806: INFO/ForkPoolWorker-15] [ac017ba5-34da-4389-bebd-cb3d38c22259] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:48:00.809258044Z [2024-04-12 01:48:00,808: INFO/ForkPoolWorker-16] [f194ee3a-dd86-474f-b521-22d804ad3463] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:48:00.817540181Z [2024-04-12 01:48:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4cf3f76-adb2-4bd7-b3d8-b90524ff92af] received 2024-04-12T01:48:00.820278301Z [2024-04-12 01:48:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822a4f5f-318d-4ea7-b839-7c9c88c1d244] received 2024-04-12T01:48:00.827893894Z [2024-04-12 01:48:00,827: INFO/ForkPoolWorker-2] [822a4f5f-318d-4ea7-b839-7c9c88c1d244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:48:00.838044757Z [2024-04-12 01:48:00,837: INFO/ForkPoolWorker-1] [d4cf3f76-adb2-4bd7-b3d8-b90524ff92af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:48:01.146686078Z [2024-04-12 01:48:01,143: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:48:01.203525404Z [2024-04-12 01:48:01,200: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:48:01.250946416Z [2024-04-12 01:48:01,247: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:48:01.305063054Z [2024-04-12 01:48:01,302: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:48:01.341213754Z [2024-04-12 01:48:01,340: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:48:01.344872552Z [2024-04-12 01:48:01,344: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:48:01.377626965Z [2024-04-12 01:48:01,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:48:01.379248066Z [2024-04-12 01:48:01,379: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:48:01.379469594Z [2024-04-12 01:48:01,379: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:48:01.379665609Z [2024-04-12 01:48:01,379: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:48:01.379968659Z [2024-04-12 01:48:01,379: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:48:01.508850089Z [2024-04-12 01:48:01,508: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:48:01.527835220Z [2024-04-12 01:48:01,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:48:02.237946191Z [2024-04-12 01:48:02,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac017ba5-34da-4389-bebd-cb3d38c22259] succeeded in 1.4376698470005067s: None 2024-04-12T01:48:02.452094259Z [2024-04-12 01:48:02,451: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f194ee3a-dd86-474f-b521-22d804ad3463] succeeded in 1.6492389060003916s: None 2024-04-12T01:48:02.533198803Z [2024-04-12 01:48:02,532: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:48:02.535880563Z [2024-04-12 01:48:02,535: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:48:02.556063262Z [2024-04-12 01:48:02,555: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:48:02.557632296Z [2024-04-12 01:48:02,557: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:48:02.557726557Z [2024-04-12 01:48:02,557: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:48:02.557962981Z [2024-04-12 01:48:02,557: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:48:02.558012726Z [2024-04-12 01:48:02,557: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:48:02.561288736Z [2024-04-12 01:48:02,561: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:48:02.561359101Z [2024-04-12 01:48:02,561: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:48:02.657910113Z [2024-04-12 01:48:02,657: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:48:02.721859439Z [2024-04-12 01:48:02,721: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:48:02.725053688Z [2024-04-12 01:48:02,724: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:48:02.743512365Z [2024-04-12 01:48:02,743: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:48:02.745295986Z [2024-04-12 01:48:02,745: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:48:02.745446904Z [2024-04-12 01:48:02,745: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:48:02.745690914Z [2024-04-12 01:48:02,745: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:48:02.745861503Z [2024-04-12 01:48:02,745: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:48:02.746358759Z [2024-04-12 01:48:02,746: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:48:02.746549003Z [2024-04-12 01:48:02,746: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:48:02.835116300Z [2024-04-12 01:48:02,834: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:48:04.430477272Z [2024-04-12 01:48:04,430: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4cf3f76-adb2-4bd7-b3d8-b90524ff92af] succeeded in 3.6065986749999865s: None 2024-04-12T01:48:04.765333931Z [2024-04-12 01:48:04,764: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[822a4f5f-318d-4ea7-b839-7c9c88c1d244] succeeded in 3.943034293999517s: None 2024-04-12T01:49:01.187233781Z [2024-04-12 01:49:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[511b6cef-66d3-495f-aa87-b160edfad987] received 2024-04-12T01:49:01.195878737Z [2024-04-12 01:49:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6f3eede-42c9-405d-a20b-f1b332d2b460] received 2024-04-12T01:49:01.205630922Z [2024-04-12 01:49:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8710c098-b764-4fa5-af9f-413c7786cd2b] received 2024-04-12T01:49:01.206273676Z [2024-04-12 01:49:01,206: INFO/ForkPoolWorker-15] [511b6cef-66d3-495f-aa87-b160edfad987] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:49:01.209120475Z [2024-04-12 01:49:01,208: INFO/ForkPoolWorker-16] [e6f3eede-42c9-405d-a20b-f1b332d2b460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:49:01.216398237Z [2024-04-12 01:49:01,215: INFO/ForkPoolWorker-1] [8710c098-b764-4fa5-af9f-413c7786cd2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:49:01.469507547Z [2024-04-12 01:49:01,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:49:01.492993454Z [2024-04-12 01:49:01,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:49:01.534135370Z [2024-04-12 01:49:01,530: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:49:01.630119960Z [2024-04-12 01:49:01,629: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T01:49:01.633889276Z [2024-04-12 01:49:01,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:49:01.667656392Z [2024-04-12 01:49:01,662: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:49:01.684506911Z [2024-04-12 01:49:01,680: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:49:01.684674240Z [2024-04-12 01:49:01,684: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:49:01.684906310Z [2024-04-12 01:49:01,684: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T01:49:01.685732054Z [2024-04-12 01:49:01,685: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:49:01.830867141Z [2024-04-12 01:49:01,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:49:02.483458503Z [2024-04-12 01:49:02,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[511b6cef-66d3-495f-aa87-b160edfad987] succeeded in 1.2899398959998507s: None 2024-04-12T01:49:02.637653046Z [2024-04-12 01:49:02,637: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:49:02.640791166Z [2024-04-12 01:49:02,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:49:02.663087358Z [2024-04-12 01:49:02,662: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:49:02.663112776Z [2024-04-12 01:49:02,662: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:49:02.664658126Z [2024-04-12 01:49:02,664: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:49:02.664722108Z [2024-04-12 01:49:02,664: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:49:02.664902234Z [2024-04-12 01:49:02,664: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:49:02.664970791Z [2024-04-12 01:49:02,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:49:02.665217139Z [2024-04-12 01:49:02,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:49:02.665590061Z [2024-04-12 01:49:02,665: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:49:02.666609068Z [2024-04-12 01:49:02,666: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:49:02.684907223Z [2024-04-12 01:49:02,684: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:49:02.685945878Z [2024-04-12 01:49:02,685: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:49:02.685983384Z [2024-04-12 01:49:02,685: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:49:02.686065555Z [2024-04-12 01:49:02,685: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:49:02.686101193Z [2024-04-12 01:49:02,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:49:02.688055845Z [2024-04-12 01:49:02,687: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:49:02.688094514Z [2024-04-12 01:49:02,688: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:49:02.734575712Z [2024-04-12 01:49:02,734: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:49:02.758251723Z [2024-04-12 01:49:02,757: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:49:04.708533677Z [2024-04-12 01:49:04,708: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8710c098-b764-4fa5-af9f-413c7786cd2b] succeeded in 3.5008812449996185s: None 2024-04-12T01:49:05.304768026Z [2024-04-12 01:49:05,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6f3eede-42c9-405d-a20b-f1b332d2b460] succeeded in 4.107029254000736s: None 2024-04-12T01:50:00.334308739Z [2024-04-12 01:50:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a992f3c-a7ae-46ef-9585-f01bb4b06a70] received 2024-04-12T01:50:00.335844979Z [2024-04-12 01:50:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[add664c0-717f-48e2-8fc1-d9417a67987a] received 2024-04-12T01:50:00.345384968Z [2024-04-12 01:50:00,345: INFO/ForkPoolWorker-16] [add664c0-717f-48e2-8fc1-d9417a67987a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:50:00.345433784Z [2024-04-12 01:50:00,345: INFO/ForkPoolWorker-15] [4a992f3c-a7ae-46ef-9585-f01bb4b06a70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:00.345657423Z [2024-04-12 01:50:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f78f77c-050b-47c2-a7ff-eccd2606afca] received 2024-04-12T01:50:00.347527023Z [2024-04-12 01:50:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9bbc278-5d91-49c2-b064-dc301ae1e386] received 2024-04-12T01:50:00.350685603Z [2024-04-12 01:50:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b441e20-4a47-4359-9484-13309ddab409] received 2024-04-12T01:50:00.361501488Z [2024-04-12 01:50:00,361: INFO/ForkPoolWorker-3] [5b441e20-4a47-4359-9484-13309ddab409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:50:00.366339613Z [2024-04-12 01:50:00,366: INFO/ForkPoolWorker-2] [f9bbc278-5d91-49c2-b064-dc301ae1e386] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:50:00.371086904Z [2024-04-12 01:50:00,370: INFO/ForkPoolWorker-1] [6f78f77c-050b-47c2-a7ff-eccd2606afca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:50:00.634637722Z [2024-04-12 01:50:00,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:50:00.647812196Z [2024-04-12 01:50:00,645: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:50:00.675499956Z [2024-04-12 01:50:00,672: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:50:00.746604738Z [2024-04-12 01:50:00,742: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:50:00.868804969Z [2024-04-12 01:50:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:50:00.953883770Z [2024-04-12 01:50:00,953: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:50:00.957967737Z [2024-04-12 01:50:00,957: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:00.996267547Z [2024-04-12 01:50:00,996: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:01.001573428Z [2024-04-12 01:50:01,001: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:50:01.005276423Z [2024-04-12 01:50:01,005: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:50:01.005304261Z [2024-04-12 01:50:01,005: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:50:01.005388446Z [2024-04-12 01:50:01,005: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:50:01.005549192Z [2024-04-12 01:50:01,005: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:50:01.178317639Z [2024-04-12 01:50:01,178: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:01.520295463Z [2024-04-12 01:50:01,519: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[add664c0-717f-48e2-8fc1-d9417a67987a] succeeded in 1.1829967470002885s: None 2024-04-12T01:50:01.835133965Z [2024-04-12 01:50:01,834: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f9bbc278-5d91-49c2-b064-dc301ae1e386] succeeded in 1.4851124309989245s: None 2024-04-12T01:50:01.981953514Z [2024-04-12 01:50:01,981: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T01:50:01.984997691Z [2024-04-12 01:50:01,984: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:02.004409791Z [2024-04-12 01:50:02,004: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T01:50:02.005688796Z [2024-04-12 01:50:02,005: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:02.005704538Z [2024-04-12 01:50:02,005: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:02.005849722Z [2024-04-12 01:50:02,005: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:02.005879335Z [2024-04-12 01:50:02,005: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T01:50:02.006170201Z [2024-04-12 01:50:02,006: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:50:02.006237379Z [2024-04-12 01:50:02,006: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:02.106270638Z [2024-04-12 01:50:02,106: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:02.157499641Z [2024-04-12 01:50:02,157: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:50:02.161644080Z [2024-04-12 01:50:02,161: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:02.190758858Z [2024-04-12 01:50:02,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:50:02.192191223Z [2024-04-12 01:50:02,192: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:02.192348277Z [2024-04-12 01:50:02,192: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:02.192579683Z [2024-04-12 01:50:02,192: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:02.192905014Z [2024-04-12 01:50:02,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:50:02.193112608Z [2024-04-12 01:50:02,193: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:50:02.193246873Z [2024-04-12 01:50:02,193: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:02.250164662Z [2024-04-12 01:50:02,249: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:50:02.254999278Z [2024-04-12 01:50:02,254: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:02.272090754Z [2024-04-12 01:50:02,271: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:50:02.273019431Z [2024-04-12 01:50:02,272: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:02.273040030Z [2024-04-12 01:50:02,272: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:02.273141155Z [2024-04-12 01:50:02,273: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:02.273181028Z [2024-04-12 01:50:02,273: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:50:02.273353333Z [2024-04-12 01:50:02,273: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:50:02.273383210Z [2024-04-12 01:50:02,273: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:02.278388527Z [2024-04-12 01:50:02,278: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:02.357271829Z [2024-04-12 01:50:02,357: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:02.817017058Z [2024-04-12 01:50:02,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a992f3c-a7ae-46ef-9585-f01bb4b06a70] succeeded in 2.4798879339996347s: None 2024-04-12T01:50:03.311464745Z [2024-04-12 01:50:03,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b341f5ee-1deb-4b90-9d79-d54fcc6d0622] received 2024-04-12T01:50:03.319579658Z [2024-04-12 01:50:03,319: INFO/ForkPoolWorker-15] [b341f5ee-1deb-4b90-9d79-d54fcc6d0622] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:03.524803525Z [2024-04-12 01:50:03,524: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5b441e20-4a47-4359-9484-13309ddab409] succeeded in 3.1714909089987486s: None 2024-04-12T01:50:03.646568383Z [2024-04-12 01:50:03,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:50:04.402995239Z [2024-04-12 01:50:04,402: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f78f77c-050b-47c2-a7ff-eccd2606afca] succeeded in 4.054350537999198s: None 2024-04-12T01:50:04.689829563Z [2024-04-12 01:50:04,689: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:50:04.692580785Z [2024-04-12 01:50:04,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:04.714902932Z [2024-04-12 01:50:04,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:50:04.716614188Z [2024-04-12 01:50:04,716: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:04.716760624Z [2024-04-12 01:50:04,716: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:04.716971732Z [2024-04-12 01:50:04,716: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:04.717094154Z [2024-04-12 01:50:04,716: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:50:04.717410354Z [2024-04-12 01:50:04,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:50:04.717551267Z [2024-04-12 01:50:04,717: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:04.826238726Z [2024-04-12 01:50:04,825: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:05.519177264Z [2024-04-12 01:50:05,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b341f5ee-1deb-4b90-9d79-d54fcc6d0622] succeeded in 2.2055443080007535s: None 2024-04-12T01:50:05.692243531Z [2024-04-12 01:50:05,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cb87823-0461-44fd-be2b-e3cc4248c7f6] received 2024-04-12T01:50:05.701844923Z [2024-04-12 01:50:05,701: INFO/ForkPoolWorker-15] [6cb87823-0461-44fd-be2b-e3cc4248c7f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:50:06.014645361Z [2024-04-12 01:50:06,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:50:07.128947783Z [2024-04-12 01:50:07,128: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:50:07.132025507Z [2024-04-12 01:50:07,131: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:07.161787488Z [2024-04-12 01:50:07,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:50:07.163261252Z [2024-04-12 01:50:07,162: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:07.163283852Z [2024-04-12 01:50:07,163: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:07.163527119Z [2024-04-12 01:50:07,163: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:07.163663238Z [2024-04-12 01:50:07,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:50:07.164003349Z [2024-04-12 01:50:07,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:50:07.164025736Z [2024-04-12 01:50:07,163: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:07.258234028Z [2024-04-12 01:50:07,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:07.944664316Z [2024-04-12 01:50:07,944: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cb87823-0461-44fd-be2b-e3cc4248c7f6] succeeded in 2.250062131000959s: None 2024-04-12T01:50:08.077066363Z [2024-04-12 01:50:08,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ac7c393-84ef-407b-972a-8b907b69c725] received 2024-04-12T01:50:08.108461066Z [2024-04-12 01:50:08,108: INFO/ForkPoolWorker-15] [9ac7c393-84ef-407b-972a-8b907b69c725] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:08.406103619Z [2024-04-12 01:50:08,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:50:09.573942031Z [2024-04-12 01:50:09,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:50:09.577238074Z [2024-04-12 01:50:09,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:50:09.602644942Z [2024-04-12 01:50:09,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:50:09.604325649Z [2024-04-12 01:50:09,604: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:50:09.604580712Z [2024-04-12 01:50:09,604: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:50:09.604967707Z [2024-04-12 01:50:09,604: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:50:09.605010950Z [2024-04-12 01:50:09,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:50:09.605411323Z [2024-04-12 01:50:09,605: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:50:09.605544899Z [2024-04-12 01:50:09,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:50:09.714964611Z [2024-04-12 01:50:09,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:50:10.323339406Z [2024-04-12 01:50:10,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ac7c393-84ef-407b-972a-8b907b69c725] succeeded in 2.2417011770012323s: None 2024-04-12T01:51:01.095884217Z [2024-04-12 01:51:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d49396ef-155b-4a91-9ed1-f79901238a3f] received 2024-04-12T01:51:01.101574235Z [2024-04-12 01:51:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3b51725-a0c2-4b85-ad1d-6e1b47345d6c] received 2024-04-12T01:51:01.107456070Z [2024-04-12 01:51:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa30efe-80b5-4759-b348-0e305bbffdb4] received 2024-04-12T01:51:01.108616350Z [2024-04-12 01:51:01,108: INFO/ForkPoolWorker-15] [d49396ef-155b-4a91-9ed1-f79901238a3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:51:01.115603622Z [2024-04-12 01:51:01,115: INFO/ForkPoolWorker-16] [c3b51725-a0c2-4b85-ad1d-6e1b47345d6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:51:01.119557948Z [2024-04-12 01:51:01,119: INFO/ForkPoolWorker-1] [0aa30efe-80b5-4759-b348-0e305bbffdb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:51:01.410474001Z [2024-04-12 01:51:01,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:51:01.432258299Z [2024-04-12 01:51:01,429: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:51:01.531095411Z [2024-04-12 01:51:01,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:51:01.735447907Z [2024-04-12 01:51:01,735: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:51:01.744489051Z [2024-04-12 01:51:01,740: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:51:01.795351506Z [2024-04-12 01:51:01,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:51:01.797916881Z [2024-04-12 01:51:01,797: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:51:01.799981783Z [2024-04-12 01:51:01,797: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:51:01.800183044Z [2024-04-12 01:51:01,800: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:51:01.801385567Z [2024-04-12 01:51:01,801: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:51:01.887383323Z [2024-04-12 01:51:01,887: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:51:02.438567349Z [2024-04-12 01:51:02,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3b51725-a0c2-4b85-ad1d-6e1b47345d6c] succeeded in 1.334670449999976s: None 2024-04-12T01:51:02.504334699Z [2024-04-12 01:51:02,503: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:51:02.507411072Z [2024-04-12 01:51:02,506: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:51:02.532925613Z [2024-04-12 01:51:02,532: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:51:02.534262176Z [2024-04-12 01:51:02,533: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:51:02.535371058Z [2024-04-12 01:51:02,535: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:51:02.535533287Z [2024-04-12 01:51:02,535: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:51:02.535772164Z [2024-04-12 01:51:02,535: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:51:02.535907100Z [2024-04-12 01:51:02,535: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:51:02.536272404Z [2024-04-12 01:51:02,536: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:51:02.536478241Z [2024-04-12 01:51:02,536: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:51:02.538532543Z [2024-04-12 01:51:02,538: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:51:02.561924694Z [2024-04-12 01:51:02,561: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:51:02.563367246Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:51:02.563378679Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:51:02.563601933Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:51:02.563691890Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:51:02.563982639Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:51:02.564091023Z [2024-04-12 01:51:02,563: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:51:02.620495410Z [2024-04-12 01:51:02,620: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:51:02.647988935Z [2024-04-12 01:51:02,647: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:51:04.371372430Z [2024-04-12 01:51:04,370: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0aa30efe-80b5-4759-b348-0e305bbffdb4] succeeded in 3.2618109979994188s: None 2024-04-12T01:51:05.211732454Z [2024-04-12 01:51:05,211: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d49396ef-155b-4a91-9ed1-f79901238a3f] succeeded in 4.111865785000191s: None 2024-04-12T01:52:00.969083611Z [2024-04-12 01:52:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f556413c-53be-4c5c-bf51-e6f7d1205f60] received 2024-04-12T01:52:00.977242036Z [2024-04-12 01:52:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c79aa65b-38e1-4ca9-ba9d-39394c0ba628] received 2024-04-12T01:52:00.981540466Z [2024-04-12 01:52:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee580975-ec4b-4bfe-9957-2152283da465] received 2024-04-12T01:52:00.983515469Z [2024-04-12 01:52:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c986d6-8745-46c7-b761-72b948fe9d96] received 2024-04-12T01:52:00.986811616Z [2024-04-12 01:52:00,986: INFO/ForkPoolWorker-15] [f556413c-53be-4c5c-bf51-e6f7d1205f60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:52:00.996559986Z [2024-04-12 01:52:00,996: INFO/ForkPoolWorker-2] [31c986d6-8745-46c7-b761-72b948fe9d96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:52:00.997291404Z [2024-04-12 01:52:00,997: INFO/ForkPoolWorker-16] [c79aa65b-38e1-4ca9-ba9d-39394c0ba628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:52:01.006122773Z [2024-04-12 01:52:01,005: INFO/ForkPoolWorker-1] [ee580975-ec4b-4bfe-9957-2152283da465] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:52:01.330168564Z [2024-04-12 01:52:01,327: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:52:01.442663502Z [2024-04-12 01:52:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:52:01.498014762Z [2024-04-12 01:52:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:52:01.499458377Z [2024-04-12 01:52:01,495: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:52:01.647229025Z [2024-04-12 01:52:01,646: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T01:52:01.655813184Z [2024-04-12 01:52:01,655: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:52:01.772288572Z [2024-04-12 01:52:01,772: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:52:01.777127265Z [2024-04-12 01:52:01,776: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:52:01.777152328Z [2024-04-12 01:52:01,777: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:52:01.777217994Z [2024-04-12 01:52:01,777: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T01:52:01.777386303Z [2024-04-12 01:52:01,777: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:52:01.971707883Z [2024-04-12 01:52:01,971: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:52:01.988132547Z [2024-04-12 01:52:01,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:52:02.664952214Z [2024-04-12 01:52:02,664: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31c986d6-8745-46c7-b761-72b948fe9d96] succeeded in 1.6795024490002106s: None 2024-04-12T01:52:02.672111873Z [2024-04-12 01:52:02,671: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f556413c-53be-4c5c-bf51-e6f7d1205f60] succeeded in 1.6980863310000132s: None 2024-04-12T01:52:02.910611288Z [2024-04-12 01:52:02,910: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:52:02.914102714Z [2024-04-12 01:52:02,913: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:52:02.934951419Z [2024-04-12 01:52:02,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:52:02.936005763Z [2024-04-12 01:52:02,935: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:52:02.936021241Z [2024-04-12 01:52:02,935: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:52:02.936118206Z [2024-04-12 01:52:02,935: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:52:02.936137768Z [2024-04-12 01:52:02,936: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:52:02.936342494Z [2024-04-12 01:52:02,936: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:52:02.936353501Z [2024-04-12 01:52:02,936: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:52:03.023891460Z [2024-04-12 01:52:03,023: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:52:03.141460908Z [2024-04-12 01:52:03,141: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:52:03.144483168Z [2024-04-12 01:52:03,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:52:03.159309320Z [2024-04-12 01:52:03,159: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:52:03.160959874Z [2024-04-12 01:52:03,160: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:52:03.161059081Z [2024-04-12 01:52:03,160: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:52:03.161203776Z [2024-04-12 01:52:03,161: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:52:03.161473286Z [2024-04-12 01:52:03,161: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:52:03.161682801Z [2024-04-12 01:52:03,161: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:52:03.161802553Z [2024-04-12 01:52:03,161: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:52:03.284101575Z [2024-04-12 01:52:03,283: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:52:05.300281087Z [2024-04-12 01:52:05,299: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee580975-ec4b-4bfe-9957-2152283da465] succeeded in 4.31522121099988s: None 2024-04-12T01:52:05.615373648Z [2024-04-12 01:52:05,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c79aa65b-38e1-4ca9-ba9d-39394c0ba628] succeeded in 4.636884829998962s: None 2024-04-12T01:53:00.965789896Z [2024-04-12 01:53:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96a53ed3-9dfe-4d35-a9d1-474a83d4788f] received 2024-04-12T01:53:00.967026154Z [2024-04-12 01:53:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45655361-308e-4c96-9f40-ba04e96166fe] received 2024-04-12T01:53:00.968283887Z [2024-04-12 01:53:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[628871b5-b1c4-4cc5-93f6-758d25485045] received 2024-04-12T01:53:00.980194929Z [2024-04-12 01:53:00,979: INFO/ForkPoolWorker-1] [628871b5-b1c4-4cc5-93f6-758d25485045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:53:00.982145274Z [2024-04-12 01:53:00,981: INFO/ForkPoolWorker-16] [45655361-308e-4c96-9f40-ba04e96166fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:53:00.985688302Z [2024-04-12 01:53:00,985: INFO/ForkPoolWorker-15] [96a53ed3-9dfe-4d35-a9d1-474a83d4788f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:53:01.264058988Z [2024-04-12 01:53:01,260: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:53:01.265082417Z [2024-04-12 01:53:01,262: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:53:01.312952798Z [2024-04-12 01:53:01,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:53:01.408768293Z [2024-04-12 01:53:01,408: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:53:01.412566331Z [2024-04-12 01:53:01,412: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:53:01.442817144Z [2024-04-12 01:53:01,442: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:53:01.444217322Z [2024-04-12 01:53:01,444: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:53:01.444304359Z [2024-04-12 01:53:01,444: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:53:01.444339777Z [2024-04-12 01:53:01,444: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:53:01.444695854Z [2024-04-12 01:53:01,444: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:53:01.533939893Z [2024-04-12 01:53:01,533: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:53:02.115050745Z [2024-04-12 01:53:02,114: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[45655361-308e-4c96-9f40-ba04e96166fe] succeeded in 1.1468607490005525s: None 2024-04-12T01:53:02.440926017Z [2024-04-12 01:53:02,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:53:02.443715123Z [2024-04-12 01:53:02,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:53:02.458854569Z [2024-04-12 01:53:02,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:53:02.460845419Z [2024-04-12 01:53:02,460: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:53:02.460863601Z [2024-04-12 01:53:02,460: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:53:02.460945019Z [2024-04-12 01:53:02,460: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:53:02.460973667Z [2024-04-12 01:53:02,460: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:53:02.461185533Z [2024-04-12 01:53:02,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:53:02.461195990Z [2024-04-12 01:53:02,461: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:53:02.463474068Z [2024-04-12 01:53:02,463: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:53:02.466268151Z [2024-04-12 01:53:02,465: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:53:02.490705421Z [2024-04-12 01:53:02,490: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:53:02.491665992Z [2024-04-12 01:53:02,491: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:53:02.491714448Z [2024-04-12 01:53:02,491: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:53:02.491774389Z [2024-04-12 01:53:02,491: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:53:02.491816985Z [2024-04-12 01:53:02,491: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:53:02.492014813Z [2024-04-12 01:53:02,491: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:53:02.492154452Z [2024-04-12 01:53:02,492: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:53:02.547086429Z [2024-04-12 01:53:02,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:53:02.569059672Z [2024-04-12 01:53:02,568: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:53:04.028810938Z [2024-04-12 01:53:04,027: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[628871b5-b1c4-4cc5-93f6-758d25485045] succeeded in 3.054202285999054s: None 2024-04-12T01:53:04.541360594Z [2024-04-12 01:53:04,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96a53ed3-9dfe-4d35-a9d1-474a83d4788f] succeeded in 3.572699157999523s: None 2024-04-12T01:54:00.892263400Z [2024-04-12 01:54:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69310628-9a50-4c0c-ba50-862248a0cdd7] received 2024-04-12T01:54:00.894020099Z [2024-04-12 01:54:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[166d801b-4960-4fea-82e5-17b8848f19f5] received 2024-04-12T01:54:00.897789035Z [2024-04-12 01:54:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cd9288d-cc50-4873-8c79-69c5727c6382] received 2024-04-12T01:54:00.903413125Z [2024-04-12 01:54:00,903: INFO/ForkPoolWorker-15] [69310628-9a50-4c0c-ba50-862248a0cdd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:54:00.904961586Z [2024-04-12 01:54:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36f2dcfe-9dfe-4f9d-b13f-54f329740ef5] received 2024-04-12T01:54:00.906143544Z [2024-04-12 01:54:00,905: INFO/ForkPoolWorker-16] [166d801b-4960-4fea-82e5-17b8848f19f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:54:00.906671885Z [2024-04-12 01:54:00,906: INFO/ForkPoolWorker-1] [3cd9288d-cc50-4873-8c79-69c5727c6382] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:54:00.919290335Z [2024-04-12 01:54:00,918: INFO/ForkPoolWorker-2] [36f2dcfe-9dfe-4f9d-b13f-54f329740ef5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:54:01.197429584Z [2024-04-12 01:54:01,194: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:54:01.268302235Z [2024-04-12 01:54:01,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:54:01.323457061Z [2024-04-12 01:54:01,320: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:54:01.366029241Z [2024-04-12 01:54:01,363: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:54:01.467879874Z [2024-04-12 01:54:01,467: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:54:01.481187022Z [2024-04-12 01:54:01,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:54:01.527938090Z [2024-04-12 01:54:01,527: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:54:01.529036328Z [2024-04-12 01:54:01,528: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:54:01.529174284Z [2024-04-12 01:54:01,529: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:54:01.529255166Z [2024-04-12 01:54:01,529: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:54:01.529450850Z [2024-04-12 01:54:01,529: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:54:01.658303276Z [2024-04-12 01:54:01,653: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:54:01.706079178Z [2024-04-12 01:54:01,705: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:54:02.311066626Z [2024-04-12 01:54:02,310: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cd9288d-cc50-4873-8c79-69c5727c6382] succeeded in 1.412016152000433s: None 2024-04-12T01:54:02.387066504Z [2024-04-12 01:54:02,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[166d801b-4960-4fea-82e5-17b8848f19f5] succeeded in 1.4902366509995773s: None 2024-04-12T01:54:02.598664969Z [2024-04-12 01:54:02,598: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:54:02.600970009Z [2024-04-12 01:54:02,600: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:54:02.601882682Z [2024-04-12 01:54:02,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:54:02.603733895Z [2024-04-12 01:54:02,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:54:02.621559936Z [2024-04-12 01:54:02,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:54:02.622906375Z [2024-04-12 01:54:02,622: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:54:02.623528898Z [2024-04-12 01:54:02,623: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:54:02.623536933Z [2024-04-12 01:54:02,623: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:54:02.623609524Z [2024-04-12 01:54:02,623: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:54:02.623882109Z [2024-04-12 01:54:02,623: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:54:02.623953696Z [2024-04-12 01:54:02,623: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:54:02.635303165Z [2024-04-12 01:54:02,635: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:54:02.636712060Z [2024-04-12 01:54:02,636: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:54:02.636948010Z [2024-04-12 01:54:02,636: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:54:02.637197205Z [2024-04-12 01:54:02,637: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:54:02.637386223Z [2024-04-12 01:54:02,637: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:54:02.637731181Z [2024-04-12 01:54:02,637: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:54:02.637926167Z [2024-04-12 01:54:02,637: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:54:02.700060082Z [2024-04-12 01:54:02,699: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:54:02.721833335Z [2024-04-12 01:54:02,720: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:54:04.299380086Z [2024-04-12 01:54:04,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69310628-9a50-4c0c-ba50-862248a0cdd7] succeeded in 3.4044822310006566s: None 2024-04-12T01:54:04.935478983Z [2024-04-12 01:54:04,934: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[36f2dcfe-9dfe-4f9d-b13f-54f329740ef5] succeeded in 4.021643899999617s: None 2024-04-12T01:55:00.372438178Z [2024-04-12 01:55:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac6814d2-2b51-45c1-a16b-d53c62dbbe29] received 2024-04-12T01:55:00.381721093Z [2024-04-12 01:55:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0558ab93-5975-44aa-bf86-c7aa86dc4fe1] received 2024-04-12T01:55:00.384620229Z [2024-04-12 01:55:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0eeeea2-f0b2-40f5-875d-f2335ac6bbe3] received 2024-04-12T01:55:00.386281262Z [2024-04-12 01:55:00,386: INFO/ForkPoolWorker-15] [ac6814d2-2b51-45c1-a16b-d53c62dbbe29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:00.386904686Z [2024-04-12 01:55:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1a23b76-032e-4c61-893a-7f85489f52d4] received 2024-04-12T01:55:00.395902018Z [2024-04-12 01:55:00,395: INFO/ForkPoolWorker-16] [0558ab93-5975-44aa-bf86-c7aa86dc4fe1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:55:00.403497600Z [2024-04-12 01:55:00,403: INFO/ForkPoolWorker-1] [e0eeeea2-f0b2-40f5-875d-f2335ac6bbe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:55:00.409699268Z [2024-04-12 01:55:00,409: INFO/ForkPoolWorker-2] [f1a23b76-032e-4c61-893a-7f85489f52d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:55:00.680066608Z [2024-04-12 01:55:00,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:55:00.724189205Z [2024-04-12 01:55:00,720: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:55:00.762562828Z [2024-04-12 01:55:00,759: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:55:00.811149502Z [2024-04-12 01:55:00,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:55:00.941453630Z [2024-04-12 01:55:00,940: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:55:00.948003870Z [2024-04-12 01:55:00,947: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:00.983717410Z [2024-04-12 01:55:00,983: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:55:00.986708492Z [2024-04-12 01:55:00,986: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:55:00.986969421Z [2024-04-12 01:55:00,986: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:55:00.987178927Z [2024-04-12 01:55:00,986: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:55:00.987461685Z [2024-04-12 01:55:00,987: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:55:01.125863999Z [2024-04-12 01:55:01,125: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:01.719300757Z [2024-04-12 01:55:01,712: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0eeeea2-f0b2-40f5-875d-f2335ac6bbe3] succeeded in 1.3261748790009733s: None 2024-04-12T01:55:01.910536258Z [2024-04-12 01:55:01,910: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:55:01.913835206Z [2024-04-12 01:55:01,913: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:01.933973430Z [2024-04-12 01:55:01,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:55:01.935316219Z [2024-04-12 01:55:01,935: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:01.935390143Z [2024-04-12 01:55:01,935: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:01.935601495Z [2024-04-12 01:55:01,935: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:01.935638621Z [2024-04-12 01:55:01,935: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:55:01.935899508Z [2024-04-12 01:55:01,935: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:55:01.936238328Z [2024-04-12 01:55:01,936: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:01.938878710Z [2024-04-12 01:55:01,938: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:55:01.941909298Z [2024-04-12 01:55:01,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:01.959224172Z [2024-04-12 01:55:01,958: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:55:01.960139764Z [2024-04-12 01:55:01,959: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:01.960158178Z [2024-04-12 01:55:01,960: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:01.960275053Z [2024-04-12 01:55:01,960: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:01.960304514Z [2024-04-12 01:55:01,960: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:55:01.960534479Z [2024-04-12 01:55:01,960: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:55:01.960886178Z [2024-04-12 01:55:01,960: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:02.013185603Z [2024-04-12 01:55:02,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:55:02.018710445Z [2024-04-12 01:55:02,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:02.033129525Z [2024-04-12 01:55:02,032: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:02.034124370Z [2024-04-12 01:55:02,033: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:02.040935581Z [2024-04-12 01:55:02,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:55:02.042954301Z [2024-04-12 01:55:02,042: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:02.043338971Z [2024-04-12 01:55:02,042: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:02.043546786Z [2024-04-12 01:55:02,043: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:02.043693364Z [2024-04-12 01:55:02,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:55:02.044002398Z [2024-04-12 01:55:02,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:55:02.044114044Z [2024-04-12 01:55:02,043: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:02.122189692Z [2024-04-12 01:55:02,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:02.753526347Z [2024-04-12 01:55:02,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac6814d2-2b51-45c1-a16b-d53c62dbbe29] succeeded in 2.374449877999723s: None 2024-04-12T01:55:02.942048960Z [2024-04-12 01:55:02,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c812f1c2-c056-43db-abc0-02bf3606a8b1] received 2024-04-12T01:55:02.952840345Z [2024-04-12 01:55:02,952: INFO/ForkPoolWorker-15] [c812f1c2-c056-43db-abc0-02bf3606a8b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:03.207371117Z [2024-04-12 01:55:03,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:55:03.675474900Z [2024-04-12 01:55:03,675: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1a23b76-032e-4c61-893a-7f85489f52d4] succeeded in 3.2860953630006406s: None 2024-04-12T01:55:03.715236662Z [2024-04-12 01:55:03,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0558ab93-5975-44aa-bf86-c7aa86dc4fe1] succeeded in 3.331351306000215s: None 2024-04-12T01:55:04.308735741Z [2024-04-12 01:55:04,308: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:55:04.311503071Z [2024-04-12 01:55:04,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:04.332396075Z [2024-04-12 01:55:04,332: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:55:04.334280196Z [2024-04-12 01:55:04,334: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:04.334569331Z [2024-04-12 01:55:04,334: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:04.334686083Z [2024-04-12 01:55:04,334: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:04.334720353Z [2024-04-12 01:55:04,334: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:55:04.335427496Z [2024-04-12 01:55:04,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:55:04.335440627Z [2024-04-12 01:55:04,335: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:04.439375735Z [2024-04-12 01:55:04,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:05.100890272Z [2024-04-12 01:55:05,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c812f1c2-c056-43db-abc0-02bf3606a8b1] succeeded in 2.1552290590007033s: None 2024-04-12T01:55:05.596752618Z [2024-04-12 01:55:05,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[190edaa2-eef0-42e0-b198-e7e63a7c26ab] received 2024-04-12T01:55:05.606657553Z [2024-04-12 01:55:05,606: INFO/ForkPoolWorker-15] [190edaa2-eef0-42e0-b198-e7e63a7c26ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:55:05.885653083Z [2024-04-12 01:55:05,882: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:55:06.905576692Z [2024-04-12 01:55:06,905: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:55:06.908804162Z [2024-04-12 01:55:06,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:06.934388704Z [2024-04-12 01:55:06,934: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:55:06.935786458Z [2024-04-12 01:55:06,935: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:06.935961434Z [2024-04-12 01:55:06,935: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:06.936193525Z [2024-04-12 01:55:06,935: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:06.936332271Z [2024-04-12 01:55:06,936: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:55:06.936678068Z [2024-04-12 01:55:06,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:55:06.936863154Z [2024-04-12 01:55:06,936: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:07.028270771Z [2024-04-12 01:55:07,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:08.571331867Z [2024-04-12 01:55:08,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[190edaa2-eef0-42e0-b198-e7e63a7c26ab] succeeded in 2.972311539999282s: None 2024-04-12T01:55:09.023909579Z [2024-04-12 01:55:09,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44861790-6588-4623-814b-0de5c5ffa24a] received 2024-04-12T01:55:09.035054019Z [2024-04-12 01:55:09,034: INFO/ForkPoolWorker-15] [44861790-6588-4623-814b-0de5c5ffa24a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:09.293967027Z [2024-04-12 01:55:09,290: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T01:55:10.250080229Z [2024-04-12 01:55:10,249: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:55:10.252820337Z [2024-04-12 01:55:10,252: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:55:10.276118579Z [2024-04-12 01:55:10,275: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:55:10.277853163Z [2024-04-12 01:55:10,277: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:55:10.278189951Z [2024-04-12 01:55:10,277: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:55:10.278616784Z [2024-04-12 01:55:10,278: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:55:10.278845022Z [2024-04-12 01:55:10,278: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:55:10.279278801Z [2024-04-12 01:55:10,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T01:55:10.279449901Z [2024-04-12 01:55:10,279: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:55:10.364058489Z [2024-04-12 01:55:10,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:55:11.015552266Z [2024-04-12 01:55:11,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44861790-6588-4623-814b-0de5c5ffa24a] succeeded in 1.9885980660001223s: None 2024-04-12T01:56:00.564607229Z [2024-04-12 01:56:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b3a79af-582c-4d75-9744-4714d6d88f0e] received 2024-04-12T01:56:00.569172060Z [2024-04-12 01:56:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90fed82a-7f48-4f95-923a-7e1a6700e2cc] received 2024-04-12T01:56:00.572807192Z [2024-04-12 01:56:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9971190-97f1-41f2-a166-20d20f94bb60] received 2024-04-12T01:56:00.574327994Z [2024-04-12 01:56:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e757345-6607-4ade-85a0-879835a623ff] received 2024-04-12T01:56:00.580266098Z [2024-04-12 01:56:00,580: INFO/ForkPoolWorker-2] [3e757345-6607-4ade-85a0-879835a623ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:56:00.581019771Z [2024-04-12 01:56:00,580: INFO/ForkPoolWorker-15] [7b3a79af-582c-4d75-9744-4714d6d88f0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:56:00.582824627Z [2024-04-12 01:56:00,582: INFO/ForkPoolWorker-1] [e9971190-97f1-41f2-a166-20d20f94bb60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:56:00.585297759Z [2024-04-12 01:56:00,584: INFO/ForkPoolWorker-16] [90fed82a-7f48-4f95-923a-7e1a6700e2cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:56:00.898909080Z [2024-04-12 01:56:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:56:00.909059550Z [2024-04-12 01:56:00,905: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:56:00.971362521Z [2024-04-12 01:56:00,968: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:56:01.068619343Z [2024-04-12 01:56:01,065: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:56:01.113338761Z [2024-04-12 01:56:01,112: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:56:01.116689538Z [2024-04-12 01:56:01,116: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:56:01.134393901Z [2024-04-12 01:56:01,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:56:01.148804296Z [2024-04-12 01:56:01,148: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:56:01.152128095Z [2024-04-12 01:56:01,151: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:56:01.152277281Z [2024-04-12 01:56:01,152: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:56:01.152328129Z [2024-04-12 01:56:01,152: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:56:01.152634327Z [2024-04-12 01:56:01,152: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:56:01.253285641Z [2024-04-12 01:56:01,253: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:56:01.729752183Z [2024-04-12 01:56:01,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b3a79af-582c-4d75-9744-4714d6d88f0e] succeeded in 1.1627076330005366s: None 2024-04-12T01:56:01.780316565Z [2024-04-12 01:56:01,779: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9971190-97f1-41f2-a166-20d20f94bb60] succeeded in 1.2039126300005591s: None 2024-04-12T01:56:02.116788049Z [2024-04-12 01:56:02,116: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:56:02.119359323Z [2024-04-12 01:56:02,118: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:56:02.145292782Z [2024-04-12 01:56:02,145: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:56:02.147330148Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:56:02.147340885Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:56:02.147474164Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:56:02.147479625Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:56:02.147732345Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:56:02.147825751Z [2024-04-12 01:56:02,147: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:56:02.239912903Z [2024-04-12 01:56:02,239: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:56:02.283240265Z [2024-04-12 01:56:02,282: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:56:02.286743947Z [2024-04-12 01:56:02,286: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:56:02.306197205Z [2024-04-12 01:56:02,305: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:56:02.307447890Z [2024-04-12 01:56:02,307: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:56:02.307607771Z [2024-04-12 01:56:02,307: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:56:02.307842269Z [2024-04-12 01:56:02,307: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:56:02.307851828Z [2024-04-12 01:56:02,307: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:56:02.308238360Z [2024-04-12 01:56:02,308: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:56:02.308672323Z [2024-04-12 01:56:02,308: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:56:02.375411290Z [2024-04-12 01:56:02,375: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:56:04.109396739Z [2024-04-12 01:56:04,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90fed82a-7f48-4f95-923a-7e1a6700e2cc] succeeded in 3.5356516580013704s: None 2024-04-12T01:56:04.208356568Z [2024-04-12 01:56:04,207: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3e757345-6607-4ade-85a0-879835a623ff] succeeded in 3.6325828690005437s: None 2024-04-12T01:57:01.055554355Z [2024-04-12 01:57:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32c12d91-82e0-465c-a26b-24c6a9d86b29] received 2024-04-12T01:57:01.058090732Z [2024-04-12 01:57:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbc2562d-4628-4586-b9ee-15eaa8b40a17] received 2024-04-12T01:57:01.066015992Z [2024-04-12 01:57:01,065: INFO/ForkPoolWorker-15] [32c12d91-82e0-465c-a26b-24c6a9d86b29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:57:01.066841801Z [2024-04-12 01:57:01,066: INFO/ForkPoolWorker-16] [cbc2562d-4628-4586-b9ee-15eaa8b40a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:57:01.072909615Z [2024-04-12 01:57:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58914b83-8bdc-4952-9de8-1f4b71aee39a] received 2024-04-12T01:57:01.082646958Z [2024-04-12 01:57:01,082: INFO/ForkPoolWorker-1] [58914b83-8bdc-4952-9de8-1f4b71aee39a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:57:01.347373077Z [2024-04-12 01:57:01,344: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:57:01.347867575Z [2024-04-12 01:57:01,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:57:01.395440392Z [2024-04-12 01:57:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:57:01.523758253Z [2024-04-12 01:57:01,523: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T01:57:01.536758989Z [2024-04-12 01:57:01,536: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:57:01.567592060Z [2024-04-12 01:57:01,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:57:01.568565736Z [2024-04-12 01:57:01,568: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:57:01.568657311Z [2024-04-12 01:57:01,568: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:57:01.568719643Z [2024-04-12 01:57:01,568: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T01:57:01.568892564Z [2024-04-12 01:57:01,568: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:57:01.699549988Z [2024-04-12 01:57:01,699: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:57:02.263296505Z [2024-04-12 01:57:02,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58914b83-8bdc-4952-9de8-1f4b71aee39a] succeeded in 1.188825175000602s: None 2024-04-12T01:57:02.482980329Z [2024-04-12 01:57:02,482: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:57:02.486067947Z [2024-04-12 01:57:02,485: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:57:02.507789673Z [2024-04-12 01:57:02,507: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:57:02.509335808Z [2024-04-12 01:57:02,509: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:57:02.509502490Z [2024-04-12 01:57:02,509: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:57:02.509739433Z [2024-04-12 01:57:02,509: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:57:02.509896303Z [2024-04-12 01:57:02,509: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:57:02.510233143Z [2024-04-12 01:57:02,510: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:57:02.510446378Z [2024-04-12 01:57:02,510: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:57:02.514785374Z [2024-04-12 01:57:02,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T01:57:02.517900783Z [2024-04-12 01:57:02,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:57:02.538783778Z [2024-04-12 01:57:02,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:57:02.539958827Z [2024-04-12 01:57:02,539: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:57:02.539994175Z [2024-04-12 01:57:02,539: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:57:02.540112772Z [2024-04-12 01:57:02,539: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:57:02.540149477Z [2024-04-12 01:57:02,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T01:57:02.540352802Z [2024-04-12 01:57:02,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:57:02.540440810Z [2024-04-12 01:57:02,540: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:57:02.587259050Z [2024-04-12 01:57:02,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:57:02.611053292Z [2024-04-12 01:57:02,610: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:57:04.381421897Z [2024-04-12 01:57:04,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32c12d91-82e0-465c-a26b-24c6a9d86b29] succeeded in 3.3223133129995404s: None 2024-04-12T01:57:04.804306926Z [2024-04-12 01:57:04,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbc2562d-4628-4586-b9ee-15eaa8b40a17] succeeded in 3.7433359429996926s: None 2024-04-12T01:58:00.990830218Z [2024-04-12 01:58:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1422dad6-5b93-471f-bb36-8a994544bd10] received 2024-04-12T01:58:00.994499891Z [2024-04-12 01:58:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc43be6f-349f-40f8-9a05-892efdcd1038] received 2024-04-12T01:58:00.998997432Z [2024-04-12 01:58:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[274ef509-efd0-49d4-857c-7ca81ed3939a] received 2024-04-12T01:58:01.002523432Z [2024-04-12 01:58:01,002: INFO/ForkPoolWorker-16] [cc43be6f-349f-40f8-9a05-892efdcd1038] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:58:01.006841350Z [2024-04-12 01:58:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1838d97-a94d-4c1d-909f-f2c620f8b6f5] received 2024-04-12T01:58:01.018314498Z [2024-04-12 01:58:01,018: INFO/ForkPoolWorker-15] [1422dad6-5b93-471f-bb36-8a994544bd10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:58:01.023756442Z [2024-04-12 01:58:01,023: INFO/ForkPoolWorker-1] [274ef509-efd0-49d4-857c-7ca81ed3939a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:58:01.024208533Z [2024-04-12 01:58:01,023: INFO/ForkPoolWorker-2] [f1838d97-a94d-4c1d-909f-f2c620f8b6f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:58:01.298583327Z [2024-04-12 01:58:01,295: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:58:01.307969108Z [2024-04-12 01:58:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:58:01.348978305Z [2024-04-12 01:58:01,345: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:58:01.399864191Z [2024-04-12 01:58:01,395: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T01:58:01.478016515Z [2024-04-12 01:58:01,477: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:58:01.482507871Z [2024-04-12 01:58:01,482: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:58:01.521261476Z [2024-04-12 01:58:01,521: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:58:01.524933883Z [2024-04-12 01:58:01,524: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:58:01.525032013Z [2024-04-12 01:58:01,524: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:58:01.525129980Z [2024-04-12 01:58:01,525: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:58:01.525361425Z [2024-04-12 01:58:01,525: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:58:01.696549276Z [2024-04-12 01:58:01,696: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:58:01.834316068Z [2024-04-12 01:58:01,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:58:02.287960647Z [2024-04-12 01:58:02,287: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc43be6f-349f-40f8-9a05-892efdcd1038] succeeded in 1.2924577479989239s: None 2024-04-12T01:58:02.446329572Z [2024-04-12 01:58:02,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1422dad6-5b93-471f-bb36-8a994544bd10] succeeded in 1.453520416000174s: None 2024-04-12T01:58:02.576933761Z [2024-04-12 01:58:02,576: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:58:02.579905446Z [2024-04-12 01:58:02,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:58:02.603674918Z [2024-04-12 01:58:02,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:58:02.605207118Z [2024-04-12 01:58:02,605: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:58:02.605415405Z [2024-04-12 01:58:02,605: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:58:02.605652786Z [2024-04-12 01:58:02,605: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:58:02.605834022Z [2024-04-12 01:58:02,605: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:58:02.606165271Z [2024-04-12 01:58:02,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:58:02.606682466Z [2024-04-12 01:58:02,606: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:58:02.675664791Z [2024-04-12 01:58:02,675: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T01:58:02.678663651Z [2024-04-12 01:58:02,678: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:58:02.697694223Z [2024-04-12 01:58:02,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:58:02.701229670Z [2024-04-12 01:58:02,700: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T01:58:02.702656683Z [2024-04-12 01:58:02,702: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:58:02.702713155Z [2024-04-12 01:58:02,702: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:58:02.702830355Z [2024-04-12 01:58:02,702: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:58:02.702875987Z [2024-04-12 01:58:02,702: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T01:58:02.703729289Z [2024-04-12 01:58:02,703: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:58:02.703823621Z [2024-04-12 01:58:02,703: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:58:02.795006832Z [2024-04-12 01:58:02,794: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:58:04.840098084Z [2024-04-12 01:58:04,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1838d97-a94d-4c1d-909f-f2c620f8b6f5] succeeded in 3.83019540100031s: None 2024-04-12T01:58:06.043520970Z [2024-04-12 01:58:06,042: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[274ef509-efd0-49d4-857c-7ca81ed3939a] succeeded in 5.035554476999096s: None 2024-04-12T01:59:00.771037746Z [2024-04-12 01:59:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1de819fe-af46-4c84-b543-c91da230f85d] received 2024-04-12T01:59:00.772559082Z [2024-04-12 01:59:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a615f981-c45e-442a-a4fa-b58a438fd5f7] received 2024-04-12T01:59:00.773763897Z [2024-04-12 01:59:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0630bdc-2dd9-42af-a43d-085abcaf4da7] received 2024-04-12T01:59:00.782736114Z [2024-04-12 01:59:00,782: INFO/ForkPoolWorker-15] [1de819fe-af46-4c84-b543-c91da230f85d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:59:00.783139557Z [2024-04-12 01:59:00,782: INFO/ForkPoolWorker-16] [a615f981-c45e-442a-a4fa-b58a438fd5f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:59:00.796288845Z [2024-04-12 01:59:00,795: INFO/ForkPoolWorker-1] [f0630bdc-2dd9-42af-a43d-085abcaf4da7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:59:01.035830936Z [2024-04-12 01:59:01,032: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T01:59:01.058513769Z [2024-04-12 01:59:01,055: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T01:59:01.070481421Z [2024-04-12 01:59:01,067: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T01:59:01.192695033Z [2024-04-12 01:59:01,192: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T01:59:01.196153262Z [2024-04-12 01:59:01,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:59:01.217768850Z [2024-04-12 01:59:01,217: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T01:59:01.218756343Z [2024-04-12 01:59:01,218: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T01:59:01.218905838Z [2024-04-12 01:59:01,218: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T01:59:01.219009438Z [2024-04-12 01:59:01,218: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T01:59:01.219482552Z [2024-04-12 01:59:01,219: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T01:59:01.344385271Z [2024-04-12 01:59:01,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:59:01.878286687Z [2024-04-12 01:59:01,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a615f981-c45e-442a-a4fa-b58a438fd5f7] succeeded in 1.1040239600006316s: None 2024-04-12T01:59:02.142127932Z [2024-04-12 01:59:02,141: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T01:59:02.144863481Z [2024-04-12 01:59:02,144: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:59:02.160783747Z [2024-04-12 01:59:02,160: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T01:59:02.163932108Z [2024-04-12 01:59:02,163: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T01:59:02.166636319Z [2024-04-12 01:59:02,166: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T01:59:02.167824309Z [2024-04-12 01:59:02,167: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:59:02.167836636Z [2024-04-12 01:59:02,167: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:59:02.168042538Z [2024-04-12 01:59:02,167: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:59:02.168116171Z [2024-04-12 01:59:02,167: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T01:59:02.168417787Z [2024-04-12 01:59:02,168: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T01:59:02.168456216Z [2024-04-12 01:59:02,168: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:59:02.179377094Z [2024-04-12 01:59:02,179: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T01:59:02.180434491Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T01:59:02.180476558Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T01:59:02.180632632Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T01:59:02.180682976Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T01:59:02.180923878Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T01:59:02.181262663Z [2024-04-12 01:59:02,180: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T01:59:02.251405620Z [2024-04-12 01:59:02,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:59:02.251768330Z [2024-04-12 01:59:02,251: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T01:59:04.112305969Z [2024-04-12 01:59:04,111: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1de819fe-af46-4c84-b543-c91da230f85d] succeeded in 3.339307039999767s: None 2024-04-12T01:59:04.452627680Z [2024-04-12 01:59:04,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0630bdc-2dd9-42af-a43d-085abcaf4da7] succeeded in 3.672455309000725s: None 2024-04-12T02:00:00.688319508Z [2024-04-12 02:00:00,687: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68ef3550-09a8-4d36-908e-9510df86ac17] received 2024-04-12T02:00:00.690594609Z [2024-04-12 02:00:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c13ea80-b0ec-4662-afe5-96377cb5511d] received 2024-04-12T02:00:00.692514149Z [2024-04-12 02:00:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a77e48ab-6cba-4ebd-a686-a1391d6f261e] received 2024-04-12T02:00:00.695675120Z [2024-04-12 02:00:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4feb657f-5359-452f-900e-e2c79eb208e6] received 2024-04-12T02:00:00.702163148Z [2024-04-12 02:00:00,701: INFO/ForkPoolWorker-16] [1c13ea80-b0ec-4662-afe5-96377cb5511d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:00:00.704083486Z [2024-04-12 02:00:00,703: INFO/ForkPoolWorker-1] [a77e48ab-6cba-4ebd-a686-a1391d6f261e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:00:00.704442354Z [2024-04-12 02:00:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd865d47-2a6e-4dd7-a1a0-0af307af8332] received 2024-04-12T02:00:00.704582059Z [2024-04-12 02:00:00,704: INFO/ForkPoolWorker-15] [68ef3550-09a8-4d36-908e-9510df86ac17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:00.714390448Z [2024-04-12 02:00:00,713: INFO/ForkPoolWorker-2] [4feb657f-5359-452f-900e-e2c79eb208e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:00:00.720625547Z [2024-04-12 02:00:00,720: INFO/ForkPoolWorker-3] [dd865d47-2a6e-4dd7-a1a0-0af307af8332] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:00:01.008530239Z [2024-04-12 02:00:01,001: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:00:01.021507445Z [2024-04-12 02:00:01,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:00:01.103169073Z [2024-04-12 02:00:01,098: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:00:01.103875190Z [2024-04-12 02:00:01,099: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:00:01.107863404Z [2024-04-12 02:00:01,104: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:00:01.259402367Z [2024-04-12 02:00:01,259: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:00:01.262913794Z [2024-04-12 02:00:01,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:01.302019074Z [2024-04-12 02:00:01,301: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:00:01.309269456Z [2024-04-12 02:00:01,309: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:00:01.309421402Z [2024-04-12 02:00:01,309: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:00:01.309514995Z [2024-04-12 02:00:01,309: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:00:01.309815354Z [2024-04-12 02:00:01,309: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:00:01.405779261Z [2024-04-12 02:00:01,405: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:01.465069673Z [2024-04-12 02:00:01,464: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:01.906287897Z [2024-04-12 02:00:01,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c13ea80-b0ec-4662-afe5-96377cb5511d] succeeded in 1.211687389000872s: None 2024-04-12T02:00:02.093070984Z [2024-04-12 02:00:02,092: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a77e48ab-6cba-4ebd-a686-a1391d6f261e] succeeded in 1.395239211000444s: None 2024-04-12T02:00:02.420597417Z [2024-04-12 02:00:02,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:00:02.423570937Z [2024-04-12 02:00:02,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:02.427904694Z [2024-04-12 02:00:02,427: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:00:02.431279266Z [2024-04-12 02:00:02,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:02.448265655Z [2024-04-12 02:00:02,448: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:00:02.450816309Z [2024-04-12 02:00:02,450: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:02.450945991Z [2024-04-12 02:00:02,450: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:02.451069053Z [2024-04-12 02:00:02,450: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:02.451141593Z [2024-04-12 02:00:02,451: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:00:02.451397069Z [2024-04-12 02:00:02,451: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:00:02.451405061Z [2024-04-12 02:00:02,451: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:02.457010285Z [2024-04-12 02:00:02,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:00:02.458323393Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:02.458361860Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:02.458482128Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:02.458520184Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:00:02.458723013Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:00:02.458774844Z [2024-04-12 02:00:02,458: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:02.466701092Z [2024-04-12 02:00:02,466: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-12T02:00:02.470611225Z [2024-04-12 02:00:02,469: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:02.515142359Z [2024-04-12 02:00:02,514: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T02:00:02.517008792Z [2024-04-12 02:00:02,516: INFO/ForkPoolWorker-3] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:02.517027008Z [2024-04-12 02:00:02,516: INFO/ForkPoolWorker-3] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:02.517167895Z [2024-04-12 02:00:02,517: INFO/ForkPoolWorker-3] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:02.517199628Z [2024-04-12 02:00:02,517: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-12T02:00:02.517402834Z [2024-04-12 02:00:02,517: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:00:02.517460642Z [2024-04-12 02:00:02,517: INFO/ForkPoolWorker-3] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:02.542148934Z [2024-04-12 02:00:02,541: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:02.546620108Z [2024-04-12 02:00:02,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:02.598249156Z [2024-04-12 02:00:02,597: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:02.997651635Z [2024-04-12 02:00:02,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68ef3550-09a8-4d36-908e-9510df86ac17] succeeded in 2.304511160000402s: None 2024-04-12T02:00:03.713143550Z [2024-04-12 02:00:03,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6841997f-7d58-4006-8693-b1405aec5f77] received 2024-04-12T02:00:03.722292965Z [2024-04-12 02:00:03,721: INFO/ForkPoolWorker-15] [6841997f-7d58-4006-8693-b1405aec5f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:03.991428287Z [2024-04-12 02:00:03,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:00:04.205694578Z [2024-04-12 02:00:04,205: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[dd865d47-2a6e-4dd7-a1a0-0af307af8332] succeeded in 3.497488405000695s: None 2024-04-12T02:00:04.373470851Z [2024-04-12 02:00:04,373: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4feb657f-5359-452f-900e-e2c79eb208e6] succeeded in 3.6749658999997337s: None 2024-04-12T02:00:04.949093107Z [2024-04-12 02:00:04,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:00:04.951943063Z [2024-04-12 02:00:04,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:04.976145528Z [2024-04-12 02:00:04,975: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:00:04.978155291Z [2024-04-12 02:00:04,977: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:04.978342405Z [2024-04-12 02:00:04,978: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:04.978603460Z [2024-04-12 02:00:04,978: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:04.978621884Z [2024-04-12 02:00:04,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:00:04.978926623Z [2024-04-12 02:00:04,978: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:00:04.979069919Z [2024-04-12 02:00:04,978: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:05.058234986Z [2024-04-12 02:00:05,057: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:05.657400372Z [2024-04-12 02:00:05,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06942c89-43c5-451f-825a-64a44c91e9c6] received 2024-04-12T02:00:05.669273337Z [2024-04-12 02:00:05,668: INFO/ForkPoolWorker-16] [06942c89-43c5-451f-825a-64a44c91e9c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:00:05.726536838Z [2024-04-12 02:00:05,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6841997f-7d58-4006-8693-b1405aec5f77] succeeded in 2.010488162000911s: None 2024-04-12T02:00:05.914114019Z [2024-04-12 02:00:05,911: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:00:06.930528394Z [2024-04-12 02:00:06,930: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:00:06.933558084Z [2024-04-12 02:00:06,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:06.956586871Z [2024-04-12 02:00:06,956: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:00:06.958117235Z [2024-04-12 02:00:06,957: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:06.958269094Z [2024-04-12 02:00:06,958: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:06.958548475Z [2024-04-12 02:00:06,958: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:06.958704734Z [2024-04-12 02:00:06,958: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:00:06.959303895Z [2024-04-12 02:00:06,958: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:00:06.959506596Z [2024-04-12 02:00:06,959: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:07.045764158Z [2024-04-12 02:00:07,045: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:08.583390072Z [2024-04-12 02:00:08,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[06942c89-43c5-451f-825a-64a44c91e9c6] succeeded in 2.92236702000082s: None 2024-04-12T02:00:09.573799868Z [2024-04-12 02:00:09,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8b1c8b2-3198-4888-92e1-b56d412a450b] received 2024-04-12T02:00:09.581026387Z [2024-04-12 02:00:09,580: INFO/ForkPoolWorker-15] [a8b1c8b2-3198-4888-92e1-b56d412a450b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:09.837095155Z [2024-04-12 02:00:09,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:00:10.763010167Z [2024-04-12 02:00:10,762: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:00:10.765915873Z [2024-04-12 02:00:10,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:00:10.787394719Z [2024-04-12 02:00:10,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:00:10.788746445Z [2024-04-12 02:00:10,788: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:00:10.788844560Z [2024-04-12 02:00:10,788: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:00:10.789095526Z [2024-04-12 02:00:10,788: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:00:10.789169865Z [2024-04-12 02:00:10,789: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:00:10.789475446Z [2024-04-12 02:00:10,789: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:00:10.789596753Z [2024-04-12 02:00:10,789: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:00:10.889851179Z [2024-04-12 02:00:10,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:00:11.455748346Z [2024-04-12 02:00:11,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8b1c8b2-3198-4888-92e1-b56d412a450b] succeeded in 1.8793214400011493s: None 2024-04-12T02:01:00.921138578Z [2024-04-12 02:01:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc11443f-3a21-4c5e-b158-3af5b292c5bd] received 2024-04-12T02:01:00.925188274Z [2024-04-12 02:01:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[541eb155-2ffa-414a-a02a-718e53bc047b] received 2024-04-12T02:01:00.930321957Z [2024-04-12 02:01:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1dedfbc-3a9f-46f1-b39a-3ca6e0e316ca] received 2024-04-12T02:01:00.932141837Z [2024-04-12 02:01:00,931: INFO/ForkPoolWorker-16] [541eb155-2ffa-414a-a02a-718e53bc047b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:01:00.932318852Z [2024-04-12 02:01:00,931: INFO/ForkPoolWorker-15] [fc11443f-3a21-4c5e-b158-3af5b292c5bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:01:00.940442685Z [2024-04-12 02:01:00,940: INFO/ForkPoolWorker-1] [c1dedfbc-3a9f-46f1-b39a-3ca6e0e316ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:01:01.191204869Z [2024-04-12 02:01:01,188: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:01:01.194822244Z [2024-04-12 02:01:01,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:01:01.206741553Z [2024-04-12 02:01:01,204: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:01:01.325301077Z [2024-04-12 02:01:01,324: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:01:01.329018420Z [2024-04-12 02:01:01,328: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:01:01.347862851Z [2024-04-12 02:01:01,347: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:01:01.349323201Z [2024-04-12 02:01:01,349: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:01:01.349627161Z [2024-04-12 02:01:01,349: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:01:01.349816516Z [2024-04-12 02:01:01,349: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:01:01.350556733Z [2024-04-12 02:01:01,350: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:01:01.444808970Z [2024-04-12 02:01:01,444: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:01:02.024844926Z [2024-04-12 02:01:02,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[541eb155-2ffa-414a-a02a-718e53bc047b] succeeded in 1.0977813190002053s: None 2024-04-12T02:01:02.314846066Z [2024-04-12 02:01:02,314: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:01:02.317691404Z [2024-04-12 02:01:02,317: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:01:02.337824321Z [2024-04-12 02:01:02,337: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:01:02.339681981Z [2024-04-12 02:01:02,339: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:01:02.340835573Z [2024-04-12 02:01:02,340: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:01:02.340867923Z [2024-04-12 02:01:02,340: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:01:02.341007035Z [2024-04-12 02:01:02,340: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:01:02.341025516Z [2024-04-12 02:01:02,340: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:01:02.341051206Z [2024-04-12 02:01:02,340: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:01:02.341249774Z [2024-04-12 02:01:02,341: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:01:02.341267031Z [2024-04-12 02:01:02,341: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:01:02.364426871Z [2024-04-12 02:01:02,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:01:02.365631869Z [2024-04-12 02:01:02,365: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:01:02.365792177Z [2024-04-12 02:01:02,365: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:01:02.365998818Z [2024-04-12 02:01:02,365: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:01:02.366137452Z [2024-04-12 02:01:02,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:01:02.367144136Z [2024-04-12 02:01:02,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:01:02.367207059Z [2024-04-12 02:01:02,366: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:01:02.422966835Z [2024-04-12 02:01:02,422: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:01:02.440955167Z [2024-04-12 02:01:02,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:01:04.110194905Z [2024-04-12 02:01:04,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1dedfbc-3a9f-46f1-b39a-3ca6e0e316ca] succeeded in 3.178440229001353s: None 2024-04-12T02:01:04.705790591Z [2024-04-12 02:01:04,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc11443f-3a21-4c5e-b158-3af5b292c5bd] succeeded in 3.781682721000834s: None 2024-04-12T02:02:01.118515832Z [2024-04-12 02:02:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[035384e8-df01-42b6-a716-f87234a015ac] received 2024-04-12T02:02:01.121356229Z [2024-04-12 02:02:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d26a6af-bb9a-41b4-8ac0-5daa1afbd146] received 2024-04-12T02:02:01.129495858Z [2024-04-12 02:02:01,129: INFO/ForkPoolWorker-16] [7d26a6af-bb9a-41b4-8ac0-5daa1afbd146] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:02:01.133566001Z [2024-04-12 02:02:01,133: INFO/ForkPoolWorker-15] [035384e8-df01-42b6-a716-f87234a015ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:02:01.140978037Z [2024-04-12 02:02:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[740d4632-8a74-4267-94f7-f0ab7859834a] received 2024-04-12T02:02:01.148075069Z [2024-04-12 02:02:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26335580-b9c6-4cc8-ad2f-616cf7e3d41d] received 2024-04-12T02:02:01.151165043Z [2024-04-12 02:02:01,150: INFO/ForkPoolWorker-1] [740d4632-8a74-4267-94f7-f0ab7859834a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:02:01.156421135Z [2024-04-12 02:02:01,156: INFO/ForkPoolWorker-2] [26335580-b9c6-4cc8-ad2f-616cf7e3d41d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:02:01.410215522Z [2024-04-12 02:02:01,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:02:01.417352365Z [2024-04-12 02:02:01,414: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:02:01.420045436Z [2024-04-12 02:02:01,416: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:02:01.508536379Z [2024-04-12 02:02:01,505: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:02:01.605737513Z [2024-04-12 02:02:01,605: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:02:01.617505210Z [2024-04-12 02:02:01,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:02:01.659947115Z [2024-04-12 02:02:01,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:02:01.667537742Z [2024-04-12 02:02:01,662: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:02:01.667595160Z [2024-04-12 02:02:01,662: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:02:01.667600296Z [2024-04-12 02:02:01,663: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:02:01.667603932Z [2024-04-12 02:02:01,663: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:02:01.798557534Z [2024-04-12 02:02:01,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:02:01.852838264Z [2024-04-12 02:02:01,852: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:02:02.386621056Z [2024-04-12 02:02:02,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[740d4632-8a74-4267-94f7-f0ab7859834a] succeeded in 1.2440931709988945s: None 2024-04-12T02:02:02.401315407Z [2024-04-12 02:02:02,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[035384e8-df01-42b6-a716-f87234a015ac] succeeded in 1.2759338169998955s: None 2024-04-12T02:02:02.573895984Z [2024-04-12 02:02:02,573: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:02:02.577153227Z [2024-04-12 02:02:02,576: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:02:02.599054312Z [2024-04-12 02:02:02,598: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:02:02.600350957Z [2024-04-12 02:02:02,600: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:02:02.600546097Z [2024-04-12 02:02:02,600: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:02:02.600753202Z [2024-04-12 02:02:02,600: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:02:02.600887088Z [2024-04-12 02:02:02,600: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:02:02.601190109Z [2024-04-12 02:02:02,601: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:02:02.601339683Z [2024-04-12 02:02:02,601: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:02:02.670111390Z [2024-04-12 02:02:02,669: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:02:02.691578706Z [2024-04-12 02:02:02,691: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:02:02.694806779Z [2024-04-12 02:02:02,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:02:02.714494189Z [2024-04-12 02:02:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:02:02.716214818Z [2024-04-12 02:02:02,715: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:02:02.716354971Z [2024-04-12 02:02:02,716: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:02:02.716618624Z [2024-04-12 02:02:02,716: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:02:02.716738914Z [2024-04-12 02:02:02,716: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:02:02.717111297Z [2024-04-12 02:02:02,716: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:02:02.717254449Z [2024-04-12 02:02:02,717: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:02:02.791448159Z [2024-04-12 02:02:02,791: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:02:04.388162583Z [2024-04-12 02:02:04,387: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d26a6af-bb9a-41b4-8ac0-5daa1afbd146] succeeded in 3.265380644999823s: None 2024-04-12T02:02:04.533947213Z [2024-04-12 02:02:04,533: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[26335580-b9c6-4cc8-ad2f-616cf7e3d41d] succeeded in 3.383218476001275s: None 2024-04-12T02:03:00.337221659Z [2024-04-12 02:03:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad146ac4-7b53-4ad9-84c3-d8fefa2d3559] received 2024-04-12T02:03:00.339975646Z [2024-04-12 02:03:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b03c7ba-69f1-4229-8f93-faa7d090ce5f] received 2024-04-12T02:03:00.343566165Z [2024-04-12 02:03:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4058a75-1f45-4905-9742-d437dfc2966a] received 2024-04-12T02:03:00.348179702Z [2024-04-12 02:03:00,347: INFO/ForkPoolWorker-16] [0b03c7ba-69f1-4229-8f93-faa7d090ce5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:03:00.352416739Z [2024-04-12 02:03:00,352: INFO/ForkPoolWorker-15] [ad146ac4-7b53-4ad9-84c3-d8fefa2d3559] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:03:00.352998863Z [2024-04-12 02:03:00,352: INFO/ForkPoolWorker-1] [e4058a75-1f45-4905-9742-d437dfc2966a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:03:00.627750472Z [2024-04-12 02:03:00,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:03:00.636278529Z [2024-04-12 02:03:00,633: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:03:00.636801137Z [2024-04-12 02:03:00,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:03:00.771710060Z [2024-04-12 02:03:00,771: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:03:00.775726203Z [2024-04-12 02:03:00,775: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:03:00.796848152Z [2024-04-12 02:03:00,796: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:03:00.797949268Z [2024-04-12 02:03:00,797: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:03:00.798062296Z [2024-04-12 02:03:00,797: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:03:00.798102647Z [2024-04-12 02:03:00,798: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:03:00.798497190Z [2024-04-12 02:03:00,798: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:03:00.903368713Z [2024-04-12 02:03:00,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:03:01.460659884Z [2024-04-12 02:03:01,460: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b03c7ba-69f1-4229-8f93-faa7d090ce5f] succeeded in 1.119182771000851s: None 2024-04-12T02:03:01.794935521Z [2024-04-12 02:03:01,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:03:01.798154447Z [2024-04-12 02:03:01,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:03:01.815270969Z [2024-04-12 02:03:01,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:03:01.816516294Z [2024-04-12 02:03:01,816: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:03:01.817456315Z [2024-04-12 02:03:01,816: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:03:01.817759438Z [2024-04-12 02:03:01,817: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:03:01.817907265Z [2024-04-12 02:03:01,817: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:03:01.818284153Z [2024-04-12 02:03:01,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:03:01.818578617Z [2024-04-12 02:03:01,818: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:03:01.883729359Z [2024-04-12 02:03:01,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:03:01.974047735Z [2024-04-12 02:03:01,973: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:03:01.977128192Z [2024-04-12 02:03:01,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:03:02.014932573Z [2024-04-12 02:03:02,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:03:02.017150709Z [2024-04-12 02:03:02,016: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:03:02.017234123Z [2024-04-12 02:03:02,017: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:03:02.017397752Z [2024-04-12 02:03:02,017: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:03:02.017660559Z [2024-04-12 02:03:02,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:03:02.017935723Z [2024-04-12 02:03:02,017: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:03:02.018502670Z [2024-04-12 02:03:02,018: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:03:02.094225918Z [2024-04-12 02:03:02,093: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:03:03.499115986Z [2024-04-12 02:03:03,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4058a75-1f45-4905-9742-d437dfc2966a] succeeded in 3.1539708740001515s: None 2024-04-12T02:03:03.563777985Z [2024-04-12 02:03:03,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad146ac4-7b53-4ad9-84c3-d8fefa2d3559] succeeded in 3.2220771570009674s: None 2024-04-12T02:04:00.254930635Z [2024-04-12 02:04:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f4bf7a4-baf5-4777-a957-7b0244562d72] received 2024-04-12T02:04:00.262583758Z [2024-04-12 02:04:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f898c55a-d874-4555-b584-04e45f4323c8] received 2024-04-12T02:04:00.270772093Z [2024-04-12 02:04:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f882700e-520f-4955-a582-2f1a6f2f20a1] received 2024-04-12T02:04:00.272034737Z [2024-04-12 02:04:00,271: INFO/ForkPoolWorker-15] [9f4bf7a4-baf5-4777-a957-7b0244562d72] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:04:00.274799933Z [2024-04-12 02:04:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff967ce6-ad09-4371-a6de-f310629b4a34] received 2024-04-12T02:04:00.282320818Z [2024-04-12 02:04:00,282: INFO/ForkPoolWorker-1] [f882700e-520f-4955-a582-2f1a6f2f20a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:04:00.287607310Z [2024-04-12 02:04:00,287: INFO/ForkPoolWorker-16] [f898c55a-d874-4555-b584-04e45f4323c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:04:00.289493558Z [2024-04-12 02:04:00,289: INFO/ForkPoolWorker-2] [ff967ce6-ad09-4371-a6de-f310629b4a34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:04:00.565878689Z [2024-04-12 02:04:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:04:00.568932495Z [2024-04-12 02:04:00,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:04:00.580561762Z [2024-04-12 02:04:00,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:04:00.619295754Z [2024-04-12 02:04:00,614: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:04:00.785759775Z [2024-04-12 02:04:00,785: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:04:00.790329467Z [2024-04-12 02:04:00,789: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:04:00.815614620Z [2024-04-12 02:04:00,815: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:04:00.817538747Z [2024-04-12 02:04:00,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:04:00.822567496Z [2024-04-12 02:04:00,822: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:04:00.824223797Z [2024-04-12 02:04:00,824: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:04:00.824431943Z [2024-04-12 02:04:00,824: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:04:00.824748261Z [2024-04-12 02:04:00,824: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:04:00.961188949Z [2024-04-12 02:04:00,960: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:04:01.608443208Z [2024-04-12 02:04:01,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f4bf7a4-baf5-4777-a957-7b0244562d72] succeeded in 1.35301699899901s: None 2024-04-12T02:04:01.703980753Z [2024-04-12 02:04:01,696: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ff967ce6-ad09-4371-a6de-f310629b4a34] succeeded in 1.4197489300004236s: None 2024-04-12T02:04:01.881668882Z [2024-04-12 02:04:01,881: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:04:01.887380458Z [2024-04-12 02:04:01,886: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:04:01.936517791Z [2024-04-12 02:04:01,935: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:04:01.936940681Z [2024-04-12 02:04:01,936: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:04:01.939450571Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:04:01.939527234Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:04:01.939678611Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:04:01.939710120Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:04:01.939978079Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:04:01.939986126Z [2024-04-12 02:04:01,939: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:04:01.940700693Z [2024-04-12 02:04:01,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:04:01.992554760Z [2024-04-12 02:04:01,990: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:04:01.992586302Z [2024-04-12 02:04:01,991: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:04:01.992590776Z [2024-04-12 02:04:01,991: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:04:01.992594452Z [2024-04-12 02:04:01,992: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:04:01.992598036Z [2024-04-12 02:04:01,992: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:04:01.996477328Z [2024-04-12 02:04:01,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:04:01.996485748Z [2024-04-12 02:04:01,994: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:04:02.103745493Z [2024-04-12 02:04:02,103: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:04:02.122917952Z [2024-04-12 02:04:02,122: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:04:03.792151155Z [2024-04-12 02:04:03,791: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f898c55a-d874-4555-b584-04e45f4323c8] succeeded in 3.521975408000799s: None 2024-04-12T02:04:04.426142803Z [2024-04-12 02:04:04,425: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f882700e-520f-4955-a582-2f1a6f2f20a1] succeeded in 4.152539625998543s: None 2024-04-12T02:05:00.881268410Z [2024-04-12 02:05:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4dcfc6c-5b28-4788-abf6-48e3c412b990] received 2024-04-12T02:05:00.897991818Z [2024-04-12 02:05:00,897: INFO/ForkPoolWorker-15] [e4dcfc6c-5b28-4788-abf6-48e3c412b990] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:05:00.904879868Z [2024-04-12 02:05:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d88f8cbf-8057-4839-b88a-6e516420f2c6] received 2024-04-12T02:05:00.910233335Z [2024-04-12 02:05:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb44111a-1c00-45cb-98f0-be842da6efa6] received 2024-04-12T02:05:00.915516249Z [2024-04-12 02:05:00,915: INFO/ForkPoolWorker-16] [d88f8cbf-8057-4839-b88a-6e516420f2c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:05:00.915906594Z [2024-04-12 02:05:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7594f237-2922-4646-87e0-53e3ed524ce0] received 2024-04-12T02:05:00.916363349Z [2024-04-12 02:05:00,916: INFO/ForkPoolWorker-1] [eb44111a-1c00-45cb-98f0-be842da6efa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:00.928573209Z [2024-04-12 02:05:00,928: INFO/ForkPoolWorker-2] [7594f237-2922-4646-87e0-53e3ed524ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:05:01.180229986Z [2024-04-12 02:05:01,177: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:05:01.190761266Z [2024-04-12 02:05:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:05:01.294832255Z [2024-04-12 02:05:01,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:05:01.306767513Z [2024-04-12 02:05:01,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:05:01.447393738Z [2024-04-12 02:05:01,446: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:05:01.450769885Z [2024-04-12 02:05:01,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:01.487535365Z [2024-04-12 02:05:01,487: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:05:01.489161632Z [2024-04-12 02:05:01,488: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:05:01.489259666Z [2024-04-12 02:05:01,489: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:05:01.489307604Z [2024-04-12 02:05:01,489: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:05:01.489746437Z [2024-04-12 02:05:01,489: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:05:01.601720796Z [2024-04-12 02:05:01,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:02.114704030Z [2024-04-12 02:05:02,114: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4dcfc6c-5b28-4788-abf6-48e3c412b990] succeeded in 1.2293024259997765s: None 2024-04-12T02:05:02.314622737Z [2024-04-12 02:05:02,314: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:05:02.317279790Z [2024-04-12 02:05:02,316: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:02.337232170Z [2024-04-12 02:05:02,337: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:05:02.338189555Z [2024-04-12 02:05:02,337: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:02.338198966Z [2024-04-12 02:05:02,338: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:02.338310565Z [2024-04-12 02:05:02,338: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:02.338315455Z [2024-04-12 02:05:02,338: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:05:02.338498292Z [2024-04-12 02:05:02,338: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:05:02.338504388Z [2024-04-12 02:05:02,338: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:02.391810543Z [2024-04-12 02:05:02,391: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:05:02.394585969Z [2024-04-12 02:05:02,394: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:02.421331641Z [2024-04-12 02:05:02,421: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:05:02.422200023Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:02.422214786Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:02.422322756Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:02.422328050Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:05:02.422501428Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:05:02.422510410Z [2024-04-12 02:05:02,422: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:02.424717446Z [2024-04-12 02:05:02,424: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:02.491792868Z [2024-04-12 02:05:02,491: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:02.522132400Z [2024-04-12 02:05:02,521: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:05:02.526497641Z [2024-04-12 02:05:02,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:02.569637456Z [2024-04-12 02:05:02,569: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:05:02.572348852Z [2024-04-12 02:05:02,572: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:02.572462254Z [2024-04-12 02:05:02,572: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:02.572658755Z [2024-04-12 02:05:02,572: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:02.572795102Z [2024-04-12 02:05:02,572: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:05:02.573040593Z [2024-04-12 02:05:02,572: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:05:02.573210904Z [2024-04-12 02:05:02,573: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:02.653900811Z [2024-04-12 02:05:02,653: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:03.297293044Z [2024-04-12 02:05:03,296: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb44111a-1c00-45cb-98f0-be842da6efa6] succeeded in 2.38550895499975s: None 2024-04-12T02:05:04.096901944Z [2024-04-12 02:05:04,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a428a82d-e262-4b97-a9b0-b8db9a6e923c] received 2024-04-12T02:05:04.123260253Z [2024-04-12 02:05:04,122: INFO/ForkPoolWorker-15] [a428a82d-e262-4b97-a9b0-b8db9a6e923c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:04.205428077Z [2024-04-12 02:05:04,204: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d88f8cbf-8057-4839-b88a-6e516420f2c6] succeeded in 3.2984449039995525s: None 2024-04-12T02:05:04.345956886Z [2024-04-12 02:05:04,345: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7594f237-2922-4646-87e0-53e3ed524ce0] succeeded in 3.4268947829987155s: None 2024-04-12T02:05:04.473118924Z [2024-04-12 02:05:04,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:05:05.660022566Z [2024-04-12 02:05:05,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:05:05.663255319Z [2024-04-12 02:05:05,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:05.688299149Z [2024-04-12 02:05:05,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:05:05.690099618Z [2024-04-12 02:05:05,689: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:05.690125849Z [2024-04-12 02:05:05,690: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:05.690200116Z [2024-04-12 02:05:05,690: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:05.690229823Z [2024-04-12 02:05:05,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:05:05.690482711Z [2024-04-12 02:05:05,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:05:05.690498166Z [2024-04-12 02:05:05,690: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:05.771938429Z [2024-04-12 02:05:05,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:06.408462329Z [2024-04-12 02:05:06,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a428a82d-e262-4b97-a9b0-b8db9a6e923c] succeeded in 2.309130882000318s: None 2024-04-12T02:05:06.526213088Z [2024-04-12 02:05:06,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34f4ea4e-8a1d-4750-bf05-fd2197410db2] received 2024-04-12T02:05:06.534277433Z [2024-04-12 02:05:06,533: INFO/ForkPoolWorker-15] [34f4ea4e-8a1d-4750-bf05-fd2197410db2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:05:06.789017597Z [2024-04-12 02:05:06,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:05:07.928645453Z [2024-04-12 02:05:07,927: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:05:07.931250206Z [2024-04-12 02:05:07,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:07.972243716Z [2024-04-12 02:05:07,971: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:05:07.973994422Z [2024-04-12 02:05:07,973: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:07.974038893Z [2024-04-12 02:05:07,973: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:07.974465864Z [2024-04-12 02:05:07,973: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:07.974663629Z [2024-04-12 02:05:07,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:05:07.975620895Z [2024-04-12 02:05:07,975: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:05:07.975956107Z [2024-04-12 02:05:07,975: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:08.076475070Z [2024-04-12 02:05:08,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:09.634706555Z [2024-04-12 02:05:09,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34f4ea4e-8a1d-4750-bf05-fd2197410db2] succeeded in 3.1063949020008295s: None 2024-04-12T02:05:10.069267580Z [2024-04-12 02:05:10,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f66afb4e-9043-43f3-b295-ac778302dcc4] received 2024-04-12T02:05:10.088726958Z [2024-04-12 02:05:10,077: INFO/ForkPoolWorker-15] [f66afb4e-9043-43f3-b295-ac778302dcc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:10.338554474Z [2024-04-12 02:05:10,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:05:11.279977178Z [2024-04-12 02:05:11,279: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:05:11.282865636Z [2024-04-12 02:05:11,282: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:05:11.303227880Z [2024-04-12 02:05:11,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:05:11.304438517Z [2024-04-12 02:05:11,304: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:05:11.304551466Z [2024-04-12 02:05:11,304: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:05:11.304728896Z [2024-04-12 02:05:11,304: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:05:11.304818698Z [2024-04-12 02:05:11,304: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:05:11.305192207Z [2024-04-12 02:05:11,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:05:11.305338734Z [2024-04-12 02:05:11,305: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:05:11.410148206Z [2024-04-12 02:05:11,409: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:05:12.042099547Z [2024-04-12 02:05:12,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f66afb4e-9043-43f3-b295-ac778302dcc4] succeeded in 1.9695341010010452s: None 2024-04-12T02:06:01.186757091Z [2024-04-12 02:06:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dd13b45-5c76-4808-a1bb-417b20e2a663] received 2024-04-12T02:06:01.191637193Z [2024-04-12 02:06:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28bb5294-6a27-42bc-a9ed-263845f9f617] received 2024-04-12T02:06:01.197004357Z [2024-04-12 02:06:01,196: INFO/ForkPoolWorker-15] [3dd13b45-5c76-4808-a1bb-417b20e2a663] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:06:01.197523266Z [2024-04-12 02:06:01,197: INFO/ForkPoolWorker-16] [28bb5294-6a27-42bc-a9ed-263845f9f617] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:06:01.203700191Z [2024-04-12 02:06:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7edd2f7f-80f1-4172-b92e-7d67312f63b1] received 2024-04-12T02:06:01.208932786Z [2024-04-12 02:06:01,208: INFO/ForkPoolWorker-1] [7edd2f7f-80f1-4172-b92e-7d67312f63b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:06:01.219490739Z [2024-04-12 02:06:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4833196-728f-48ca-bd83-ed1456ff3dde] received 2024-04-12T02:06:01.231180830Z [2024-04-12 02:06:01,230: INFO/ForkPoolWorker-2] [c4833196-728f-48ca-bd83-ed1456ff3dde] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:06:01.455351494Z [2024-04-12 02:06:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:06:01.489508884Z [2024-04-12 02:06:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:06:01.508429012Z [2024-04-12 02:06:01,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:06:01.565966548Z [2024-04-12 02:06:01,560: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:06:01.883658920Z [2024-04-12 02:06:01,883: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:06:01.887060586Z [2024-04-12 02:06:01,886: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:06:01.910699178Z [2024-04-12 02:06:01,910: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:06:01.911804604Z [2024-04-12 02:06:01,911: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:06:01.911879191Z [2024-04-12 02:06:01,911: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:06:01.911923331Z [2024-04-12 02:06:01,911: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:06:01.912099948Z [2024-04-12 02:06:01,912: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:06:01.913651931Z [2024-04-12 02:06:01,913: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:06:02.016898196Z [2024-04-12 02:06:02,016: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:06:02.455883285Z [2024-04-12 02:06:02,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dd13b45-5c76-4808-a1bb-417b20e2a663] succeeded in 1.2666620829986641s: None 2024-04-12T02:06:02.537128841Z [2024-04-12 02:06:02,536: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:06:02.539957830Z [2024-04-12 02:06:02,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:06:02.561163384Z [2024-04-12 02:06:02,560: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:06:02.562178569Z [2024-04-12 02:06:02,562: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:06:02.562273217Z [2024-04-12 02:06:02,562: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:06:02.562774340Z [2024-04-12 02:06:02,562: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:06:02.562848068Z [2024-04-12 02:06:02,562: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:06:02.563088734Z [2024-04-12 02:06:02,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:06:02.563361853Z [2024-04-12 02:06:02,563: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:06:02.586876248Z [2024-04-12 02:06:02,586: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4833196-728f-48ca-bd83-ed1456ff3dde] succeeded in 1.3658368670003256s: None 2024-04-12T02:06:02.640805306Z [2024-04-12 02:06:02,640: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:06:02.710260627Z [2024-04-12 02:06:02,709: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:06:02.712982065Z [2024-04-12 02:06:02,712: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:06:02.733323942Z [2024-04-12 02:06:02,733: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:06:02.734479838Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:06:02.734495653Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:06:02.734520670Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:06:02.734533426Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:06:02.734729619Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:06:02.734755989Z [2024-04-12 02:06:02,734: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:06:02.821286318Z [2024-04-12 02:06:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:06:04.510252532Z [2024-04-12 02:06:04,509: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7edd2f7f-80f1-4172-b92e-7d67312f63b1] succeeded in 3.305026015999829s: None 2024-04-12T02:06:04.581654943Z [2024-04-12 02:06:04,581: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28bb5294-6a27-42bc-a9ed-263845f9f617] succeeded in 3.388157946999854s: None 2024-04-12T02:07:00.428164204Z [2024-04-12 02:07:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[066eadf1-c03f-47bf-9850-a5ea68d49db0] received 2024-04-12T02:07:00.434593624Z [2024-04-12 02:07:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edeaf85d-4c26-444c-80e0-163739940c4c] received 2024-04-12T02:07:00.440052459Z [2024-04-12 02:07:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd4fbe5e-ddf7-4dfa-bbea-98a7676440f0] received 2024-04-12T02:07:00.446018266Z [2024-04-12 02:07:00,444: INFO/ForkPoolWorker-15] [066eadf1-c03f-47bf-9850-a5ea68d49db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:07:00.449576237Z [2024-04-12 02:07:00,449: INFO/ForkPoolWorker-16] [edeaf85d-4c26-444c-80e0-163739940c4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:07:00.451257718Z [2024-04-12 02:07:00,451: INFO/ForkPoolWorker-1] [cd4fbe5e-ddf7-4dfa-bbea-98a7676440f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:07:00.698745355Z [2024-04-12 02:07:00,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:07:00.726402229Z [2024-04-12 02:07:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:07:00.732219165Z [2024-04-12 02:07:00,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:07:00.863466819Z [2024-04-12 02:07:00,863: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:07:00.867139343Z [2024-04-12 02:07:00,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:07:00.904931310Z [2024-04-12 02:07:00,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:07:00.905824870Z [2024-04-12 02:07:00,905: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:07:00.905897017Z [2024-04-12 02:07:00,905: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:07:00.905949118Z [2024-04-12 02:07:00,905: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:07:00.906121147Z [2024-04-12 02:07:00,906: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:07:01.034717768Z [2024-04-12 02:07:01,034: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:07:01.710701374Z [2024-04-12 02:07:01,710: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[edeaf85d-4c26-444c-80e0-163739940c4c] succeeded in 1.2743660399992223s: None 2024-04-12T02:07:01.828506094Z [2024-04-12 02:07:01,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:07:01.831578897Z [2024-04-12 02:07:01,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:07:01.856491621Z [2024-04-12 02:07:01,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:07:01.860592327Z [2024-04-12 02:07:01,860: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:07:01.860754073Z [2024-04-12 02:07:01,860: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:07:01.860995387Z [2024-04-12 02:07:01,860: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:07:01.861136793Z [2024-04-12 02:07:01,860: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:07:01.861908529Z [2024-04-12 02:07:01,861: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:07:01.862205218Z [2024-04-12 02:07:01,862: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:07:01.946149370Z [2024-04-12 02:07:01,945: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:07:01.988116115Z [2024-04-12 02:07:01,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:07:01.990968874Z [2024-04-12 02:07:01,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:07:02.011574401Z [2024-04-12 02:07:02,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:07:02.012852223Z [2024-04-12 02:07:02,012: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:07:02.012867807Z [2024-04-12 02:07:02,012: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:07:02.012999676Z [2024-04-12 02:07:02,012: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:07:02.013027862Z [2024-04-12 02:07:02,012: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:07:02.013241589Z [2024-04-12 02:07:02,013: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:07:02.013255301Z [2024-04-12 02:07:02,013: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:07:02.094784897Z [2024-04-12 02:07:02,094: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:07:03.421602176Z [2024-04-12 02:07:03,420: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd4fbe5e-ddf7-4dfa-bbea-98a7676440f0] succeeded in 2.9796614370006864s: None 2024-04-12T02:07:04.041422981Z [2024-04-12 02:07:04,040: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[066eadf1-c03f-47bf-9850-a5ea68d49db0] succeeded in 3.60803998099982s: None 2024-04-12T02:08:00.920948925Z [2024-04-12 02:08:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[878b3e3c-519d-4844-8be1-cd1d606c91f4] received 2024-04-12T02:08:00.924333164Z [2024-04-12 02:08:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c576b191-28d6-4ee8-828b-523ba9088f59] received 2024-04-12T02:08:00.930671137Z [2024-04-12 02:08:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157c1b55-1891-4b63-98a9-875fb39529fa] received 2024-04-12T02:08:00.933312491Z [2024-04-12 02:08:00,933: INFO/ForkPoolWorker-16] [c576b191-28d6-4ee8-828b-523ba9088f59] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:08:00.933832678Z [2024-04-12 02:08:00,933: INFO/ForkPoolWorker-15] [878b3e3c-519d-4844-8be1-cd1d606c91f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:08:00.940731341Z [2024-04-12 02:08:00,940: INFO/ForkPoolWorker-1] [157c1b55-1891-4b63-98a9-875fb39529fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:08:00.945851288Z [2024-04-12 02:08:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecd79b62-7e00-4952-8733-9eef8981ef3d] received 2024-04-12T02:08:00.954168059Z [2024-04-12 02:08:00,953: INFO/ForkPoolWorker-2] [ecd79b62-7e00-4952-8733-9eef8981ef3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:08:01.232939988Z [2024-04-12 02:08:01,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:08:01.259506205Z [2024-04-12 02:08:01,256: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:08:01.293370358Z [2024-04-12 02:08:01,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:08:01.300057211Z [2024-04-12 02:08:01,295: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:08:01.464106824Z [2024-04-12 02:08:01,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:08:01.517345868Z [2024-04-12 02:08:01,516: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:08:01.521777938Z [2024-04-12 02:08:01,521: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:08:01.549365402Z [2024-04-12 02:08:01,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:08:01.550056164Z [2024-04-12 02:08:01,549: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:08:01.550179507Z [2024-04-12 02:08:01,549: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:08:01.550314737Z [2024-04-12 02:08:01,550: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:08:01.550606323Z [2024-04-12 02:08:01,550: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:08:01.642699060Z [2024-04-12 02:08:01,642: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:08:02.154948474Z [2024-04-12 02:08:02,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[878b3e3c-519d-4844-8be1-cd1d606c91f4] succeeded in 1.229361218998747s: None 2024-04-12T02:08:02.355709092Z [2024-04-12 02:08:02,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c576b191-28d6-4ee8-828b-523ba9088f59] succeeded in 1.4298908170003415s: None 2024-04-12T02:08:02.483580078Z [2024-04-12 02:08:02,483: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:08:02.486806675Z [2024-04-12 02:08:02,486: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:08:02.494768831Z [2024-04-12 02:08:02,494: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:08:02.499073656Z [2024-04-12 02:08:02,498: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:08:02.513511287Z [2024-04-12 02:08:02,513: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:08:02.514942824Z [2024-04-12 02:08:02,514: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:08:02.515186777Z [2024-04-12 02:08:02,515: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:08:02.515437070Z [2024-04-12 02:08:02,515: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:08:02.515610545Z [2024-04-12 02:08:02,515: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:08:02.516612126Z [2024-04-12 02:08:02,515: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:08:02.517372578Z [2024-04-12 02:08:02,517: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:08:02.518967433Z [2024-04-12 02:08:02,518: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:08:02.520304689Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:08:02.520469644Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:08:02.520627999Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:08:02.520756443Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:08:02.520985138Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:08:02.521039749Z [2024-04-12 02:08:02,520: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:08:02.617749289Z [2024-04-12 02:08:02,617: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:08:02.619051361Z [2024-04-12 02:08:02,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:08:04.404851245Z [2024-04-12 02:08:04,404: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[157c1b55-1891-4b63-98a9-875fb39529fa] succeeded in 3.4714244150000013s: None 2024-04-12T02:08:05.543330917Z [2024-04-12 02:08:05,542: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ecd79b62-7e00-4952-8733-9eef8981ef3d] succeeded in 4.594930356999612s: None 2024-04-12T02:09:00.700797232Z [2024-04-12 02:09:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d58a29cb-6996-443b-b08b-7083e42c9168] received 2024-04-12T02:09:00.704903751Z [2024-04-12 02:09:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b25f353-8dfe-4b34-a394-b90c07d54670] received 2024-04-12T02:09:00.707385203Z [2024-04-12 02:09:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec20db46-2217-47a7-8b5f-d89b680f0e24] received 2024-04-12T02:09:00.712249185Z [2024-04-12 02:09:00,712: INFO/ForkPoolWorker-16] [4b25f353-8dfe-4b34-a394-b90c07d54670] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:09:00.716972008Z [2024-04-12 02:09:00,716: INFO/ForkPoolWorker-15] [d58a29cb-6996-443b-b08b-7083e42c9168] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:09:00.717982286Z [2024-04-12 02:09:00,717: INFO/ForkPoolWorker-1] [ec20db46-2217-47a7-8b5f-d89b680f0e24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:09:00.955437913Z [2024-04-12 02:09:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:09:00.981362196Z [2024-04-12 02:09:00,978: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:09:00.986938297Z [2024-04-12 02:09:00,984: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:09:01.130327533Z [2024-04-12 02:09:01,129: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:09:01.134068530Z [2024-04-12 02:09:01,133: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:09:01.159809280Z [2024-04-12 02:09:01,159: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:09:01.160883950Z [2024-04-12 02:09:01,160: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:09:01.161035529Z [2024-04-12 02:09:01,160: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:09:01.161164606Z [2024-04-12 02:09:01,161: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:09:01.161391442Z [2024-04-12 02:09:01,161: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:09:01.253110701Z [2024-04-12 02:09:01,252: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:09:01.823021938Z [2024-04-12 02:09:01,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec20db46-2217-47a7-8b5f-d89b680f0e24] succeeded in 1.113752145000035s: None 2024-04-12T02:09:02.038565353Z [2024-04-12 02:09:02,038: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:09:02.041608152Z [2024-04-12 02:09:02,041: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:09:02.061856987Z [2024-04-12 02:09:02,061: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:09:02.063206039Z [2024-04-12 02:09:02,062: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:09:02.063328449Z [2024-04-12 02:09:02,063: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:09:02.063390481Z [2024-04-12 02:09:02,063: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:09:02.063492065Z [2024-04-12 02:09:02,063: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:09:02.063723972Z [2024-04-12 02:09:02,063: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:09:02.063782329Z [2024-04-12 02:09:02,063: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:09:02.101077992Z [2024-04-12 02:09:02,100: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:09:02.104106822Z [2024-04-12 02:09:02,103: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:09:02.122509895Z [2024-04-12 02:09:02,122: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:09:02.123701020Z [2024-04-12 02:09:02,123: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:09:02.123904682Z [2024-04-12 02:09:02,123: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:09:02.124125098Z [2024-04-12 02:09:02,123: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:09:02.124321363Z [2024-04-12 02:09:02,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:09:02.124658570Z [2024-04-12 02:09:02,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:09:02.124786301Z [2024-04-12 02:09:02,124: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:09:02.149485113Z [2024-04-12 02:09:02,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:09:02.193386963Z [2024-04-12 02:09:02,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:09:04.209724326Z [2024-04-12 02:09:04,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b25f353-8dfe-4b34-a394-b90c07d54670] succeeded in 3.5029645490012626s: None 2024-04-12T02:09:04.997806177Z [2024-04-12 02:09:04,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d58a29cb-6996-443b-b08b-7083e42c9168] succeeded in 4.291522826999426s: None 2024-04-12T02:10:01.076316914Z [2024-04-12 02:10:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f137a62-62d1-43de-9631-6845dc86b72a] received 2024-04-12T02:10:01.077769349Z [2024-04-12 02:10:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c343f24d-7483-4ac9-bd77-a8bd3fce0c0b] received 2024-04-12T02:10:01.084726013Z [2024-04-12 02:10:01,084: INFO/ForkPoolWorker-16] [c343f24d-7483-4ac9-bd77-a8bd3fce0c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:10:01.085379608Z [2024-04-12 02:10:01,085: INFO/ForkPoolWorker-15] [3f137a62-62d1-43de-9631-6845dc86b72a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:01.092180189Z [2024-04-12 02:10:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27528aa6-9e54-4ff0-8491-8b6e3e6137c9] received 2024-04-12T02:10:01.094875320Z [2024-04-12 02:10:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eab7c737-ce7a-42a1-ae7e-4dd09a49feaf] received 2024-04-12T02:10:01.099794084Z [2024-04-12 02:10:01,099: INFO/ForkPoolWorker-1] [27528aa6-9e54-4ff0-8491-8b6e3e6137c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:10:01.101762632Z [2024-04-12 02:10:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[608878d2-c43b-4509-b627-bec8d0b26a1e] received 2024-04-12T02:10:01.109706327Z [2024-04-12 02:10:01,107: INFO/ForkPoolWorker-2] [eab7c737-ce7a-42a1-ae7e-4dd09a49feaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:10:01.117440636Z [2024-04-12 02:10:01,117: INFO/ForkPoolWorker-3] [608878d2-c43b-4509-b627-bec8d0b26a1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:10:01.502594971Z [2024-04-12 02:10:01,498: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:10:01.502831736Z [2024-04-12 02:10:01,499: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:10:01.527191839Z [2024-04-12 02:10:01,523: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:10:01.531546348Z [2024-04-12 02:10:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:10:01.664283726Z [2024-04-12 02:10:01,663: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T02:10:01.671942210Z [2024-04-12 02:10:01,668: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:01.681419511Z [2024-04-12 02:10:01,677: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:10:01.704483390Z [2024-04-12 02:10:01,700: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T02:10:01.712521942Z [2024-04-12 02:10:01,710: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:10:01.712542347Z [2024-04-12 02:10:01,710: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:10:01.712546616Z [2024-04-12 02:10:01,710: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T02:10:01.712550009Z [2024-04-12 02:10:01,710: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:10:01.787970117Z [2024-04-12 02:10:01,787: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:01.874667794Z [2024-04-12 02:10:01,874: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:02.388468056Z [2024-04-12 02:10:02,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c343f24d-7483-4ac9-bd77-a8bd3fce0c0b] succeeded in 1.3084098880008241s: None 2024-04-12T02:10:02.391007618Z [2024-04-12 02:10:02,390: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[608878d2-c43b-4509-b627-bec8d0b26a1e] succeeded in 1.2874032950003311s: None 2024-04-12T02:10:02.811172783Z [2024-04-12 02:10:02,810: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:10:02.814251064Z [2024-04-12 02:10:02,813: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:02.831354606Z [2024-04-12 02:10:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:10:02.834235675Z [2024-04-12 02:10:02,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:02.844465528Z [2024-04-12 02:10:02,844: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:10:02.846121337Z [2024-04-12 02:10:02,845: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:02.846611911Z [2024-04-12 02:10:02,846: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:02.846768948Z [2024-04-12 02:10:02,846: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:02.846862833Z [2024-04-12 02:10:02,846: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:10:02.847095300Z [2024-04-12 02:10:02,846: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:10:02.847181160Z [2024-04-12 02:10:02,847: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:02.851560689Z [2024-04-12 02:10:02,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:10:02.852621722Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:02.852631291Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:02.852777329Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:02.852785571Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:10:02.852968118Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:10:02.852975706Z [2024-04-12 02:10:02,852: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:02.926267083Z [2024-04-12 02:10:02,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:02.926581339Z [2024-04-12 02:10:02,926: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:02.978904673Z [2024-04-12 02:10:02,978: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:10:02.981885921Z [2024-04-12 02:10:02,981: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:03.009282072Z [2024-04-12 02:10:03,009: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:10:03.010326936Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:03.010342677Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:03.010487266Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:03.010496368Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:10:03.010732850Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:10:03.011036932Z [2024-04-12 02:10:03,010: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:03.071889171Z [2024-04-12 02:10:03,071: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:03.502106306Z [2024-04-12 02:10:03,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f137a62-62d1-43de-9631-6845dc86b72a] succeeded in 2.4227290819999325s: None 2024-04-12T02:10:04.430038467Z [2024-04-12 02:10:04,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2736118f-c07f-4b79-a3c6-567b83515623] received 2024-04-12T02:10:04.443570229Z [2024-04-12 02:10:04,443: INFO/ForkPoolWorker-15] [2736118f-c07f-4b79-a3c6-567b83515623] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:04.734320770Z [2024-04-12 02:10:04,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:10:05.651850359Z [2024-04-12 02:10:05,651: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eab7c737-ce7a-42a1-ae7e-4dd09a49feaf] succeeded in 4.555431185000998s: None 2024-04-12T02:10:05.786370542Z [2024-04-12 02:10:05,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:10:05.789246468Z [2024-04-12 02:10:05,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:05.804786915Z [2024-04-12 02:10:05,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:10:05.805762787Z [2024-04-12 02:10:05,805: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:05.805784518Z [2024-04-12 02:10:05,805: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:05.805940717Z [2024-04-12 02:10:05,805: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:05.805955755Z [2024-04-12 02:10:05,805: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:10:05.806204364Z [2024-04-12 02:10:05,806: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:10:05.806279203Z [2024-04-12 02:10:05,806: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:05.859915538Z [2024-04-12 02:10:05,859: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27528aa6-9e54-4ff0-8491-8b6e3e6137c9] succeeded in 4.7666229360002035s: None 2024-04-12T02:10:05.894236190Z [2024-04-12 02:10:05,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:06.583926081Z [2024-04-12 02:10:06,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2736118f-c07f-4b79-a3c6-567b83515623] succeeded in 2.150174764001349s: None 2024-04-12T02:10:06.831488347Z [2024-04-12 02:10:06,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f9c5d3-25f1-47e8-b3d8-d8d19c479f76] received 2024-04-12T02:10:06.844115555Z [2024-04-12 02:10:06,843: INFO/ForkPoolWorker-15] [c3f9c5d3-25f1-47e8-b3d8-d8d19c479f76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:10:07.080476282Z [2024-04-12 02:10:07,077: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:10:08.064658458Z [2024-04-12 02:10:08,063: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:10:08.066749696Z [2024-04-12 02:10:08,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:08.089904598Z [2024-04-12 02:10:08,089: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:10:08.090659717Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:08.090773480Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:08.090828653Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:08.090839245Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:10:08.091036602Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:10:08.091079625Z [2024-04-12 02:10:08,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:08.182374818Z [2024-04-12 02:10:08,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:09.687267101Z [2024-04-12 02:10:09,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3f9c5d3-25f1-47e8-b3d8-d8d19c479f76] succeeded in 2.853265059999103s: None 2024-04-12T02:10:09.944505695Z [2024-04-12 02:10:09,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed6eb3e-1bd2-455b-854b-097f23e9f4ce] received 2024-04-12T02:10:09.953089970Z [2024-04-12 02:10:09,952: INFO/ForkPoolWorker-15] [bed6eb3e-1bd2-455b-854b-097f23e9f4ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:10.252095902Z [2024-04-12 02:10:10,249: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:10:11.237903608Z [2024-04-12 02:10:11,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:10:11.240692628Z [2024-04-12 02:10:11,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:10:11.260674250Z [2024-04-12 02:10:11,260: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:10:11.262621018Z [2024-04-12 02:10:11,262: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:10:11.262640197Z [2024-04-12 02:10:11,262: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:10:11.262823796Z [2024-04-12 02:10:11,262: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:10:11.262914833Z [2024-04-12 02:10:11,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:10:11.263297844Z [2024-04-12 02:10:11,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:10:11.263344556Z [2024-04-12 02:10:11,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:10:11.372682524Z [2024-04-12 02:10:11,372: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:10:11.992703002Z [2024-04-12 02:10:11,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bed6eb3e-1bd2-455b-854b-097f23e9f4ce] succeeded in 2.0462909920006496s: None 2024-04-12T02:11:00.347353386Z [2024-04-12 02:11:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29c8ddfc-947f-461e-b38c-340b75e7d46c] received 2024-04-12T02:11:00.353877425Z [2024-04-12 02:11:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[900a4eb2-ae0c-4651-85ce-a96236a11516] received 2024-04-12T02:11:00.355060136Z [2024-04-12 02:11:00,354: INFO/ForkPoolWorker-15] [29c8ddfc-947f-461e-b38c-340b75e7d46c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:11:00.364337426Z [2024-04-12 02:11:00,364: INFO/ForkPoolWorker-16] [900a4eb2-ae0c-4651-85ce-a96236a11516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:11:00.368208129Z [2024-04-12 02:11:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8b3e8b4-50bb-4b48-b0d0-c5c9d570a0fa] received 2024-04-12T02:11:00.374192467Z [2024-04-12 02:11:00,374: INFO/ForkPoolWorker-1] [b8b3e8b4-50bb-4b48-b0d0-c5c9d570a0fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:11:00.591368828Z [2024-04-12 02:11:00,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:11:00.636163221Z [2024-04-12 02:11:00,633: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:11:00.678337307Z [2024-04-12 02:11:00,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:11:00.817836258Z [2024-04-12 02:11:00,817: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:11:00.821767099Z [2024-04-12 02:11:00,821: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:11:00.843546300Z [2024-04-12 02:11:00,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:11:00.845432498Z [2024-04-12 02:11:00,844: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:11:00.845448409Z [2024-04-12 02:11:00,844: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:11:00.845463964Z [2024-04-12 02:11:00,844: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:11:00.845467307Z [2024-04-12 02:11:00,844: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:11:00.964303726Z [2024-04-12 02:11:00,964: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:11:01.533282395Z [2024-04-12 02:11:01,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8b3e8b4-50bb-4b48-b0d0-c5c9d570a0fa] succeeded in 1.163555715998882s: None 2024-04-12T02:11:01.627193072Z [2024-04-12 02:11:01,626: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:11:01.630129681Z [2024-04-12 02:11:01,629: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:11:01.635766581Z [2024-04-12 02:11:01,635: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:11:01.639619535Z [2024-04-12 02:11:01,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:11:01.704976372Z [2024-04-12 02:11:01,704: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:11:01.711413867Z [2024-04-12 02:11:01,708: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:11:01.711430839Z [2024-04-12 02:11:01,711: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:11:01.711627630Z [2024-04-12 02:11:01,711: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:11:01.711640974Z [2024-04-12 02:11:01,711: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:11:01.711910395Z [2024-04-12 02:11:01,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:11:01.711921417Z [2024-04-12 02:11:01,711: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:11:01.747796657Z [2024-04-12 02:11:01,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:11:01.749284167Z [2024-04-12 02:11:01,749: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:11:01.750112324Z [2024-04-12 02:11:01,749: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:11:01.751637054Z [2024-04-12 02:11:01,751: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:11:01.751775897Z [2024-04-12 02:11:01,751: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:11:01.752071709Z [2024-04-12 02:11:01,751: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:11:01.752206983Z [2024-04-12 02:11:01,752: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:11:01.815511503Z [2024-04-12 02:11:01,815: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:11:01.818991595Z [2024-04-12 02:11:01,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:11:03.265424679Z [2024-04-12 02:11:03,264: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[900a4eb2-ae0c-4651-85ce-a96236a11516] succeeded in 2.910139273999448s: None 2024-04-12T02:11:03.827367155Z [2024-04-12 02:11:03,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29c8ddfc-947f-461e-b38c-340b75e7d46c] succeeded in 3.4774172519992135s: None 2024-04-12T02:11:30.705130386Z [2024-04-12 02:11:30,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4741e1b-5a4d-4309-9e76-e2381439d8e6] received 2024-04-12T02:11:30.717621316Z [2024-04-12 02:11:30,717: INFO/ForkPoolWorker-15] [d4741e1b-5a4d-4309-9e76-e2381439d8e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021130_867791', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:11:30.962899810Z [2024-04-12 02:11:30,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-12T02:11:31.257070530Z [2024-04-12 02:11:31,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:11:31.896791673Z [2024-04-12 02:11:31,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4741e1b-5a4d-4309-9e76-e2381439d8e6] succeeded in 1.1895290730008128s: None 2024-04-12T02:12:00.317801904Z [2024-04-12 02:12:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e163697-5a57-47eb-a47e-2b7a2d503010] received 2024-04-12T02:12:00.323580827Z [2024-04-12 02:12:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be0cc558-9b0e-481c-8509-b34ff61c57f7] received 2024-04-12T02:12:00.326079972Z [2024-04-12 02:12:00,325: INFO/ForkPoolWorker-15] [3e163697-5a57-47eb-a47e-2b7a2d503010] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:12:00.334836948Z [2024-04-12 02:12:00,334: INFO/ForkPoolWorker-16] [be0cc558-9b0e-481c-8509-b34ff61c57f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:12:00.337986693Z [2024-04-12 02:12:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef51bb4c-d103-46ea-ae8a-d1241e5e4bed] received 2024-04-12T02:12:00.342650019Z [2024-04-12 02:12:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[046ebd91-e85d-4623-97cb-25bb9c39e46e] received 2024-04-12T02:12:00.351074711Z [2024-04-12 02:12:00,350: INFO/ForkPoolWorker-2] [046ebd91-e85d-4623-97cb-25bb9c39e46e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:12:00.351454072Z [2024-04-12 02:12:00,349: INFO/ForkPoolWorker-1] [ef51bb4c-d103-46ea-ae8a-d1241e5e4bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:12:00.666990724Z [2024-04-12 02:12:00,664: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:12:00.736757333Z [2024-04-12 02:12:00,733: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:12:00.754278280Z [2024-04-12 02:12:00,750: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:12:00.830309686Z [2024-04-12 02:12:00,823: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:12:00.890933822Z [2024-04-12 02:12:00,890: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:12:00.895863857Z [2024-04-12 02:12:00,895: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:12:00.941719897Z [2024-04-12 02:12:00,941: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:12:00.944222534Z [2024-04-12 02:12:00,944: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:12:00.944326935Z [2024-04-12 02:12:00,944: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:12:00.944417295Z [2024-04-12 02:12:00,944: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:12:00.944644513Z [2024-04-12 02:12:00,944: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:12:01.059319512Z [2024-04-12 02:12:01,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:12:01.187650241Z [2024-04-12 02:12:01,187: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:12:01.697926548Z [2024-04-12 02:12:01,693: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e163697-5a57-47eb-a47e-2b7a2d503010] succeeded in 1.3720709530007298s: None 2024-04-12T02:12:01.772729886Z [2024-04-12 02:12:01,772: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef51bb4c-d103-46ea-ae8a-d1241e5e4bed] succeeded in 1.4333983550004632s: None 2024-04-12T02:12:02.018773341Z [2024-04-12 02:12:02,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:12:02.022108466Z [2024-04-12 02:12:02,021: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:12:02.040865478Z [2024-04-12 02:12:02,040: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:12:02.042086986Z [2024-04-12 02:12:02,041: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:12:02.042101491Z [2024-04-12 02:12:02,042: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:12:02.042236450Z [2024-04-12 02:12:02,042: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:12:02.042249881Z [2024-04-12 02:12:02,042: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:12:02.042919585Z [2024-04-12 02:12:02,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:12:02.042925236Z [2024-04-12 02:12:02,042: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:12:02.057411701Z [2024-04-12 02:12:02,057: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:12:02.060192333Z [2024-04-12 02:12:02,059: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:12:02.078936762Z [2024-04-12 02:12:02,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:12:02.079997872Z [2024-04-12 02:12:02,079: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:12:02.080105679Z [2024-04-12 02:12:02,079: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:12:02.080286684Z [2024-04-12 02:12:02,080: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:12:02.080415080Z [2024-04-12 02:12:02,080: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:12:02.080784731Z [2024-04-12 02:12:02,080: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:12:02.080900954Z [2024-04-12 02:12:02,080: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:12:02.117308693Z [2024-04-12 02:12:02,117: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:12:02.161330283Z [2024-04-12 02:12:02,161: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:12:03.728199317Z [2024-04-12 02:12:03,727: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[046ebd91-e85d-4623-97cb-25bb9c39e46e] succeeded in 3.3833038570010103s: None 2024-04-12T02:12:04.032803799Z [2024-04-12 02:12:04,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be0cc558-9b0e-481c-8509-b34ff61c57f7] succeeded in 3.7067867999994633s: None 2024-04-12T02:13:00.233128498Z [2024-04-12 02:13:00,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15040cbc-3b73-4a40-99a0-c99930c9b6b2] received 2024-04-12T02:13:00.236800755Z [2024-04-12 02:13:00,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebb365a8-9629-40e6-b151-30be17ae0946] received 2024-04-12T02:13:00.247379564Z [2024-04-12 02:13:00,247: INFO/ForkPoolWorker-16] [ebb365a8-9629-40e6-b151-30be17ae0946] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:13:00.250250165Z [2024-04-12 02:13:00,250: INFO/ForkPoolWorker-15] [15040cbc-3b73-4a40-99a0-c99930c9b6b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:13:00.263381467Z [2024-04-12 02:13:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38270ac5-fedd-4fc2-8246-2b9c7d629e55] received 2024-04-12T02:13:00.270583499Z [2024-04-12 02:13:00,270: INFO/ForkPoolWorker-1] [38270ac5-fedd-4fc2-8246-2b9c7d629e55] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:13:00.513063830Z [2024-04-12 02:13:00,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:13:00.524033535Z [2024-04-12 02:13:00,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:13:00.662822085Z [2024-04-12 02:13:00,659: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:13:00.810250306Z [2024-04-12 02:13:00,809: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:13:00.814575066Z [2024-04-12 02:13:00,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:13:00.860137644Z [2024-04-12 02:13:00,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:13:00.861967985Z [2024-04-12 02:13:00,861: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:13:00.861975230Z [2024-04-12 02:13:00,861: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:13:00.861978194Z [2024-04-12 02:13:00,861: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:13:00.862133884Z [2024-04-12 02:13:00,861: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:13:00.954630010Z [2024-04-12 02:13:00,954: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:13:01.560067793Z [2024-04-12 02:13:01,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38270ac5-fedd-4fc2-8246-2b9c7d629e55] succeeded in 1.2950607779985148s: None 2024-04-12T02:13:01.601308762Z [2024-04-12 02:13:01,600: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:13:01.604493353Z [2024-04-12 02:13:01,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:13:01.624118126Z [2024-04-12 02:13:01,623: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:13:01.625244647Z [2024-04-12 02:13:01,625: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:13:01.625370369Z [2024-04-12 02:13:01,625: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:13:01.625546577Z [2024-04-12 02:13:01,625: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:13:01.625635945Z [2024-04-12 02:13:01,625: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:13:01.626178105Z [2024-04-12 02:13:01,626: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:13:01.626314798Z [2024-04-12 02:13:01,626: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:13:01.645770104Z [2024-04-12 02:13:01,645: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:13:01.648789171Z [2024-04-12 02:13:01,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:13:01.724745819Z [2024-04-12 02:13:01,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:13:01.740469152Z [2024-04-12 02:13:01,729: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:13:01.740493176Z [2024-04-12 02:13:01,730: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:13:01.740498383Z [2024-04-12 02:13:01,730: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:13:01.740503337Z [2024-04-12 02:13:01,730: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:13:01.740507221Z [2024-04-12 02:13:01,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:13:01.740510833Z [2024-04-12 02:13:01,730: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:13:01.740620407Z [2024-04-12 02:13:01,740: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:13:01.839048457Z [2024-04-12 02:13:01,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:13:03.249851227Z [2024-04-12 02:13:03,249: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebb365a8-9629-40e6-b151-30be17ae0946] succeeded in 3.0091049059992656s: None 2024-04-12T02:13:03.920693435Z [2024-04-12 02:13:03,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15040cbc-3b73-4a40-99a0-c99930c9b6b2] succeeded in 3.6825018300005468s: None 2024-04-12T02:14:00.728650773Z [2024-04-12 02:14:00,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9be48d90-99cd-44ad-8b36-23fafa8878ef] received 2024-04-12T02:14:00.730491462Z [2024-04-12 02:14:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3acbdad6-7494-417c-b8e0-8c40ddcc9965] received 2024-04-12T02:14:00.737272093Z [2024-04-12 02:14:00,737: INFO/ForkPoolWorker-15] [9be48d90-99cd-44ad-8b36-23fafa8878ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:14:00.737660797Z [2024-04-12 02:14:00,737: INFO/ForkPoolWorker-16] [3acbdad6-7494-417c-b8e0-8c40ddcc9965] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:14:00.737748956Z [2024-04-12 02:14:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9811b41f-3068-4c9a-8e05-f5054da67ee9] received 2024-04-12T02:14:00.743005870Z [2024-04-12 02:14:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54e1469f-f87a-4212-9ba3-8a965833e6f8] received 2024-04-12T02:14:00.748571396Z [2024-04-12 02:14:00,748: INFO/ForkPoolWorker-1] [9811b41f-3068-4c9a-8e05-f5054da67ee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:14:00.768341081Z [2024-04-12 02:14:00,765: INFO/ForkPoolWorker-2] [54e1469f-f87a-4212-9ba3-8a965833e6f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:14:01.095463287Z [2024-04-12 02:14:01,092: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:14:01.191853033Z [2024-04-12 02:14:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:14:01.230588008Z [2024-04-12 02:14:01,223: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:14:01.283685649Z [2024-04-12 02:14:01,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:14:01.400749755Z [2024-04-12 02:14:01,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:14:01.438884276Z [2024-04-12 02:14:01,438: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:14:01.443638947Z [2024-04-12 02:14:01,443: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:14:01.498350908Z [2024-04-12 02:14:01,498: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:14:01.499480024Z [2024-04-12 02:14:01,499: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:14:01.499525228Z [2024-04-12 02:14:01,499: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:14:01.499571400Z [2024-04-12 02:14:01,499: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:14:01.499744554Z [2024-04-12 02:14:01,499: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:14:01.641089002Z [2024-04-12 02:14:01,640: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:14:02.342019146Z [2024-04-12 02:14:02,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9be48d90-99cd-44ad-8b36-23fafa8878ef] succeeded in 1.611983101000078s: None 2024-04-12T02:14:02.383616114Z [2024-04-12 02:14:02,383: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[54e1469f-f87a-4212-9ba3-8a965833e6f8] succeeded in 1.6369743660015956s: None 2024-04-12T02:14:02.575395735Z [2024-04-12 02:14:02,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:14:02.578838298Z [2024-04-12 02:14:02,578: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:14:02.603927638Z [2024-04-12 02:14:02,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:14:02.605669557Z [2024-04-12 02:14:02,605: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:14:02.606123969Z [2024-04-12 02:14:02,605: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:14:02.606497301Z [2024-04-12 02:14:02,606: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:14:02.606737145Z [2024-04-12 02:14:02,606: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:14:02.607312363Z [2024-04-12 02:14:02,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:14:02.607640201Z [2024-04-12 02:14:02,607: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:14:02.643742411Z [2024-04-12 02:14:02,643: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:14:02.646992372Z [2024-04-12 02:14:02,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:14:02.669379254Z [2024-04-12 02:14:02,669: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:14:02.671970524Z [2024-04-12 02:14:02,671: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:14:02.672069814Z [2024-04-12 02:14:02,671: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:14:02.672288855Z [2024-04-12 02:14:02,672: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:14:02.672369190Z [2024-04-12 02:14:02,672: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:14:02.672773489Z [2024-04-12 02:14:02,672: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:14:02.672874582Z [2024-04-12 02:14:02,672: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:14:02.679902908Z [2024-04-12 02:14:02,679: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:14:02.746511138Z [2024-04-12 02:14:02,746: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:14:04.414430271Z [2024-04-12 02:14:04,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9811b41f-3068-4c9a-8e05-f5054da67ee9] succeeded in 3.6751671920010267s: None 2024-04-12T02:14:05.198371636Z [2024-04-12 02:14:05,197: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3acbdad6-7494-417c-b8e0-8c40ddcc9965] succeeded in 4.464684929998839s: None 2024-04-12T02:15:00.861596257Z [2024-04-12 02:15:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aca941e-caec-45a0-a249-92fef0df2612] received 2024-04-12T02:15:00.864931370Z [2024-04-12 02:15:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2165967-b11b-4393-9725-c7b5bc6774f1] received 2024-04-12T02:15:00.866343642Z [2024-04-12 02:15:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce1dfa30-ca01-4ebe-a6d2-8738bb565b94] received 2024-04-12T02:15:00.867349473Z [2024-04-12 02:15:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3d983fc-f7c7-4f21-9307-1851e8859ad6] received 2024-04-12T02:15:00.875149092Z [2024-04-12 02:15:00,874: INFO/ForkPoolWorker-15] [2aca941e-caec-45a0-a249-92fef0df2612] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:00.876730314Z [2024-04-12 02:15:00,876: INFO/ForkPoolWorker-16] [d2165967-b11b-4393-9725-c7b5bc6774f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:15:00.880663681Z [2024-04-12 02:15:00,880: INFO/ForkPoolWorker-1] [ce1dfa30-ca01-4ebe-a6d2-8738bb565b94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:15:00.884571048Z [2024-04-12 02:15:00,884: INFO/ForkPoolWorker-2] [c3d983fc-f7c7-4f21-9307-1851e8859ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:15:01.163382864Z [2024-04-12 02:15:01,160: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:15:01.164016591Z [2024-04-12 02:15:01,160: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:15:01.211209552Z [2024-04-12 02:15:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:15:01.548483338Z [2024-04-12 02:15:01,542: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:15:01.732418297Z [2024-04-12 02:15:01,732: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:15:01.735574299Z [2024-04-12 02:15:01,735: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:01.755946538Z [2024-04-12 02:15:01,755: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:15:01.757659111Z [2024-04-12 02:15:01,757: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:15:01.757769847Z [2024-04-12 02:15:01,757: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:15:01.757953423Z [2024-04-12 02:15:01,757: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:15:01.758183436Z [2024-04-12 02:15:01,758: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:15:01.848441974Z [2024-04-12 02:15:01,848: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:02.389337918Z [2024-04-12 02:15:02,388: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3d983fc-f7c7-4f21-9307-1851e8859ad6] succeeded in 1.5204552060004062s: None 2024-04-12T02:15:02.499935925Z [2024-04-12 02:15:02,499: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:15:02.504445788Z [2024-04-12 02:15:02,504: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:02.518514006Z [2024-04-12 02:15:02,518: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:15:02.523097823Z [2024-04-12 02:15:02,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:02.552877352Z [2024-04-12 02:15:02,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:15:02.556215742Z [2024-04-12 02:15:02,555: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:02.556287600Z [2024-04-12 02:15:02,556: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:02.556466107Z [2024-04-12 02:15:02,556: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:02.556521030Z [2024-04-12 02:15:02,556: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:15:02.556739531Z [2024-04-12 02:15:02,556: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:15:02.556797249Z [2024-04-12 02:15:02,556: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:02.565652729Z [2024-04-12 02:15:02,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:15:02.567640228Z [2024-04-12 02:15:02,567: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:02.567804123Z [2024-04-12 02:15:02,567: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:02.568041881Z [2024-04-12 02:15:02,567: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:02.568200812Z [2024-04-12 02:15:02,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:15:02.570168179Z [2024-04-12 02:15:02,570: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:15:02.570338969Z [2024-04-12 02:15:02,570: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:02.674364082Z [2024-04-12 02:15:02,674: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:02.700766087Z [2024-04-12 02:15:02,700: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:02.717384631Z [2024-04-12 02:15:02,717: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:15:02.720983565Z [2024-04-12 02:15:02,720: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:02.754553712Z [2024-04-12 02:15:02,754: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:15:02.755659581Z [2024-04-12 02:15:02,755: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:02.755670847Z [2024-04-12 02:15:02,755: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:02.755845947Z [2024-04-12 02:15:02,755: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:02.755874030Z [2024-04-12 02:15:02,755: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:15:02.756126541Z [2024-04-12 02:15:02,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:15:02.756135257Z [2024-04-12 02:15:02,756: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:02.841482926Z [2024-04-12 02:15:02,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:03.515916766Z [2024-04-12 02:15:03,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2aca941e-caec-45a0-a249-92fef0df2612] succeeded in 2.6516280920004647s: None 2024-04-12T02:15:03.635948656Z [2024-04-12 02:15:03,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01a294fa-7054-4e8c-9b87-d5f11e732422] received 2024-04-12T02:15:03.646329612Z [2024-04-12 02:15:03,645: INFO/ForkPoolWorker-15] [01a294fa-7054-4e8c-9b87-d5f11e732422] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:03.919505686Z [2024-04-12 02:15:03,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:15:04.172912042Z [2024-04-12 02:15:04,172: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce1dfa30-ca01-4ebe-a6d2-8738bb565b94] succeeded in 3.3032842129996425s: None 2024-04-12T02:15:04.526387502Z [2024-04-12 02:15:04,526: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2165967-b11b-4393-9725-c7b5bc6774f1] succeeded in 3.659610792999956s: None 2024-04-12T02:15:05.145835255Z [2024-04-12 02:15:05,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:15:05.148942410Z [2024-04-12 02:15:05,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:05.170704987Z [2024-04-12 02:15:05,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:15:05.171877861Z [2024-04-12 02:15:05,171: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:05.172019245Z [2024-04-12 02:15:05,171: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:05.172230666Z [2024-04-12 02:15:05,171: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:05.172409458Z [2024-04-12 02:15:05,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:15:05.172810702Z [2024-04-12 02:15:05,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:15:05.172985671Z [2024-04-12 02:15:05,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:05.259383307Z [2024-04-12 02:15:05,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:05.923059157Z [2024-04-12 02:15:05,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01a294fa-7054-4e8c-9b87-d5f11e732422] succeeded in 2.282011961000535s: None 2024-04-12T02:15:06.060493946Z [2024-04-12 02:15:06,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cced2be-8b39-4f53-985d-36dd617033bd] received 2024-04-12T02:15:06.070419521Z [2024-04-12 02:15:06,070: INFO/ForkPoolWorker-15] [2cced2be-8b39-4f53-985d-36dd617033bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:15:06.340626035Z [2024-04-12 02:15:06,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:15:07.481524978Z [2024-04-12 02:15:07,481: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:15:07.484511851Z [2024-04-12 02:15:07,484: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:07.506354873Z [2024-04-12 02:15:07,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:15:07.507444428Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:07.507456737Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:07.507551198Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:07.507603768Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:15:07.507823170Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:15:07.507838572Z [2024-04-12 02:15:07,507: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:07.589935245Z [2024-04-12 02:15:07,589: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:08.149545546Z [2024-04-12 02:15:08,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cced2be-8b39-4f53-985d-36dd617033bd] succeeded in 2.0866274059990246s: None 2024-04-12T02:15:08.969594201Z [2024-04-12 02:15:08,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72c57893-e72e-49ef-86b6-ea1b069cd8e6] received 2024-04-12T02:15:08.986497554Z [2024-04-12 02:15:08,984: INFO/ForkPoolWorker-15] [72c57893-e72e-49ef-86b6-ea1b069cd8e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:09.247351623Z [2024-04-12 02:15:09,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:15:10.297747397Z [2024-04-12 02:15:10,297: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:15:10.300670019Z [2024-04-12 02:15:10,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:15:10.329068021Z [2024-04-12 02:15:10,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:15:10.330390492Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:15:10.330426188Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:15:10.330534992Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:15:10.330592209Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:15:10.330813385Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:15:10.330865779Z [2024-04-12 02:15:10,330: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:15:10.454001689Z [2024-04-12 02:15:10,453: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:15:11.043897207Z [2024-04-12 02:15:11,043: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72c57893-e72e-49ef-86b6-ea1b069cd8e6] succeeded in 2.0723946039997827s: None 2024-04-12T02:16:00.892793613Z [2024-04-12 02:16:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4fd5cb4-ba1f-4c17-96b8-deefcdb0937f] received 2024-04-12T02:16:00.898186694Z [2024-04-12 02:16:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ee14312-035b-4320-b7ec-4f46839c5f2e] received 2024-04-12T02:16:00.902359929Z [2024-04-12 02:16:00,902: INFO/ForkPoolWorker-15] [d4fd5cb4-ba1f-4c17-96b8-deefcdb0937f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:16:00.905204250Z [2024-04-12 02:16:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4920cb3-d959-490a-a164-f8776d9a1286] received 2024-04-12T02:16:00.907144141Z [2024-04-12 02:16:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea57026e-32ea-4e38-9390-ec3c167cfa32] received 2024-04-12T02:16:00.912305684Z [2024-04-12 02:16:00,912: INFO/ForkPoolWorker-1] [e4920cb3-d959-490a-a164-f8776d9a1286] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:16:00.928840128Z [2024-04-12 02:16:00,928: INFO/ForkPoolWorker-2] [ea57026e-32ea-4e38-9390-ec3c167cfa32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:16:00.934168832Z [2024-04-12 02:16:00,933: INFO/ForkPoolWorker-16] [4ee14312-035b-4320-b7ec-4f46839c5f2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:16:01.183621175Z [2024-04-12 02:16:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:16:01.210944324Z [2024-04-12 02:16:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:16:01.344412145Z [2024-04-12 02:16:01,339: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:16:01.352520429Z [2024-04-12 02:16:01,345: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:16:01.468878113Z [2024-04-12 02:16:01,468: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:16:01.581834819Z [2024-04-12 02:16:01,581: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:16:01.587236206Z [2024-04-12 02:16:01,586: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:16:01.614173517Z [2024-04-12 02:16:01,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:16:01.615426744Z [2024-04-12 02:16:01,615: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:16:01.615592838Z [2024-04-12 02:16:01,615: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:16:01.615713124Z [2024-04-12 02:16:01,615: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:16:01.616039238Z [2024-04-12 02:16:01,615: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:16:01.781673899Z [2024-04-12 02:16:01,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:16:02.084028040Z [2024-04-12 02:16:02,083: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4920cb3-d959-490a-a164-f8776d9a1286] succeeded in 1.1770647520006605s: None 2024-04-12T02:16:02.304148577Z [2024-04-12 02:16:02,303: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ee14312-035b-4320-b7ec-4f46839c5f2e] succeeded in 1.4025354890000017s: None 2024-04-12T02:16:02.391295705Z [2024-04-12 02:16:02,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:16:02.394325143Z [2024-04-12 02:16:02,393: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:16:02.414337269Z [2024-04-12 02:16:02,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:16:02.415512484Z [2024-04-12 02:16:02,415: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:16:02.415591089Z [2024-04-12 02:16:02,415: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:16:02.415737744Z [2024-04-12 02:16:02,415: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:16:02.415807671Z [2024-04-12 02:16:02,415: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:16:02.416043514Z [2024-04-12 02:16:02,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:16:02.416099661Z [2024-04-12 02:16:02,416: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:16:02.510070893Z [2024-04-12 02:16:02,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:16:02.537664406Z [2024-04-12 02:16:02,537: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:16:02.540797852Z [2024-04-12 02:16:02,540: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:16:02.559206702Z [2024-04-12 02:16:02,558: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:16:02.560586536Z [2024-04-12 02:16:02,560: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:16:02.560618921Z [2024-04-12 02:16:02,560: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:16:02.560777501Z [2024-04-12 02:16:02,560: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:16:02.560825592Z [2024-04-12 02:16:02,560: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:16:02.561078713Z [2024-04-12 02:16:02,560: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:16:02.561129083Z [2024-04-12 02:16:02,561: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:16:02.631058655Z [2024-04-12 02:16:02,630: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:16:04.265083463Z [2024-04-12 02:16:04,264: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4fd5cb4-ba1f-4c17-96b8-deefcdb0937f] succeeded in 3.3686580670000694s: None 2024-04-12T02:16:06.663934243Z [2024-04-12 02:16:06,663: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ea57026e-32ea-4e38-9390-ec3c167cfa32] succeeded in 5.750363897999705s: None 2024-04-12T02:17:00.893509340Z [2024-04-12 02:17:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aea5107-d210-4537-a3aa-3ec65dc34874] received 2024-04-12T02:17:00.895123908Z [2024-04-12 02:17:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b822af07-4522-4b03-8ffc-6080cb75a4ca] received 2024-04-12T02:17:00.896652672Z [2024-04-12 02:17:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2519afd7-a7c7-4a52-8c9c-6e7189b45eea] received 2024-04-12T02:17:00.910126300Z [2024-04-12 02:17:00,909: INFO/ForkPoolWorker-16] [b822af07-4522-4b03-8ffc-6080cb75a4ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:17:00.912210992Z [2024-04-12 02:17:00,911: INFO/ForkPoolWorker-15] [8aea5107-d210-4537-a3aa-3ec65dc34874] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:17:00.921044043Z [2024-04-12 02:17:00,920: INFO/ForkPoolWorker-1] [2519afd7-a7c7-4a52-8c9c-6e7189b45eea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:17:01.157161690Z [2024-04-12 02:17:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:17:01.173368134Z [2024-04-12 02:17:01,170: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:17:01.204835402Z [2024-04-12 02:17:01,201: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:17:01.360732467Z [2024-04-12 02:17:01,360: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:17:01.365113858Z [2024-04-12 02:17:01,364: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:17:01.401818032Z [2024-04-12 02:17:01,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:17:01.403025947Z [2024-04-12 02:17:01,402: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:17:01.403313762Z [2024-04-12 02:17:01,402: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:17:01.403593420Z [2024-04-12 02:17:01,403: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:17:01.404107806Z [2024-04-12 02:17:01,403: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:17:01.505918912Z [2024-04-12 02:17:01,505: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:17:02.040546958Z [2024-04-12 02:17:02,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2519afd7-a7c7-4a52-8c9c-6e7189b45eea] succeeded in 1.1412382779999461s: None 2024-04-12T02:17:02.186159504Z [2024-04-12 02:17:02,185: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:17:02.189567688Z [2024-04-12 02:17:02,189: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:17:02.207946641Z [2024-04-12 02:17:02,207: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:17:02.210635134Z [2024-04-12 02:17:02,210: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:17:02.212304659Z [2024-04-12 02:17:02,212: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:17:02.213665900Z [2024-04-12 02:17:02,213: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:17:02.213676894Z [2024-04-12 02:17:02,213: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:17:02.213750143Z [2024-04-12 02:17:02,213: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:17:02.213793487Z [2024-04-12 02:17:02,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:17:02.214128094Z [2024-04-12 02:17:02,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:17:02.214140865Z [2024-04-12 02:17:02,214: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:17:02.228210471Z [2024-04-12 02:17:02,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:17:02.229434776Z [2024-04-12 02:17:02,229: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:17:02.229483979Z [2024-04-12 02:17:02,229: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:17:02.229673267Z [2024-04-12 02:17:02,229: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:17:02.229857790Z [2024-04-12 02:17:02,229: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:17:02.230655380Z [2024-04-12 02:17:02,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:17:02.230714489Z [2024-04-12 02:17:02,230: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:17:02.294891917Z [2024-04-12 02:17:02,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:17:02.307738355Z [2024-04-12 02:17:02,307: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:17:03.684603959Z [2024-04-12 02:17:03,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8aea5107-d210-4537-a3aa-3ec65dc34874] succeeded in 2.788059811999119s: None 2024-04-12T02:17:04.169458298Z [2024-04-12 02:17:04,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b822af07-4522-4b03-8ffc-6080cb75a4ca] succeeded in 3.2727724190008303s: None 2024-04-12T02:17:31.162283220Z [2024-04-12 02:17:31,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3acfca32-b539-43de-8c03-0b9b3edea5f7] received 2024-04-12T02:17:31.172360349Z [2024-04-12 02:17:31,172: INFO/ForkPoolWorker-15] [3acfca32-b539-43de-8c03-0b9b3edea5f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021730_012570', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:17:31.425086219Z [2024-04-12 02:17:31,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-12T02:17:31.746578055Z [2024-04-12 02:17:31,746: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:17:32.362667218Z [2024-04-12 02:17:32,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3acfca32-b539-43de-8c03-0b9b3edea5f7] succeeded in 1.1969079159989633s: None 2024-04-12T02:18:00.627753915Z [2024-04-12 02:18:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f4278c-d7eb-4520-90b7-3a067bd7c9ba] received 2024-04-12T02:18:00.635117398Z [2024-04-12 02:18:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4440b1ea-6708-46f8-8438-c801bf5677ac] received 2024-04-12T02:18:00.637046414Z [2024-04-12 02:18:00,636: INFO/ForkPoolWorker-15] [47f4278c-d7eb-4520-90b7-3a067bd7c9ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:18:00.640057459Z [2024-04-12 02:18:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a76af4e0-b487-41c6-841a-eef708aec890] received 2024-04-12T02:18:00.642482477Z [2024-04-12 02:18:00,642: INFO/ForkPoolWorker-16] [4440b1ea-6708-46f8-8438-c801bf5677ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:18:00.646210848Z [2024-04-12 02:18:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3895f3a9-7d3a-441b-a69c-aeab53cbf29c] received 2024-04-12T02:18:00.653397255Z [2024-04-12 02:18:00,653: INFO/ForkPoolWorker-1] [a76af4e0-b487-41c6-841a-eef708aec890] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:18:00.674141790Z [2024-04-12 02:18:00,673: INFO/ForkPoolWorker-2] [3895f3a9-7d3a-441b-a69c-aeab53cbf29c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:18:00.959935157Z [2024-04-12 02:18:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:18:00.973599357Z [2024-04-12 02:18:00,970: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:18:01.096721826Z [2024-04-12 02:18:01,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:18:01.099253153Z [2024-04-12 02:18:01,095: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:18:01.280707661Z [2024-04-12 02:18:01,280: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:18:01.284388315Z [2024-04-12 02:18:01,283: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:18:01.310358898Z [2024-04-12 02:18:01,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:18:01.313086306Z [2024-04-12 02:18:01,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:18:01.314156232Z [2024-04-12 02:18:01,313: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:18:01.314264904Z [2024-04-12 02:18:01,314: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:18:01.314337195Z [2024-04-12 02:18:01,314: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:18:01.314784378Z [2024-04-12 02:18:01,314: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:18:01.440420320Z [2024-04-12 02:18:01,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:18:01.919482055Z [2024-04-12 02:18:01,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47f4278c-d7eb-4520-90b7-3a067bd7c9ba] succeeded in 1.2895118159995036s: None 2024-04-12T02:18:01.965780187Z [2024-04-12 02:18:01,965: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a76af4e0-b487-41c6-841a-eef708aec890] succeeded in 1.3235204269985843s: None 2024-04-12T02:18:02.271532560Z [2024-04-12 02:18:02,271: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:18:02.274610896Z [2024-04-12 02:18:02,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:18:02.296421033Z [2024-04-12 02:18:02,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:18:02.297593386Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:18:02.297608285Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:18:02.297753590Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:18:02.297840698Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:18:02.298090032Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:18:02.298112478Z [2024-04-12 02:18:02,297: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:18:02.341197141Z [2024-04-12 02:18:02,340: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:18:02.344063828Z [2024-04-12 02:18:02,343: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:18:02.368812843Z [2024-04-12 02:18:02,368: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:18:02.370644568Z [2024-04-12 02:18:02,370: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:18:02.370672290Z [2024-04-12 02:18:02,370: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:18:02.370680128Z [2024-04-12 02:18:02,370: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:18:02.370908861Z [2024-04-12 02:18:02,370: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:18:02.371137195Z [2024-04-12 02:18:02,370: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:18:02.371557454Z [2024-04-12 02:18:02,371: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:18:02.371566285Z [2024-04-12 02:18:02,371: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:18:02.457738408Z [2024-04-12 02:18:02,457: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:18:03.938454111Z [2024-04-12 02:18:03,937: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3895f3a9-7d3a-441b-a69c-aeab53cbf29c] succeeded in 3.2824954520001484s: None 2024-04-12T02:18:04.381037489Z [2024-04-12 02:18:04,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4440b1ea-6708-46f8-8438-c801bf5677ac] succeeded in 3.743673156999648s: None 2024-04-12T02:19:01.198896792Z [2024-04-12 02:19:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e2e575f-28ad-4c0f-8d62-20a898ad71b3] received 2024-04-12T02:19:01.204307145Z [2024-04-12 02:19:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fa422d5-ed6c-440c-a13c-7709f725b40c] received 2024-04-12T02:19:01.207792118Z [2024-04-12 02:19:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba2168f3-1e43-496b-a9cc-55d8846b2bf4] received 2024-04-12T02:19:01.208050965Z [2024-04-12 02:19:01,207: INFO/ForkPoolWorker-15] [0e2e575f-28ad-4c0f-8d62-20a898ad71b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:19:01.212458516Z [2024-04-12 02:19:01,212: INFO/ForkPoolWorker-1] [ba2168f3-1e43-496b-a9cc-55d8846b2bf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:19:01.217008586Z [2024-04-12 02:19:01,216: INFO/ForkPoolWorker-16] [1fa422d5-ed6c-440c-a13c-7709f725b40c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:19:01.456939816Z [2024-04-12 02:19:01,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:19:01.468287937Z [2024-04-12 02:19:01,465: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:19:01.492131105Z [2024-04-12 02:19:01,489: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:19:01.614902038Z [2024-04-12 02:19:01,614: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:19:01.618453183Z [2024-04-12 02:19:01,617: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:19:01.645618754Z [2024-04-12 02:19:01,645: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:19:01.648682039Z [2024-04-12 02:19:01,648: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:19:01.648702850Z [2024-04-12 02:19:01,648: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:19:01.649048441Z [2024-04-12 02:19:01,648: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:19:01.649478869Z [2024-04-12 02:19:01,649: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:19:01.751174736Z [2024-04-12 02:19:01,750: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:19:02.348935192Z [2024-04-12 02:19:02,348: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba2168f3-1e43-496b-a9cc-55d8846b2bf4] succeeded in 1.140105611000763s: None 2024-04-12T02:19:02.492473399Z [2024-04-12 02:19:02,492: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:19:02.497057791Z [2024-04-12 02:19:02,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:19:02.518293247Z [2024-04-12 02:19:02,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:19:02.519517164Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:19:02.519539303Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:19:02.519685888Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:19:02.519700384Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:19:02.519935440Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:19:02.519950571Z [2024-04-12 02:19:02,519: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:19:02.559683164Z [2024-04-12 02:19:02,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:19:02.562618338Z [2024-04-12 02:19:02,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:19:02.589320027Z [2024-04-12 02:19:02,589: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:19:02.593350161Z [2024-04-12 02:19:02,593: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:19:02.593559732Z [2024-04-12 02:19:02,593: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:19:02.593837215Z [2024-04-12 02:19:02,593: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:19:02.594004206Z [2024-04-12 02:19:02,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:19:02.594420107Z [2024-04-12 02:19:02,594: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:19:02.594639643Z [2024-04-12 02:19:02,594: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:19:02.599122775Z [2024-04-12 02:19:02,598: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:19:02.666150001Z [2024-04-12 02:19:02,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:19:04.983164568Z [2024-04-12 02:19:04,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fa422d5-ed6c-440c-a13c-7709f725b40c] succeeded in 3.775646632999269s: None 2024-04-12T02:19:05.725333254Z [2024-04-12 02:19:05,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e2e575f-28ad-4c0f-8d62-20a898ad71b3] succeeded in 4.5244038040000305s: None 2024-04-12T02:19:31.587282907Z [2024-04-12 02:19:31,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe582e24-7b6c-450a-948e-e56f33351c24] received 2024-04-12T02:19:31.600917304Z [2024-04-12 02:19:31,600: INFO/ForkPoolWorker-15] [fe582e24-7b6c-450a-948e-e56f33351c24] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021930_435515', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:19:31.895526434Z [2024-04-12 02:19:31,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-12T02:19:32.214988549Z [2024-04-12 02:19:32,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:19:32.852157587Z [2024-04-12 02:19:32,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe582e24-7b6c-450a-948e-e56f33351c24] succeeded in 1.2615048919997207s: None 2024-04-12T02:20:01.146633472Z [2024-04-12 02:20:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70793596-0abb-445e-a04f-f10f5598a59c] received 2024-04-12T02:20:01.149029878Z [2024-04-12 02:20:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[186d57a0-52a7-491f-9e59-b5be1cc510cc] received 2024-04-12T02:20:01.153905223Z [2024-04-12 02:20:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5881a71-e600-4c27-a455-6e8f40acaa4e] received 2024-04-12T02:20:01.155114537Z [2024-04-12 02:20:01,154: INFO/ForkPoolWorker-16] [186d57a0-52a7-491f-9e59-b5be1cc510cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:20:01.155741387Z [2024-04-12 02:20:01,155: INFO/ForkPoolWorker-15] [70793596-0abb-445e-a04f-f10f5598a59c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:01.159456597Z [2024-04-12 02:20:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ad04245-fbe8-469b-bdd9-c07014872141] received 2024-04-12T02:20:01.159637315Z [2024-04-12 02:20:01,159: INFO/ForkPoolWorker-1] [a5881a71-e600-4c27-a455-6e8f40acaa4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:20:01.167513570Z [2024-04-12 02:20:01,167: INFO/ForkPoolWorker-2] [3ad04245-fbe8-469b-bdd9-c07014872141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:20:01.169097576Z [2024-04-12 02:20:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81868d3a-fe52-4f08-a407-cc494aec8d62] received 2024-04-12T02:20:01.214599225Z [2024-04-12 02:20:01,214: INFO/ForkPoolWorker-3] [81868d3a-fe52-4f08-a407-cc494aec8d62] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:20:01.490982073Z [2024-04-12 02:20:01,488: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:20:01.509434255Z [2024-04-12 02:20:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:20:01.563840506Z [2024-04-12 02:20:01,560: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:20:01.618946607Z [2024-04-12 02:20:01,611: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:20:01.732511707Z [2024-04-12 02:20:01,725: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T02:20:01.732546689Z [2024-04-12 02:20:01,729: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:01.762173389Z [2024-04-12 02:20:01,761: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T02:20:01.763461875Z [2024-04-12 02:20:01,763: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:20:01.763585667Z [2024-04-12 02:20:01,763: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:20:01.765585546Z [2024-04-12 02:20:01,763: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T02:20:01.765791394Z [2024-04-12 02:20:01,765: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:20:01.789444238Z [2024-04-12 02:20:01,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:20:01.850127221Z [2024-04-12 02:20:01,849: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:01.862887619Z [2024-04-12 02:20:01,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:02.528927728Z [2024-04-12 02:20:02,528: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[186d57a0-52a7-491f-9e59-b5be1cc510cc] succeeded in 1.378906845999154s: None 2024-04-12T02:20:02.546933150Z [2024-04-12 02:20:02,546: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[81868d3a-fe52-4f08-a407-cc494aec8d62] succeeded in 1.3729821389988501s: None 2024-04-12T02:20:02.896783745Z [2024-04-12 02:20:02,896: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:20:02.899697766Z [2024-04-12 02:20:02,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:02.917278391Z [2024-04-12 02:20:02,917: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:20:02.918259326Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:02.918301060Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:02.918406800Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:02.918421255Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:20:02.918587696Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:20:02.918595341Z [2024-04-12 02:20:02,918: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:03.000641623Z [2024-04-12 02:20:03,000: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:03.079601694Z [2024-04-12 02:20:03,079: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:20:03.083325348Z [2024-04-12 02:20:03,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:03.103289995Z [2024-04-12 02:20:03,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:20:03.104579045Z [2024-04-12 02:20:03,104: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:03.104988636Z [2024-04-12 02:20:03,104: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:03.105197776Z [2024-04-12 02:20:03,104: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:03.105316204Z [2024-04-12 02:20:03,105: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:20:03.106480192Z [2024-04-12 02:20:03,105: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:20:03.106608643Z [2024-04-12 02:20:03,106: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:03.178041630Z [2024-04-12 02:20:03,177: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:03.387161630Z [2024-04-12 02:20:03,386: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:20:03.390840129Z [2024-04-12 02:20:03,390: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:03.423078677Z [2024-04-12 02:20:03,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:20:03.424567804Z [2024-04-12 02:20:03,424: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:03.424744517Z [2024-04-12 02:20:03,424: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:03.424947722Z [2024-04-12 02:20:03,424: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:03.425089095Z [2024-04-12 02:20:03,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:20:03.425459867Z [2024-04-12 02:20:03,425: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:20:03.425650271Z [2024-04-12 02:20:03,425: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:03.506657608Z [2024-04-12 02:20:03,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:04.204781849Z [2024-04-12 02:20:04,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70793596-0abb-445e-a04f-f10f5598a59c] succeeded in 3.0540255989999423s: None 2024-04-12T02:20:04.581127053Z [2024-04-12 02:20:04,580: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3ad04245-fbe8-469b-bdd9-c07014872141] succeeded in 3.4187005099993257s: None 2024-04-12T02:20:05.094751798Z [2024-04-12 02:20:05,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5881a71-e600-4c27-a455-6e8f40acaa4e] succeeded in 3.9387876729997515s: None 2024-04-12T02:20:05.101460542Z [2024-04-12 02:20:05,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[872b8ef3-5e79-4906-9b9b-982d1779d778] received 2024-04-12T02:20:05.112637136Z [2024-04-12 02:20:05,112: INFO/ForkPoolWorker-15] [872b8ef3-5e79-4906-9b9b-982d1779d778] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:05.392160767Z [2024-04-12 02:20:05,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:20:06.576357104Z [2024-04-12 02:20:06,575: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:20:06.579048163Z [2024-04-12 02:20:06,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:06.602579759Z [2024-04-12 02:20:06,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:20:06.603809518Z [2024-04-12 02:20:06,603: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:06.603978428Z [2024-04-12 02:20:06,603: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:06.604248214Z [2024-04-12 02:20:06,604: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:06.604497297Z [2024-04-12 02:20:06,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:20:06.604843194Z [2024-04-12 02:20:06,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:20:06.604978316Z [2024-04-12 02:20:06,604: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:06.705390433Z [2024-04-12 02:20:06,704: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:07.369542460Z [2024-04-12 02:20:07,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[872b8ef3-5e79-4906-9b9b-982d1779d778] succeeded in 2.265234208000038s: None 2024-04-12T02:20:07.521271104Z [2024-04-12 02:20:07,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e900f726-6e9f-425f-9472-abe68dafd2f1] received 2024-04-12T02:20:07.535811966Z [2024-04-12 02:20:07,535: INFO/ForkPoolWorker-15] [e900f726-6e9f-425f-9472-abe68dafd2f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:20:07.897965415Z [2024-04-12 02:20:07,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:20:08.980510985Z [2024-04-12 02:20:08,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:20:08.986144250Z [2024-04-12 02:20:08,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:09.009539129Z [2024-04-12 02:20:09,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:20:09.010952604Z [2024-04-12 02:20:09,010: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:09.010980912Z [2024-04-12 02:20:09,010: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:09.011173213Z [2024-04-12 02:20:09,010: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:09.011190457Z [2024-04-12 02:20:09,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:20:09.011519356Z [2024-04-12 02:20:09,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:20:09.011538880Z [2024-04-12 02:20:09,011: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:09.106833931Z [2024-04-12 02:20:09,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:10.472547671Z [2024-04-12 02:20:10,470: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e900f726-6e9f-425f-9472-abe68dafd2f1] succeeded in 2.946324676999211s: None 2024-04-12T02:20:11.370205952Z [2024-04-12 02:20:11,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b6a0de-4a4a-4e56-bea4-bb971e87c16b] received 2024-04-12T02:20:11.381695367Z [2024-04-12 02:20:11,381: INFO/ForkPoolWorker-15] [a9b6a0de-4a4a-4e56-bea4-bb971e87c16b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:11.626843149Z [2024-04-12 02:20:11,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:20:12.612348579Z [2024-04-12 02:20:12,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:20:12.615244788Z [2024-04-12 02:20:12,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:20:12.636275343Z [2024-04-12 02:20:12,636: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:20:12.637472590Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:20:12.637481728Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:20:12.637645567Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:20:12.637656007Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:20:12.637984289Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:20:12.638045369Z [2024-04-12 02:20:12,637: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:20:12.732069149Z [2024-04-12 02:20:12,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:20:13.301704699Z [2024-04-12 02:20:13,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9b6a0de-4a4a-4e56-bea4-bb971e87c16b] succeeded in 1.9280789670010563s: None 2024-04-12T02:21:01.007287372Z [2024-04-12 02:21:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33573a87-5db6-4d07-abd7-3e51fe81a32d] received 2024-04-12T02:21:01.014276861Z [2024-04-12 02:21:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b5a18cd-2656-4a62-b215-5e28cff1815f] received 2024-04-12T02:21:01.014763251Z [2024-04-12 02:21:01,014: INFO/ForkPoolWorker-15] [33573a87-5db6-4d07-abd7-3e51fe81a32d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:21:01.015586019Z [2024-04-12 02:21:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[971bc862-c8dc-43ae-b5f0-c19407521e66] received 2024-04-12T02:21:01.020013007Z [2024-04-12 02:21:01,019: INFO/ForkPoolWorker-16] [0b5a18cd-2656-4a62-b215-5e28cff1815f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:21:01.020570396Z [2024-04-12 02:21:01,020: INFO/ForkPoolWorker-1] [971bc862-c8dc-43ae-b5f0-c19407521e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:21:01.250841479Z [2024-04-12 02:21:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:21:01.295294197Z [2024-04-12 02:21:01,292: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:21:01.299624703Z [2024-04-12 02:21:01,296: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:21:01.453096791Z [2024-04-12 02:21:01,452: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:21:01.458767415Z [2024-04-12 02:21:01,458: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:21:01.498879398Z [2024-04-12 02:21:01,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:21:01.500125444Z [2024-04-12 02:21:01,499: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:21:01.500442055Z [2024-04-12 02:21:01,500: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:21:01.500707727Z [2024-04-12 02:21:01,500: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:21:01.501151800Z [2024-04-12 02:21:01,500: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:21:01.636896485Z [2024-04-12 02:21:01,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:21:02.197830475Z [2024-04-12 02:21:02,196: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[971bc862-c8dc-43ae-b5f0-c19407521e66] succeeded in 1.180272691999562s: None 2024-04-12T02:21:02.315648671Z [2024-04-12 02:21:02,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:21:02.317104456Z [2024-04-12 02:21:02,316: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:21:02.336892306Z [2024-04-12 02:21:02,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:21:02.338300649Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:21:02.338319651Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:21:02.338420661Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:21:02.338450805Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:21:02.338656069Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:21:02.338673037Z [2024-04-12 02:21:02,338: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:21:02.410649429Z [2024-04-12 02:21:02,410: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:21:02.430422404Z [2024-04-12 02:21:02,430: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:21:02.433356138Z [2024-04-12 02:21:02,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:21:02.447808679Z [2024-04-12 02:21:02,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:21:02.448851034Z [2024-04-12 02:21:02,448: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:21:02.448995561Z [2024-04-12 02:21:02,448: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:21:02.449192985Z [2024-04-12 02:21:02,449: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:21:02.449266847Z [2024-04-12 02:21:02,449: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:21:02.449509434Z [2024-04-12 02:21:02,449: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:21:02.449641860Z [2024-04-12 02:21:02,449: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:21:02.519822931Z [2024-04-12 02:21:02,519: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:21:04.075720486Z [2024-04-12 02:21:04,074: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b5a18cd-2656-4a62-b215-5e28cff1815f] succeeded in 3.059274371000356s: None 2024-04-12T02:21:04.861572064Z [2024-04-12 02:21:04,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33573a87-5db6-4d07-abd7-3e51fe81a32d] succeeded in 3.8525155529987387s: None 2024-04-12T02:22:01.024033662Z [2024-04-12 02:22:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28497e58-aaf3-49eb-891e-d7e0363c7df0] received 2024-04-12T02:22:01.029553968Z [2024-04-12 02:22:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b74c941-6edd-43bb-a3bd-19e0023c4184] received 2024-04-12T02:22:01.036183930Z [2024-04-12 02:22:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[127f3921-cc58-4ae1-afa7-ca16a409749e] received 2024-04-12T02:22:01.041029712Z [2024-04-12 02:22:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[365117f9-9be0-49f1-97d6-c29ebec5090b] received 2024-04-12T02:22:01.046258069Z [2024-04-12 02:22:01,046: INFO/ForkPoolWorker-1] [127f3921-cc58-4ae1-afa7-ca16a409749e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:22:01.050941783Z [2024-04-12 02:22:01,050: INFO/ForkPoolWorker-2] [365117f9-9be0-49f1-97d6-c29ebec5090b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:22:01.055271172Z [2024-04-12 02:22:01,055: INFO/ForkPoolWorker-15] [28497e58-aaf3-49eb-891e-d7e0363c7df0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:22:01.058272300Z [2024-04-12 02:22:01,058: INFO/ForkPoolWorker-16] [8b74c941-6edd-43bb-a3bd-19e0023c4184] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:22:01.313680527Z [2024-04-12 02:22:01,310: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:22:01.338789953Z [2024-04-12 02:22:01,336: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:22:01.350747835Z [2024-04-12 02:22:01,347: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:22:01.354578633Z [2024-04-12 02:22:01,351: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:22:01.473292650Z [2024-04-12 02:22:01,472: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:22:01.478264522Z [2024-04-12 02:22:01,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:22:01.506924492Z [2024-04-12 02:22:01,506: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:22:01.510818206Z [2024-04-12 02:22:01,510: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:22:01.510942636Z [2024-04-12 02:22:01,510: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:22:01.511022042Z [2024-04-12 02:22:01,510: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:22:01.511363890Z [2024-04-12 02:22:01,511: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:22:01.588004917Z [2024-04-12 02:22:01,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:22:01.623172290Z [2024-04-12 02:22:01,622: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:22:02.106392696Z [2024-04-12 02:22:02,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28497e58-aaf3-49eb-891e-d7e0363c7df0] succeeded in 1.0687147690005077s: None 2024-04-12T02:22:02.283018336Z [2024-04-12 02:22:02,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[127f3921-cc58-4ae1-afa7-ca16a409749e] succeeded in 1.2447654190000321s: None 2024-04-12T02:22:02.485488946Z [2024-04-12 02:22:02,485: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:22:02.488667841Z [2024-04-12 02:22:02,488: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:22:02.510386761Z [2024-04-12 02:22:02,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:22:02.511688957Z [2024-04-12 02:22:02,511: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:22:02.511751855Z [2024-04-12 02:22:02,511: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:22:02.512004989Z [2024-04-12 02:22:02,511: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:22:02.512142740Z [2024-04-12 02:22:02,511: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:22:02.512503783Z [2024-04-12 02:22:02,512: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:22:02.512684068Z [2024-04-12 02:22:02,512: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:22:02.544138790Z [2024-04-12 02:22:02,543: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:22:02.546738450Z [2024-04-12 02:22:02,546: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:22:02.568752362Z [2024-04-12 02:22:02,568: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:22:02.570378814Z [2024-04-12 02:22:02,570: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:22:02.570462738Z [2024-04-12 02:22:02,570: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:22:02.570680931Z [2024-04-12 02:22:02,570: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:22:02.570815865Z [2024-04-12 02:22:02,570: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:22:02.571228219Z [2024-04-12 02:22:02,571: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:22:02.571346811Z [2024-04-12 02:22:02,571: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:22:02.591770929Z [2024-04-12 02:22:02,591: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:22:02.638009338Z [2024-04-12 02:22:02,637: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:22:04.151587707Z [2024-04-12 02:22:04,151: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[365117f9-9be0-49f1-97d6-c29ebec5090b] succeeded in 3.1090343300002132s: None 2024-04-12T02:22:04.404695733Z [2024-04-12 02:22:04,404: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b74c941-6edd-43bb-a3bd-19e0023c4184] succeeded in 3.3719214140000986s: None 2024-04-12T02:23:00.866999889Z [2024-04-12 02:23:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43c2b3f2-10d3-4a6c-b2db-2ff3a175b072] received 2024-04-12T02:23:00.869972362Z [2024-04-12 02:23:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0af9c0ac-46ba-4fd0-95a1-e9d86e440252] received 2024-04-12T02:23:00.876063090Z [2024-04-12 02:23:00,875: INFO/ForkPoolWorker-15] [43c2b3f2-10d3-4a6c-b2db-2ff3a175b072] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:23:00.888233933Z [2024-04-12 02:23:00,888: INFO/ForkPoolWorker-16] [0af9c0ac-46ba-4fd0-95a1-e9d86e440252] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:23:00.902459765Z [2024-04-12 02:23:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51ee8829-4984-4552-8f03-5f7691b35ff1] received 2024-04-12T02:23:00.915953831Z [2024-04-12 02:23:00,915: INFO/ForkPoolWorker-1] [51ee8829-4984-4552-8f03-5f7691b35ff1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:23:01.267338062Z [2024-04-12 02:23:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:23:01.323751079Z [2024-04-12 02:23:01,320: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:23:01.352755121Z [2024-04-12 02:23:01,348: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:23:01.462749768Z [2024-04-12 02:23:01,462: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:23:01.466386425Z [2024-04-12 02:23:01,465: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:23:01.494448074Z [2024-04-12 02:23:01,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:23:01.495359381Z [2024-04-12 02:23:01,495: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:23:01.495411093Z [2024-04-12 02:23:01,495: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:23:01.495462304Z [2024-04-12 02:23:01,495: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:23:01.495631399Z [2024-04-12 02:23:01,495: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:23:01.587063196Z [2024-04-12 02:23:01,586: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:23:02.179711307Z [2024-04-12 02:23:02,179: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43c2b3f2-10d3-4a6c-b2db-2ff3a175b072] succeeded in 1.3086920240002655s: None 2024-04-12T02:23:02.392985781Z [2024-04-12 02:23:02,392: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:23:02.395696204Z [2024-04-12 02:23:02,395: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:23:02.429276027Z [2024-04-12 02:23:02,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:23:02.430473043Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:23:02.430524714Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:23:02.430646205Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:23:02.430685547Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:23:02.430923534Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:23:02.430941554Z [2024-04-12 02:23:02,430: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:23:02.464673925Z [2024-04-12 02:23:02,464: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:23:02.467836387Z [2024-04-12 02:23:02,467: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:23:02.497140681Z [2024-04-12 02:23:02,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:23:02.498856315Z [2024-04-12 02:23:02,498: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:23:02.499140266Z [2024-04-12 02:23:02,498: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:23:02.499437285Z [2024-04-12 02:23:02,499: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:23:02.499653936Z [2024-04-12 02:23:02,499: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:23:02.500151268Z [2024-04-12 02:23:02,499: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:23:02.500512005Z [2024-04-12 02:23:02,500: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:23:02.509697750Z [2024-04-12 02:23:02,509: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:23:02.564677553Z [2024-04-12 02:23:02,564: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:23:03.974981887Z [2024-04-12 02:23:03,974: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0af9c0ac-46ba-4fd0-95a1-e9d86e440252] succeeded in 3.0978777989985247s: None 2024-04-12T02:23:04.553028153Z [2024-04-12 02:23:04,552: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51ee8829-4984-4552-8f03-5f7691b35ff1] succeeded in 3.642562375000125s: None 2024-04-12T02:24:00.427817191Z [2024-04-12 02:24:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8411bd7c-ff8e-4ec3-beb2-139017e87894] received 2024-04-12T02:24:00.429418517Z [2024-04-12 02:24:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b492ad17-f5ef-4754-8d03-e0d6380bea16] received 2024-04-12T02:24:00.439653189Z [2024-04-12 02:24:00,439: INFO/ForkPoolWorker-15] [8411bd7c-ff8e-4ec3-beb2-139017e87894] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:24:00.440320784Z [2024-04-12 02:24:00,440: INFO/ForkPoolWorker-16] [b492ad17-f5ef-4754-8d03-e0d6380bea16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:24:00.446531193Z [2024-04-12 02:24:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b32a006-91e6-4285-9629-159fc4b2f25a] received 2024-04-12T02:24:00.449325458Z [2024-04-12 02:24:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3decb328-1fa5-4255-bcbc-5e3e79c1464a] received 2024-04-12T02:24:00.452822278Z [2024-04-12 02:24:00,452: INFO/ForkPoolWorker-1] [0b32a006-91e6-4285-9629-159fc4b2f25a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:24:00.466206169Z [2024-04-12 02:24:00,465: INFO/ForkPoolWorker-2] [3decb328-1fa5-4255-bcbc-5e3e79c1464a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:24:00.712280921Z [2024-04-12 02:24:00,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:24:00.714762627Z [2024-04-12 02:24:00,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:24:00.811024448Z [2024-04-12 02:24:00,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:24:00.872872677Z [2024-04-12 02:24:00,870: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:24:00.920007206Z [2024-04-12 02:24:00,919: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:24:01.021661491Z [2024-04-12 02:24:01,021: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:24:01.025297805Z [2024-04-12 02:24:01,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:24:01.080258806Z [2024-04-12 02:24:01,080: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:24:01.084867526Z [2024-04-12 02:24:01,084: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:24:01.084880500Z [2024-04-12 02:24:01,084: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:24:01.084884074Z [2024-04-12 02:24:01,084: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:24:01.084887140Z [2024-04-12 02:24:01,084: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:24:01.192074205Z [2024-04-12 02:24:01,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:24:01.414062906Z [2024-04-12 02:24:01,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8411bd7c-ff8e-4ec3-beb2-139017e87894] succeeded in 0.9829414890009502s: None 2024-04-12T02:24:01.676996093Z [2024-04-12 02:24:01,676: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b32a006-91e6-4285-9629-159fc4b2f25a] succeeded in 1.2287515129992244s: None 2024-04-12T02:24:01.926523849Z [2024-04-12 02:24:01,926: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:24:01.929962407Z [2024-04-12 02:24:01,929: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:24:01.955003684Z [2024-04-12 02:24:01,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:24:01.956308025Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:24:01.956323396Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:24:01.956529777Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:24:01.956562798Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:24:01.956825369Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:24:01.957151624Z [2024-04-12 02:24:01,956: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:24:01.964516633Z [2024-04-12 02:24:01,963: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:24:01.967453192Z [2024-04-12 02:24:01,967: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:24:01.987052618Z [2024-04-12 02:24:01,986: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:24:01.988209118Z [2024-04-12 02:24:01,987: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:24:01.988219759Z [2024-04-12 02:24:01,988: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:24:01.988523975Z [2024-04-12 02:24:01,988: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:24:01.988534649Z [2024-04-12 02:24:01,988: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:24:01.988951885Z [2024-04-12 02:24:01,988: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:24:01.988960190Z [2024-04-12 02:24:01,988: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:24:02.056497976Z [2024-04-12 02:24:02,056: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:24:02.057247243Z [2024-04-12 02:24:02,057: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:24:03.574990391Z [2024-04-12 02:24:03,574: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3decb328-1fa5-4255-bcbc-5e3e79c1464a] succeeded in 3.123570302999724s: None 2024-04-12T02:24:03.912744049Z [2024-04-12 02:24:03,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b492ad17-f5ef-4754-8d03-e0d6380bea16] succeeded in 3.479854600998806s: None 2024-04-12T02:25:00.248221737Z [2024-04-12 02:25:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1ca6abc-e0dd-4fef-9d61-28b49d22f133] received 2024-04-12T02:25:00.249811020Z [2024-04-12 02:25:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be1f3eec-3f99-4b8a-ba6d-7102a989d24e] received 2024-04-12T02:25:00.256183977Z [2024-04-12 02:25:00,255: INFO/ForkPoolWorker-15] [f1ca6abc-e0dd-4fef-9d61-28b49d22f133] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:25:00.256548483Z [2024-04-12 02:25:00,256: INFO/ForkPoolWorker-16] [be1f3eec-3f99-4b8a-ba6d-7102a989d24e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:25:00.265143015Z [2024-04-12 02:25:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c943aa6-cd6e-47c5-8bb4-d51d75aff768] received 2024-04-12T02:25:00.268903629Z [2024-04-12 02:25:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b611e9d-e6d2-4216-ba8c-9d0328f52c97] received 2024-04-12T02:25:00.275836649Z [2024-04-12 02:25:00,275: INFO/ForkPoolWorker-2] [2b611e9d-e6d2-4216-ba8c-9d0328f52c97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:25:00.278317024Z [2024-04-12 02:25:00,278: INFO/ForkPoolWorker-1] [0c943aa6-cd6e-47c5-8bb4-d51d75aff768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:00.515573045Z [2024-04-12 02:25:00,512: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:25:00.562980982Z [2024-04-12 02:25:00,559: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:25:00.621575895Z [2024-04-12 02:25:00,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:25:00.630457047Z [2024-04-12 02:25:00,627: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:25:00.768848438Z [2024-04-12 02:25:00,768: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:25:00.772711210Z [2024-04-12 02:25:00,772: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:00.794702471Z [2024-04-12 02:25:00,794: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:25:00.798518550Z [2024-04-12 02:25:00,798: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:25:00.798645284Z [2024-04-12 02:25:00,798: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:25:00.798761585Z [2024-04-12 02:25:00,798: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:25:00.799205894Z [2024-04-12 02:25:00,798: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:25:00.876152382Z [2024-04-12 02:25:00,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:01.565208466Z [2024-04-12 02:25:01,564: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be1f3eec-3f99-4b8a-ba6d-7102a989d24e] succeeded in 1.313971372999731s: None 2024-04-12T02:25:01.699556329Z [2024-04-12 02:25:01,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:25:01.702862420Z [2024-04-12 02:25:01,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:01.737819229Z [2024-04-12 02:25:01,737: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:25:01.739860874Z [2024-04-12 02:25:01,739: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:01.739996842Z [2024-04-12 02:25:01,739: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:01.740193033Z [2024-04-12 02:25:01,739: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:01.740323145Z [2024-04-12 02:25:01,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:25:01.740866005Z [2024-04-12 02:25:01,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:25:01.741080120Z [2024-04-12 02:25:01,740: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:01.752723380Z [2024-04-12 02:25:01,752: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:25:01.755519085Z [2024-04-12 02:25:01,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:01.771814432Z [2024-04-12 02:25:01,771: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:25:01.773027304Z [2024-04-12 02:25:01,772: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:01.773179479Z [2024-04-12 02:25:01,773: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:01.773385569Z [2024-04-12 02:25:01,773: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:01.773510066Z [2024-04-12 02:25:01,773: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:25:01.773789156Z [2024-04-12 02:25:01,773: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:25:01.773967304Z [2024-04-12 02:25:01,773: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:01.821268152Z [2024-04-12 02:25:01,821: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:01.871233263Z [2024-04-12 02:25:01,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:01.910276005Z [2024-04-12 02:25:01,909: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:25:01.913496805Z [2024-04-12 02:25:01,913: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:01.941712133Z [2024-04-12 02:25:01,941: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:25:01.943225762Z [2024-04-12 02:25:01,942: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:01.943376232Z [2024-04-12 02:25:01,943: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:01.943528758Z [2024-04-12 02:25:01,943: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:01.943580019Z [2024-04-12 02:25:01,943: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:25:01.943907695Z [2024-04-12 02:25:01,943: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:25:01.944023542Z [2024-04-12 02:25:01,943: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:02.037975772Z [2024-04-12 02:25:02,037: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:02.462365919Z [2024-04-12 02:25:02,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c943aa6-cd6e-47c5-8bb4-d51d75aff768] succeeded in 2.1935783459994127s: None 2024-04-12T02:25:03.052478873Z [2024-04-12 02:25:03,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e3cca7e-ba5a-44be-abe0-4e6a35884f4b] received 2024-04-12T02:25:03.060811662Z [2024-04-12 02:25:03,060: INFO/ForkPoolWorker-16] [7e3cca7e-ba5a-44be-abe0-4e6a35884f4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:03.258730305Z [2024-04-12 02:25:03,258: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1ca6abc-e0dd-4fef-9d61-28b49d22f133] succeeded in 3.0084800620006718s: None 2024-04-12T02:25:03.355678285Z [2024-04-12 02:25:03,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:25:03.832539896Z [2024-04-12 02:25:03,832: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b611e9d-e6d2-4216-ba8c-9d0328f52c97] succeeded in 3.562216796000939s: None 2024-04-12T02:25:04.462904463Z [2024-04-12 02:25:04,462: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:25:04.466028342Z [2024-04-12 02:25:04,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:04.491602533Z [2024-04-12 02:25:04,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:25:04.493128727Z [2024-04-12 02:25:04,492: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:04.493302880Z [2024-04-12 02:25:04,493: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:04.493531966Z [2024-04-12 02:25:04,493: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:04.493718276Z [2024-04-12 02:25:04,493: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:25:04.494065271Z [2024-04-12 02:25:04,493: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:25:04.494196404Z [2024-04-12 02:25:04,494: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:04.597699473Z [2024-04-12 02:25:04,597: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:05.154511342Z [2024-04-12 02:25:05,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e3cca7e-ba5a-44be-abe0-4e6a35884f4b] succeeded in 2.099874520999947s: None 2024-04-12T02:25:05.439610400Z [2024-04-12 02:25:05,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2687e7c0-7612-4d3c-95ff-902d10a74190] received 2024-04-12T02:25:05.455158225Z [2024-04-12 02:25:05,454: INFO/ForkPoolWorker-15] [2687e7c0-7612-4d3c-95ff-902d10a74190] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:25:05.736092502Z [2024-04-12 02:25:05,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:25:06.746569070Z [2024-04-12 02:25:06,746: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:25:06.749409114Z [2024-04-12 02:25:06,749: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:06.769217235Z [2024-04-12 02:25:06,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:25:06.770138520Z [2024-04-12 02:25:06,769: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:06.770149413Z [2024-04-12 02:25:06,770: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:06.770300091Z [2024-04-12 02:25:06,770: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:06.770306676Z [2024-04-12 02:25:06,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:25:06.770487880Z [2024-04-12 02:25:06,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:25:06.770497410Z [2024-04-12 02:25:06,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:06.854246721Z [2024-04-12 02:25:06,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:08.192726597Z [2024-04-12 02:25:08,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa344c62-a20f-4ad1-9d17-e4eae5fc4bf8] received 2024-04-12T02:25:08.207001419Z [2024-04-12 02:25:08,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2687e7c0-7612-4d3c-95ff-902d10a74190] succeeded in 2.762421720999555s: None 2024-04-12T02:25:08.212405159Z [2024-04-12 02:25:08,212: INFO/ForkPoolWorker-16] [fa344c62-a20f-4ad1-9d17-e4eae5fc4bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:08.468951781Z [2024-04-12 02:25:08,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:25:09.401611607Z [2024-04-12 02:25:09,401: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:25:09.404560401Z [2024-04-12 02:25:09,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:25:09.429398959Z [2024-04-12 02:25:09,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:25:09.430866607Z [2024-04-12 02:25:09,430: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:25:09.431028341Z [2024-04-12 02:25:09,430: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:25:09.431217741Z [2024-04-12 02:25:09,431: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:25:09.431298661Z [2024-04-12 02:25:09,431: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:25:09.431603693Z [2024-04-12 02:25:09,431: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:25:09.431748423Z [2024-04-12 02:25:09,431: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:25:09.508482816Z [2024-04-12 02:25:09,508: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:25:10.140702248Z [2024-04-12 02:25:10,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa344c62-a20f-4ad1-9d17-e4eae5fc4bf8] succeeded in 1.9445193150004343s: None 2024-04-12T02:26:00.246569657Z [2024-04-12 02:26:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c4089a2-c8af-4ad1-afd4-6ee0bd0b5ebe] received 2024-04-12T02:26:00.247885081Z [2024-04-12 02:26:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b39da6f-d392-48bf-9c6e-ab4519fd5baf] received 2024-04-12T02:26:00.254197011Z [2024-04-12 02:26:00,253: INFO/ForkPoolWorker-16] [3b39da6f-d392-48bf-9c6e-ab4519fd5baf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:26:00.255953676Z [2024-04-12 02:26:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18f6c790-28bd-42a3-b038-e11bb618f777] received 2024-04-12T02:26:00.259214695Z [2024-04-12 02:26:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3112b428-1323-42b0-8512-46c91b552494] received 2024-04-12T02:26:00.262607734Z [2024-04-12 02:26:00,262: INFO/ForkPoolWorker-1] [18f6c790-28bd-42a3-b038-e11bb618f777] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:26:00.263566319Z [2024-04-12 02:26:00,263: INFO/ForkPoolWorker-15] [0c4089a2-c8af-4ad1-afd4-6ee0bd0b5ebe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:26:00.271041452Z [2024-04-12 02:26:00,270: INFO/ForkPoolWorker-2] [3112b428-1323-42b0-8512-46c91b552494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:26:00.527779250Z [2024-04-12 02:26:00,525: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:26:00.623779415Z [2024-04-12 02:26:00,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:26:00.652112439Z [2024-04-12 02:26:00,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:26:00.673034346Z [2024-04-12 02:26:00,670: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:26:00.720987714Z [2024-04-12 02:26:00,720: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:26:00.724410487Z [2024-04-12 02:26:00,724: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:26:00.781148892Z [2024-04-12 02:26:00,780: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:26:00.785018647Z [2024-04-12 02:26:00,784: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:26:00.785099330Z [2024-04-12 02:26:00,784: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:26:00.785106841Z [2024-04-12 02:26:00,785: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:26:00.785252457Z [2024-04-12 02:26:00,785: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:26:00.827427267Z [2024-04-12 02:26:00,827: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:26:00.931051637Z [2024-04-12 02:26:00,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:26:01.282377436Z [2024-04-12 02:26:01,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c4089a2-c8af-4ad1-afd4-6ee0bd0b5ebe] succeeded in 1.0327052990014636s: None 2024-04-12T02:26:01.456754280Z [2024-04-12 02:26:01,456: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18f6c790-28bd-42a3-b038-e11bb618f777] succeeded in 1.1997029129997827s: None 2024-04-12T02:26:01.696511455Z [2024-04-12 02:26:01,693: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:26:01.700075894Z [2024-04-12 02:26:01,698: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:26:01.711451426Z [2024-04-12 02:26:01,711: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:26:01.714907871Z [2024-04-12 02:26:01,714: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:26:01.722410311Z [2024-04-12 02:26:01,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:26:01.723405687Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:26:01.723439896Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:26:01.723537685Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:26:01.723566654Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:26:01.723788138Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:26:01.723828789Z [2024-04-12 02:26:01,723: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:26:01.732942047Z [2024-04-12 02:26:01,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:26:01.733802542Z [2024-04-12 02:26:01,733: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:26:01.733840737Z [2024-04-12 02:26:01,733: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:26:01.733926631Z [2024-04-12 02:26:01,733: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:26:01.733959668Z [2024-04-12 02:26:01,733: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:26:01.734101668Z [2024-04-12 02:26:01,734: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:26:01.734134608Z [2024-04-12 02:26:01,734: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:26:01.803420639Z [2024-04-12 02:26:01,803: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:26:01.811816777Z [2024-04-12 02:26:01,811: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:26:03.280419166Z [2024-04-12 02:26:03,279: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3112b428-1323-42b0-8512-46c91b552494] succeeded in 3.0192554160003056s: None 2024-04-12T02:26:03.697580915Z [2024-04-12 02:26:03,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b39da6f-d392-48bf-9c6e-ab4519fd5baf] succeeded in 3.4482038200003444s: None 2024-04-12T02:26:28.804019798Z [2024-04-12 02:26:28,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c0adfc0-7a98-4b91-a6b0-d659af591312] received 2024-04-12T02:26:28.815792645Z [2024-04-12 02:26:28,815: INFO/ForkPoolWorker-15] [7c0adfc0-7a98-4b91-a6b0-d659af591312] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240412022627_177073', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-12T02:26:29.119455878Z [2024-04-12 02:26:29,114: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-12T02:26:29.330062103Z [2024-04-12 02:26:29,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:26:29.944037712Z [2024-04-12 02:26:29,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c0adfc0-7a98-4b91-a6b0-d659af591312] succeeded in 1.137682924998444s: None 2024-04-12T02:27:01.165388991Z [2024-04-12 02:27:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e7e679-1679-4668-ae3e-e32b69d99fea] received 2024-04-12T02:27:01.171600905Z [2024-04-12 02:27:01,171: INFO/ForkPoolWorker-15] [d3e7e679-1679-4668-ae3e-e32b69d99fea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:27:01.178622660Z [2024-04-12 02:27:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b4642c0-b862-47a0-b618-61fc0db0017f] received 2024-04-12T02:27:01.183323364Z [2024-04-12 02:27:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41e99bfa-9889-4e93-8f79-fb4aeb6f4928] received 2024-04-12T02:27:01.193847252Z [2024-04-12 02:27:01,193: INFO/ForkPoolWorker-16] [6b4642c0-b862-47a0-b618-61fc0db0017f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:27:01.196948542Z [2024-04-12 02:27:01,196: INFO/ForkPoolWorker-1] [41e99bfa-9889-4e93-8f79-fb4aeb6f4928] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:27:01.475647641Z [2024-04-12 02:27:01,472: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:27:01.500604366Z [2024-04-12 02:27:01,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:27:01.509127296Z [2024-04-12 02:27:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:27:01.665714026Z [2024-04-12 02:27:01,664: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:27:01.669677464Z [2024-04-12 02:27:01,669: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:27:01.737680844Z [2024-04-12 02:27:01,736: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:27:01.744632187Z [2024-04-12 02:27:01,742: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:27:01.744645085Z [2024-04-12 02:27:01,742: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:27:01.744667947Z [2024-04-12 02:27:01,742: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:27:01.744674070Z [2024-04-12 02:27:01,742: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:27:01.828752847Z [2024-04-12 02:27:01,828: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:27:02.388543841Z [2024-04-12 02:27:02,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b4642c0-b862-47a0-b618-61fc0db0017f] succeeded in 1.207724400999723s: None 2024-04-12T02:27:02.513527565Z [2024-04-12 02:27:02,513: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:27:02.516217566Z [2024-04-12 02:27:02,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:27:02.538758968Z [2024-04-12 02:27:02,538: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:27:02.540130750Z [2024-04-12 02:27:02,539: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:27:02.540302099Z [2024-04-12 02:27:02,539: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:27:02.540363531Z [2024-04-12 02:27:02,540: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:27:02.540424548Z [2024-04-12 02:27:02,540: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:27:02.540609150Z [2024-04-12 02:27:02,540: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:27:02.540616553Z [2024-04-12 02:27:02,540: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:27:02.580986298Z [2024-04-12 02:27:02,580: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:27:02.583899073Z [2024-04-12 02:27:02,583: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:27:02.600940657Z [2024-04-12 02:27:02,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:27:02.602003460Z [2024-04-12 02:27:02,601: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:27:02.602018654Z [2024-04-12 02:27:02,601: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:27:02.602098475Z [2024-04-12 02:27:02,601: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:27:02.602110707Z [2024-04-12 02:27:02,602: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:27:02.602300184Z [2024-04-12 02:27:02,602: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:27:02.602313281Z [2024-04-12 02:27:02,602: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:27:02.619262502Z [2024-04-12 02:27:02,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:27:02.662680082Z [2024-04-12 02:27:02,662: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:27:04.413881155Z [2024-04-12 02:27:04,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41e99bfa-9889-4e93-8f79-fb4aeb6f4928] succeeded in 3.228602172999672s: None 2024-04-12T02:27:05.118920816Z [2024-04-12 02:27:05,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3e7e679-1679-4668-ae3e-e32b69d99fea] succeeded in 3.951606239001194s: None 2024-04-12T02:28:00.644294445Z [2024-04-12 02:28:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffb64ed9-69ec-47e4-8668-644ffa6cb624] received 2024-04-12T02:28:00.646080834Z [2024-04-12 02:28:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddc5bf23-9c4c-4b28-9200-538bf7b2e059] received 2024-04-12T02:28:00.656494158Z [2024-04-12 02:28:00,656: INFO/ForkPoolWorker-15] [ffb64ed9-69ec-47e4-8668-644ffa6cb624] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:28:00.664621591Z [2024-04-12 02:28:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[328ce4e5-09ae-4484-bf27-782c058e3e25] received 2024-04-12T02:28:00.666794016Z [2024-04-12 02:28:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b50fb98-ef88-41d1-9206-8f30e99f4023] received 2024-04-12T02:28:00.681699477Z [2024-04-12 02:28:00,681: INFO/ForkPoolWorker-16] [ddc5bf23-9c4c-4b28-9200-538bf7b2e059] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:28:00.683482101Z [2024-04-12 02:28:00,682: INFO/ForkPoolWorker-1] [328ce4e5-09ae-4484-bf27-782c058e3e25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:28:00.684468604Z [2024-04-12 02:28:00,683: INFO/ForkPoolWorker-2] [7b50fb98-ef88-41d1-9206-8f30e99f4023] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:28:00.955558290Z [2024-04-12 02:28:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:28:00.982724031Z [2024-04-12 02:28:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:28:01.185941552Z [2024-04-12 02:28:01,185: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:28:01.190496275Z [2024-04-12 02:28:01,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:28:01.206444834Z [2024-04-12 02:28:01,200: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:28:01.214924687Z [2024-04-12 02:28:01,214: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:28:01.215844347Z [2024-04-12 02:28:01,215: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:28:01.215976235Z [2024-04-12 02:28:01,215: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:28:01.216023389Z [2024-04-12 02:28:01,215: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:28:01.216218304Z [2024-04-12 02:28:01,216: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:28:01.216356217Z [2024-04-12 02:28:01,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:28:01.220251302Z [2024-04-12 02:28:01,214: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:28:01.303994136Z [2024-04-12 02:28:01,303: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:28:01.833707116Z [2024-04-12 02:28:01,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffb64ed9-69ec-47e4-8668-644ffa6cb624] succeeded in 1.1847924409994448s: None 2024-04-12T02:28:01.943596952Z [2024-04-12 02:28:01,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[328ce4e5-09ae-4484-bf27-782c058e3e25] succeeded in 1.2750205060001463s: None 2024-04-12T02:28:02.309838647Z [2024-04-12 02:28:02,309: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:28:02.312650555Z [2024-04-12 02:28:02,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:28:02.336093576Z [2024-04-12 02:28:02,335: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:28:02.337284706Z [2024-04-12 02:28:02,337: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:28:02.337338871Z [2024-04-12 02:28:02,337: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:28:02.337469302Z [2024-04-12 02:28:02,337: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:28:02.337521437Z [2024-04-12 02:28:02,337: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:28:02.338060178Z [2024-04-12 02:28:02,337: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:28:02.338109043Z [2024-04-12 02:28:02,338: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:28:02.424755405Z [2024-04-12 02:28:02,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:28:02.617063511Z [2024-04-12 02:28:02,616: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:28:02.620591819Z [2024-04-12 02:28:02,620: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:28:02.651222862Z [2024-04-12 02:28:02,647: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:28:02.653293580Z [2024-04-12 02:28:02,653: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:28:02.653414917Z [2024-04-12 02:28:02,653: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:28:02.653643054Z [2024-04-12 02:28:02,653: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:28:02.653725862Z [2024-04-12 02:28:02,653: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:28:02.654034527Z [2024-04-12 02:28:02,653: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:28:02.654391476Z [2024-04-12 02:28:02,654: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:28:02.758578853Z [2024-04-12 02:28:02,758: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:28:04.287778936Z [2024-04-12 02:28:04,287: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7b50fb98-ef88-41d1-9206-8f30e99f4023] succeeded in 3.6176490759989974s: None 2024-04-12T02:28:04.344150795Z [2024-04-12 02:28:04,343: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ddc5bf23-9c4c-4b28-9200-538bf7b2e059] succeeded in 3.692924294999102s: None 2024-04-12T02:29:00.980977658Z [2024-04-12 02:29:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df26600b-78f0-46c2-880e-718e53be799b] received 2024-04-12T02:29:00.982471555Z [2024-04-12 02:29:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ad1fa1-8c03-4763-8c6f-fcb7cf294fe3] received 2024-04-12T02:29:00.983838066Z [2024-04-12 02:29:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edad14e2-9a7e-4e7a-a780-a502e7754b4c] received 2024-04-12T02:29:00.992566311Z [2024-04-12 02:29:00,992: INFO/ForkPoolWorker-1] [edad14e2-9a7e-4e7a-a780-a502e7754b4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:29:00.993057044Z [2024-04-12 02:29:00,992: INFO/ForkPoolWorker-15] [df26600b-78f0-46c2-880e-718e53be799b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:29:00.994027776Z [2024-04-12 02:29:00,993: INFO/ForkPoolWorker-16] [c6ad1fa1-8c03-4763-8c6f-fcb7cf294fe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:29:01.276073181Z [2024-04-12 02:29:01,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:29:01.295463867Z [2024-04-12 02:29:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:29:01.311560756Z [2024-04-12 02:29:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:29:01.462905914Z [2024-04-12 02:29:01,462: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:29:01.466767242Z [2024-04-12 02:29:01,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:29:01.507261543Z [2024-04-12 02:29:01,507: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:29:01.508318103Z [2024-04-12 02:29:01,508: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:29:01.508502764Z [2024-04-12 02:29:01,508: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:29:01.508596566Z [2024-04-12 02:29:01,508: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:29:01.508883721Z [2024-04-12 02:29:01,508: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:29:01.585919802Z [2024-04-12 02:29:01,585: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:29:02.095885711Z [2024-04-12 02:29:02,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edad14e2-9a7e-4e7a-a780-a502e7754b4c] succeeded in 1.1097274089988787s: None 2024-04-12T02:29:02.336199976Z [2024-04-12 02:29:02,335: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:29:02.338764444Z [2024-04-12 02:29:02,338: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:29:02.374541007Z [2024-04-12 02:29:02,374: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:29:02.375955401Z [2024-04-12 02:29:02,375: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:29:02.376053298Z [2024-04-12 02:29:02,375: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:29:02.376081628Z [2024-04-12 02:29:02,375: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:29:02.376099260Z [2024-04-12 02:29:02,376: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:29:02.376359438Z [2024-04-12 02:29:02,376: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:29:02.376367311Z [2024-04-12 02:29:02,376: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:29:02.460422291Z [2024-04-12 02:29:02,460: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:29:02.463202352Z [2024-04-12 02:29:02,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:29:02.465950121Z [2024-04-12 02:29:02,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:29:02.490664628Z [2024-04-12 02:29:02,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:29:02.491966366Z [2024-04-12 02:29:02,491: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:29:02.492293650Z [2024-04-12 02:29:02,491: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:29:02.492627604Z [2024-04-12 02:29:02,492: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:29:02.496365655Z [2024-04-12 02:29:02,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:29:02.499641709Z [2024-04-12 02:29:02,499: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:29:02.499826878Z [2024-04-12 02:29:02,499: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:29:02.584952937Z [2024-04-12 02:29:02,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:29:04.405124672Z [2024-04-12 02:29:04,404: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6ad1fa1-8c03-4763-8c6f-fcb7cf294fe3] succeeded in 3.4186933979999594s: None 2024-04-12T02:29:05.210331399Z [2024-04-12 02:29:05,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df26600b-78f0-46c2-880e-718e53be799b] succeeded in 4.226546867999787s: None 2024-04-12T02:30:00.452232233Z [2024-04-12 02:30:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c31211a-8065-45a0-8c3b-1c1919c0d7c6] received 2024-04-12T02:30:00.453858346Z [2024-04-12 02:30:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a18c449-ce2c-4b8b-bca5-6136637c2e56] received 2024-04-12T02:30:00.456057639Z [2024-04-12 02:30:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b0e4cb9-b9a1-4b96-a024-01ebe83940b7] received 2024-04-12T02:30:00.462893305Z [2024-04-12 02:30:00,462: INFO/ForkPoolWorker-1] [7b0e4cb9-b9a1-4b96-a024-01ebe83940b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:30:00.463883264Z [2024-04-12 02:30:00,463: INFO/ForkPoolWorker-16] [3a18c449-ce2c-4b8b-bca5-6136637c2e56] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:30:00.470789757Z [2024-04-12 02:30:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbceac3d-64d1-45d1-b72e-927dad09e795] received 2024-04-12T02:30:00.470842204Z [2024-04-12 02:30:00,470: INFO/ForkPoolWorker-15] [6c31211a-8065-45a0-8c3b-1c1919c0d7c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:00.471846637Z [2024-04-12 02:30:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d13e98f-3f3c-4a23-96ca-2a7300916ef5] received 2024-04-12T02:30:00.477782056Z [2024-04-12 02:30:00,477: INFO/ForkPoolWorker-2] [cbceac3d-64d1-45d1-b72e-927dad09e795] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:30:00.482273768Z [2024-04-12 02:30:00,481: INFO/ForkPoolWorker-3] [7d13e98f-3f3c-4a23-96ca-2a7300916ef5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:30:00.814991345Z [2024-04-12 02:30:00,806: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:30:00.826083600Z [2024-04-12 02:30:00,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:30:00.830738069Z [2024-04-12 02:30:00,826: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:30:00.845909278Z [2024-04-12 02:30:00,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:30:00.909410640Z [2024-04-12 02:30:00,904: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:30:00.975592634Z [2024-04-12 02:30:00,974: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-12T02:30:00.979406097Z [2024-04-12 02:30:00,978: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:01.062400595Z [2024-04-12 02:30:01,062: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-12T02:30:01.072187113Z [2024-04-12 02:30:01,071: INFO/ForkPoolWorker-3] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:30:01.072384061Z [2024-04-12 02:30:01,072: INFO/ForkPoolWorker-3] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:30:01.072544967Z [2024-04-12 02:30:01,072: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-12T02:30:01.072849257Z [2024-04-12 02:30:01,072: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:30:01.087158315Z [2024-04-12 02:30:01,086: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:01.285250792Z [2024-04-12 02:30:01,285: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:01.866555189Z [2024-04-12 02:30:01,866: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a18c449-ce2c-4b8b-bca5-6136637c2e56] succeeded in 1.409383660999083s: None 2024-04-12T02:30:02.029462425Z [2024-04-12 02:30:02,027: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7d13e98f-3f3c-4a23-96ca-2a7300916ef5] succeeded in 1.5542385460012156s: None 2024-04-12T02:30:02.226946221Z [2024-04-12 02:30:02,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:30:02.229864651Z [2024-04-12 02:30:02,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:02.257523865Z [2024-04-12 02:30:02,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:30:02.262021891Z [2024-04-12 02:30:02,261: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:02.262294797Z [2024-04-12 02:30:02,262: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:02.262596036Z [2024-04-12 02:30:02,262: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:02.262831501Z [2024-04-12 02:30:02,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:30:02.263368319Z [2024-04-12 02:30:02,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:30:02.263572276Z [2024-04-12 02:30:02,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:02.293631416Z [2024-04-12 02:30:02,293: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:30:02.296828502Z [2024-04-12 02:30:02,296: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:02.318276853Z [2024-04-12 02:30:02,318: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:30:02.323284120Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:02.323332006Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:02.323476211Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:02.323535331Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:30:02.323780862Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:30:02.323837414Z [2024-04-12 02:30:02,323: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:02.338816766Z [2024-04-12 02:30:02,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:02.356645536Z [2024-04-12 02:30:02,356: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:30:02.359482973Z [2024-04-12 02:30:02,359: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:02.379018006Z [2024-04-12 02:30:02,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:30:02.380070876Z [2024-04-12 02:30:02,379: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:02.380110525Z [2024-04-12 02:30:02,379: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:02.380213760Z [2024-04-12 02:30:02,380: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:02.380258404Z [2024-04-12 02:30:02,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:30:02.380537351Z [2024-04-12 02:30:02,380: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:30:02.380922352Z [2024-04-12 02:30:02,380: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:02.414986680Z [2024-04-12 02:30:02,414: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:02.455589105Z [2024-04-12 02:30:02,455: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:02.903571485Z [2024-04-12 02:30:02,903: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c31211a-8065-45a0-8c3b-1c1919c0d7c6] succeeded in 2.449171195999952s: None 2024-04-12T02:30:03.044496977Z [2024-04-12 02:30:03,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75744a9c-5dd0-4939-912c-55a877ba23c5] received 2024-04-12T02:30:03.051839384Z [2024-04-12 02:30:03,051: INFO/ForkPoolWorker-15] [75744a9c-5dd0-4939-912c-55a877ba23c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:03.347472908Z [2024-04-12 02:30:03,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:30:03.903722387Z [2024-04-12 02:30:03,903: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cbceac3d-64d1-45d1-b72e-927dad09e795] succeeded in 3.4317751130001852s: None 2024-04-12T02:30:04.254601677Z [2024-04-12 02:30:04,254: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b0e4cb9-b9a1-4b96-a024-01ebe83940b7] succeeded in 3.797227926999767s: None 2024-04-12T02:30:04.441027222Z [2024-04-12 02:30:04,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:30:04.444187298Z [2024-04-12 02:30:04,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:04.464712814Z [2024-04-12 02:30:04,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:30:04.466382984Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:04.466475017Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:04.466649725Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:04.466757628Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:30:04.466990517Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:30:04.467153370Z [2024-04-12 02:30:04,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:04.564235077Z [2024-04-12 02:30:04,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:05.293795589Z [2024-04-12 02:30:05,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75744a9c-5dd0-4939-912c-55a877ba23c5] succeeded in 2.245563766999112s: None 2024-04-12T02:30:05.488522639Z [2024-04-12 02:30:05,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a1a63fb-8d43-4446-aff7-aa42aef31734] received 2024-04-12T02:30:05.496492299Z [2024-04-12 02:30:05,496: INFO/ForkPoolWorker-15] [2a1a63fb-8d43-4446-aff7-aa42aef31734] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:30:05.806328865Z [2024-04-12 02:30:05,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:30:06.887304956Z [2024-04-12 02:30:06,886: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:30:06.890275880Z [2024-04-12 02:30:06,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:06.912807449Z [2024-04-12 02:30:06,912: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:30:06.914392376Z [2024-04-12 02:30:06,913: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:06.914423320Z [2024-04-12 02:30:06,914: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:06.914437865Z [2024-04-12 02:30:06,914: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:06.914448399Z [2024-04-12 02:30:06,914: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:30:06.914904984Z [2024-04-12 02:30:06,914: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:30:06.914917188Z [2024-04-12 02:30:06,914: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:07.030693494Z [2024-04-12 02:30:07,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:07.681468176Z [2024-04-12 02:30:07,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a1a63fb-8d43-4446-aff7-aa42aef31734] succeeded in 2.1752808250003s: None 2024-04-12T02:30:07.920578638Z [2024-04-12 02:30:07,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6919e2c3-aff4-4044-9df7-ec1a2accb78b] received 2024-04-12T02:30:07.930896769Z [2024-04-12 02:30:07,929: INFO/ForkPoolWorker-15] [6919e2c3-aff4-4044-9df7-ec1a2accb78b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:08.288172275Z [2024-04-12 02:30:08,285: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:30:09.321097677Z [2024-04-12 02:30:09,320: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:30:09.324044649Z [2024-04-12 02:30:09,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:30:09.351799606Z [2024-04-12 02:30:09,351: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:30:09.353535005Z [2024-04-12 02:30:09,353: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:30:09.353632730Z [2024-04-12 02:30:09,353: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:30:09.353793338Z [2024-04-12 02:30:09,353: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:30:09.353851734Z [2024-04-12 02:30:09,353: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:30:09.354516846Z [2024-04-12 02:30:09,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:30:09.354657029Z [2024-04-12 02:30:09,354: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:30:09.460001672Z [2024-04-12 02:30:09,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:10.112355915Z [2024-04-12 02:30:10,111: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6919e2c3-aff4-4044-9df7-ec1a2accb78b] succeeded in 2.1895873630001006s: None 2024-04-12T02:30:28.541739151Z [2024-04-12 02:30:28,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70fb9af5-b420-471c-859d-415759912b29] received 2024-04-12T02:30:28.548131396Z [2024-04-12 02:30:28,547: INFO/ForkPoolWorker-15] [70fb9af5-b420-471c-859d-415759912b29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240412023027_069258', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-12T02:30:28.825506904Z [2024-04-12 02:30:28,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-12T02:30:29.105559875Z [2024-04-12 02:30:29,105: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:30:29.669718505Z [2024-04-12 02:30:29,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70fb9af5-b420-471c-859d-415759912b29] succeeded in 1.1261881400005223s: None 2024-04-12T02:31:00.921150565Z [2024-04-12 02:31:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fed0c76-a2eb-4c34-8ba2-1aafff2637f3] received 2024-04-12T02:31:00.926408505Z [2024-04-12 02:31:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2617a8b-75d5-4d59-a911-64c4ff54d524] received 2024-04-12T02:31:00.928972406Z [2024-04-12 02:31:00,928: INFO/ForkPoolWorker-15] [8fed0c76-a2eb-4c34-8ba2-1aafff2637f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:31:00.929726932Z [2024-04-12 02:31:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1f67560-1275-43b0-a78e-eb0f64fef029] received 2024-04-12T02:31:00.938492105Z [2024-04-12 02:31:00,938: INFO/ForkPoolWorker-1] [c1f67560-1275-43b0-a78e-eb0f64fef029] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:31:00.940180367Z [2024-04-12 02:31:00,939: INFO/ForkPoolWorker-16] [c2617a8b-75d5-4d59-a911-64c4ff54d524] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:31:01.175031118Z [2024-04-12 02:31:01,172: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:31:01.190118810Z [2024-04-12 02:31:01,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:31:01.195306782Z [2024-04-12 02:31:01,192: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:31:01.346034040Z [2024-04-12 02:31:01,345: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:31:01.349745454Z [2024-04-12 02:31:01,349: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:31:01.372134739Z [2024-04-12 02:31:01,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:31:01.373289753Z [2024-04-12 02:31:01,373: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:31:01.373525783Z [2024-04-12 02:31:01,373: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:31:01.373611124Z [2024-04-12 02:31:01,373: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:31:01.373792532Z [2024-04-12 02:31:01,373: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:31:01.480440517Z [2024-04-12 02:31:01,480: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:31:02.057222466Z [2024-04-12 02:31:02,056: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1f67560-1275-43b0-a78e-eb0f64fef029] succeeded in 1.1249856609993003s: None 2024-04-12T02:31:02.179939927Z [2024-04-12 02:31:02,179: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:31:02.182880561Z [2024-04-12 02:31:02,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:31:02.212764322Z [2024-04-12 02:31:02,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:31:02.215236288Z [2024-04-12 02:31:02,214: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:31:02.215649949Z [2024-04-12 02:31:02,215: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:31:02.216079254Z [2024-04-12 02:31:02,215: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:31:02.216479231Z [2024-04-12 02:31:02,216: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:31:02.217250154Z [2024-04-12 02:31:02,216: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:31:02.217583808Z [2024-04-12 02:31:02,217: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:31:02.240884799Z [2024-04-12 02:31:02,240: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:31:02.243565793Z [2024-04-12 02:31:02,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:31:02.259691815Z [2024-04-12 02:31:02,259: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:31:02.260709369Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:31:02.260803915Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:31:02.260827280Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:31:02.260892196Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:31:02.261462571Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:31:02.261475797Z [2024-04-12 02:31:02,260: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:31:02.322882408Z [2024-04-12 02:31:02,322: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:31:02.327269147Z [2024-04-12 02:31:02,327: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:31:04.335986162Z [2024-04-12 02:31:04,335: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2617a8b-75d5-4d59-a911-64c4ff54d524] succeeded in 3.4063881339989166s: None 2024-04-12T02:31:04.971376236Z [2024-04-12 02:31:04,970: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fed0c76-a2eb-4c34-8ba2-1aafff2637f3] succeeded in 4.048028667999461s: None 2024-04-12T02:32:00.277167469Z [2024-04-12 02:32:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2e3c608-b224-409b-9ce3-fae40cbba8e2] received 2024-04-12T02:32:00.283658438Z [2024-04-12 02:32:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dd3974d-5f2b-44ce-9c1a-d054c3034ae1] received 2024-04-12T02:32:00.288731600Z [2024-04-12 02:32:00,288: INFO/ForkPoolWorker-15] [a2e3c608-b224-409b-9ce3-fae40cbba8e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:32:00.289513793Z [2024-04-12 02:32:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13d8ff7d-ad99-40a3-bbdc-93ac4c62b806] received 2024-04-12T02:32:00.293911995Z [2024-04-12 02:32:00,293: INFO/ForkPoolWorker-16] [9dd3974d-5f2b-44ce-9c1a-d054c3034ae1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:32:00.296804475Z [2024-04-12 02:32:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4207f91-c532-4d76-98c4-4e0a73c32bac] received 2024-04-12T02:32:00.310290391Z [2024-04-12 02:32:00,309: INFO/ForkPoolWorker-1] [13d8ff7d-ad99-40a3-bbdc-93ac4c62b806] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:32:00.333267155Z [2024-04-12 02:32:00,332: INFO/ForkPoolWorker-2] [e4207f91-c532-4d76-98c4-4e0a73c32bac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:32:00.573583419Z [2024-04-12 02:32:00,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:32:00.683683229Z [2024-04-12 02:32:00,678: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:32:00.800357387Z [2024-04-12 02:32:00,797: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:32:01.137089639Z [2024-04-12 02:32:01,136: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:32:01.146024129Z [2024-04-12 02:32:01,145: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:32:01.168237797Z [2024-04-12 02:32:01,165: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:32:01.182884657Z [2024-04-12 02:32:01,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:32:01.184465380Z [2024-04-12 02:32:01,184: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:32:01.184598670Z [2024-04-12 02:32:01,184: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:32:01.184712370Z [2024-04-12 02:32:01,184: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:32:01.184924286Z [2024-04-12 02:32:01,184: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:32:01.305984665Z [2024-04-12 02:32:01,305: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:32:01.606248501Z [2024-04-12 02:32:01,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:32:02.053528768Z [2024-04-12 02:32:02,053: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4207f91-c532-4d76-98c4-4e0a73c32bac] succeeded in 1.7546684360004292s: None 2024-04-12T02:32:02.168896741Z [2024-04-12 02:32:02,168: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:32:02.171728866Z [2024-04-12 02:32:02,171: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:32:02.253641661Z [2024-04-12 02:32:02,253: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:32:02.257854597Z [2024-04-12 02:32:02,257: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:32:02.258127865Z [2024-04-12 02:32:02,257: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:32:02.258633584Z [2024-04-12 02:32:02,258: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:32:02.258949407Z [2024-04-12 02:32:02,258: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:32:02.260129843Z [2024-04-12 02:32:02,259: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:32:02.260290307Z [2024-04-12 02:32:02,260: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:32:02.324441376Z [2024-04-12 02:32:02,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2e3c608-b224-409b-9ce3-fae40cbba8e2] succeeded in 2.0450017130006017s: None 2024-04-12T02:32:02.346858882Z [2024-04-12 02:32:02,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:32:02.364636341Z [2024-04-12 02:32:02,364: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:32:02.367276247Z [2024-04-12 02:32:02,366: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:32:02.390031321Z [2024-04-12 02:32:02,389: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:32:02.390978945Z [2024-04-12 02:32:02,390: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:32:02.390994325Z [2024-04-12 02:32:02,390: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:32:02.391181373Z [2024-04-12 02:32:02,390: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:32:02.391230816Z [2024-04-12 02:32:02,391: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:32:02.391456203Z [2024-04-12 02:32:02,391: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:32:02.391509899Z [2024-04-12 02:32:02,391: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:32:02.456491104Z [2024-04-12 02:32:02,456: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:32:04.423626196Z [2024-04-12 02:32:04,422: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13d8ff7d-ad99-40a3-bbdc-93ac4c62b806] succeeded in 4.131972780000069s: None 2024-04-12T02:32:04.943714870Z [2024-04-12 02:32:04,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dd3974d-5f2b-44ce-9c1a-d054c3034ae1] succeeded in 4.65775837900037s: None 2024-04-12T02:33:00.417519115Z [2024-04-12 02:33:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe3982e0-278a-4abf-8aad-d125916d5bcb] received 2024-04-12T02:33:00.419730754Z [2024-04-12 02:33:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f59c8c68-93e0-4d6e-92d4-c78dd52f2295] received 2024-04-12T02:33:00.422268323Z [2024-04-12 02:33:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f859da21-ee50-4be5-86a1-ec96e08aff1e] received 2024-04-12T02:33:00.427870077Z [2024-04-12 02:33:00,427: INFO/ForkPoolWorker-15] [fe3982e0-278a-4abf-8aad-d125916d5bcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:33:00.432194161Z [2024-04-12 02:33:00,431: INFO/ForkPoolWorker-16] [f59c8c68-93e0-4d6e-92d4-c78dd52f2295] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:33:00.433725750Z [2024-04-12 02:33:00,433: INFO/ForkPoolWorker-1] [f859da21-ee50-4be5-86a1-ec96e08aff1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:33:00.719251318Z [2024-04-12 02:33:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:33:00.740291426Z [2024-04-12 02:33:00,736: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:33:00.751211984Z [2024-04-12 02:33:00,748: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:33:00.875843039Z [2024-04-12 02:33:00,875: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:33:00.879654391Z [2024-04-12 02:33:00,879: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:33:00.917379136Z [2024-04-12 02:33:00,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:33:00.921117208Z [2024-04-12 02:33:00,920: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:33:00.921345448Z [2024-04-12 02:33:00,921: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:33:00.921523520Z [2024-04-12 02:33:00,921: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:33:00.921783632Z [2024-04-12 02:33:00,921: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:33:01.022239960Z [2024-04-12 02:33:01,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:33:01.639421927Z [2024-04-12 02:33:01,638: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f859da21-ee50-4be5-86a1-ec96e08aff1e] succeeded in 1.2140730699993583s: None 2024-04-12T02:33:01.716169044Z [2024-04-12 02:33:01,715: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:33:01.718911661Z [2024-04-12 02:33:01,718: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:33:01.751032092Z [2024-04-12 02:33:01,750: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:33:01.752809029Z [2024-04-12 02:33:01,752: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:33:01.752868877Z [2024-04-12 02:33:01,752: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:33:01.753017773Z [2024-04-12 02:33:01,752: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:33:01.753097840Z [2024-04-12 02:33:01,752: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:33:01.753370653Z [2024-04-12 02:33:01,753: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:33:01.753449779Z [2024-04-12 02:33:01,753: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:33:01.774831952Z [2024-04-12 02:33:01,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:33:01.777584017Z [2024-04-12 02:33:01,777: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:33:01.812087663Z [2024-04-12 02:33:01,811: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:33:01.813334473Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:33:01.813361239Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:33:01.813461706Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:33:01.813531051Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:33:01.813944049Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:33:01.813962242Z [2024-04-12 02:33:01,813: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:33:01.832694893Z [2024-04-12 02:33:01,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:33:01.895315024Z [2024-04-12 02:33:01,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:33:03.321879671Z [2024-04-12 02:33:03,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe3982e0-278a-4abf-8aad-d125916d5bcb] succeeded in 2.9011794890011515s: None 2024-04-12T02:33:03.799125834Z [2024-04-12 02:33:03,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f59c8c68-93e0-4d6e-92d4-c78dd52f2295] succeeded in 3.3769159490002494s: None 2024-04-12T02:34:00.785904845Z [2024-04-12 02:34:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[132a80d2-e143-4fcd-8224-29aad4739e03] received 2024-04-12T02:34:00.788774983Z [2024-04-12 02:34:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f996642e-a124-42dc-89c6-3426583a6bdd] received 2024-04-12T02:34:00.790127227Z [2024-04-12 02:34:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[582e161a-c5bb-4e49-98e0-96a5cd308c57] received 2024-04-12T02:34:00.791928891Z [2024-04-12 02:34:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1b468bd-e7a5-4366-922e-2ab14ed71335] received 2024-04-12T02:34:00.798101596Z [2024-04-12 02:34:00,797: INFO/ForkPoolWorker-16] [f996642e-a124-42dc-89c6-3426583a6bdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:34:00.798980040Z [2024-04-12 02:34:00,798: INFO/ForkPoolWorker-15] [132a80d2-e143-4fcd-8224-29aad4739e03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:34:00.801832499Z [2024-04-12 02:34:00,801: INFO/ForkPoolWorker-2] [b1b468bd-e7a5-4366-922e-2ab14ed71335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:34:00.807102587Z [2024-04-12 02:34:00,806: INFO/ForkPoolWorker-1] [582e161a-c5bb-4e49-98e0-96a5cd308c57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:34:01.074492271Z [2024-04-12 02:34:01,071: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:34:01.080911326Z [2024-04-12 02:34:01,077: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:34:01.117263517Z [2024-04-12 02:34:01,114: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:34:01.127378541Z [2024-04-12 02:34:01,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:34:01.355974588Z [2024-04-12 02:34:01,355: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:34:01.359776126Z [2024-04-12 02:34:01,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:34:01.397344771Z [2024-04-12 02:34:01,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:34:01.399548415Z [2024-04-12 02:34:01,399: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:34:01.399599697Z [2024-04-12 02:34:01,399: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:34:01.399655024Z [2024-04-12 02:34:01,399: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:34:01.399805587Z [2024-04-12 02:34:01,399: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:34:01.509710056Z [2024-04-12 02:34:01,509: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:34:01.532397261Z [2024-04-12 02:34:01,531: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:34:02.080852164Z [2024-04-12 02:34:02,080: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[582e161a-c5bb-4e49-98e0-96a5cd308c57] succeeded in 1.2853918159999012s: None 2024-04-12T02:34:02.196110599Z [2024-04-12 02:34:02,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f996642e-a124-42dc-89c6-3426583a6bdd] succeeded in 1.405946632999985s: None 2024-04-12T02:34:02.344432189Z [2024-04-12 02:34:02,344: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:34:02.346987100Z [2024-04-12 02:34:02,346: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:34:02.372448282Z [2024-04-12 02:34:02,372: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:34:02.373595235Z [2024-04-12 02:34:02,373: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:34:02.373701543Z [2024-04-12 02:34:02,373: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:34:02.373930314Z [2024-04-12 02:34:02,373: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:34:02.373938332Z [2024-04-12 02:34:02,373: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:34:02.374431280Z [2024-04-12 02:34:02,374: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:34:02.374441878Z [2024-04-12 02:34:02,374: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:34:02.378045542Z [2024-04-12 02:34:02,377: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:34:02.380949426Z [2024-04-12 02:34:02,380: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:34:02.407351529Z [2024-04-12 02:34:02,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:34:02.408909643Z [2024-04-12 02:34:02,408: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:34:02.409116487Z [2024-04-12 02:34:02,408: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:34:02.409361345Z [2024-04-12 02:34:02,409: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:34:02.409555606Z [2024-04-12 02:34:02,409: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:34:02.410946509Z [2024-04-12 02:34:02,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:34:02.411433051Z [2024-04-12 02:34:02,410: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:34:02.459359239Z [2024-04-12 02:34:02,458: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:34:02.505988188Z [2024-04-12 02:34:02,504: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:34:04.249139355Z [2024-04-12 02:34:04,248: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[132a80d2-e143-4fcd-8224-29aad4739e03] succeeded in 3.457591334999961s: None 2024-04-12T02:34:04.503644066Z [2024-04-12 02:34:04,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b1b468bd-e7a5-4366-922e-2ab14ed71335] succeeded in 3.7099260209997738s: None 2024-04-12T02:35:00.725248233Z [2024-04-12 02:35:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ead1af9a-f28c-4a93-b813-29d589c6d952] received 2024-04-12T02:35:00.728271516Z [2024-04-12 02:35:00,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc7f0fa3-0653-454a-8f6a-830b0cd6253c] received 2024-04-12T02:35:00.732085288Z [2024-04-12 02:35:00,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52490d49-937a-4f44-8357-9e0126c8c375] received 2024-04-12T02:35:00.733507331Z [2024-04-12 02:35:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4317fda2-cb22-4bd2-b950-87ac0d89a5a9] received 2024-04-12T02:35:00.739055690Z [2024-04-12 02:35:00,738: INFO/ForkPoolWorker-16] [fc7f0fa3-0653-454a-8f6a-830b0cd6253c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:35:00.743281203Z [2024-04-12 02:35:00,740: INFO/ForkPoolWorker-1] [52490d49-937a-4f44-8357-9e0126c8c375] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:35:00.746173462Z [2024-04-12 02:35:00,745: INFO/ForkPoolWorker-15] [ead1af9a-f28c-4a93-b813-29d589c6d952] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:00.747059191Z [2024-04-12 02:35:00,746: INFO/ForkPoolWorker-2] [4317fda2-cb22-4bd2-b950-87ac0d89a5a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:35:01.034573930Z [2024-04-12 02:35:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:35:01.034985189Z [2024-04-12 02:35:01,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:35:01.080340968Z [2024-04-12 02:35:01,077: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:35:01.082374740Z [2024-04-12 02:35:01,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:35:01.198024578Z [2024-04-12 02:35:01,197: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:35:01.202275962Z [2024-04-12 02:35:01,201: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:01.234423054Z [2024-04-12 02:35:01,233: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:35:01.240302712Z [2024-04-12 02:35:01,240: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:35:01.240516945Z [2024-04-12 02:35:01,240: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:35:01.240640343Z [2024-04-12 02:35:01,240: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:35:01.240902947Z [2024-04-12 02:35:01,240: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:35:01.341775462Z [2024-04-12 02:35:01,341: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:01.846564834Z [2024-04-12 02:35:01,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52490d49-937a-4f44-8357-9e0126c8c375] succeeded in 1.1132188860010501s: None 2024-04-12T02:35:02.120199195Z [2024-04-12 02:35:02,119: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:35:02.123476037Z [2024-04-12 02:35:02,123: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:02.154628612Z [2024-04-12 02:35:02,154: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:35:02.166634116Z [2024-04-12 02:35:02,166: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:02.166782222Z [2024-04-12 02:35:02,166: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:02.168844345Z [2024-04-12 02:35:02,168: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:02.169045791Z [2024-04-12 02:35:02,168: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:35:02.170240389Z [2024-04-12 02:35:02,170: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:35:02.170336989Z [2024-04-12 02:35:02,170: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:02.181814623Z [2024-04-12 02:35:02,181: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:35:02.184935510Z [2024-04-12 02:35:02,184: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:02.217280503Z [2024-04-12 02:35:02,216: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:35:02.221583573Z [2024-04-12 02:35:02,221: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:02.221973579Z [2024-04-12 02:35:02,221: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:02.222506863Z [2024-04-12 02:35:02,222: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:02.222921547Z [2024-04-12 02:35:02,222: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:35:02.223460744Z [2024-04-12 02:35:02,223: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:35:02.223787131Z [2024-04-12 02:35:02,223: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:02.255720702Z [2024-04-12 02:35:02,255: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:02.275916181Z [2024-04-12 02:35:02,275: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:35:02.283615598Z [2024-04-12 02:35:02,283: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:02.303891830Z [2024-04-12 02:35:02,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:35:02.304922801Z [2024-04-12 02:35:02,304: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:02.304990534Z [2024-04-12 02:35:02,304: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:02.305120411Z [2024-04-12 02:35:02,304: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:02.305186426Z [2024-04-12 02:35:02,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:35:02.305399590Z [2024-04-12 02:35:02,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:35:02.305477417Z [2024-04-12 02:35:02,305: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:02.306812632Z [2024-04-12 02:35:02,306: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:02.403978068Z [2024-04-12 02:35:02,403: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:02.972348570Z [2024-04-12 02:35:02,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ead1af9a-f28c-4a93-b813-29d589c6d952] succeeded in 2.2417289710010664s: None 2024-04-12T02:35:03.274227922Z [2024-04-12 02:35:03,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ac2dcf8-0de5-4fc6-9696-c0878c9396d4] received 2024-04-12T02:35:03.295755446Z [2024-04-12 02:35:03,295: INFO/ForkPoolWorker-15] [9ac2dcf8-0de5-4fc6-9696-c0878c9396d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:03.529795570Z [2024-04-12 02:35:03,526: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:35:03.888915868Z [2024-04-12 02:35:03,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4317fda2-cb22-4bd2-b950-87ac0d89a5a9] succeeded in 3.1525176760005706s: None 2024-04-12T02:35:04.129637371Z [2024-04-12 02:35:04,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc7f0fa3-0653-454a-8f6a-830b0cd6253c] succeeded in 3.397849323000628s: None 2024-04-12T02:35:04.565668936Z [2024-04-12 02:35:04,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:35:04.568471548Z [2024-04-12 02:35:04,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:04.586243142Z [2024-04-12 02:35:04,586: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:35:04.587336697Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:04.587358899Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:04.587469696Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:04.587552517Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:35:04.587786542Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:35:04.587801782Z [2024-04-12 02:35:04,587: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:04.674516291Z [2024-04-12 02:35:04,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:05.353124456Z [2024-04-12 02:35:05,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ac2dcf8-0de5-4fc6-9696-c0878c9396d4] succeeded in 2.0762405559999024s: None 2024-04-12T02:35:05.690270181Z [2024-04-12 02:35:05,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef847a25-5c35-4295-8c2d-ffc1a8770779] received 2024-04-12T02:35:05.701626325Z [2024-04-12 02:35:05,701: INFO/ForkPoolWorker-15] [ef847a25-5c35-4295-8c2d-ffc1a8770779] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:35:05.962473805Z [2024-04-12 02:35:05,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:35:06.948943398Z [2024-04-12 02:35:06,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:35:06.951586166Z [2024-04-12 02:35:06,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:06.968941626Z [2024-04-12 02:35:06,968: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:35:06.969952895Z [2024-04-12 02:35:06,969: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:06.970330453Z [2024-04-12 02:35:06,970: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:06.970443127Z [2024-04-12 02:35:06,970: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:06.970466591Z [2024-04-12 02:35:06,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:35:06.970719107Z [2024-04-12 02:35:06,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:35:06.971047158Z [2024-04-12 02:35:06,970: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:07.049129387Z [2024-04-12 02:35:07,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:07.630073419Z [2024-04-12 02:35:07,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef847a25-5c35-4295-8c2d-ffc1a8770779] succeeded in 1.9351451890015596s: None 2024-04-12T02:35:08.025241448Z [2024-04-12 02:35:08,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38a27222-0ac8-41ac-8847-f8c22ebc085b] received 2024-04-12T02:35:08.034222942Z [2024-04-12 02:35:08,033: INFO/ForkPoolWorker-15] [38a27222-0ac8-41ac-8847-f8c22ebc085b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:08.276029374Z [2024-04-12 02:35:08,273: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:35:09.183127107Z [2024-04-12 02:35:09,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:35:09.185723468Z [2024-04-12 02:35:09,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:35:09.201986908Z [2024-04-12 02:35:09,201: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:35:09.203067045Z [2024-04-12 02:35:09,202: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:35:09.203169211Z [2024-04-12 02:35:09,202: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:35:09.203176763Z [2024-04-12 02:35:09,203: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:35:09.203213126Z [2024-04-12 02:35:09,203: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:35:09.203470732Z [2024-04-12 02:35:09,203: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:35:09.203553310Z [2024-04-12 02:35:09,203: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:35:09.288713438Z [2024-04-12 02:35:09,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:35:09.898384405Z [2024-04-12 02:35:09,897: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38a27222-0ac8-41ac-8847-f8c22ebc085b] succeeded in 1.8698821199996019s: None 2024-04-12T02:36:00.538436953Z [2024-04-12 02:36:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bc8ba18-0824-449a-857b-f91f30e12391] received 2024-04-12T02:36:00.541723688Z [2024-04-12 02:36:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24181cdc-c96e-4949-984e-4d7390365070] received 2024-04-12T02:36:00.544697020Z [2024-04-12 02:36:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea8a37d2-ba27-4c51-adf7-12440fbf8bcb] received 2024-04-12T02:36:00.549185299Z [2024-04-12 02:36:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8208841-1108-4429-9131-bf0516020044] received 2024-04-12T02:36:00.555803296Z [2024-04-12 02:36:00,555: INFO/ForkPoolWorker-2] [a8208841-1108-4429-9131-bf0516020044] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:36:00.559315407Z [2024-04-12 02:36:00,558: INFO/ForkPoolWorker-16] [24181cdc-c96e-4949-984e-4d7390365070] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:36:00.564853693Z [2024-04-12 02:36:00,564: INFO/ForkPoolWorker-15] [3bc8ba18-0824-449a-857b-f91f30e12391] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:36:00.568939477Z [2024-04-12 02:36:00,568: INFO/ForkPoolWorker-1] [ea8a37d2-ba27-4c51-adf7-12440fbf8bcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:36:00.883740532Z [2024-04-12 02:36:00,880: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:36:00.900753657Z [2024-04-12 02:36:00,897: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:36:00.906561955Z [2024-04-12 02:36:00,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:36:00.945354504Z [2024-04-12 02:36:00,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:36:01.116826297Z [2024-04-12 02:36:01,116: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:36:01.121162711Z [2024-04-12 02:36:01,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:36:01.162919769Z [2024-04-12 02:36:01,162: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:36:01.169295360Z [2024-04-12 02:36:01,168: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:36:01.169605412Z [2024-04-12 02:36:01,169: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:36:01.169798684Z [2024-04-12 02:36:01,169: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:36:01.170087746Z [2024-04-12 02:36:01,169: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:36:01.174085274Z [2024-04-12 02:36:01,173: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:36:01.293684287Z [2024-04-12 02:36:01,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:36:01.626024360Z [2024-04-12 02:36:01,625: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea8a37d2-ba27-4c51-adf7-12440fbf8bcb] succeeded in 1.0793430590001662s: None 2024-04-12T02:36:01.931403150Z [2024-04-12 02:36:01,931: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bc8ba18-0824-449a-857b-f91f30e12391] succeeded in 1.3905574740001612s: None 2024-04-12T02:36:02.054410970Z [2024-04-12 02:36:02,053: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:36:02.057679595Z [2024-04-12 02:36:02,057: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:36:02.090168416Z [2024-04-12 02:36:02,089: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:36:02.092018654Z [2024-04-12 02:36:02,091: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:36:02.092104685Z [2024-04-12 02:36:02,091: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:36:02.092245043Z [2024-04-12 02:36:02,092: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:36:02.092305901Z [2024-04-12 02:36:02,092: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:36:02.092722423Z [2024-04-12 02:36:02,092: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:36:02.092837592Z [2024-04-12 02:36:02,092: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:36:02.157959212Z [2024-04-12 02:36:02,157: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:36:02.161886396Z [2024-04-12 02:36:02,161: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:36:02.182293428Z [2024-04-12 02:36:02,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:36:02.183994645Z [2024-04-12 02:36:02,183: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:36:02.184315736Z [2024-04-12 02:36:02,184: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:36:02.184593275Z [2024-04-12 02:36:02,184: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:36:02.184711512Z [2024-04-12 02:36:02,184: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:36:02.185656656Z [2024-04-12 02:36:02,184: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:36:02.185668700Z [2024-04-12 02:36:02,185: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:36:02.189950234Z [2024-04-12 02:36:02,189: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:36:02.271615303Z [2024-04-12 02:36:02,271: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:36:03.604595875Z [2024-04-12 02:36:03,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24181cdc-c96e-4949-984e-4d7390365070] succeeded in 3.0575478539994947s: None 2024-04-12T02:36:04.095035218Z [2024-04-12 02:36:04,094: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a8208841-1108-4429-9131-bf0516020044] succeeded in 3.5443565440000384s: None 2024-04-12T02:37:00.395553508Z [2024-04-12 02:37:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acd98385-32b8-4c1f-bfb2-d644e6ee00a3] received 2024-04-12T02:37:00.400465232Z [2024-04-12 02:37:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5487e39a-d0f0-436d-a4be-c48b6794aead] received 2024-04-12T02:37:00.410349384Z [2024-04-12 02:37:00,410: INFO/ForkPoolWorker-15] [acd98385-32b8-4c1f-bfb2-d644e6ee00a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:37:00.416790405Z [2024-04-12 02:37:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2723a620-a2f9-480e-af1f-27394899c18f] received 2024-04-12T02:37:00.419737960Z [2024-04-12 02:37:00,419: INFO/ForkPoolWorker-16] [5487e39a-d0f0-436d-a4be-c48b6794aead] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:37:00.427823470Z [2024-04-12 02:37:00,427: INFO/ForkPoolWorker-1] [2723a620-a2f9-480e-af1f-27394899c18f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:37:00.684019920Z [2024-04-12 02:37:00,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:37:00.720892275Z [2024-04-12 02:37:00,718: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:37:00.731349849Z [2024-04-12 02:37:00,728: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:37:00.857725339Z [2024-04-12 02:37:00,857: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:37:00.861250702Z [2024-04-12 02:37:00,860: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:37:00.900658146Z [2024-04-12 02:37:00,900: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:37:00.902235314Z [2024-04-12 02:37:00,902: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:37:00.902442630Z [2024-04-12 02:37:00,902: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:37:00.902983617Z [2024-04-12 02:37:00,902: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:37:00.903839274Z [2024-04-12 02:37:00,903: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:37:01.031200364Z [2024-04-12 02:37:01,030: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:37:01.618744098Z [2024-04-12 02:37:01,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5487e39a-d0f0-436d-a4be-c48b6794aead] succeeded in 1.2171071829998255s: None 2024-04-12T02:37:01.791773513Z [2024-04-12 02:37:01,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:37:01.794764295Z [2024-04-12 02:37:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:37:01.811034332Z [2024-04-12 02:37:01,810: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:37:01.812161449Z [2024-04-12 02:37:01,811: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:37:01.812235152Z [2024-04-12 02:37:01,812: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:37:01.812418270Z [2024-04-12 02:37:01,812: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:37:01.812464633Z [2024-04-12 02:37:01,812: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:37:01.812695339Z [2024-04-12 02:37:01,812: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:37:01.812738154Z [2024-04-12 02:37:01,812: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:37:01.885224601Z [2024-04-12 02:37:01,884: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:37:01.967761681Z [2024-04-12 02:37:01,967: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:37:01.971039771Z [2024-04-12 02:37:01,970: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:37:01.998629086Z [2024-04-12 02:37:01,998: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:37:01.999713997Z [2024-04-12 02:37:01,999: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:37:01.999737038Z [2024-04-12 02:37:01,999: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:37:01.999936880Z [2024-04-12 02:37:01,999: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:37:01.999951700Z [2024-04-12 02:37:01,999: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:37:02.000214951Z [2024-04-12 02:37:02,000: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:37:02.000231840Z [2024-04-12 02:37:02,000: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:37:02.087127231Z [2024-04-12 02:37:02,086: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:37:03.559886268Z [2024-04-12 02:37:03,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2723a620-a2f9-480e-af1f-27394899c18f] succeeded in 3.140134497998588s: None 2024-04-12T02:37:03.899481269Z [2024-04-12 02:37:03,898: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acd98385-32b8-4c1f-bfb2-d644e6ee00a3] succeeded in 3.5002488330010237s: None 2024-04-12T02:38:00.510639658Z [2024-04-12 02:38:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f18b519-bd21-4c81-8d00-b04866dd7778] received 2024-04-12T02:38:00.513838614Z [2024-04-12 02:38:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f530ee-650c-4b25-a997-e085c0218abd] received 2024-04-12T02:38:00.515309398Z [2024-04-12 02:38:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97af9ed8-4888-4278-b1cb-a7d097316925] received 2024-04-12T02:38:00.518968771Z [2024-04-12 02:38:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[068ef413-6bf3-48aa-8144-f177545e03da] received 2024-04-12T02:38:00.521321948Z [2024-04-12 02:38:00,521: INFO/ForkPoolWorker-1] [97af9ed8-4888-4278-b1cb-a7d097316925] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:38:00.527648057Z [2024-04-12 02:38:00,527: INFO/ForkPoolWorker-15] [2f18b519-bd21-4c81-8d00-b04866dd7778] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:38:00.542794356Z [2024-04-12 02:38:00,542: INFO/ForkPoolWorker-16] [d1f530ee-650c-4b25-a997-e085c0218abd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:38:00.543969902Z [2024-04-12 02:38:00,543: INFO/ForkPoolWorker-2] [068ef413-6bf3-48aa-8144-f177545e03da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:38:00.824499914Z [2024-04-12 02:38:00,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:38:00.879320425Z [2024-04-12 02:38:00,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:38:00.913371698Z [2024-04-12 02:38:00,909: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:38:00.933396499Z [2024-04-12 02:38:00,930: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:38:01.088953039Z [2024-04-12 02:38:01,088: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:38:01.092863290Z [2024-04-12 02:38:01,092: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:38:01.113208601Z [2024-04-12 02:38:01,113: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:38:01.114639250Z [2024-04-12 02:38:01,114: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:38:01.114818441Z [2024-04-12 02:38:01,114: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:38:01.114934565Z [2024-04-12 02:38:01,114: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:38:01.115227079Z [2024-04-12 02:38:01,115: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:38:01.167814114Z [2024-04-12 02:38:01,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:38:01.201970649Z [2024-04-12 02:38:01,201: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:38:01.763557587Z [2024-04-12 02:38:01,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f18b519-bd21-4c81-8d00-b04866dd7778] succeeded in 1.2510669870007405s: None 2024-04-12T02:38:01.806473494Z [2024-04-12 02:38:01,806: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[068ef413-6bf3-48aa-8144-f177545e03da] succeeded in 1.2827848350007116s: None 2024-04-12T02:38:02.142072527Z [2024-04-12 02:38:02,141: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:38:02.145185420Z [2024-04-12 02:38:02,144: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:38:02.168941471Z [2024-04-12 02:38:02,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:38:02.170405561Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:38:02.170443727Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:38:02.170570833Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:38:02.170634651Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:38:02.170891975Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:38:02.170904572Z [2024-04-12 02:38:02,170: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:38:02.249939476Z [2024-04-12 02:38:02,249: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:38:02.325285017Z [2024-04-12 02:38:02,324: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:38:02.328475111Z [2024-04-12 02:38:02,328: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:38:02.352439133Z [2024-04-12 02:38:02,352: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:38:02.357073043Z [2024-04-12 02:38:02,356: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:38:02.357102341Z [2024-04-12 02:38:02,356: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:38:02.357379554Z [2024-04-12 02:38:02,357: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:38:02.357623601Z [2024-04-12 02:38:02,357: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:38:02.358038934Z [2024-04-12 02:38:02,357: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:38:02.358216685Z [2024-04-12 02:38:02,358: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:38:02.460208851Z [2024-04-12 02:38:02,459: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:38:03.985064967Z [2024-04-12 02:38:03,984: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97af9ed8-4888-4278-b1cb-a7d097316925] succeeded in 3.4681939639995107s: None 2024-04-12T02:38:05.031399304Z [2024-04-12 02:38:05,030: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1f530ee-650c-4b25-a997-e085c0218abd] succeeded in 4.511111522999272s: None 2024-04-12T02:39:00.870818881Z [2024-04-12 02:39:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2a0c4f3-f605-43b4-9984-47d46fca5457] received 2024-04-12T02:39:00.875422528Z [2024-04-12 02:39:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ccaf9cc-b509-4afe-9673-1b745ed04c60] received 2024-04-12T02:39:00.881642058Z [2024-04-12 02:39:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3bf0174-ded3-4012-b682-aa4722f2d77e] received 2024-04-12T02:39:00.887754417Z [2024-04-12 02:39:00,887: INFO/ForkPoolWorker-16] [4ccaf9cc-b509-4afe-9673-1b745ed04c60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:39:00.888955252Z [2024-04-12 02:39:00,888: INFO/ForkPoolWorker-15] [e2a0c4f3-f605-43b4-9984-47d46fca5457] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:39:00.889680903Z [2024-04-12 02:39:00,889: INFO/ForkPoolWorker-1] [d3bf0174-ded3-4012-b682-aa4722f2d77e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:39:01.157127861Z [2024-04-12 02:39:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:39:01.160735464Z [2024-04-12 02:39:01,157: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:39:01.168528999Z [2024-04-12 02:39:01,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:39:01.318023801Z [2024-04-12 02:39:01,317: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:39:01.321824183Z [2024-04-12 02:39:01,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:39:01.347431797Z [2024-04-12 02:39:01,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:39:01.348621158Z [2024-04-12 02:39:01,348: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:39:01.348718371Z [2024-04-12 02:39:01,348: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:39:01.348778199Z [2024-04-12 02:39:01,348: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:39:01.349002387Z [2024-04-12 02:39:01,348: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:39:01.436719609Z [2024-04-12 02:39:01,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:39:01.985377504Z [2024-04-12 02:39:01,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2a0c4f3-f605-43b4-9984-47d46fca5457] succeeded in 1.1098217899998417s: None 2024-04-12T02:39:02.258867357Z [2024-04-12 02:39:02,258: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:39:02.262267233Z [2024-04-12 02:39:02,261: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:39:02.273070876Z [2024-04-12 02:39:02,272: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:39:02.277588122Z [2024-04-12 02:39:02,276: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:39:02.279647978Z [2024-04-12 02:39:02,279: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:39:02.280793462Z [2024-04-12 02:39:02,280: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:39:02.280851045Z [2024-04-12 02:39:02,280: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:39:02.280963428Z [2024-04-12 02:39:02,280: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:39:02.281110533Z [2024-04-12 02:39:02,280: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:39:02.281300857Z [2024-04-12 02:39:02,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:39:02.281315591Z [2024-04-12 02:39:02,281: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:39:02.299660093Z [2024-04-12 02:39:02,299: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:39:02.301038906Z [2024-04-12 02:39:02,300: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:39:02.301247731Z [2024-04-12 02:39:02,301: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:39:02.301438209Z [2024-04-12 02:39:02,301: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:39:02.301589404Z [2024-04-12 02:39:02,301: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:39:02.301890319Z [2024-04-12 02:39:02,301: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:39:02.302388820Z [2024-04-12 02:39:02,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:39:02.356543522Z [2024-04-12 02:39:02,356: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:39:02.376560096Z [2024-04-12 02:39:02,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:39:04.158899041Z [2024-04-12 02:39:04,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ccaf9cc-b509-4afe-9673-1b745ed04c60] succeeded in 3.2799877529996593s: None 2024-04-12T02:39:04.504328369Z [2024-04-12 02:39:04,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3bf0174-ded3-4012-b682-aa4722f2d77e] succeeded in 3.62124439299987s: None 2024-04-12T02:40:00.795640431Z [2024-04-12 02:40:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3ca25fb-66d5-4386-8939-d4c46b998392] received 2024-04-12T02:40:00.801612187Z [2024-04-12 02:40:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66af9f36-3dbe-4369-9680-c8433ffa82d7] received 2024-04-12T02:40:00.802116626Z [2024-04-12 02:40:00,801: INFO/ForkPoolWorker-15] [c3ca25fb-66d5-4386-8939-d4c46b998392] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:40:00.806245274Z [2024-04-12 02:40:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac38f26c-0f59-4602-b0b2-7c1422e13c29] received 2024-04-12T02:40:00.809772317Z [2024-04-12 02:40:00,809: INFO/ForkPoolWorker-16] [66af9f36-3dbe-4369-9680-c8433ffa82d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:40:00.813990624Z [2024-04-12 02:40:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4bb9643-27e2-4e5f-b570-d9197f8df839] received 2024-04-12T02:40:00.817487414Z [2024-04-12 02:40:00,817: INFO/ForkPoolWorker-1] [ac38f26c-0f59-4602-b0b2-7c1422e13c29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:40:00.822031580Z [2024-04-12 02:40:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff052869-3373-478b-97f6-924304e56209] received 2024-04-12T02:40:00.822768380Z [2024-04-12 02:40:00,822: INFO/ForkPoolWorker-2] [b4bb9643-27e2-4e5f-b570-d9197f8df839] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:00.841200976Z [2024-04-12 02:40:00,840: INFO/ForkPoolWorker-3] [ff052869-3373-478b-97f6-924304e56209] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:40:01.174723864Z [2024-04-12 02:40:01,171: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:40:01.177536347Z [2024-04-12 02:40:01,173: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:40:01.263159658Z [2024-04-12 02:40:01,258: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:40:01.336163060Z [2024-04-12 02:40:01,333: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:40:01.341261984Z [2024-04-12 02:40:01,340: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:01.369579231Z [2024-04-12 02:40:01,364: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:40:01.373381186Z [2024-04-12 02:40:01,373: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:40:01.378175430Z [2024-04-12 02:40:01,377: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:40:01.378206176Z [2024-04-12 02:40:01,377: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:40:01.378210353Z [2024-04-12 02:40:01,377: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:40:01.378213506Z [2024-04-12 02:40:01,377: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:40:01.436821040Z [2024-04-12 02:40:01,433: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:40:01.498520451Z [2024-04-12 02:40:01,498: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:01.782235853Z [2024-04-12 02:40:01,781: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:02.221475012Z [2024-04-12 02:40:02,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66af9f36-3dbe-4369-9680-c8433ffa82d7] succeeded in 1.4184113800001796s: None 2024-04-12T02:40:02.396502915Z [2024-04-12 02:40:02,396: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ff052869-3373-478b-97f6-924304e56209] succeeded in 1.5665281100009452s: None 2024-04-12T02:40:02.589426415Z [2024-04-12 02:40:02,589: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:40:02.592566410Z [2024-04-12 02:40:02,592: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:02.611966815Z [2024-04-12 02:40:02,611: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:40:02.613291074Z [2024-04-12 02:40:02,613: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:02.613409939Z [2024-04-12 02:40:02,613: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:02.613589334Z [2024-04-12 02:40:02,613: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:02.613707035Z [2024-04-12 02:40:02,613: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:40:02.613940397Z [2024-04-12 02:40:02,613: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:40:02.614428493Z [2024-04-12 02:40:02,614: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:02.670244736Z [2024-04-12 02:40:02,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:40:02.673576539Z [2024-04-12 02:40:02,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:02.705473839Z [2024-04-12 02:40:02,705: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:02.707356774Z [2024-04-12 02:40:02,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:40:02.709225878Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:02.709262245Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:02.709476086Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:02.709499875Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:40:02.709830272Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:40:02.709879296Z [2024-04-12 02:40:02,709: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:02.832235538Z [2024-04-12 02:40:02,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:02.900767163Z [2024-04-12 02:40:02,900: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:40:02.904089459Z [2024-04-12 02:40:02,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:02.923193559Z [2024-04-12 02:40:02,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:40:02.924298860Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:02.924393410Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:02.924557463Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:02.924621093Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:40:02.924838225Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:40:02.924913888Z [2024-04-12 02:40:02,924: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:02.997531393Z [2024-04-12 02:40:02,997: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:03.284188534Z [2024-04-12 02:40:03,283: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b4bb9643-27e2-4e5f-b570-d9197f8df839] succeeded in 2.468513964000522s: None 2024-04-12T02:40:03.582624925Z [2024-04-12 02:40:03,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03ff5810-8f5f-4a97-932f-a646f6fa001a] received 2024-04-12T02:40:03.597017938Z [2024-04-12 02:40:03,596: INFO/ForkPoolWorker-16] [03ff5810-8f5f-4a97-932f-a646f6fa001a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:03.873501814Z [2024-04-12 02:40:03,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:40:04.693203946Z [2024-04-12 02:40:04,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3ca25fb-66d5-4386-8939-d4c46b998392] succeeded in 3.8944703719989775s: None 2024-04-12T02:40:04.714752094Z [2024-04-12 02:40:04,714: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac38f26c-0f59-4602-b0b2-7c1422e13c29] succeeded in 3.90630721999878s: None 2024-04-12T02:40:04.956826108Z [2024-04-12 02:40:04,956: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:40:04.959619742Z [2024-04-12 02:40:04,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:04.981087367Z [2024-04-12 02:40:04,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:40:04.982621517Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:04.982652035Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:04.982675333Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:04.982685755Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:40:04.983008390Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:40:04.983028225Z [2024-04-12 02:40:04,982: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:05.071916775Z [2024-04-12 02:40:05,071: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:05.701840528Z [2024-04-12 02:40:05,701: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03ff5810-8f5f-4a97-932f-a646f6fa001a] succeeded in 2.1147744760000933s: None 2024-04-12T02:40:06.670714301Z [2024-04-12 02:40:06,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10653fc5-5d92-470f-a5f5-15c7bde4cf8c] received 2024-04-12T02:40:06.680210346Z [2024-04-12 02:40:06,679: INFO/ForkPoolWorker-15] [10653fc5-5d92-470f-a5f5-15c7bde4cf8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:40:06.954371303Z [2024-04-12 02:40:06,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:40:07.975050536Z [2024-04-12 02:40:07,974: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:40:07.978241034Z [2024-04-12 02:40:07,977: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:08.004491072Z [2024-04-12 02:40:08,000: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:40:08.010078851Z [2024-04-12 02:40:08,008: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:08.010150492Z [2024-04-12 02:40:08,008: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:08.010159504Z [2024-04-12 02:40:08,008: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:08.010167405Z [2024-04-12 02:40:08,009: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:40:08.010174241Z [2024-04-12 02:40:08,009: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:40:08.010205398Z [2024-04-12 02:40:08,009: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:08.132466520Z [2024-04-12 02:40:08,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:08.728575478Z [2024-04-12 02:40:08,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10653fc5-5d92-470f-a5f5-15c7bde4cf8c] succeeded in 2.0559383909985627s: None 2024-04-12T02:40:08.768281534Z [2024-04-12 02:40:08,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b9f4c7c-3cb4-4820-bda1-72fe12b8af67] received 2024-04-12T02:40:08.774862776Z [2024-04-12 02:40:08,774: INFO/ForkPoolWorker-15] [8b9f4c7c-3cb4-4820-bda1-72fe12b8af67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:09.017244824Z [2024-04-12 02:40:09,014: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:40:09.932362938Z [2024-04-12 02:40:09,931: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:40:09.934955122Z [2024-04-12 02:40:09,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:40:09.960520244Z [2024-04-12 02:40:09,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:40:09.961790443Z [2024-04-12 02:40:09,961: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:40:09.962067059Z [2024-04-12 02:40:09,961: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:40:09.962387842Z [2024-04-12 02:40:09,962: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:40:09.962654977Z [2024-04-12 02:40:09,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:40:09.963262445Z [2024-04-12 02:40:09,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:40:09.963631539Z [2024-04-12 02:40:09,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:40:10.064479789Z [2024-04-12 02:40:10,061: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:40:10.621814015Z [2024-04-12 02:40:10,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b9f4c7c-3cb4-4820-bda1-72fe12b8af67] succeeded in 1.8509461049998208s: None 2024-04-12T02:41:00.859444502Z [2024-04-12 02:41:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ba26a31-a4a5-4ffc-92a7-237beeeed094] received 2024-04-12T02:41:00.864059111Z [2024-04-12 02:41:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba4d8582-cfc6-4be5-adcd-4b51bee5782e] received 2024-04-12T02:41:00.865750924Z [2024-04-12 02:41:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd288b79-f5a1-441f-896f-2ad69c182714] received 2024-04-12T02:41:00.876974907Z [2024-04-12 02:41:00,876: INFO/ForkPoolWorker-16] [ba4d8582-cfc6-4be5-adcd-4b51bee5782e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:41:00.879423816Z [2024-04-12 02:41:00,879: INFO/ForkPoolWorker-15] [6ba26a31-a4a5-4ffc-92a7-237beeeed094] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:41:00.883756431Z [2024-04-12 02:41:00,883: INFO/ForkPoolWorker-1] [dd288b79-f5a1-441f-896f-2ad69c182714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:41:01.166670877Z [2024-04-12 02:41:01,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:41:01.231844785Z [2024-04-12 02:41:01,228: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:41:01.239826600Z [2024-04-12 02:41:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:41:01.394659867Z [2024-04-12 02:41:01,394: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:41:01.398744598Z [2024-04-12 02:41:01,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:41:01.432129682Z [2024-04-12 02:41:01,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:41:01.434014745Z [2024-04-12 02:41:01,433: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:41:01.434111071Z [2024-04-12 02:41:01,433: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:41:01.434211533Z [2024-04-12 02:41:01,434: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:41:01.434483016Z [2024-04-12 02:41:01,434: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:41:01.523635009Z [2024-04-12 02:41:01,523: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:41:02.158206249Z [2024-04-12 02:41:02,157: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba4d8582-cfc6-4be5-adcd-4b51bee5782e] succeeded in 1.2913375460011594s: None 2024-04-12T02:41:02.326292485Z [2024-04-12 02:41:02,325: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:41:02.329006736Z [2024-04-12 02:41:02,328: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:41:02.345656946Z [2024-04-12 02:41:02,345: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:41:02.348508804Z [2024-04-12 02:41:02,348: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:41:02.350717272Z [2024-04-12 02:41:02,350: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:41:02.351998191Z [2024-04-12 02:41:02,351: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:41:02.352067982Z [2024-04-12 02:41:02,351: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:41:02.352270032Z [2024-04-12 02:41:02,352: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:41:02.352287507Z [2024-04-12 02:41:02,352: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:41:02.352750667Z [2024-04-12 02:41:02,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:41:02.353000809Z [2024-04-12 02:41:02,352: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:41:02.365087933Z [2024-04-12 02:41:02,364: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:41:02.365881272Z [2024-04-12 02:41:02,365: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:41:02.365894389Z [2024-04-12 02:41:02,365: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:41:02.365991146Z [2024-04-12 02:41:02,365: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:41:02.366006252Z [2024-04-12 02:41:02,365: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:41:02.366282629Z [2024-04-12 02:41:02,366: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:41:02.366290629Z [2024-04-12 02:41:02,366: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:41:02.432358572Z [2024-04-12 02:41:02,432: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:41:02.432797609Z [2024-04-12 02:41:02,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:41:04.190726854Z [2024-04-12 02:41:04,190: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dd288b79-f5a1-441f-896f-2ad69c182714] succeeded in 3.314220636000755s: None 2024-04-12T02:41:04.794834215Z [2024-04-12 02:41:04,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ba26a31-a4a5-4ffc-92a7-237beeeed094] succeeded in 3.9327311150009336s: None 2024-04-12T02:42:00.473005479Z [2024-04-12 02:42:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e201d56-0e38-4838-94df-ed3d1f76c281] received 2024-04-12T02:42:00.478073684Z [2024-04-12 02:42:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b15ee545-3ab6-403d-a4dd-93b55cd6febd] received 2024-04-12T02:42:00.485296731Z [2024-04-12 02:42:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f703d7b0-a2b3-411c-8d42-817a55c96b9a] received 2024-04-12T02:42:00.487772614Z [2024-04-12 02:42:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69f24ab8-9b68-466f-b2df-8e454e07c173] received 2024-04-12T02:42:00.495287089Z [2024-04-12 02:42:00,494: INFO/ForkPoolWorker-15] [4e201d56-0e38-4838-94df-ed3d1f76c281] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:42:00.500957742Z [2024-04-12 02:42:00,500: INFO/ForkPoolWorker-16] [b15ee545-3ab6-403d-a4dd-93b55cd6febd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:42:00.510238030Z [2024-04-12 02:42:00,509: INFO/ForkPoolWorker-1] [f703d7b0-a2b3-411c-8d42-817a55c96b9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:42:00.514994280Z [2024-04-12 02:42:00,514: INFO/ForkPoolWorker-2] [69f24ab8-9b68-466f-b2df-8e454e07c173] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:42:00.963564227Z [2024-04-12 02:42:00,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:42:01.039068181Z [2024-04-12 02:42:01,032: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:42:01.046459223Z [2024-04-12 02:42:01,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:42:01.153066200Z [2024-04-12 02:42:01,149: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:42:01.338780253Z [2024-04-12 02:42:01,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:42:01.365306801Z [2024-04-12 02:42:01,364: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:42:01.377072578Z [2024-04-12 02:42:01,376: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:42:01.433467659Z [2024-04-12 02:42:01,433: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:42:01.434689928Z [2024-04-12 02:42:01,434: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:42:01.434737734Z [2024-04-12 02:42:01,434: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:42:01.434768750Z [2024-04-12 02:42:01,434: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:42:01.434917659Z [2024-04-12 02:42:01,434: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:42:01.549692594Z [2024-04-12 02:42:01,549: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:42:02.266077524Z [2024-04-12 02:42:02,265: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69f24ab8-9b68-466f-b2df-8e454e07c173] succeeded in 1.7759405759989022s: None 2024-04-12T02:42:02.268154897Z [2024-04-12 02:42:02,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e201d56-0e38-4838-94df-ed3d1f76c281] succeeded in 1.7908406780006771s: None 2024-04-12T02:42:02.416951797Z [2024-04-12 02:42:02,416: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:42:02.420180930Z [2024-04-12 02:42:02,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:42:02.441108393Z [2024-04-12 02:42:02,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:42:02.442310417Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:42:02.442376829Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:42:02.442489783Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:42:02.442538896Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:42:02.442760784Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:42:02.442855769Z [2024-04-12 02:42:02,442: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:42:02.524476389Z [2024-04-12 02:42:02,524: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:42:02.900803506Z [2024-04-12 02:42:02,900: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:42:02.903406094Z [2024-04-12 02:42:02,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:42:02.920812419Z [2024-04-12 02:42:02,920: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:42:02.921904935Z [2024-04-12 02:42:02,921: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:42:02.921932523Z [2024-04-12 02:42:02,921: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:42:02.922051571Z [2024-04-12 02:42:02,921: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:42:02.922080437Z [2024-04-12 02:42:02,922: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:42:02.922532316Z [2024-04-12 02:42:02,922: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:42:02.922565841Z [2024-04-12 02:42:02,922: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:42:03.014386831Z [2024-04-12 02:42:03,014: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:42:04.382051356Z [2024-04-12 02:42:04,381: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b15ee545-3ab6-403d-a4dd-93b55cd6febd] succeeded in 3.896162376000575s: None 2024-04-12T02:42:04.768507123Z [2024-04-12 02:42:04,768: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f703d7b0-a2b3-411c-8d42-817a55c96b9a] succeeded in 4.280719946000318s: None 2024-04-12T02:43:00.634423436Z [2024-04-12 02:43:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1483886b-b28e-43be-b7d1-e1d97de4d4ac] received 2024-04-12T02:43:00.640493996Z [2024-04-12 02:43:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eefbf028-fcd6-4c09-be28-d7cbb2c88dbf] received 2024-04-12T02:43:00.641638285Z [2024-04-12 02:43:00,641: INFO/ForkPoolWorker-15] [1483886b-b28e-43be-b7d1-e1d97de4d4ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:43:00.644470816Z [2024-04-12 02:43:00,644: INFO/ForkPoolWorker-16] [eefbf028-fcd6-4c09-be28-d7cbb2c88dbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:43:00.647491844Z [2024-04-12 02:43:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30101938-12b2-411a-93f2-10325c383c9b] received 2024-04-12T02:43:00.651464473Z [2024-04-12 02:43:00,651: INFO/ForkPoolWorker-1] [30101938-12b2-411a-93f2-10325c383c9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:43:00.915203244Z [2024-04-12 02:43:00,912: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:43:00.916897774Z [2024-04-12 02:43:00,913: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:43:00.925853172Z [2024-04-12 02:43:00,922: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:43:01.048948275Z [2024-04-12 02:43:01,048: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-12T02:43:01.052219659Z [2024-04-12 02:43:01,051: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:43:01.086578326Z [2024-04-12 02:43:01,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:43:01.090115968Z [2024-04-12 02:43:01,089: INFO/ForkPoolWorker-16] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:43:01.090271613Z [2024-04-12 02:43:01,090: INFO/ForkPoolWorker-16] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:43:01.090312624Z [2024-04-12 02:43:01,090: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-12T02:43:01.090572522Z [2024-04-12 02:43:01,090: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:43:01.166870705Z [2024-04-12 02:43:01,166: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:43:01.656122792Z [2024-04-12 02:43:01,655: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eefbf028-fcd6-4c09-be28-d7cbb2c88dbf] succeeded in 1.0161448750004638s: None 2024-04-12T02:43:02.034291936Z [2024-04-12 02:43:02,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:43:02.037475338Z [2024-04-12 02:43:02,037: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:43:02.059969869Z [2024-04-12 02:43:02,059: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:43:02.063513086Z [2024-04-12 02:43:02,063: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:43:02.063703434Z [2024-04-12 02:43:02,063: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:43:02.063937066Z [2024-04-12 02:43:02,063: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:43:02.064090098Z [2024-04-12 02:43:02,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:43:02.064432178Z [2024-04-12 02:43:02,064: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:43:02.064602622Z [2024-04-12 02:43:02,064: INFO/ForkPoolWorker-15] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:43:02.078376556Z [2024-04-12 02:43:02,078: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:43:02.081165281Z [2024-04-12 02:43:02,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:43:02.110041430Z [2024-04-12 02:43:02,109: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:43:02.111345400Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:43:02.111425357Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:43:02.111521452Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:43:02.111771778Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:43:02.111913378Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:43:02.111930528Z [2024-04-12 02:43:02,111: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:43:02.158513276Z [2024-04-12 02:43:02,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:43:02.181298920Z [2024-04-12 02:43:02,181: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:43:03.624358192Z [2024-04-12 02:43:03,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1483886b-b28e-43be-b7d1-e1d97de4d4ac] succeeded in 2.98819462100073s: None 2024-04-12T02:43:04.719822301Z [2024-04-12 02:43:04,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30101938-12b2-411a-93f2-10325c383c9b] succeeded in 4.072928767000121s: None 2024-04-12T02:44:01.098072758Z [2024-04-12 02:44:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1307adfb-2d1c-4228-a097-192422d57506] received 2024-04-12T02:44:01.101468823Z [2024-04-12 02:44:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35efaaa1-8522-4cd3-b41f-985663fb81fb] received 2024-04-12T02:44:01.109508134Z [2024-04-12 02:44:01,109: INFO/ForkPoolWorker-15] [1307adfb-2d1c-4228-a097-192422d57506] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:44:01.113357826Z [2024-04-12 02:44:01,113: INFO/ForkPoolWorker-16] [35efaaa1-8522-4cd3-b41f-985663fb81fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:44:01.119765755Z [2024-04-12 02:44:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[201f6f60-de7d-4599-8a63-1742d0d2667c] received 2024-04-12T02:44:01.121585979Z [2024-04-12 02:44:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09b4a8cc-ff71-459d-8f4f-990c222fd242] received 2024-04-12T02:44:01.126043622Z [2024-04-12 02:44:01,125: INFO/ForkPoolWorker-1] [201f6f60-de7d-4599-8a63-1742d0d2667c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:44:01.132463888Z [2024-04-12 02:44:01,132: INFO/ForkPoolWorker-2] [09b4a8cc-ff71-459d-8f4f-990c222fd242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:44:01.387361658Z [2024-04-12 02:44:01,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:44:01.424798712Z [2024-04-12 02:44:01,419: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:44:01.426808865Z [2024-04-12 02:44:01,423: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:44:01.450943502Z [2024-04-12 02:44:01,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:44:01.599323133Z [2024-04-12 02:44:01,598: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:44:01.603781149Z [2024-04-12 02:44:01,603: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:44:01.738670712Z [2024-04-12 02:44:01,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:44:01.739661130Z [2024-04-12 02:44:01,739: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:44:01.739792085Z [2024-04-12 02:44:01,739: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:44:01.739857130Z [2024-04-12 02:44:01,739: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:44:01.740056333Z [2024-04-12 02:44:01,739: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:44:01.827987874Z [2024-04-12 02:44:01,827: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:44:01.846734681Z [2024-04-12 02:44:01,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:44:02.327613363Z [2024-04-12 02:44:02,327: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[201f6f60-de7d-4599-8a63-1742d0d2667c] succeeded in 1.2066964269997698s: None 2024-04-12T02:44:02.348452520Z [2024-04-12 02:44:02,348: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1307adfb-2d1c-4228-a097-192422d57506] succeeded in 1.2452560530000483s: None 2024-04-12T02:44:02.610882762Z [2024-04-12 02:44:02,610: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:44:02.613722713Z [2024-04-12 02:44:02,613: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:44:02.634887271Z [2024-04-12 02:44:02,634: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:44:02.636264823Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:44:02.636296225Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:44:02.636481269Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:44:02.636500447Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:44:02.636797227Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:44:02.636808428Z [2024-04-12 02:44:02,636: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:44:02.697310432Z [2024-04-12 02:44:02,696: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:44:02.700083518Z [2024-04-12 02:44:02,699: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:44:02.722589701Z [2024-04-12 02:44:02,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:44:02.724075993Z [2024-04-12 02:44:02,723: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:44:02.724194237Z [2024-04-12 02:44:02,724: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:44:02.724414756Z [2024-04-12 02:44:02,724: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:44:02.724568399Z [2024-04-12 02:44:02,724: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:44:02.725172163Z [2024-04-12 02:44:02,724: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:44:02.725265776Z [2024-04-12 02:44:02,725: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:44:02.726042044Z [2024-04-12 02:44:02,725: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:44:02.832200480Z [2024-04-12 02:44:02,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:44:04.075503038Z [2024-04-12 02:44:04,075: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[09b4a8cc-ff71-459d-8f4f-990c222fd242] succeeded in 2.9522294260004855s: None 2024-04-12T02:44:04.769605115Z [2024-04-12 02:44:04,769: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35efaaa1-8522-4cd3-b41f-985663fb81fb] succeeded in 3.6656819050003833s: None 2024-04-12T02:45:01.063164599Z [2024-04-12 02:45:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9db71ad7-3293-4a36-ab4b-8343adbb116b] received 2024-04-12T02:45:01.068285033Z [2024-04-12 02:45:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbfa19e5-58cb-4f07-b5fd-4a436e8837cb] received 2024-04-12T02:45:01.069572113Z [2024-04-12 02:45:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74b54469-26b7-4e3c-9907-37c29bcc00e9] received 2024-04-12T02:45:01.073408877Z [2024-04-12 02:45:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a757ac3-c303-4b40-a413-98beb32f4aa2] received 2024-04-12T02:45:01.076050991Z [2024-04-12 02:45:01,069: INFO/ForkPoolWorker-15] [9db71ad7-3293-4a36-ab4b-8343adbb116b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:01.076797855Z [2024-04-12 02:45:01,076: INFO/ForkPoolWorker-1] [74b54469-26b7-4e3c-9907-37c29bcc00e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:45:01.081399966Z [2024-04-12 02:45:01,081: INFO/ForkPoolWorker-2] [7a757ac3-c303-4b40-a413-98beb32f4aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:45:01.086446428Z [2024-04-12 02:45:01,084: INFO/ForkPoolWorker-16] [cbfa19e5-58cb-4f07-b5fd-4a436e8837cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:45:01.359170576Z [2024-04-12 02:45:01,356: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:45:01.368103573Z [2024-04-12 02:45:01,364: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:45:01.384274090Z [2024-04-12 02:45:01,380: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:45:01.466031678Z [2024-04-12 02:45:01,460: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:45:01.511663102Z [2024-04-12 02:45:01,511: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:45:01.515251380Z [2024-04-12 02:45:01,514: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:01.551694946Z [2024-04-12 02:45:01,551: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:45:01.553170384Z [2024-04-12 02:45:01,552: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:45:01.553259414Z [2024-04-12 02:45:01,553: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:45:01.553285689Z [2024-04-12 02:45:01,553: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:45:01.553890634Z [2024-04-12 02:45:01,553: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:45:01.740489896Z [2024-04-12 02:45:01,739: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:02.250311535Z [2024-04-12 02:45:02,249: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7a757ac3-c303-4b40-a413-98beb32f4aa2] succeeded in 1.1733695399998396s: None 2024-04-12T02:45:02.526833482Z [2024-04-12 02:45:02,526: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:45:02.529659252Z [2024-04-12 02:45:02,529: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:02.554170276Z [2024-04-12 02:45:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:45:02.557109288Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:02.557130840Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:02.557135861Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:02.557139364Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:45:02.557142020Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:45:02.557144695Z [2024-04-12 02:45:02,556: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:02.628303616Z [2024-04-12 02:45:02,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:45:02.643176222Z [2024-04-12 02:45:02,642: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:02.659627527Z [2024-04-12 02:45:02,659: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:02.686888719Z [2024-04-12 02:45:02,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:45:02.693495351Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:02.693598970Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:02.693611794Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:02.693658847Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:45:02.694005765Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:45:02.694017036Z [2024-04-12 02:45:02,693: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:02.705618449Z [2024-04-12 02:45:02,705: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:45:02.708740890Z [2024-04-12 02:45:02,708: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:02.737547286Z [2024-04-12 02:45:02,737: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:45:02.739186612Z [2024-04-12 02:45:02,738: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:02.739213261Z [2024-04-12 02:45:02,739: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:02.742576346Z [2024-04-12 02:45:02,739: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:02.742595394Z [2024-04-12 02:45:02,742: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:45:02.742789749Z [2024-04-12 02:45:02,742: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:45:02.742830818Z [2024-04-12 02:45:02,742: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:02.799131183Z [2024-04-12 02:45:02,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:02.851427958Z [2024-04-12 02:45:02,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:03.376824997Z [2024-04-12 02:45:03,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9db71ad7-3293-4a36-ab4b-8343adbb116b] succeeded in 2.3115121489990997s: None 2024-04-12T02:45:03.862735558Z [2024-04-12 02:45:03,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31b4cc79-2ec3-4938-ab28-3d01ea064071] received 2024-04-12T02:45:03.872356805Z [2024-04-12 02:45:03,872: INFO/ForkPoolWorker-15] [31b4cc79-2ec3-4938-ab28-3d01ea064071] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:04.129214669Z [2024-04-12 02:45:04,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:45:04.325137659Z [2024-04-12 02:45:04,324: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[74b54469-26b7-4e3c-9907-37c29bcc00e9] succeeded in 3.2543734119990404s: None 2024-04-12T02:45:04.470732473Z [2024-04-12 02:45:04,470: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbfa19e5-58cb-4f07-b5fd-4a436e8837cb] succeeded in 3.398865556000601s: None 2024-04-12T02:45:05.110284379Z [2024-04-12 02:45:05,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:45:05.113166796Z [2024-04-12 02:45:05,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:05.134206942Z [2024-04-12 02:45:05,133: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:45:05.137629575Z [2024-04-12 02:45:05,137: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:05.139336542Z [2024-04-12 02:45:05,138: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:05.139843311Z [2024-04-12 02:45:05,139: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:05.140199841Z [2024-04-12 02:45:05,139: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:45:05.140873634Z [2024-04-12 02:45:05,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:45:05.141705287Z [2024-04-12 02:45:05,141: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:05.225221170Z [2024-04-12 02:45:05,224: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:06.008579854Z [2024-04-12 02:45:06,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31b4cc79-2ec3-4938-ab28-3d01ea064071] succeeded in 2.1428016900008515s: None 2024-04-12T02:45:06.285966262Z [2024-04-12 02:45:06,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7325fea4-4f22-42b4-bf0a-984d1f74c9d6] received 2024-04-12T02:45:06.294808668Z [2024-04-12 02:45:06,294: INFO/ForkPoolWorker-15] [7325fea4-4f22-42b4-bf0a-984d1f74c9d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:45:06.562772143Z [2024-04-12 02:45:06,559: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:45:07.498806345Z [2024-04-12 02:45:07,498: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:45:07.501435728Z [2024-04-12 02:45:07,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:07.522909733Z [2024-04-12 02:45:07,522: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:45:07.524396613Z [2024-04-12 02:45:07,524: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:07.524536040Z [2024-04-12 02:45:07,524: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:07.524757925Z [2024-04-12 02:45:07,524: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:07.524914463Z [2024-04-12 02:45:07,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:45:07.525213659Z [2024-04-12 02:45:07,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:45:07.525341273Z [2024-04-12 02:45:07,525: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:07.636976735Z [2024-04-12 02:45:07,636: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:08.285992553Z [2024-04-12 02:45:08,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7325fea4-4f22-42b4-bf0a-984d1f74c9d6] succeeded in 1.9962880450002558s: None 2024-04-12T02:45:08.857448864Z [2024-04-12 02:45:08,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339ff307-0e11-4d97-b3ae-8986b38a09cd] received 2024-04-12T02:45:08.870566965Z [2024-04-12 02:45:08,870: INFO/ForkPoolWorker-15] [339ff307-0e11-4d97-b3ae-8986b38a09cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:09.104483260Z [2024-04-12 02:45:09,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-12T02:45:10.043481604Z [2024-04-12 02:45:10,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-12T02:45:10.046260105Z [2024-04-12 02:45:10,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:45:10.072098350Z [2024-04-12 02:45:10,071: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:45:10.072846736Z [2024-04-12 02:45:10,072: INFO/ForkPoolWorker-15] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:45:10.073666657Z [2024-04-12 02:45:10,072: INFO/ForkPoolWorker-15] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:45:10.073683078Z [2024-04-12 02:45:10,073: INFO/ForkPoolWorker-15] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:45:10.073688296Z [2024-04-12 02:45:10,073: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-12T02:45:10.073692159Z [2024-04-12 02:45:10,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-12T02:45:10.073705465Z [2024-04-12 02:45:10,073: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:45:10.157292441Z [2024-04-12 02:45:10,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:45:10.750977661Z [2024-04-12 02:45:10,750: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[339ff307-0e11-4d97-b3ae-8986b38a09cd] succeeded in 1.8873406689999683s: None 2024-04-12T02:46:01.042458327Z [2024-04-12 02:46:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb452bf5-c427-4890-b409-6486a2eefb5f] received 2024-04-12T02:46:01.047210730Z [2024-04-12 02:46:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c07333c8-05a7-42c6-9a56-4db9af3a48d4] received 2024-04-12T02:46:01.049018145Z [2024-04-12 02:46:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13a2fb51-0167-4cc6-846f-fa751ed8c1e9] received 2024-04-12T02:46:01.051754749Z [2024-04-12 02:46:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac3fee3-ac2e-4054-a17c-b2f063d26344] received 2024-04-12T02:46:01.058439467Z [2024-04-12 02:46:01,058: INFO/ForkPoolWorker-15] [bb452bf5-c427-4890-b409-6486a2eefb5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:46:01.058703661Z [2024-04-12 02:46:01,058: INFO/ForkPoolWorker-16] [c07333c8-05a7-42c6-9a56-4db9af3a48d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:46:01.059733031Z [2024-04-12 02:46:01,059: INFO/ForkPoolWorker-2] [6ac3fee3-ac2e-4054-a17c-b2f063d26344] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:46:01.069105291Z [2024-04-12 02:46:01,068: INFO/ForkPoolWorker-1] [13a2fb51-0167-4cc6-846f-fa751ed8c1e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:46:01.378205182Z [2024-04-12 02:46:01,374: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:46:01.415322162Z [2024-04-12 02:46:01,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:46:01.423313831Z [2024-04-12 02:46:01,420: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:46:01.453769990Z [2024-04-12 02:46:01,450: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:46:01.531942892Z [2024-04-12 02:46:01,531: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-12T02:46:01.535881784Z [2024-04-12 02:46:01,535: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:46:01.558261394Z [2024-04-12 02:46:01,558: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:46:01.559184094Z [2024-04-12 02:46:01,558: INFO/ForkPoolWorker-1] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:46:01.559393226Z [2024-04-12 02:46:01,559: INFO/ForkPoolWorker-1] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:46:01.559516191Z [2024-04-12 02:46:01,559: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-12T02:46:01.559821634Z [2024-04-12 02:46:01,559: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:46:01.672513035Z [2024-04-12 02:46:01,667: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:46:01.724511304Z [2024-04-12 02:46:01,717: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:46:02.237402636Z [2024-04-12 02:46:02,237: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13a2fb51-0167-4cc6-846f-fa751ed8c1e9] succeeded in 1.1860080619990185s: None 2024-04-12T02:46:02.251459905Z [2024-04-12 02:46:02,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb452bf5-c427-4890-b409-6486a2eefb5f] succeeded in 1.206577823999396s: None 2024-04-12T02:46:02.541756038Z [2024-04-12 02:46:02,541: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-12T02:46:02.544615213Z [2024-04-12 02:46:02,544: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:46:02.556402841Z [2024-04-12 02:46:02,556: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:46:02.559369223Z [2024-04-12 02:46:02,558: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:46:02.570343270Z [2024-04-12 02:46:02,570: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:46:02.572022345Z [2024-04-12 02:46:02,571: INFO/ForkPoolWorker-2] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:46:02.572059784Z [2024-04-12 02:46:02,571: INFO/ForkPoolWorker-2] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:46:02.572250954Z [2024-04-12 02:46:02,572: INFO/ForkPoolWorker-2] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:46:02.572366298Z [2024-04-12 02:46:02,572: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-12T02:46:02.572751544Z [2024-04-12 02:46:02,572: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:46:02.572823551Z [2024-04-12 02:46:02,572: INFO/ForkPoolWorker-2] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:46:02.585803356Z [2024-04-12 02:46:02,585: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:46:02.587088304Z [2024-04-12 02:46:02,586: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:46:02.587165572Z [2024-04-12 02:46:02,586: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:46:02.587205512Z [2024-04-12 02:46:02,587: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:46:02.587366571Z [2024-04-12 02:46:02,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:46:02.587651509Z [2024-04-12 02:46:02,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:46:02.588026189Z [2024-04-12 02:46:02,587: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:46:02.639219867Z [2024-04-12 02:46:02,638: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:46:02.690046557Z [2024-04-12 02:46:02,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:46:04.024761298Z [2024-04-12 02:46:04,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ac3fee3-ac2e-4054-a17c-b2f063d26344] succeeded in 2.9709614790008345s: None 2024-04-12T02:46:05.278515347Z [2024-04-12 02:46:05,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c07333c8-05a7-42c6-9a56-4db9af3a48d4] succeeded in 4.227931961999275s: None 2024-04-12T02:47:00.876492280Z [2024-04-12 02:47:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cc49e37-4641-4614-906c-a98250ad689f] received 2024-04-12T02:47:00.880175911Z [2024-04-12 02:47:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2f35943-5ee1-4fa9-aaed-5848d36167af] received 2024-04-12T02:47:00.891556661Z [2024-04-12 02:47:00,891: INFO/ForkPoolWorker-16] [b2f35943-5ee1-4fa9-aaed-5848d36167af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:47:00.891802048Z [2024-04-12 02:47:00,891: INFO/ForkPoolWorker-15] [8cc49e37-4641-4614-906c-a98250ad689f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:47:00.897622429Z [2024-04-12 02:47:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ca71cd7-6175-4967-80f0-c61b80d5fd83] received 2024-04-12T02:47:00.910038702Z [2024-04-12 02:47:00,909: INFO/ForkPoolWorker-1] [8ca71cd7-6175-4967-80f0-c61b80d5fd83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:47:01.162585835Z [2024-04-12 02:47:01,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:47:01.169972027Z [2024-04-12 02:47:01,166: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:47:01.173353348Z [2024-04-12 02:47:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:47:01.301859190Z [2024-04-12 02:47:01,301: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-12T02:47:01.305603867Z [2024-04-12 02:47:01,305: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:47:01.323353032Z [2024-04-12 02:47:01,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-12T02:47:01.324181006Z [2024-04-12 02:47:01,323: INFO/ForkPoolWorker-15] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:47:01.324315798Z [2024-04-12 02:47:01,324: INFO/ForkPoolWorker-15] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:47:01.324360982Z [2024-04-12 02:47:01,324: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-12T02:47:01.324609186Z [2024-04-12 02:47:01,324: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:47:01.437299256Z [2024-04-12 02:47:01,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:47:02.003873528Z [2024-04-12 02:47:02,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8cc49e37-4641-4614-906c-a98250ad689f] succeeded in 1.1222601810004562s: None 2024-04-12T02:47:02.234505754Z [2024-04-12 02:47:02,234: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:47:02.237562395Z [2024-04-12 02:47:02,237: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:47:02.258834713Z [2024-04-12 02:47:02,258: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:47:02.261716633Z [2024-04-12 02:47:02,261: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:47:02.261762072Z [2024-04-12 02:47:02,261: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:47:02.261902744Z [2024-04-12 02:47:02,261: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:47:02.261953779Z [2024-04-12 02:47:02,261: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:47:02.262316860Z [2024-04-12 02:47:02,262: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:47:02.262386352Z [2024-04-12 02:47:02,262: INFO/ForkPoolWorker-16] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:47:02.343923278Z [2024-04-12 02:47:02,343: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:47:02.397808794Z [2024-04-12 02:47:02,397: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:47:02.401114039Z [2024-04-12 02:47:02,400: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:47:02.433331679Z [2024-04-12 02:47:02,433: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:47:02.435120231Z [2024-04-12 02:47:02,434: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:47:02.435534921Z [2024-04-12 02:47:02,435: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:47:02.435883675Z [2024-04-12 02:47:02,435: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:47:02.436159384Z [2024-04-12 02:47:02,435: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:47:02.437258013Z [2024-04-12 02:47:02,437: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:47:02.437636062Z [2024-04-12 02:47:02,437: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:47:02.532509175Z [2024-04-12 02:47:02,532: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:47:04.301193276Z [2024-04-12 02:47:04,300: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2f35943-5ee1-4fa9-aaed-5848d36167af] succeeded in 3.4183074979991943s: None 2024-04-12T02:47:05.396224886Z [2024-04-12 02:47:05,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ca71cd7-6175-4967-80f0-c61b80d5fd83] succeeded in 4.496485263000068s: None 2024-04-12T02:48:00.704499995Z [2024-04-12 02:48:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52067545-fc05-4dc1-a1d3-5e55b7d562a4] received 2024-04-12T02:48:00.710193280Z [2024-04-12 02:48:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2d4448d-7f20-4eff-9b4f-1c88de4528e9] received 2024-04-12T02:48:00.717480316Z [2024-04-12 02:48:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9436ed70-4430-452c-826f-d8fc9bb50675] received 2024-04-12T02:48:00.721456256Z [2024-04-12 02:48:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6d60904-545e-4946-86e0-024922386ffd] received 2024-04-12T02:48:00.724044643Z [2024-04-12 02:48:00,723: INFO/ForkPoolWorker-15] [52067545-fc05-4dc1-a1d3-5e55b7d562a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:48:00.730603451Z [2024-04-12 02:48:00,730: INFO/ForkPoolWorker-1] [9436ed70-4430-452c-826f-d8fc9bb50675] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:48:00.736061476Z [2024-04-12 02:48:00,735: INFO/ForkPoolWorker-16] [b2d4448d-7f20-4eff-9b4f-1c88de4528e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:48:00.737126616Z [2024-04-12 02:48:00,736: INFO/ForkPoolWorker-2] [d6d60904-545e-4946-86e0-024922386ffd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:48:00.994638519Z [2024-04-12 02:48:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-12T02:48:01.023708416Z [2024-04-12 02:48:01,019: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-12T02:48:01.028295745Z [2024-04-12 02:48:01,025: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-12T02:48:01.035693999Z [2024-04-12 02:48:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-12T02:48:01.204367353Z [2024-04-12 02:48:01,203: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-12T02:48:01.207971920Z [2024-04-12 02:48:01,207: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:48:01.225535391Z [2024-04-12 02:48:01,225: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-12T02:48:01.229063841Z [2024-04-12 02:48:01,228: INFO/ForkPoolWorker-2] Read SDNC 83db70af-c568-49f3-a4d4-fbf0ba8f4f11 (sdnc-osm) 2024-04-12T02:48:01.229111309Z [2024-04-12 02:48:01,229: INFO/ForkPoolWorker-2] [{'_id': '83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-12T02:48:01.229315269Z [2024-04-12 02:48:01,229: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-12T02:48:01.229510577Z [2024-04-12 02:48:01,229: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 2024-04-12T02:48:01.295143328Z [2024-04-12 02:48:01,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:48:01.345283652Z [2024-04-12 02:48:01,345: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:48:01.779870301Z [2024-04-12 02:48:01,779: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52067545-fc05-4dc1-a1d3-5e55b7d562a4] succeeded in 1.067907403999925s: None 2024-04-12T02:48:01.953372569Z [2024-04-12 02:48:01,953: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6d60904-545e-4946-86e0-024922386ffd] succeeded in 1.226535623000018s: None 2024-04-12T02:48:02.135051940Z [2024-04-12 02:48:02,134: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-12T02:48:02.137875823Z [2024-04-12 02:48:02,137: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:48:02.153992699Z [2024-04-12 02:48:02,153: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-12T02:48:02.154842883Z [2024-04-12 02:48:02,154: INFO/ForkPoolWorker-1] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:48:02.154875435Z [2024-04-12 02:48:02,154: INFO/ForkPoolWorker-1] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:48:02.154953859Z [2024-04-12 02:48:02,154: INFO/ForkPoolWorker-1] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:48:02.154960651Z [2024-04-12 02:48:02,154: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-12T02:48:02.155292265Z [2024-04-12 02:48:02,155: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-12T02:48:02.155311509Z [2024-04-12 02:48:02,155: INFO/ForkPoolWorker-1] Creating DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:48:02.233864462Z [2024-04-12 02:48:02,233: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:48:02.266027546Z [2024-04-12 02:48:02,265: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-12T02:48:02.269118325Z [2024-04-12 02:48:02,268: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'W05y5GdjEYx3uAezRd5oCVNf3ozLZVdP'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-12T02:48:02.293396021Z [2024-04-12 02:48:02,293: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-12T02:48:02.294911039Z [2024-04-12 02:48:02,294: INFO/ForkPoolWorker-16] Read VIM 58cbfb45-5d6c-4714-a9f9-9192f7e6bd00 (_system-osm-vim) 2024-04-12T02:48:02.294953942Z [2024-04-12 02:48:02,294: INFO/ForkPoolWorker-16] Read VIM ceb32bee-8cbb-4abe-a1bc-adc934403ec5 (osm) 2024-04-12T02:48:02.295133454Z [2024-04-12 02:48:02,294: INFO/ForkPoolWorker-16] [{'_id': '58cbfb45-5d6c-4714-a9f9-9192f7e6bd00', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-12T02:48:02.295185595Z [2024-04-12 02:48:02,295: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-12T02:48:02.296048277Z [2024-04-12 02:48:02,295: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-12T02:48:02.296092331Z [2024-04-12 02:48:02,295: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 2024-04-12T02:48:02.395218731Z [2024-04-12 02:48:02,394: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-12T02:48:03.817770852Z [2024-04-12 02:48:03,817: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9436ed70-4430-452c-826f-d8fc9bb50675] succeeded in 3.095079495999016s: None 2024-04-12T02:48:04.144247469Z [2024-04-12 02:48:04,143: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2d4448d-7f20-4eff-9b4f-1c88de4528e9] succeeded in 3.4293664839988196s: None 2024-04-11T22:27:41.952986644Z 2024-04-11T22:27:41.958136852Z Cleaning logs every 900 seconds 2024-04-11T22:27:41.958147480Z Trimming airflow logs to 15 days. 2024-04-11T22:30:01.018857817Z Trimming airflow logs to 15 days. 2024-04-11T22:45:00.056536592Z Trimming airflow logs to 15 days. 2024-04-11T22:45:01.112693876Z Trimming airflow logs to 15 days. 2024-04-11T23:00:00.142807457Z Trimming airflow logs to 15 days. 2024-04-11T23:00:01.170908682Z Trimming airflow logs to 15 days. 2024-04-11T23:15:00.313185723Z Trimming airflow logs to 15 days. 2024-04-11T23:15:01.368830971Z Trimming airflow logs to 15 days. 2024-04-11T23:30:00.426963409Z Trimming airflow logs to 15 days. 2024-04-11T23:30:01.483426748Z Trimming airflow logs to 15 days. 2024-04-11T23:45:00.573557201Z Trimming airflow logs to 15 days. 2024-04-11T23:45:01.642994270Z Trimming airflow logs to 15 days. 2024-04-12T00:00:00.713905255Z Trimming airflow logs to 15 days. 2024-04-12T00:00:01.823373314Z Trimming airflow logs to 15 days. 2024-04-12T00:15:00.923548152Z Trimming airflow logs to 15 days. 2024-04-12T00:15:01.979200761Z Trimming airflow logs to 15 days. 2024-04-12T00:30:00.059677907Z Trimming airflow logs to 15 days. 2024-04-12T00:30:01.121182516Z Trimming airflow logs to 15 days. 2024-04-12T00:45:00.232815882Z Trimming airflow logs to 15 days. 2024-04-12T00:45:01.284680012Z Trimming airflow logs to 15 days. 2024-04-12T01:00:00.341877387Z Trimming airflow logs to 15 days. 2024-04-12T01:00:01.417592968Z Trimming airflow logs to 15 days. 2024-04-12T01:15:00.545133215Z Trimming airflow logs to 15 days. 2024-04-12T01:15:01.611285266Z Trimming airflow logs to 15 days. 2024-04-12T01:30:00.759963599Z Trimming airflow logs to 15 days. 2024-04-12T01:30:01.840746415Z Trimming airflow logs to 15 days. 2024-04-12T01:45:00.926617529Z Trimming airflow logs to 15 days. 2024-04-12T02:00:00.072146094Z Trimming airflow logs to 15 days. 2024-04-12T02:00:01.183128098Z Trimming airflow logs to 15 days. 2024-04-12T02:15:00.287880264Z Trimming airflow logs to 15 days. 2024-04-12T02:15:01.396626253Z Trimming airflow logs to 15 days. 2024-04-12T02:30:00.492978912Z Trimming airflow logs to 15 days. 2024-04-12T02:30:01.587699894Z Trimming airflow logs to 15 days. 2024-04-12T02:45:00.721106760Z Trimming airflow logs to 15 days. 2024-04-12T02:45:01.836779139Z Trimming airflow logs to 15 days.