2024-03-28T23:28:36.335065653Z 2024-03-28T23:28:36.351724438Z Cleaning logs every 900 seconds 2024-03-28T23:28:36.351741830Z Trimming airflow logs to 15 days. 2024-03-28T23:30:00.419345982Z Trimming airflow logs to 15 days. 2024-03-28T23:30:01.438638675Z Trimming airflow logs to 15 days. 2024-03-28T23:45:00.459427351Z Trimming airflow logs to 15 days. 2024-03-28T23:45:01.503143107Z Trimming airflow logs to 15 days. 2024-03-29T00:00:00.554743561Z Trimming airflow logs to 15 days. 2024-03-29T00:00:01.663043023Z Trimming airflow logs to 15 days. 2024-03-29T00:15:00.930822165Z Trimming airflow logs to 15 days. 2024-03-29T00:15:01.995418336Z Trimming airflow logs to 15 days. 2024-03-29T00:30:00.063241721Z Trimming airflow logs to 15 days. 2024-03-29T00:30:01.108635893Z Trimming airflow logs to 15 days. 2024-03-29T00:45:00.166189201Z Trimming airflow logs to 15 days. 2024-03-29T00:45:01.247139037Z Trimming airflow logs to 15 days. 2024-03-29T01:00:00.427699683Z Trimming airflow logs to 15 days. 2024-03-29T01:00:01.494716805Z Trimming airflow logs to 15 days. 2024-03-29T01:15:00.595338254Z Trimming airflow logs to 15 days. 2024-03-29T01:15:01.656311001Z Trimming airflow logs to 15 days. 2024-03-29T01:30:00.737511907Z Trimming airflow logs to 15 days. 2024-03-29T01:30:01.788255028Z Trimming airflow logs to 15 days. 2024-03-29T01:45:00.909360733Z Trimming airflow logs to 15 days. 2024-03-29T01:45:01.999856798Z Trimming airflow logs to 15 days. 2024-03-29T02:00:00.072044348Z Trimming airflow logs to 15 days. 2024-03-29T02:00:01.131150064Z Trimming airflow logs to 15 days. 2024-03-29T02:15:00.229971464Z Trimming airflow logs to 15 days. 2024-03-29T02:15:01.302956626Z Trimming airflow logs to 15 days. 2024-03-29T02:30:00.422268840Z Trimming airflow logs to 15 days. 2024-03-29T02:30:01.534016898Z Trimming airflow logs to 15 days. 2024-03-29T02:45:00.684444273Z Trimming airflow logs to 15 days. 2024-03-29T02:45:01.888557374Z Trimming airflow logs to 15 days. 2024-03-29T03:00:00.297976827Z Trimming airflow logs to 15 days. 2024-03-29T03:00:01.387260023Z Trimming airflow logs to 15 days. 2024-03-29T03:15:00.538803554Z Trimming airflow logs to 15 days. 2024-03-29T03:15:01.698781605Z Trimming airflow logs to 15 days. 2024-03-29T03:30:00.859776733Z Trimming airflow logs to 15 days. 2024-03-29T03:30:01.994864886Z Trimming airflow logs to 15 days. 2024-03-29T03:45:00.210367614Z Trimming airflow logs to 15 days. 2024-03-29T03:45:01.318768995Z Trimming airflow logs to 15 days. 2024-03-28T23:28:10.010920504Z .. 2024-03-28T23:28:10.830015344Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-28T23:28:12.324088041Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-28T23:28:17.386846314Z [2024-03-28T23:28:17.368+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-03-28T23:28:32.944220840Z 2024-03-28T23:28:34.646692796Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-28T23:28:37.962646943Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-28T23:28:42.610574569Z [2024-03-28 23:28:42 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-03-28T23:28:42.618601305Z [2024-03-28 23:28:42 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-03-28T23:28:42.618630008Z [2024-03-28 23:28:42 +0000] [16] [INFO] Using worker: sync 2024-03-28T23:28:42.644531231Z [2024-03-28 23:28:42 +0000] [17] [INFO] Booting worker with pid: 17 2024-03-28T23:28:42.649053568Z [2024-03-28 23:28:42 +0000] [18] [INFO] Booting worker with pid: 18 2024-03-28T23:28:44.095391151Z 2024-03-28T23:28:44.095405585Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-03-28T23:28:44.095410494Z --- ***** ----- 2024-03-28T23:28:44.095413912Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-03-28 23:28:44 2024-03-28T23:28:44.095416973Z - *** --- * --- 2024-03-28T23:28:44.095420654Z - ** ---------- [config] 2024-03-28T23:28:44.095424133Z - ** ---------- .> app: airflow.executors.celery_executor:0x7fdd62038190 2024-03-28T23:28:44.095427128Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-03-28T23:28:44.095430357Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-03-28T23:28:44.095434758Z - *** --- * --- .> concurrency: 16 (prefork) 2024-03-28T23:28:44.095437998Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-03-28T23:28:44.095440974Z --- ***** ----- 2024-03-28T23:28:44.095444011Z -------------- [queues] 2024-03-28T23:28:44.095446992Z .> default exchange=default(direct) key=default 2024-03-28T23:28:44.095449948Z 2024-03-28T23:28:44.095452757Z 2024-03-28T23:28:44.095455837Z [tasks] 2024-03-28T23:28:44.095458914Z . airflow.executors.celery_executor.execute_command 2024-03-28T23:28:44.095533570Z 2024-03-28T23:28:50.436226085Z [2024-03-28 23:28:50,432: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-03-28T23:28:50.490853254Z [2024-03-28 23:28:50,490: INFO/MainProcess] mingle: searching for neighbors 2024-03-28T23:28:51.596832200Z [2024-03-28 23:28:51,596: INFO/MainProcess] mingle: all alone 2024-03-28T23:28:51.645367650Z [2024-03-28 23:28:51,645: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-03-28T23:29:46.267686835Z [2024-03-28 23:29:46,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4897d4e-9c3a-47ff-a3db-f607e267d14b] received 2024-03-28T23:29:46.339785182Z [2024-03-28 23:29:46,339: INFO/ForkPoolWorker-15] [c4897d4e-9c3a-47ff-a3db-f607e267d14b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:29:46.820094710Z [2024-03-28 23:29:46,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:29:47.163276764Z [2024-03-28 23:29:47,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:30:17.895822482Z [2024-03-28 23:30:17,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4897d4e-9c3a-47ff-a3db-f607e267d14b] succeeded in 31.625575116999926s: None 2024-03-28T23:30:28.751706429Z [2024-03-28 23:30:28,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[023e03c8-d091-4068-ac80-d58734fa4576] received 2024-03-28T23:30:28.761540424Z [2024-03-28 23:30:28,761: INFO/ForkPoolWorker-15] [023e03c8-d091-4068-ac80-d58734fa4576] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:30:29.035157854Z [2024-03-28 23:30:29,032: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:30:29.261533267Z [2024-03-28 23:30:29,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:30:59.838291142Z [2024-03-28 23:30:59,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[023e03c8-d091-4068-ac80-d58734fa4576] succeeded in 31.083131468000033s: None 2024-03-28T23:31:01.222576328Z [2024-03-28 23:31:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb2d0686-920c-4161-aa8c-3786fa13a004] received 2024-03-28T23:31:01.233768997Z [2024-03-28 23:31:01,233: INFO/ForkPoolWorker-15] [eb2d0686-920c-4161-aa8c-3786fa13a004] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:31:01.522822519Z [2024-03-28 23:31:01,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:31:01.792932287Z [2024-03-28 23:31:01,792: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:31:23.359815726Z [2024-03-28 23:31:23,359: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb2d0686-920c-4161-aa8c-3786fa13a004] succeeded in 22.134930742999927s: None 2024-03-28T23:32:00.787271463Z [2024-03-28 23:32:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f788e6c8-4df9-4935-a0b6-41e4ea04b140] received 2024-03-28T23:32:00.796808122Z [2024-03-28 23:32:00,796: INFO/ForkPoolWorker-15] [f788e6c8-4df9-4935-a0b6-41e4ea04b140] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:32:01.181837239Z [2024-03-28 23:32:01,178: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:32:01.446159952Z [2024-03-28 23:32:01,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:32:02.025612673Z [2024-03-28 23:32:02,025: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f788e6c8-4df9-4935-a0b6-41e4ea04b140] succeeded in 1.234605786999964s: None 2024-03-28T23:34:00.207162872Z [2024-03-28 23:34:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[682dd9bd-553b-4f2d-a69d-13534bcb6d39] received 2024-03-28T23:34:00.218616276Z [2024-03-28 23:34:00,218: INFO/ForkPoolWorker-15] [682dd9bd-553b-4f2d-a69d-13534bcb6d39] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:34:00.544843756Z [2024-03-28 23:34:00,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:34:00.796432646Z [2024-03-28 23:34:00,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:34:01.377027806Z [2024-03-28 23:34:01,376: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[682dd9bd-553b-4f2d-a69d-13534bcb6d39] succeeded in 1.167464461999998s: None 2024-03-28T23:36:00.662190576Z [2024-03-28 23:36:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14aab0de-4e41-49b2-85a6-98e07749bb16] received 2024-03-28T23:36:00.685043518Z [2024-03-28 23:36:00,684: INFO/ForkPoolWorker-15] [14aab0de-4e41-49b2-85a6-98e07749bb16] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:36:00.990528745Z [2024-03-28 23:36:00,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:36:01.236257811Z [2024-03-28 23:36:01,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:01.808100344Z [2024-03-28 23:36:01,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14aab0de-4e41-49b2-85a6-98e07749bb16] succeeded in 1.1376559639999186s: None 2024-03-28T23:36:07.549220252Z [2024-03-28 23:36:07,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423e3ff5-49c6-4af3-b341-bf930e55ed5e] received 2024-03-28T23:36:07.561189134Z [2024-03-28 23:36:07,560: INFO/ForkPoolWorker-15] [423e3ff5-49c6-4af3-b341-bf930e55ed5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:07.866115894Z [2024-03-28 23:36:07,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:36:09.000900983Z [2024-03-28 23:36:09,000: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:36:09.004217189Z [2024-03-28 23:36:09,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:09.020192017Z [2024-03-28 23:36:09,019: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:09.021087997Z [2024-03-28 23:36:09,020: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:09.021097621Z [2024-03-28 23:36:09,021: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:09.021221296Z [2024-03-28 23:36:09,021: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:09.021247218Z [2024-03-28 23:36:09,021: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:36:09.021406227Z [2024-03-28 23:36:09,021: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:36:09.021435021Z [2024-03-28 23:36:09,021: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:09.093990011Z [2024-03-28 23:36:09,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:09.611783579Z [2024-03-28 23:36:09,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[423e3ff5-49c6-4af3-b341-bf930e55ed5e] succeeded in 2.0600001469999825s: None 2024-03-28T23:36:09.816303159Z [2024-03-28 23:36:09,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee13bb4a-0f9c-40ec-8eae-637eca08c451] received 2024-03-28T23:36:09.823992213Z [2024-03-28 23:36:09,823: INFO/ForkPoolWorker-15] [ee13bb4a-0f9c-40ec-8eae-637eca08c451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:10.157258948Z [2024-03-28 23:36:10,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:36:11.220815040Z [2024-03-28 23:36:11,220: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:36:11.224179144Z [2024-03-28 23:36:11,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:11.242167290Z [2024-03-28 23:36:11,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:11.243422153Z [2024-03-28 23:36:11,242: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:11.243573167Z [2024-03-28 23:36:11,243: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:11.243630624Z [2024-03-28 23:36:11,243: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:11.243644657Z [2024-03-28 23:36:11,243: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:36:11.243932822Z [2024-03-28 23:36:11,243: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:36:11.243943819Z [2024-03-28 23:36:11,243: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:11.310404496Z [2024-03-28 23:36:11,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:11.786907258Z [2024-03-28 23:36:11,786: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee13bb4a-0f9c-40ec-8eae-637eca08c451] succeeded in 1.9683209340000758s: None 2024-03-28T23:36:12.287316166Z [2024-03-28 23:36:12,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfbb39ef-c607-48bd-b286-84577e6df346] received 2024-03-28T23:36:12.295368084Z [2024-03-28 23:36:12,295: INFO/ForkPoolWorker-15] [dfbb39ef-c607-48bd-b286-84577e6df346] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:36:12.575983984Z [2024-03-28 23:36:12,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:36:13.649834208Z [2024-03-28 23:36:13,649: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:36:13.653725260Z [2024-03-28 23:36:13,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:13.671723369Z [2024-03-28 23:36:13,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:13.673298930Z [2024-03-28 23:36:13,673: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:13.673422874Z [2024-03-28 23:36:13,673: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:13.673600696Z [2024-03-28 23:36:13,673: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:13.673760348Z [2024-03-28 23:36:13,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:36:13.677569604Z [2024-03-28 23:36:13,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:36:13.677583962Z [2024-03-28 23:36:13,674: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:13.756688829Z [2024-03-28 23:36:13,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:14.237532228Z [2024-03-28 23:36:14,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfbb39ef-c607-48bd-b286-84577e6df346] succeeded in 1.9483013609999489s: None 2024-03-28T23:36:14.572287865Z [2024-03-28 23:36:14,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb0e065f-ed8c-42a0-a01a-aeb5b7696425] received 2024-03-28T23:36:14.594549937Z [2024-03-28 23:36:14,589: INFO/ForkPoolWorker-15] [cb0e065f-ed8c-42a0-a01a-aeb5b7696425] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:14.924713949Z [2024-03-28 23:36:14,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:36:16.069320585Z [2024-03-28 23:36:16,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:36:16.072663928Z [2024-03-28 23:36:16,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:16.089651254Z [2024-03-28 23:36:16,089: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:16.091694114Z [2024-03-28 23:36:16,091: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:16.091751015Z [2024-03-28 23:36:16,091: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:16.091907818Z [2024-03-28 23:36:16,091: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:16.091965438Z [2024-03-28 23:36:16,091: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:36:16.092202640Z [2024-03-28 23:36:16,092: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:36:16.092262865Z [2024-03-28 23:36:16,092: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:16.171220533Z [2024-03-28 23:36:16,170: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:16.681666690Z [2024-03-28 23:36:16,681: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb0e065f-ed8c-42a0-a01a-aeb5b7696425] succeeded in 2.1072193570000763s: None 2024-03-28T23:36:28.673267293Z [2024-03-28 23:36:28,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4aa2451d-f30e-47e2-b372-34b453e7798b] received 2024-03-28T23:36:28.680447339Z [2024-03-28 23:36:28,680: INFO/ForkPoolWorker-15] [4aa2451d-f30e-47e2-b372-34b453e7798b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:36:28.946896437Z [2024-03-28 23:36:28,943: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:36:29.098785220Z [2024-03-28 23:36:29,098: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:36:29.102409775Z [2024-03-28 23:36:29,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:29.120907237Z [2024-03-28 23:36:29,120: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:29.121821016Z [2024-03-28 23:36:29,121: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:36:29.121955989Z [2024-03-28 23:36:29,121: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:36:29.121999754Z [2024-03-28 23:36:29,121: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:36:29.122219306Z [2024-03-28 23:36:29,122: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:36:29.197773038Z [2024-03-28 23:36:29,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:29.785030011Z [2024-03-28 23:36:29,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4aa2451d-f30e-47e2-b372-34b453e7798b] succeeded in 1.1090864989998863s: None 2024-03-28T23:36:34.104878829Z [2024-03-28 23:36:34,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5438371-040a-4306-9bba-26fdf71ab640] received 2024-03-28T23:36:34.114892706Z [2024-03-28 23:36:34,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69e75282-5bbb-46b7-9bbd-31f4046448fc] received 2024-03-28T23:36:34.118789974Z [2024-03-28 23:36:34,115: INFO/ForkPoolWorker-15] [b5438371-040a-4306-9bba-26fdf71ab640] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:36:34.197267738Z [2024-03-28 23:36:34,196: INFO/ForkPoolWorker-16] [69e75282-5bbb-46b7-9bbd-31f4046448fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:36:34.406050339Z [2024-03-28 23:36:34,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:36:34.491041180Z [2024-03-28 23:36:34,487: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:36:35.602034301Z [2024-03-28 23:36:35,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:36:35.606088098Z [2024-03-28 23:36:35,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:35.663908511Z [2024-03-28 23:36:35,663: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:36:35.665753698Z [2024-03-28 23:36:35,665: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:35.665946252Z [2024-03-28 23:36:35,665: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:35.666161407Z [2024-03-28 23:36:35,665: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:35.666260051Z [2024-03-28 23:36:35,666: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:36:35.667729599Z [2024-03-28 23:36:35,666: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:36:35.667833400Z [2024-03-28 23:36:35,667: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:35.752993257Z [2024-03-28 23:36:35,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:35.761370053Z [2024-03-28 23:36:35,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:36:35.763497273Z [2024-03-28 23:36:35,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:36:35.778600673Z [2024-03-28 23:36:35,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:36:35.779127682Z [2024-03-28 23:36:35,778: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:36:35.779173734Z [2024-03-28 23:36:35,779: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:36:35.779285761Z [2024-03-28 23:36:35,779: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:36:35.779325475Z [2024-03-28 23:36:35,779: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:36:35.779529250Z [2024-03-28 23:36:35,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:36:35.779562553Z [2024-03-28 23:36:35,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:36:35.855924057Z [2024-03-28 23:36:35,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:36:37.173511445Z [2024-03-28 23:36:37,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5438371-040a-4306-9bba-26fdf71ab640] succeeded in 3.0658786770000006s: None 2024-03-28T23:36:37.525908445Z [2024-03-28 23:36:37,525: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69e75282-5bbb-46b7-9bbd-31f4046448fc] succeeded in 3.402657970000064s: None 2024-03-28T23:37:00.989092282Z [2024-03-28 23:37:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11caa360-5777-4dd2-8c10-8da1876d1b03] received 2024-03-28T23:37:00.995971083Z [2024-03-28 23:37:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1524339-c101-479f-9cc6-a093074fdec4] received 2024-03-28T23:37:01.019433613Z [2024-03-28 23:37:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc76f293-9a08-4d84-89b8-ea725836bc22] received 2024-03-28T23:37:01.021669211Z [2024-03-28 23:37:01,021: INFO/ForkPoolWorker-16] [f1524339-c101-479f-9cc6-a093074fdec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:01.029532811Z [2024-03-28 23:37:01,029: INFO/ForkPoolWorker-15] [11caa360-5777-4dd2-8c10-8da1876d1b03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:37:01.149196531Z [2024-03-28 23:37:01,148: INFO/ForkPoolWorker-1] [bc76f293-9a08-4d84-89b8-ea725836bc22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:01.343228288Z [2024-03-28 23:37:01,339: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:37:01.351567642Z [2024-03-28 23:37:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:37:01.535268001Z [2024-03-28 23:37:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:37:01.537994229Z [2024-03-28 23:37:01,537: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:37:01.543365382Z [2024-03-28 23:37:01,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:01.589860732Z [2024-03-28 23:37:01,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:01.591075749Z [2024-03-28 23:37:01,590: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:37:01.591141810Z [2024-03-28 23:37:01,591: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:37:01.591179371Z [2024-03-28 23:37:01,591: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:37:01.591394483Z [2024-03-28 23:37:01,591: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:37:01.721665061Z [2024-03-28 23:37:01,721: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:02.660055038Z [2024-03-28 23:37:02,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11caa360-5777-4dd2-8c10-8da1876d1b03] succeeded in 1.6658713919998718s: None 2024-03-28T23:37:02.975686297Z [2024-03-28 23:37:02,975: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:37:02.979194784Z [2024-03-28 23:37:02,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:03.033732808Z [2024-03-28 23:37:03,033: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:37:03.040108936Z [2024-03-28 23:37:03,039: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:03.040137995Z [2024-03-28 23:37:03,039: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:03.040195964Z [2024-03-28 23:37:03,040: INFO/ForkPoolWorker-1] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:03.040400491Z [2024-03-28 23:37:03,040: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:03.040461698Z [2024-03-28 23:37:03,040: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:37:03.040850189Z [2024-03-28 23:37:03,040: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:37:03.040913656Z [2024-03-28 23:37:03,040: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:03.046042326Z [2024-03-28 23:37:03,045: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:03.138259716Z [2024-03-28 23:37:03,137: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:03.314735853Z [2024-03-28 23:37:03,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:37:03.318916889Z [2024-03-28 23:37:03,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:03.374164972Z [2024-03-28 23:37:03,373: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:37:03.376439070Z [2024-03-28 23:37:03,376: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:03.376478584Z [2024-03-28 23:37:03,376: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:03.376780995Z [2024-03-28 23:37:03,376: INFO/ForkPoolWorker-16] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:03.377025612Z [2024-03-28 23:37:03,376: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:03.377174805Z [2024-03-28 23:37:03,376: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:37:03.377655756Z [2024-03-28 23:37:03,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:37:03.378332326Z [2024-03-28 23:37:03,377: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:03.387146820Z [2024-03-28 23:37:03,386: INFO/ForkPoolWorker-16] Creating DAG vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:03.513609295Z [2024-03-28 23:37:03,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:05.179795171Z [2024-03-28 23:37:05,179: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc76f293-9a08-4d84-89b8-ea725836bc22] succeeded in 4.153198431999954s: None 2024-03-28T23:37:05.399852485Z [2024-03-28 23:37:05,399: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1524339-c101-479f-9cc6-a093074fdec4] succeeded in 4.384466005000149s: None 2024-03-28T23:37:06.100078359Z [2024-03-28 23:37:06,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c2a53d-8e2d-4689-9080-28bb04559ea1] received 2024-03-28T23:37:06.108223297Z [2024-03-28 23:37:06,107: INFO/ForkPoolWorker-15] [95c2a53d-8e2d-4689-9080-28bb04559ea1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:06.391854094Z [2024-03-28 23:37:06,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802994a4-8bb7-4812-854f-d639b1247b67] received 2024-03-28T23:37:06.415147127Z [2024-03-28 23:37:06,414: INFO/ForkPoolWorker-16] [802994a4-8bb7-4812-854f-d639b1247b67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:06.484286833Z [2024-03-28 23:37:06,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:37:06.851754537Z [2024-03-28 23:37:06,845: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:37:07.837842263Z [2024-03-28 23:37:07,837: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:07.841402553Z [2024-03-28 23:37:07,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:07.861937339Z [2024-03-28 23:37:07,861: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:07.863330854Z [2024-03-28 23:37:07,863: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:07.863505219Z [2024-03-28 23:37:07,863: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:07.863630527Z [2024-03-28 23:37:07,863: INFO/ForkPoolWorker-15] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:07.863803478Z [2024-03-28 23:37:07,863: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:07.863908938Z [2024-03-28 23:37:07,863: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:07.864176175Z [2024-03-28 23:37:07,864: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:37:07.864290491Z [2024-03-28 23:37:07,864: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:07.868825177Z [2024-03-28 23:37:07,868: INFO/ForkPoolWorker-15] Creating DAG vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:07.961459644Z [2024-03-28 23:37:07,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:08.171474230Z [2024-03-28 23:37:08,171: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:37:08.174974621Z [2024-03-28 23:37:08,174: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:08.204277557Z [2024-03-28 23:37:08,204: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:37:08.206774737Z [2024-03-28 23:37:08,206: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:08.206976671Z [2024-03-28 23:37:08,206: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:08.207160928Z [2024-03-28 23:37:08,207: INFO/ForkPoolWorker-16] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:08.207412228Z [2024-03-28 23:37:08,207: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:08.207573249Z [2024-03-28 23:37:08,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:37:08.207887470Z [2024-03-28 23:37:08,207: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:37:08.208088367Z [2024-03-28 23:37:08,207: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:08.212817192Z [2024-03-28 23:37:08,212: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:08.289249565Z [2024-03-28 23:37:08,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:09.425805362Z [2024-03-28 23:37:09,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95c2a53d-8e2d-4689-9080-28bb04559ea1] succeeded in 3.3231309760001295s: None 2024-03-28T23:37:09.972472248Z [2024-03-28 23:37:09,971: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[802994a4-8bb7-4812-854f-d639b1247b67] succeeded in 3.5788271559999885s: None 2024-03-28T23:37:11.331514189Z [2024-03-28 23:37:11,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5c73a6d-270e-4d54-912e-646fa4a75625] received 2024-03-28T23:37:11.341321031Z [2024-03-28 23:37:11,341: INFO/ForkPoolWorker-15] [b5c73a6d-270e-4d54-912e-646fa4a75625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:11.651127587Z [2024-03-28 23:37:11,648: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:12.799191680Z [2024-03-28 23:37:12,798: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:12.802633319Z [2024-03-28 23:37:12,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:12.822273123Z [2024-03-28 23:37:12,822: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:12.824622754Z [2024-03-28 23:37:12,824: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:12.824944623Z [2024-03-28 23:37:12,824: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:12.825205867Z [2024-03-28 23:37:12,824: INFO/ForkPoolWorker-15] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:12.825647624Z [2024-03-28 23:37:12,825: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:12.825896329Z [2024-03-28 23:37:12,825: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:12.826505058Z [2024-03-28 23:37:12,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:12.826836763Z [2024-03-28 23:37:12,826: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:12.838391080Z [2024-03-28 23:37:12,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:12.903595105Z [2024-03-28 23:37:12,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:13.371597382Z [2024-03-28 23:37:13,369: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5c73a6d-270e-4d54-912e-646fa4a75625] succeeded in 2.0368721360000563s: None 2024-03-28T23:37:13.609015675Z [2024-03-28 23:37:13,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd9c25cf-c815-41f3-aac6-1c3b0e91a3a0] received 2024-03-28T23:37:13.615179623Z [2024-03-28 23:37:13,614: INFO/ForkPoolWorker-15] [cd9c25cf-c815-41f3-aac6-1c3b0e91a3a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:13.900862171Z [2024-03-28 23:37:13,897: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:14.963861379Z [2024-03-28 23:37:14,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:14.967197409Z [2024-03-28 23:37:14,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:14.985854548Z [2024-03-28 23:37:14,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:14.987350664Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:14.987446651Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:14.987538344Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] Read VIM deb13ed7-3a05-4765-b5e0-a45b9d33d8ad (basic01_253784) 2024-03-28T23:37:14.987702953Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'name': 'basic01_253784', 'vim_type': 'openstack'}] 2024-03-28T23:37:14.987764769Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:14.988035522Z [2024-03-28 23:37:14,987: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:14.988135329Z [2024-03-28 23:37:14,988: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:14.993885688Z [2024-03-28 23:37:14,993: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad 2024-03-28T23:37:15.059279271Z [2024-03-28 23:37:15,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:15.667657410Z [2024-03-28 23:37:15,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd9c25cf-c815-41f3-aac6-1c3b0e91a3a0] succeeded in 2.0567718519998834s: None 2024-03-28T23:37:15.850534824Z [2024-03-28 23:37:15,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5b4d696-a638-4b12-b979-25038d406c2a] received 2024-03-28T23:37:15.860781617Z [2024-03-28 23:37:15,860: INFO/ForkPoolWorker-15] [f5b4d696-a638-4b12-b979-25038d406c2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:16.138350221Z [2024-03-28 23:37:16,135: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:17.356225448Z [2024-03-28 23:37:17,355: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:17.359688962Z [2024-03-28 23:37:17,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:17.387920657Z [2024-03-28 23:37:17,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:17.389033616Z [2024-03-28 23:37:17,388: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:17.389165113Z [2024-03-28 23:37:17,388: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:17.389364272Z [2024-03-28 23:37:17,389: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:37:17.389441128Z [2024-03-28 23:37:17,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:17.389831769Z [2024-03-28 23:37:17,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:17.389951783Z [2024-03-28 23:37:17,389: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:17.403170477Z [2024-03-28 23:37:17,402: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:17.404171467Z [2024-03-28 23:37:17,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:17.405395012Z [2024-03-28 23:37:17,405: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:17.408425316Z [2024-03-28 23:37:17,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:17.422487708Z [2024-03-28 23:37:17,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:17.424079292Z [2024-03-28 23:37:17,423: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:17.424234363Z [2024-03-28 23:37:17,423: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:17.424491651Z [2024-03-28 23:37:17,424: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:37:17.424654336Z [2024-03-28 23:37:17,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:17.425015415Z [2024-03-28 23:37:17,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:17.425160209Z [2024-03-28 23:37:17,425: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:17.429465766Z [2024-03-28 23:37:17,428: ERROR/ForkPoolWorker-15] [f5b4d696-a638-4b12-b979-25038d406c2a] Failed to execute task Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:37:17.429479470Z Traceback (most recent call last): 2024-03-28T23:37:17.429483398Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:37:17.429487745Z args.func(args) 2024-03-28T23:37:17.429506406Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:37:17.429510223Z return func(*args, **kwargs) 2024-03-28T23:37:17.429513660Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:37:17.429516592Z return f(*args, **kwargs) 2024-03-28T23:37:17.429519640Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:37:17.429522993Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:37:17.429526107Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:37:17.429529348Z raise AirflowException( 2024-03-28T23:37:17.429535521Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:37:17.466159842Z [2024-03-28 23:37:17,464: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5b4d696-a638-4b12-b979-25038d406c2a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5b4d696-a638-4b12-b979-25038d406c2a') 2024-03-28T23:37:17.466182938Z Traceback (most recent call last): 2024-03-28T23:37:17.466187435Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:37:17.466190648Z R = retval = fun(*args, **kwargs) 2024-03-28T23:37:17.466193924Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:37:17.466197915Z return self.run(*args, **kwargs) 2024-03-28T23:37:17.466201494Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:37:17.466204946Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:37:17.466207972Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:37:17.466211516Z raise AirflowException(msg) 2024-03-28T23:37:17.466220719Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5b4d696-a638-4b12-b979-25038d406c2a 2024-03-28T23:37:28.119153666Z [2024-03-28 23:37:28,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9acc5b5b-7771-40d0-82de-3c015f403336] received 2024-03-28T23:37:28.126099108Z [2024-03-28 23:37:28,125: INFO/ForkPoolWorker-15] [9acc5b5b-7771-40d0-82de-3c015f403336] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:28.390922964Z [2024-03-28 23:37:28,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:29.438351266Z [2024-03-28 23:37:29,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:29.441567291Z [2024-03-28 23:37:29,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:29.458705495Z [2024-03-28 23:37:29,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:29.460077396Z [2024-03-28 23:37:29,459: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:29.460359916Z [2024-03-28 23:37:29,460: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:29.460531139Z [2024-03-28 23:37:29,460: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:29.460779549Z [2024-03-28 23:37:29,460: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:29.460892535Z [2024-03-28 23:37:29,460: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:29.461373507Z [2024-03-28 23:37:29,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:29.461481308Z [2024-03-28 23:37:29,461: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:29.467243949Z [2024-03-28 23:37:29,467: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:29.471049014Z [2024-03-28 23:37:29,470: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:29.471752101Z [2024-03-28 23:37:29,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:29.472662694Z [2024-03-28 23:37:29,472: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:29.475391651Z [2024-03-28 23:37:29,475: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:29.484999338Z [2024-03-28 23:37:29,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:29.486116518Z [2024-03-28 23:37:29,485: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:29.486285385Z [2024-03-28 23:37:29,486: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:29.486411204Z [2024-03-28 23:37:29,486: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:29.486669645Z [2024-03-28 23:37:29,486: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:29.486794323Z [2024-03-28 23:37:29,486: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:29.487244837Z [2024-03-28 23:37:29,486: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:29.487278050Z [2024-03-28 23:37:29,487: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:29.489908208Z [2024-03-28 23:37:29,489: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:29.493222830Z [2024-03-28 23:37:29,492: ERROR/ForkPoolWorker-15] [9acc5b5b-7771-40d0-82de-3c015f403336] Failed to execute task Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:37:29.493248730Z Traceback (most recent call last): 2024-03-28T23:37:29.493254948Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:37:29.493260936Z args.func(args) 2024-03-28T23:37:29.493266298Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:37:29.493274517Z return func(*args, **kwargs) 2024-03-28T23:37:29.493280989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:37:29.493285892Z return f(*args, **kwargs) 2024-03-28T23:37:29.493290287Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:37:29.493295227Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:37:29.493299589Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:37:29.493304681Z raise AirflowException( 2024-03-28T23:37:29.493311368Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:37:29.528175022Z [2024-03-28 23:37:29,527: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9acc5b5b-7771-40d0-82de-3c015f403336] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9acc5b5b-7771-40d0-82de-3c015f403336') 2024-03-28T23:37:29.528200544Z Traceback (most recent call last): 2024-03-28T23:37:29.528206874Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:37:29.528211948Z R = retval = fun(*args, **kwargs) 2024-03-28T23:37:29.528216388Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:37:29.528220885Z return self.run(*args, **kwargs) 2024-03-28T23:37:29.528225650Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:37:29.528230770Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:37:29.528234896Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:37:29.528241031Z raise AirflowException(msg) 2024-03-28T23:37:29.528246191Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9acc5b5b-7771-40d0-82de-3c015f403336 2024-03-28T23:37:37.125391370Z [2024-03-28 23:37:37,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfcd7c58-8e22-4bc2-b693-b0ff4f16d36b] received 2024-03-28T23:37:37.147904831Z [2024-03-28 23:37:37,147: INFO/ForkPoolWorker-15] [cfcd7c58-8e22-4bc2-b693-b0ff4f16d36b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:37.470530180Z [2024-03-28 23:37:37,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:37:38.453588502Z [2024-03-28 23:37:38,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[788735d3-14b7-423d-b5f2-841e421a66d6] received 2024-03-28T23:37:38.470303639Z [2024-03-28 23:37:38,469: INFO/ForkPoolWorker-16] [788735d3-14b7-423d-b5f2-841e421a66d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:38.511135181Z [2024-03-28 23:37:38,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:38.514348565Z [2024-03-28 23:37:38,513: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:38.540897305Z [2024-03-28 23:37:38,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:38.542572866Z [2024-03-28 23:37:38,542: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:38.542771757Z [2024-03-28 23:37:38,542: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:38.542828302Z [2024-03-28 23:37:38,542: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:38.542984505Z [2024-03-28 23:37:38,542: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:38.543039253Z [2024-03-28 23:37:38,542: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:38.543320609Z [2024-03-28 23:37:38,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:37:38.543419222Z [2024-03-28 23:37:38,543: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:38.547567782Z [2024-03-28 23:37:38,547: INFO/ForkPoolWorker-15] Creating DAG vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:38.610020532Z [2024-03-28 23:37:38,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:38.748733395Z [2024-03-28 23:37:38,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:37:39.829651619Z [2024-03-28 23:37:39,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:37:39.833261268Z [2024-03-28 23:37:39,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:39.849103032Z [2024-03-28 23:37:39,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:37:39.850294015Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:39.850347715Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:39.850495185Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:39.850645790Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:39.850714059Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:37:39.850974833Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:37:39.851067734Z [2024-03-28 23:37:39,850: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:39.855243731Z [2024-03-28 23:37:39,855: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:39.927202889Z [2024-03-28 23:37:39,926: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:40.083886660Z [2024-03-28 23:37:40,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfcd7c58-8e22-4bc2-b693-b0ff4f16d36b] succeeded in 2.9549402480001845s: None 2024-03-28T23:37:41.572597098Z [2024-03-28 23:37:41,572: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[788735d3-14b7-423d-b5f2-841e421a66d6] succeeded in 3.116214664999916s: None 2024-03-28T23:37:42.956285948Z [2024-03-28 23:37:42,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb691efd-6eb4-4a48-858e-1dc650f74d06] received 2024-03-28T23:37:42.967570376Z [2024-03-28 23:37:42,967: INFO/ForkPoolWorker-15] [fb691efd-6eb4-4a48-858e-1dc650f74d06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:43.283553631Z [2024-03-28 23:37:43,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:44.367173489Z [2024-03-28 23:37:44,366: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:44.374097367Z [2024-03-28 23:37:44,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:44.397702721Z [2024-03-28 23:37:44,397: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:44.399559431Z [2024-03-28 23:37:44,399: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:44.399756081Z [2024-03-28 23:37:44,399: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:44.399927281Z [2024-03-28 23:37:44,399: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:44.400171390Z [2024-03-28 23:37:44,399: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:44.400376838Z [2024-03-28 23:37:44,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:44.400784581Z [2024-03-28 23:37:44,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:44.400990177Z [2024-03-28 23:37:44,400: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:44.408022397Z [2024-03-28 23:37:44,407: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:44.475618242Z [2024-03-28 23:37:44,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:45.046708822Z [2024-03-28 23:37:45,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb691efd-6eb4-4a48-858e-1dc650f74d06] succeeded in 2.0855236670001887s: None 2024-03-28T23:37:45.320165757Z [2024-03-28 23:37:45,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21a17f98-d791-4155-b831-2ccd8f97dc5b] received 2024-03-28T23:37:45.326489770Z [2024-03-28 23:37:45,326: INFO/ForkPoolWorker-15] [21a17f98-d791-4155-b831-2ccd8f97dc5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:45.654476628Z [2024-03-28 23:37:45,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:46.758341433Z [2024-03-28 23:37:46,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:46.761857873Z [2024-03-28 23:37:46,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:46.784128782Z [2024-03-28 23:37:46,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:46.786282340Z [2024-03-28 23:37:46,786: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:46.786352866Z [2024-03-28 23:37:46,786: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:46.786574953Z [2024-03-28 23:37:46,786: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:46.786826116Z [2024-03-28 23:37:46,786: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:46.786834483Z [2024-03-28 23:37:46,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:46.787162040Z [2024-03-28 23:37:46,787: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:46.787586714Z [2024-03-28 23:37:46,787: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:46.793577174Z [2024-03-28 23:37:46,793: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:46.873445967Z [2024-03-28 23:37:46,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:47.495923569Z [2024-03-28 23:37:47,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21a17f98-d791-4155-b831-2ccd8f97dc5b] succeeded in 2.1738087290000294s: None 2024-03-28T23:37:48.403157797Z [2024-03-28 23:37:48,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84bcff41-2df9-4964-a274-8a6283b13e3d] received 2024-03-28T23:37:48.408391900Z [2024-03-28 23:37:48,408: INFO/ForkPoolWorker-15] [84bcff41-2df9-4964-a274-8a6283b13e3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:48.679139846Z [2024-03-28 23:37:48,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:49.751197162Z [2024-03-28 23:37:49,750: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:49.754509319Z [2024-03-28 23:37:49,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:49.775065292Z [2024-03-28 23:37:49,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:49.777906063Z [2024-03-28 23:37:49,777: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:49.777940161Z [2024-03-28 23:37:49,777: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:49.778269352Z [2024-03-28 23:37:49,778: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:49.778643528Z [2024-03-28 23:37:49,778: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:49.778709429Z [2024-03-28 23:37:49,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:49.779315038Z [2024-03-28 23:37:49,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:49.779343746Z [2024-03-28 23:37:49,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:49.791266989Z [2024-03-28 23:37:49,790: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:49.873788715Z [2024-03-28 23:37:49,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:50.401923843Z [2024-03-28 23:37:50,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84bcff41-2df9-4964-a274-8a6283b13e3d] succeeded in 1.9972572419999324s: None 2024-03-28T23:37:50.670138129Z [2024-03-28 23:37:50,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7a94f30-2e97-4c30-bf57-0a477a258b4f] received 2024-03-28T23:37:50.677557817Z [2024-03-28 23:37:50,677: INFO/ForkPoolWorker-15] [d7a94f30-2e97-4c30-bf57-0a477a258b4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'send_prometheus', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:50.968764806Z [2024-03-28 23:37:50,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:37:52.040452707Z [2024-03-28 23:37:52,040: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:37:52.043859992Z [2024-03-28 23:37:52,043: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:37:52.061044483Z [2024-03-28 23:37:52,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:37:52.062519471Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:37:52.062539895Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:37:52.062553660Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] Read VIM ed3012ac-4094-4b1a-a93d-f5b1d38e292a (basic01_976204) 2024-03-28T23:37:52.062772818Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'name': 'basic01_976204', 'vim_type': 'openstack'}] 2024-03-28T23:37:52.062801899Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:37:52.063022518Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:37:52.063031986Z [2024-03-28 23:37:52,062: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:37:52.069473093Z [2024-03-28 23:37:52,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a 2024-03-28T23:37:52.133898321Z [2024-03-28 23:37:52,133: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:37:52.629140599Z [2024-03-28 23:37:52,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7a94f30-2e97-4c30-bf57-0a477a258b4f] succeeded in 1.9572215470000174s: None 2024-03-28T23:38:00.742707202Z [2024-03-28 23:38:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e50df37-a683-414d-a5ee-973f5bdf251e] received 2024-03-28T23:38:00.745271820Z [2024-03-28 23:38:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3402445-5192-4498-b066-08401d7724f4] received 2024-03-28T23:38:00.750757976Z [2024-03-28 23:38:00,750: INFO/ForkPoolWorker-15] [7e50df37-a683-414d-a5ee-973f5bdf251e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:38:00.753031241Z [2024-03-28 23:38:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7273179b-2c09-406a-abef-aece0cacbda7] received 2024-03-28T23:38:00.759859574Z [2024-03-28 23:38:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b02d56d3-09b9-47d6-8f24-67ca944dc37c] received 2024-03-28T23:38:00.762556877Z [2024-03-28 23:38:00,762: INFO/ForkPoolWorker-16] [e3402445-5192-4498-b066-08401d7724f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:00.774418432Z [2024-03-28 23:38:00,771: INFO/ForkPoolWorker-1] [7273179b-2c09-406a-abef-aece0cacbda7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:00.782370536Z [2024-03-28 23:38:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cb2b937-da39-4fa1-a7b8-52198e2d4419] received 2024-03-28T23:38:00.795156233Z [2024-03-28 23:38:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c815a583-4e2c-4422-8568-6fc7820d12ed] received 2024-03-28T23:38:00.804482924Z [2024-03-28 23:38:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91267138-ae81-4b69-910e-bcb9e036b117] received 2024-03-28T23:38:00.809878697Z [2024-03-28 23:38:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2d426af-eeed-4c1f-b1cb-dc19bee7d214] received 2024-03-28T23:38:00.870757563Z [2024-03-28 23:38:00,870: INFO/ForkPoolWorker-6] [c2d426af-eeed-4c1f-b1cb-dc19bee7d214] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:00.880664389Z [2024-03-28 23:38:00,880: INFO/ForkPoolWorker-2] [b02d56d3-09b9-47d6-8f24-67ca944dc37c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:00.898950813Z [2024-03-28 23:38:00,898: INFO/ForkPoolWorker-4] [c815a583-4e2c-4422-8568-6fc7820d12ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:00.957544689Z [2024-03-28 23:38:00,957: INFO/ForkPoolWorker-5] [91267138-ae81-4b69-910e-bcb9e036b117] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:38:00.983756009Z [2024-03-28 23:38:00,983: INFO/ForkPoolWorker-3] [6cb2b937-da39-4fa1-a7b8-52198e2d4419] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:01.432441262Z [2024-03-28 23:38:01,428: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:01.477865232Z [2024-03-28 23:38:01,471: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:01.578567825Z [2024-03-28 23:38:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:38:01.643573558Z [2024-03-28 23:38:01,639: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:01.644529856Z [2024-03-28 23:38:01,640: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:01.676205881Z [2024-03-28 23:38:01,672: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:38:01.855679842Z [2024-03-28 23:38:01,827: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:01.860803869Z [2024-03-28 23:38:01,860: INFO/ForkPoolWorker-5] Getting SDNC list 2024-03-28T23:38:01.866860778Z [2024-03-28 23:38:01,866: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:01.932351954Z [2024-03-28 23:38:01,932: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T23:38:01.935343427Z [2024-03-28 23:38:01,935: INFO/ForkPoolWorker-5] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:38:01.935465226Z [2024-03-28 23:38:01,935: INFO/ForkPoolWorker-5] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:38:01.935592807Z [2024-03-28 23:38:01,935: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-03-28T23:38:01.935927934Z [2024-03-28 23:38:01,935: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:38:01.994192929Z [2024-03-28 23:38:01,990: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:02.082825706Z [2024-03-28 23:38:02,082: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:38:02.535751026Z [2024-03-28 23:38:02,535: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:38:03.828505305Z [2024-03-28 23:38:03,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e50df37-a683-414d-a5ee-973f5bdf251e] succeeded in 3.0841798970000127s: None 2024-03-28T23:38:03.829347991Z [2024-03-28 23:38:03,828: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[91267138-ae81-4b69-910e-bcb9e036b117] succeeded in 3.0172012620000714s: None 2024-03-28T23:38:04.520656873Z [2024-03-28 23:38:04,520: INFO/ForkPoolWorker-6] Getting VIM list 2024-03-28T23:38:04.525291642Z [2024-03-28 23:38:04,524: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.595919354Z [2024-03-28 23:38:04,595: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-03-28T23:38:04.609151992Z [2024-03-28 23:38:04,608: INFO/ForkPoolWorker-6] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.609191979Z [2024-03-28 23:38:04,609: INFO/ForkPoolWorker-6] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.609368856Z [2024-03-28 23:38:04,609: INFO/ForkPoolWorker-6] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.609513258Z [2024-03-28 23:38:04,609: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-03-28T23:38:04.609889647Z [2024-03-28 23:38:04,609: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:04.610019265Z [2024-03-28 23:38:04,609: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.620579305Z [2024-03-28 23:38:04,620: WARNING/ForkPoolWorker-6] Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:04.630136765Z [2024-03-28 23:38:04,629: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:04.635727492Z [2024-03-28 23:38:04,635: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T23:38:04.636839007Z [2024-03-28 23:38:04,636: INFO/ForkPoolWorker-6] Getting VIM list 2024-03-28T23:38:04.647339329Z [2024-03-28 23:38:04,646: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.660736072Z [2024-03-28 23:38:04,659: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.722527339Z [2024-03-28 23:38:04,713: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-03-28T23:38:04.722549779Z [2024-03-28 23:38:04,717: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T23:38:04.722553942Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.722557275Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.722561029Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.722565353Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T23:38:04.722568494Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:04.722571647Z [2024-03-28 23:38:04,719: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.732955638Z [2024-03-28 23:38:04,727: INFO/ForkPoolWorker-6] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.732963252Z [2024-03-28 23:38:04,727: INFO/ForkPoolWorker-6] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.732967405Z [2024-03-28 23:38:04,727: INFO/ForkPoolWorker-6] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.732971556Z [2024-03-28 23:38:04,728: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-03-28T23:38:04.732974775Z [2024-03-28 23:38:04,728: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:04.732978021Z [2024-03-28 23:38:04,728: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.734507969Z [2024-03-28 23:38:04,731: ERROR/ForkPoolWorker-6] [c2d426af-eeed-4c1f-b1cb-dc19bee7d214] Failed to execute task Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:04.734519901Z Traceback (most recent call last): 2024-03-28T23:38:04.734524223Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:04.734528016Z args.func(args) 2024-03-28T23:38:04.734543993Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:04.734547686Z return func(*args, **kwargs) 2024-03-28T23:38:04.734550687Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:04.734553710Z return f(*args, **kwargs) 2024-03-28T23:38:04.734556754Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:04.734560081Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:04.734563085Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:04.734566029Z raise AirflowException( 2024-03-28T23:38:04.734569721Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:04.750606034Z [2024-03-28 23:38:04,750: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:38:04.762591152Z [2024-03-28 23:38:04,754: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.796704298Z [2024-03-28 23:38:04,796: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[c2d426af-eeed-4c1f-b1cb-dc19bee7d214] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c2d426af-eeed-4c1f-b1cb-dc19bee7d214') 2024-03-28T23:38:04.796720764Z Traceback (most recent call last): 2024-03-28T23:38:04.796724850Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:04.796728056Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:04.796731160Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:04.796734184Z return self.run(*args, **kwargs) 2024-03-28T23:38:04.796751137Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:04.796755321Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:04.796758456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:04.796762409Z raise AirflowException(msg) 2024-03-28T23:38:04.796766063Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c2d426af-eeed-4c1f-b1cb-dc19bee7d214 2024-03-28T23:38:04.799608303Z [2024-03-28 23:38:04,799: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:38:04.800773801Z [2024-03-28 23:38:04,800: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.800788757Z [2024-03-28 23:38:04,800: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.800927779Z [2024-03-28 23:38:04,800: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.800974411Z [2024-03-28 23:38:04,800: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:38:04.801484864Z [2024-03-28 23:38:04,801: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:04.801507420Z [2024-03-28 23:38:04,801: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.807772587Z [2024-03-28 23:38:04,807: WARNING/ForkPoolWorker-2] Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:04.808408664Z [2024-03-28 23:38:04,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:04.809421299Z [2024-03-28 23:38:04,809: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:38:04.812076264Z [2024-03-28 23:38:04,811: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.838403874Z [2024-03-28 23:38:04,838: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:38:04.839886150Z [2024-03-28 23:38:04,839: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.839905451Z [2024-03-28 23:38:04,839: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.839912023Z [2024-03-28 23:38:04,839: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.839915891Z [2024-03-28 23:38:04,839: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:38:04.840903713Z [2024-03-28 23:38:04,840: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:04.840920621Z [2024-03-28 23:38:04,840: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.841804477Z [2024-03-28 23:38:04,841: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:38:04.844587265Z [2024-03-28 23:38:04,844: ERROR/ForkPoolWorker-2] [b02d56d3-09b9-47d6-8f24-67ca944dc37c] Failed to execute task Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:04.844598360Z Traceback (most recent call last): 2024-03-28T23:38:04.844602641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:04.844606482Z args.func(args) 2024-03-28T23:38:04.844610143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:04.844613694Z return func(*args, **kwargs) 2024-03-28T23:38:04.844616844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:04.844619936Z return f(*args, **kwargs) 2024-03-28T23:38:04.844622941Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:04.844625933Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:04.844636168Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:04.844639713Z raise AirflowException( 2024-03-28T23:38:04.844643553Z airflow.exceptions.AirflowException: Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:04.845652150Z [2024-03-28 23:38:04,845: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.874941912Z [2024-03-28 23:38:04,874: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:38:04.876505130Z [2024-03-28 23:38:04,876: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.876698253Z [2024-03-28 23:38:04,876: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.876926481Z [2024-03-28 23:38:04,876: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.877075392Z [2024-03-28 23:38:04,876: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:38:04.877507012Z [2024-03-28 23:38:04,877: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:04.877680690Z [2024-03-28 23:38:04,877: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.888552463Z [2024-03-28 23:38:04,888: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:04.889391221Z [2024-03-28 23:38:04,888: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:04.890384220Z [2024-03-28 23:38:04,890: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:38:04.891965856Z [2024-03-28 23:38:04,891: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:38:04.896815312Z [2024-03-28 23:38:04,896: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:04.897870169Z [2024-03-28 23:38:04,897: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b02d56d3-09b9-47d6-8f24-67ca944dc37c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b02d56d3-09b9-47d6-8f24-67ca944dc37c') 2024-03-28T23:38:04.897883291Z Traceback (most recent call last): 2024-03-28T23:38:04.897887688Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:04.897890876Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:04.897893974Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:04.897897141Z return self.run(*args, **kwargs) 2024-03-28T23:38:04.897900619Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:04.897904057Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:04.897914211Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:04.897931417Z raise AirflowException(msg) 2024-03-28T23:38:04.897935299Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b02d56d3-09b9-47d6-8f24-67ca944dc37c 2024-03-28T23:38:04.927604290Z [2024-03-28 23:38:04,927: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:38:04.932387078Z [2024-03-28 23:38:04,932: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:04.932682049Z [2024-03-28 23:38:04,932: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:04.933466481Z [2024-03-28 23:38:04,933: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:04.933650687Z [2024-03-28 23:38:04,933: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:38:04.933995881Z [2024-03-28 23:38:04,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:04.934283818Z [2024-03-28 23:38:04,934: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:04.937656168Z [2024-03-28 23:38:04,937: ERROR/ForkPoolWorker-1] [7273179b-2c09-406a-abef-aece0cacbda7] Failed to execute task Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:04.937669812Z Traceback (most recent call last): 2024-03-28T23:38:04.937673717Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:04.937677407Z args.func(args) 2024-03-28T23:38:04.937680993Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:04.937684822Z return func(*args, **kwargs) 2024-03-28T23:38:04.937687798Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:04.937698675Z return f(*args, **kwargs) 2024-03-28T23:38:04.937701748Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:04.937704707Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:04.937707709Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:04.937710674Z raise AirflowException( 2024-03-28T23:38:04.937715411Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:05.052139208Z [2024-03-28 23:38:05,051: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7273179b-2c09-406a-abef-aece0cacbda7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7273179b-2c09-406a-abef-aece0cacbda7') 2024-03-28T23:38:05.052153864Z Traceback (most recent call last): 2024-03-28T23:38:05.052157943Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:05.052168116Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:05.052171397Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:05.052174653Z return self.run(*args, **kwargs) 2024-03-28T23:38:05.052178389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:05.052193571Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:05.052196765Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:05.052200452Z raise AirflowException(msg) 2024-03-28T23:38:05.052204406Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7273179b-2c09-406a-abef-aece0cacbda7 2024-03-28T23:38:05.533812685Z [2024-03-28 23:38:05,533: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T23:38:05.537464987Z [2024-03-28 23:38:05,537: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:05.567920199Z [2024-03-28 23:38:05,567: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T23:38:05.569079607Z [2024-03-28 23:38:05,568: INFO/ForkPoolWorker-4] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:05.569094810Z [2024-03-28 23:38:05,569: INFO/ForkPoolWorker-4] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:05.569282901Z [2024-03-28 23:38:05,569: INFO/ForkPoolWorker-4] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:05.569354724Z [2024-03-28 23:38:05,569: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T23:38:05.569607120Z [2024-03-28 23:38:05,569: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:05.569680173Z [2024-03-28 23:38:05,569: INFO/ForkPoolWorker-4] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:05.578120596Z [2024-03-28 23:38:05,577: WARNING/ForkPoolWorker-4] Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:05.579010327Z [2024-03-28 23:38:05,578: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:05.580237911Z [2024-03-28 23:38:05,580: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T23:38:05.583989571Z [2024-03-28 23:38:05,583: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:05.598290834Z [2024-03-28 23:38:05,598: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T23:38:05.599638581Z [2024-03-28 23:38:05,599: INFO/ForkPoolWorker-4] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:05.599692630Z [2024-03-28 23:38:05,599: INFO/ForkPoolWorker-4] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:05.599839013Z [2024-03-28 23:38:05,599: INFO/ForkPoolWorker-4] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:05.599908685Z [2024-03-28 23:38:05,599: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T23:38:05.600148139Z [2024-03-28 23:38:05,600: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:05.600214987Z [2024-03-28 23:38:05,600: INFO/ForkPoolWorker-4] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:05.605047026Z [2024-03-28 23:38:05,603: ERROR/ForkPoolWorker-4] [c815a583-4e2c-4422-8568-6fc7820d12ed] Failed to execute task Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:05.605120252Z Traceback (most recent call last): 2024-03-28T23:38:05.605128355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:05.605133539Z args.func(args) 2024-03-28T23:38:05.605138479Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:05.605144107Z return func(*args, **kwargs) 2024-03-28T23:38:05.605149426Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:05.605154092Z return f(*args, **kwargs) 2024-03-28T23:38:05.605158221Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:05.605162445Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:05.605166800Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:05.605171015Z raise AirflowException( 2024-03-28T23:38:05.605186695Z airflow.exceptions.AirflowException: Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:05.637072930Z [2024-03-28 23:38:05,636: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:38:05.643338960Z [2024-03-28 23:38:05,642: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:05.739971125Z [2024-03-28 23:38:05,739: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:38:05.740969796Z [2024-03-28 23:38:05,738: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[c815a583-4e2c-4422-8568-6fc7820d12ed] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c815a583-4e2c-4422-8568-6fc7820d12ed') 2024-03-28T23:38:05.740978731Z Traceback (most recent call last): 2024-03-28T23:38:05.740982605Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:05.740985812Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:05.740988924Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:05.740992002Z return self.run(*args, **kwargs) 2024-03-28T23:38:05.740995901Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:05.740999694Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:05.741002746Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:05.741006176Z raise AirflowException(msg) 2024-03-28T23:38:05.741009912Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c815a583-4e2c-4422-8568-6fc7820d12ed 2024-03-28T23:38:05.742809197Z [2024-03-28 23:38:05,742: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:05.742915178Z [2024-03-28 23:38:05,742: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:05.743052799Z [2024-03-28 23:38:05,742: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:05.743091236Z [2024-03-28 23:38:05,743: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:38:05.743428327Z [2024-03-28 23:38:05,743: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:05.743720890Z [2024-03-28 23:38:05,743: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:05.846170785Z [2024-03-28 23:38:05,845: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:38:06.884891593Z [2024-03-28 23:38:06,884: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6cb2b937-da39-4fa1-a7b8-52198e2d4419] succeeded in 6.098650949000103s: None 2024-03-28T23:38:07.814512256Z [2024-03-28 23:38:07,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3402445-5192-4498-b066-08401d7724f4] succeeded in 7.060263045000056s: None 2024-03-28T23:38:16.086695843Z [2024-03-28 23:38:16,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c4f255b-46e2-4187-8fc0-7b498014eac4] received 2024-03-28T23:38:16.097632246Z [2024-03-28 23:38:16,097: INFO/ForkPoolWorker-15] [1c4f255b-46e2-4187-8fc0-7b498014eac4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:16.104055681Z [2024-03-28 23:38:16,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d63c7c3f-660a-449e-b0c7-2a940c0c4e5d] received 2024-03-28T23:38:16.111778708Z [2024-03-28 23:38:16,111: INFO/ForkPoolWorker-16] [d63c7c3f-660a-449e-b0c7-2a940c0c4e5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:16.448861844Z [2024-03-28 23:38:16,445: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:16.458386683Z [2024-03-28 23:38:16,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:16.932235443Z [2024-03-28 23:38:16,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68fd32b5-0556-46df-9f80-64ff2d03e026] received 2024-03-28T23:38:16.941458121Z [2024-03-28 23:38:16,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0546d229-5b0b-4701-ba1f-2c8c75304c56] received 2024-03-28T23:38:16.949046644Z [2024-03-28 23:38:16,948: INFO/ForkPoolWorker-2] [0546d229-5b0b-4701-ba1f-2c8c75304c56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:16.958358303Z [2024-03-28 23:38:16,958: INFO/ForkPoolWorker-1] [68fd32b5-0556-46df-9f80-64ff2d03e026] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:17.291027931Z [2024-03-28 23:38:17,286: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:17.347674562Z [2024-03-28 23:38:17,344: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:17.995965534Z [2024-03-28 23:38:17,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:38:17.999365848Z [2024-03-28 23:38:17,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.040296307Z [2024-03-28 23:38:18,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:38:18.041642640Z [2024-03-28 23:38:18,041: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.041697437Z [2024-03-28 23:38:18,041: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.041823401Z [2024-03-28 23:38:18,041: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.041860095Z [2024-03-28 23:38:18,041: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:38:18.042056419Z [2024-03-28 23:38:18,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:18.042096248Z [2024-03-28 23:38:18,042: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.048047262Z [2024-03-28 23:38:18,047: WARNING/ForkPoolWorker-15] Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:18.048825323Z [2024-03-28 23:38:18,048: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:18.049515068Z [2024-03-28 23:38:18,049: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:38:18.051992748Z [2024-03-28 23:38:18,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.091987983Z [2024-03-28 23:38:18,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:38:18.094027731Z [2024-03-28 23:38:18,093: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.094072360Z [2024-03-28 23:38:18,093: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.094258809Z [2024-03-28 23:38:18,094: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.096594764Z [2024-03-28 23:38:18,094: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:38:18.097231330Z [2024-03-28 23:38:18,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:18.097630062Z [2024-03-28 23:38:18,097: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.100818617Z [2024-03-28 23:38:18,100: ERROR/ForkPoolWorker-15] [1c4f255b-46e2-4187-8fc0-7b498014eac4] Failed to execute task Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:18.100833698Z Traceback (most recent call last): 2024-03-28T23:38:18.100837752Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:18.100842431Z args.func(args) 2024-03-28T23:38:18.100846048Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:18.100850480Z return func(*args, **kwargs) 2024-03-28T23:38:18.100853577Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:18.100856772Z return f(*args, **kwargs) 2024-03-28T23:38:18.100859815Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:18.100862941Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:18.100876794Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:18.100880134Z raise AirflowException( 2024-03-28T23:38:18.100885033Z airflow.exceptions.AirflowException: Dag 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:18.107853036Z [2024-03-28 23:38:18,107: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:38:18.120356401Z [2024-03-28 23:38:18,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.136030314Z [2024-03-28 23:38:18,135: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c4f255b-46e2-4187-8fc0-7b498014eac4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1c4f255b-46e2-4187-8fc0-7b498014eac4') 2024-03-28T23:38:18.136048305Z Traceback (most recent call last): 2024-03-28T23:38:18.136052799Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:18.136055894Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:18.136059003Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:18.136062506Z return self.run(*args, **kwargs) 2024-03-28T23:38:18.136066598Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:18.136071272Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:18.136074286Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:18.136079416Z raise AirflowException(msg) 2024-03-28T23:38:18.136083213Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1c4f255b-46e2-4187-8fc0-7b498014eac4 2024-03-28T23:38:18.159466613Z [2024-03-28 23:38:18,159: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:38:18.161015544Z [2024-03-28 23:38:18,160: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.161246323Z [2024-03-28 23:38:18,160: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.161461705Z [2024-03-28 23:38:18,161: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.161605925Z [2024-03-28 23:38:18,161: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:38:18.161933679Z [2024-03-28 23:38:18,161: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:18.162092729Z [2024-03-28 23:38:18,161: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.169414699Z [2024-03-28 23:38:18,169: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:18.170376131Z [2024-03-28 23:38:18,169: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:18.171415450Z [2024-03-28 23:38:18,171: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:38:18.174505741Z [2024-03-28 23:38:18,174: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.201533389Z [2024-03-28 23:38:18,201: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:38:18.207219537Z [2024-03-28 23:38:18,206: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.207485468Z [2024-03-28 23:38:18,207: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.207899795Z [2024-03-28 23:38:18,207: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.208145124Z [2024-03-28 23:38:18,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:38:18.208578728Z [2024-03-28 23:38:18,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:18.208792753Z [2024-03-28 23:38:18,208: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.214549426Z [2024-03-28 23:38:18,213: ERROR/ForkPoolWorker-16] [d63c7c3f-660a-449e-b0c7-2a940c0c4e5d] Failed to execute task Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:18.214570790Z Traceback (most recent call last): 2024-03-28T23:38:18.214578010Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:18.214587275Z args.func(args) 2024-03-28T23:38:18.214594105Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:18.214600908Z return func(*args, **kwargs) 2024-03-28T23:38:18.214606615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:18.214630134Z return f(*args, **kwargs) 2024-03-28T23:38:18.214635948Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:18.214641481Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:18.214647067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:18.214652610Z raise AirflowException( 2024-03-28T23:38:18.214679836Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:18.252368916Z [2024-03-28 23:38:18,251: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d63c7c3f-660a-449e-b0c7-2a940c0c4e5d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d63c7c3f-660a-449e-b0c7-2a940c0c4e5d') 2024-03-28T23:38:18.252390971Z Traceback (most recent call last): 2024-03-28T23:38:18.252396424Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:18.252400981Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:18.252405579Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:18.252409737Z return self.run(*args, **kwargs) 2024-03-28T23:38:18.252414447Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:18.252420211Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:18.252424288Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:18.252429431Z raise AirflowException(msg) 2024-03-28T23:38:18.252434781Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d63c7c3f-660a-449e-b0c7-2a940c0c4e5d 2024-03-28T23:38:18.733436730Z [2024-03-28 23:38:18,733: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:38:18.736799380Z [2024-03-28 23:38:18,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.753873980Z [2024-03-28 23:38:18,753: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:38:18.754999560Z [2024-03-28 23:38:18,754: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.755145035Z [2024-03-28 23:38:18,754: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.755332954Z [2024-03-28 23:38:18,755: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.755437000Z [2024-03-28 23:38:18,755: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:38:18.755782709Z [2024-03-28 23:38:18,755: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:18.755887166Z [2024-03-28 23:38:18,755: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.761834182Z [2024-03-28 23:38:18,761: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:18.762693138Z [2024-03-28 23:38:18,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:38:18.763526567Z [2024-03-28 23:38:18,763: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:38:18.766050857Z [2024-03-28 23:38:18,765: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.777160375Z [2024-03-28 23:38:18,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:38:18.778283950Z [2024-03-28 23:38:18,778: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.778364482Z [2024-03-28 23:38:18,778: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.778532535Z [2024-03-28 23:38:18,778: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.778954302Z [2024-03-28 23:38:18,778: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:38:18.779300452Z [2024-03-28 23:38:18,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:38:18.779697100Z [2024-03-28 23:38:18,779: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.782983846Z [2024-03-28 23:38:18,782: ERROR/ForkPoolWorker-1] [68fd32b5-0556-46df-9f80-64ff2d03e026] Failed to execute task Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:18.782998218Z Traceback (most recent call last): 2024-03-28T23:38:18.783002466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:18.783006766Z args.func(args) 2024-03-28T23:38:18.783010445Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:18.783014086Z return func(*args, **kwargs) 2024-03-28T23:38:18.783017141Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:18.783020152Z return f(*args, **kwargs) 2024-03-28T23:38:18.783023390Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:18.783026503Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:18.783029770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:18.783032877Z raise AirflowException( 2024-03-28T23:38:18.783036365Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:18.814204538Z [2024-03-28 23:38:18,813: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68fd32b5-0556-46df-9f80-64ff2d03e026] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 68fd32b5-0556-46df-9f80-64ff2d03e026') 2024-03-28T23:38:18.814221610Z Traceback (most recent call last): 2024-03-28T23:38:18.814226322Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:18.814242648Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:18.814245991Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:18.814248876Z return self.run(*args, **kwargs) 2024-03-28T23:38:18.814252379Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:18.814256140Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:18.814259097Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:18.814262399Z raise AirflowException(msg) 2024-03-28T23:38:18.814266212Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 68fd32b5-0556-46df-9f80-64ff2d03e026 2024-03-28T23:38:18.837075030Z [2024-03-28 23:38:18,836: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:38:18.840196722Z [2024-03-28 23:38:18,839: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.863864204Z [2024-03-28 23:38:18,863: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:38:18.864980311Z [2024-03-28 23:38:18,864: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.865014269Z [2024-03-28 23:38:18,864: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.865202258Z [2024-03-28 23:38:18,865: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.865246749Z [2024-03-28 23:38:18,865: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:38:18.865516187Z [2024-03-28 23:38:18,865: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:18.865533193Z [2024-03-28 23:38:18,865: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.872269400Z [2024-03-28 23:38:18,872: WARNING/ForkPoolWorker-2] Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:18.873092195Z [2024-03-28 23:38:18,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:38:18.873936456Z [2024-03-28 23:38:18,873: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:38:18.876929866Z [2024-03-28 23:38:18,876: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:38:18.892073358Z [2024-03-28 23:38:18,891: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:38:18.895127027Z [2024-03-28 23:38:18,894: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:38:18.895441290Z [2024-03-28 23:38:18,895: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:38:18.895653588Z [2024-03-28 23:38:18,895: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:38:18.895734324Z [2024-03-28 23:38:18,895: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:38:18.896149154Z [2024-03-28 23:38:18,895: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:38:18.896200064Z [2024-03-28 23:38:18,896: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:38:18.899728612Z [2024-03-28 23:38:18,899: ERROR/ForkPoolWorker-2] [0546d229-5b0b-4701-ba1f-2c8c75304c56] Failed to execute task Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:38:18.899744049Z Traceback (most recent call last): 2024-03-28T23:38:18.899748096Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:38:18.899751891Z args.func(args) 2024-03-28T23:38:18.899755520Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:38:18.899759262Z return func(*args, **kwargs) 2024-03-28T23:38:18.899762257Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:38:18.899765559Z return f(*args, **kwargs) 2024-03-28T23:38:18.899795110Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:38:18.899798660Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:38:18.899801729Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:38:18.899804825Z raise AirflowException( 2024-03-28T23:38:18.899808448Z airflow.exceptions.AirflowException: Dag 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:38:18.928553821Z [2024-03-28 23:38:18,927: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0546d229-5b0b-4701-ba1f-2c8c75304c56] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0546d229-5b0b-4701-ba1f-2c8c75304c56') 2024-03-28T23:38:18.928569410Z Traceback (most recent call last): 2024-03-28T23:38:18.928573614Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:38:18.928576769Z R = retval = fun(*args, **kwargs) 2024-03-28T23:38:18.928579776Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:38:18.928582788Z return self.run(*args, **kwargs) 2024-03-28T23:38:18.928590731Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:38:18.928594594Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:38:18.928597687Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:38:18.928601708Z raise AirflowException(msg) 2024-03-28T23:38:18.928607321Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0546d229-5b0b-4701-ba1f-2c8c75304c56 2024-03-28T23:39:00.604284935Z [2024-03-28 23:39:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fe6ca54-a9d5-4c24-bee6-4e6884af880a] received 2024-03-28T23:39:00.606958701Z [2024-03-28 23:39:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf903436-d0b0-4df8-b66e-c95298234b38] received 2024-03-28T23:39:00.616001341Z [2024-03-28 23:39:00,615: INFO/ForkPoolWorker-15] [4fe6ca54-a9d5-4c24-bee6-4e6884af880a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:39:00.616327443Z [2024-03-28 23:39:00,616: INFO/ForkPoolWorker-16] [bf903436-d0b0-4df8-b66e-c95298234b38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:39:00.618908995Z [2024-03-28 23:39:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[052fca32-e269-47c7-9cb0-665044c0329f] received 2024-03-28T23:39:00.638253311Z [2024-03-28 23:39:00,637: INFO/ForkPoolWorker-1] [052fca32-e269-47c7-9cb0-665044c0329f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:39:01.121363754Z [2024-03-28 23:39:01,118: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:39:01.124094090Z [2024-03-28 23:39:01,118: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:39:01.149485403Z [2024-03-28 23:39:01,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:39:01.311541987Z [2024-03-28 23:39:01,311: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:39:01.315676817Z [2024-03-28 23:39:01,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:39:01.350039534Z [2024-03-28 23:39:01,349: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:39:01.351550523Z [2024-03-28 23:39:01,351: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:39:01.351683724Z [2024-03-28 23:39:01,351: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:39:01.351772169Z [2024-03-28 23:39:01,351: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:39:01.351986255Z [2024-03-28 23:39:01,351: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:39:01.461985663Z [2024-03-28 23:39:01,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:39:02.180741540Z [2024-03-28 23:39:02,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fe6ca54-a9d5-4c24-bee6-4e6884af880a] succeeded in 1.5725415459999112s: None 2024-03-28T23:39:02.415616241Z [2024-03-28 23:39:02,415: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:39:02.419131902Z [2024-03-28 23:39:02,418: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:39:02.440384219Z [2024-03-28 23:39:02,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:39:02.441701641Z [2024-03-28 23:39:02,441: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:39:02.441742910Z [2024-03-28 23:39:02,441: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:39:02.441864374Z [2024-03-28 23:39:02,441: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:39:02.441898934Z [2024-03-28 23:39:02,441: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:39:02.442190596Z [2024-03-28 23:39:02,442: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:39:02.442218371Z [2024-03-28 23:39:02,442: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:39:02.458881663Z [2024-03-28 23:39:02,458: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:39:02.462432026Z [2024-03-28 23:39:02,461: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:39:02.484993392Z [2024-03-28 23:39:02,484: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:39:02.486379256Z [2024-03-28 23:39:02,486: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:39:02.486393642Z [2024-03-28 23:39:02,486: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:39:02.486645750Z [2024-03-28 23:39:02,486: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:39:02.486752149Z [2024-03-28 23:39:02,486: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:39:02.487217109Z [2024-03-28 23:39:02,486: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:39:02.487299733Z [2024-03-28 23:39:02,487: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:39:02.541536764Z [2024-03-28 23:39:02,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:39:02.581406832Z [2024-03-28 23:39:02,581: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:39:04.044938598Z [2024-03-28 23:39:04,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf903436-d0b0-4df8-b66e-c95298234b38] succeeded in 3.4359744680000404s: None 2024-03-28T23:39:04.427338831Z [2024-03-28 23:39:04,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[052fca32-e269-47c7-9cb0-665044c0329f] succeeded in 3.8057888289999937s: None 2024-03-28T23:40:00.330613114Z [2024-03-28 23:40:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21a80bd9-c95e-42e5-a5a6-805b57d597df] received 2024-03-28T23:40:00.339897922Z [2024-03-28 23:40:00,339: INFO/ForkPoolWorker-15] [21a80bd9-c95e-42e5-a5a6-805b57d597df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:40:00.344107338Z [2024-03-28 23:40:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad970d4a-26d0-45af-90d5-5c174d39c9f5] received 2024-03-28T23:40:00.346616307Z [2024-03-28 23:40:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a812a536-a001-4f50-acce-11944f74a2d7] received 2024-03-28T23:40:00.351120502Z [2024-03-28 23:40:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fba00af4-7631-46f0-85a9-55a8e40a64b5] received 2024-03-28T23:40:00.353167876Z [2024-03-28 23:40:00,352: INFO/ForkPoolWorker-1] [a812a536-a001-4f50-acce-11944f74a2d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:40:00.353887004Z [2024-03-28 23:40:00,353: INFO/ForkPoolWorker-16] [ad970d4a-26d0-45af-90d5-5c174d39c9f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:00.365498192Z [2024-03-28 23:40:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f64692ad-d8c7-4efc-aa43-e4de3eab5ac8] received 2024-03-28T23:40:00.367939801Z [2024-03-28 23:40:00,367: INFO/ForkPoolWorker-2] [fba00af4-7631-46f0-85a9-55a8e40a64b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:40:00.387331760Z [2024-03-28 23:40:00,386: INFO/ForkPoolWorker-3] [f64692ad-d8c7-4efc-aa43-e4de3eab5ac8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:40:00.706129819Z [2024-03-28 23:40:00,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:40:00.854500177Z [2024-03-28 23:40:00,850: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:40:00.944576101Z [2024-03-28 23:40:00,940: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:40:00.980470911Z [2024-03-28 23:40:00,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:40:01.032742308Z [2024-03-28 23:40:01,032: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T23:40:01.039888326Z [2024-03-28 23:40:01,037: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:01.083802537Z [2024-03-28 23:40:01,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:40:01.086261868Z [2024-03-28 23:40:01,085: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:40:01.086692720Z [2024-03-28 23:40:01,086: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:40:01.086935060Z [2024-03-28 23:40:01,086: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T23:40:01.087331370Z [2024-03-28 23:40:01,087: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:40:01.096777013Z [2024-03-28 23:40:01,092: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:40:01.280900653Z [2024-03-28 23:40:01,280: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:01.306019100Z [2024-03-28 23:40:01,305: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:02.039126846Z [2024-03-28 23:40:02,038: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f64692ad-d8c7-4efc-aa43-e4de3eab5ac8] succeeded in 1.6607884410000224s: None 2024-03-28T23:40:02.135942909Z [2024-03-28 23:40:02,135: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fba00af4-7631-46f0-85a9-55a8e40a64b5] succeeded in 1.7822078650001458s: None 2024-03-28T23:40:02.432658745Z [2024-03-28 23:40:02,432: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:40:02.436379802Z [2024-03-28 23:40:02,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:02.479623109Z [2024-03-28 23:40:02,479: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:40:02.483750687Z [2024-03-28 23:40:02,483: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:02.483797401Z [2024-03-28 23:40:02,483: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:02.483817530Z [2024-03-28 23:40:02,483: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:02.483922875Z [2024-03-28 23:40:02,483: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:40:02.484259102Z [2024-03-28 23:40:02,484: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:40:02.484359235Z [2024-03-28 23:40:02,484: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:02.613375053Z [2024-03-28 23:40:02,613: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:02.965428157Z [2024-03-28 23:40:02,964: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:40:02.969373371Z [2024-03-28 23:40:02,968: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:02.999141728Z [2024-03-28 23:40:02,998: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:40:03.013474549Z [2024-03-28 23:40:03,013: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:03.015011716Z [2024-03-28 23:40:03,014: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:03.015663852Z [2024-03-28 23:40:03,015: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:03.019114794Z [2024-03-28 23:40:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:40:03.019784958Z [2024-03-28 23:40:03,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:40:03.020129368Z [2024-03-28 23:40:03,019: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:03.123317777Z [2024-03-28 23:40:03,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:03.204822544Z [2024-03-28 23:40:03,204: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:40:03.209529525Z [2024-03-28 23:40:03,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:03.238016472Z [2024-03-28 23:40:03,237: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:40:03.239561542Z [2024-03-28 23:40:03,239: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:03.239738312Z [2024-03-28 23:40:03,239: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:03.240130072Z [2024-03-28 23:40:03,239: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:03.240347058Z [2024-03-28 23:40:03,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:40:03.241097297Z [2024-03-28 23:40:03,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:40:03.241239348Z [2024-03-28 23:40:03,241: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:03.342575527Z [2024-03-28 23:40:03,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:03.768275623Z [2024-03-28 23:40:03,767: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad970d4a-26d0-45af-90d5-5c174d39c9f5] succeeded in 3.4204040529998565s: None 2024-03-28T23:40:03.814526461Z [2024-03-28 23:40:03,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fc8a5ee-e409-42d6-8e17-be43febc6bc8] received 2024-03-28T23:40:03.824639412Z [2024-03-28 23:40:03,824: INFO/ForkPoolWorker-16] [0fc8a5ee-e409-42d6-8e17-be43febc6bc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:04.137082989Z [2024-03-28 23:40:04,133: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:40:04.538270400Z [2024-03-28 23:40:04,537: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a812a536-a001-4f50-acce-11944f74a2d7] succeeded in 4.190184659000124s: None 2024-03-28T23:40:05.002113132Z [2024-03-28 23:40:04,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21a80bd9-c95e-42e5-a5a6-805b57d597df] succeeded in 4.664985019000142s: None 2024-03-28T23:40:05.467255061Z [2024-03-28 23:40:05,466: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:40:05.471090674Z [2024-03-28 23:40:05,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:05.497201837Z [2024-03-28 23:40:05,496: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:40:05.500217367Z [2024-03-28 23:40:05,499: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:05.500629209Z [2024-03-28 23:40:05,500: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:05.501177815Z [2024-03-28 23:40:05,500: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:05.501506124Z [2024-03-28 23:40:05,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:40:05.502237171Z [2024-03-28 23:40:05,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:40:05.502595039Z [2024-03-28 23:40:05,502: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:05.586362240Z [2024-03-28 23:40:05,586: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:06.363712345Z [2024-03-28 23:40:06,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0fc8a5ee-e409-42d6-8e17-be43febc6bc8] succeeded in 2.547509982999827s: None 2024-03-28T23:40:06.439101550Z [2024-03-28 23:40:06,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d856978f-44fc-4ed4-8038-bc339d297435] received 2024-03-28T23:40:06.467319608Z [2024-03-28 23:40:06,466: INFO/ForkPoolWorker-15] [d856978f-44fc-4ed4-8038-bc339d297435] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:40:06.837204286Z [2024-03-28 23:40:06,832: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:40:08.244635742Z [2024-03-28 23:40:08,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:40:08.248529797Z [2024-03-28 23:40:08,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:08.268374339Z [2024-03-28 23:40:08,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:40:08.269730378Z [2024-03-28 23:40:08,269: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:08.269751157Z [2024-03-28 23:40:08,269: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:08.269868299Z [2024-03-28 23:40:08,269: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:08.269887440Z [2024-03-28 23:40:08,269: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:40:08.270121790Z [2024-03-28 23:40:08,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:40:08.270164938Z [2024-03-28 23:40:08,270: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:08.358292724Z [2024-03-28 23:40:08,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:08.890382774Z [2024-03-28 23:40:08,889: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d856978f-44fc-4ed4-8038-bc339d297435] succeeded in 2.4467826100001275s: None 2024-03-28T23:40:09.253968375Z [2024-03-28 23:40:09,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa1d023f-62f3-4627-a17b-4f68ea5ea1d2] received 2024-03-28T23:40:09.261219389Z [2024-03-28 23:40:09,260: INFO/ForkPoolWorker-15] [aa1d023f-62f3-4627-a17b-4f68ea5ea1d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:09.538421861Z [2024-03-28 23:40:09,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:40:10.693294657Z [2024-03-28 23:40:10,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:40:10.696600592Z [2024-03-28 23:40:10,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:40:10.722423656Z [2024-03-28 23:40:10,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:40:10.723903232Z [2024-03-28 23:40:10,723: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:40:10.724026858Z [2024-03-28 23:40:10,723: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:40:10.724242529Z [2024-03-28 23:40:10,723: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:40:10.724278486Z [2024-03-28 23:40:10,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:40:10.724686957Z [2024-03-28 23:40:10,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:40:10.724824360Z [2024-03-28 23:40:10,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:40:10.824287804Z [2024-03-28 23:40:10,823: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:40:11.441789555Z [2024-03-28 23:40:11,441: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa1d023f-62f3-4627-a17b-4f68ea5ea1d2] succeeded in 2.1859613139999965s: None 2024-03-28T23:41:01.324879591Z [2024-03-28 23:41:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f5a2d96-06d9-4af3-8db9-e369def3d53a] received 2024-03-28T23:41:01.350652953Z [2024-03-28 23:41:01,350: INFO/ForkPoolWorker-15] [4f5a2d96-06d9-4af3-8db9-e369def3d53a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:41:01.376721408Z [2024-03-28 23:41:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76bf1d97-a666-4226-b316-2cf827e029ee] received 2024-03-28T23:41:01.380127902Z [2024-03-28 23:41:01,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87edf8cf-11a7-4df5-94ba-32d8c37b6e52] received 2024-03-28T23:41:01.415827660Z [2024-03-28 23:41:01,415: INFO/ForkPoolWorker-1] [87edf8cf-11a7-4df5-94ba-32d8c37b6e52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:41:01.629286666Z [2024-03-28 23:41:01,628: INFO/ForkPoolWorker-16] [76bf1d97-a666-4226-b316-2cf827e029ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:41:02.636564703Z [2024-03-28 23:41:02,625: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:41:02.709824568Z [2024-03-28 23:41:02,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:41:02.863260056Z [2024-03-28 23:41:02,862: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T23:41:02.867603721Z [2024-03-28 23:41:02,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:41:03.125176340Z [2024-03-28 23:41:03,119: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:41:03.162939170Z [2024-03-28 23:41:03,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:41:03.165826299Z [2024-03-28 23:41:03,165: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:41:03.167391811Z [2024-03-28 23:41:03,165: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:41:03.167726955Z [2024-03-28 23:41:03,167: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T23:41:03.168222132Z [2024-03-28 23:41:03,167: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:41:03.359049568Z [2024-03-28 23:41:03,358: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:41:04.652194981Z [2024-03-28 23:41:04,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76bf1d97-a666-4226-b316-2cf827e029ee] succeeded in 3.268300231000012s: None 2024-03-28T23:41:05.478067445Z [2024-03-28 23:41:05,477: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:41:05.482780744Z [2024-03-28 23:41:05,481: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:41:05.539760986Z [2024-03-28 23:41:05,538: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:41:05.544135106Z [2024-03-28 23:41:05,542: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:41:05.544156070Z [2024-03-28 23:41:05,542: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:41:05.544160511Z [2024-03-28 23:41:05,542: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:41:05.544173245Z [2024-03-28 23:41:05,543: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:41:05.544176663Z [2024-03-28 23:41:05,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:41:05.544179877Z [2024-03-28 23:41:05,543: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:41:05.942620131Z [2024-03-28 23:41:05,927: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:41:05.945276742Z [2024-03-28 23:41:05,944: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:41:05.962645693Z [2024-03-28 23:41:05,951: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:41:06.139266217Z [2024-03-28 23:41:06,139: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:41:06.165616291Z [2024-03-28 23:41:06,165: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:41:06.166908047Z [2024-03-28 23:41:06,165: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:41:06.167816602Z [2024-03-28 23:41:06,167: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:41:06.167935335Z [2024-03-28 23:41:06,167: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:41:06.168993983Z [2024-03-28 23:41:06,168: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:41:06.170488939Z [2024-03-28 23:41:06,168: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:41:06.414172654Z [2024-03-28 23:41:06,405: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:41:08.706022334Z [2024-03-28 23:41:08,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87edf8cf-11a7-4df5-94ba-32d8c37b6e52] succeeded in 7.324307573000169s: None 2024-03-28T23:41:09.602916004Z [2024-03-28 23:41:09,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f5a2d96-06d9-4af3-8db9-e369def3d53a] succeeded in 8.273386925000068s: None 2024-03-28T23:42:00.859669060Z [2024-03-28 23:42:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[183441de-491d-4cc7-bacc-0f8f6047d892] received 2024-03-28T23:42:00.871607942Z [2024-03-28 23:42:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[998c9a08-0de9-4be5-9f51-55a2d355533e] received 2024-03-28T23:42:00.873657102Z [2024-03-28 23:42:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faaedc6b-f4b6-410c-b5e5-4d0d4afb5fbb] received 2024-03-28T23:42:00.876357654Z [2024-03-28 23:42:00,875: INFO/ForkPoolWorker-15] [183441de-491d-4cc7-bacc-0f8f6047d892] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:42:00.887166276Z [2024-03-28 23:42:00,886: INFO/ForkPoolWorker-1] [faaedc6b-f4b6-410c-b5e5-4d0d4afb5fbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:42:00.891865237Z [2024-03-28 23:42:00,891: INFO/ForkPoolWorker-16] [998c9a08-0de9-4be5-9f51-55a2d355533e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:42:00.892683597Z [2024-03-28 23:42:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6890d2d-952d-45e4-832a-f4a323a1b8ea] received 2024-03-28T23:42:00.907519521Z [2024-03-28 23:42:00,907: INFO/ForkPoolWorker-2] [e6890d2d-952d-45e4-832a-f4a323a1b8ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:42:01.196612825Z [2024-03-28 23:42:01,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:42:01.365773083Z [2024-03-28 23:42:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:42:01.430925686Z [2024-03-28 23:42:01,425: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:42:01.447634535Z [2024-03-28 23:42:01,440: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:42:01.497063414Z [2024-03-28 23:42:01,496: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:42:01.593279881Z [2024-03-28 23:42:01,592: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:42:01.602039789Z [2024-03-28 23:42:01,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:42:01.628069869Z [2024-03-28 23:42:01,627: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:42:01.631219154Z [2024-03-28 23:42:01,630: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:42:01.631276288Z [2024-03-28 23:42:01,631: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:42:01.631287733Z [2024-03-28 23:42:01,631: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:42:01.631520721Z [2024-03-28 23:42:01,631: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:42:01.739436224Z [2024-03-28 23:42:01,739: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:42:02.209008343Z [2024-03-28 23:42:02,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[183441de-491d-4cc7-bacc-0f8f6047d892] succeeded in 1.3451351900000645s: None 2024-03-28T23:42:02.462173192Z [2024-03-28 23:42:02,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[faaedc6b-f4b6-410c-b5e5-4d0d4afb5fbb] succeeded in 1.5851452050001171s: None 2024-03-28T23:42:03.161513497Z [2024-03-28 23:42:03,161: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:42:03.165568693Z [2024-03-28 23:42:03,164: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:42:03.192980992Z [2024-03-28 23:42:03,192: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:42:03.194600505Z [2024-03-28 23:42:03,194: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:42:03.194755106Z [2024-03-28 23:42:03,194: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:42:03.194950643Z [2024-03-28 23:42:03,194: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:42:03.195123511Z [2024-03-28 23:42:03,194: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:42:03.195643332Z [2024-03-28 23:42:03,195: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:42:03.195747084Z [2024-03-28 23:42:03,195: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:42:03.302987020Z [2024-03-28 23:42:03,302: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:42:03.339975127Z [2024-03-28 23:42:03,339: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:42:03.344356109Z [2024-03-28 23:42:03,343: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:42:03.383447114Z [2024-03-28 23:42:03,383: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:42:03.387868909Z [2024-03-28 23:42:03,387: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:42:03.387914795Z [2024-03-28 23:42:03,387: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:42:03.387978359Z [2024-03-28 23:42:03,387: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:42:03.388025284Z [2024-03-28 23:42:03,387: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:42:03.388346983Z [2024-03-28 23:42:03,388: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:42:03.388382511Z [2024-03-28 23:42:03,388: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:42:03.506366911Z [2024-03-28 23:42:03,505: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:42:05.116909557Z [2024-03-28 23:42:05,116: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e6890d2d-952d-45e4-832a-f4a323a1b8ea] succeeded in 4.2210437840001305s: None 2024-03-28T23:42:05.381082108Z [2024-03-28 23:42:05,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[998c9a08-0de9-4be5-9f51-55a2d355533e] succeeded in 4.506754986000033s: None 2024-03-28T23:43:01.168053550Z [2024-03-28 23:43:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc43c0df-65f3-480e-aa3f-03515344f6df] received 2024-03-28T23:43:01.171774286Z [2024-03-28 23:43:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9331041-4086-47bf-8f68-3ff67bda109c] received 2024-03-28T23:43:01.175110158Z [2024-03-28 23:43:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0b4b423-80e3-49c4-8afc-63e5ebd83d35] received 2024-03-28T23:43:01.180194552Z [2024-03-28 23:43:01,179: INFO/ForkPoolWorker-15] [fc43c0df-65f3-480e-aa3f-03515344f6df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:43:01.187171335Z [2024-03-28 23:43:01,186: INFO/ForkPoolWorker-1] [e0b4b423-80e3-49c4-8afc-63e5ebd83d35] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:43:01.189610617Z [2024-03-28 23:43:01,189: INFO/ForkPoolWorker-16] [b9331041-4086-47bf-8f68-3ff67bda109c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:43:01.525173379Z [2024-03-28 23:43:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:43:01.562899050Z [2024-03-28 23:43:01,559: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:43:01.625183782Z [2024-03-28 23:43:01,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:43:01.761581356Z [2024-03-28 23:43:01,761: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:43:01.766617604Z [2024-03-28 23:43:01,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:43:01.797668738Z [2024-03-28 23:43:01,797: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:43:01.799713395Z [2024-03-28 23:43:01,799: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:43:01.799850666Z [2024-03-28 23:43:01,799: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:43:01.799948260Z [2024-03-28 23:43:01,799: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:43:01.800277414Z [2024-03-28 23:43:01,800: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:43:01.938059526Z [2024-03-28 23:43:01,937: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:43:02.696725648Z [2024-03-28 23:43:02,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0b4b423-80e3-49c4-8afc-63e5ebd83d35] succeeded in 1.5185647569999219s: None 2024-03-28T23:43:03.027308478Z [2024-03-28 23:43:03,026: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:43:03.031566253Z [2024-03-28 23:43:03,030: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:43:03.041674911Z [2024-03-28 23:43:03,041: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:43:03.045565674Z [2024-03-28 23:43:03,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:43:03.051001987Z [2024-03-28 23:43:03,050: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:43:03.052530626Z [2024-03-28 23:43:03,052: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:43:03.052713003Z [2024-03-28 23:43:03,052: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:43:03.052969587Z [2024-03-28 23:43:03,052: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:43:03.053033774Z [2024-03-28 23:43:03,052: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:43:03.053462580Z [2024-03-28 23:43:03,053: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:43:03.053630970Z [2024-03-28 23:43:03,053: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:43:03.067592822Z [2024-03-28 23:43:03,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:43:03.069083217Z [2024-03-28 23:43:03,068: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:43:03.069269329Z [2024-03-28 23:43:03,068: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:43:03.069516333Z [2024-03-28 23:43:03,069: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:43:03.069703160Z [2024-03-28 23:43:03,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:43:03.070095528Z [2024-03-28 23:43:03,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:43:03.070124847Z [2024-03-28 23:43:03,070: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:43:03.142317061Z [2024-03-28 23:43:03,141: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:43:03.163521611Z [2024-03-28 23:43:03,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:43:05.575903971Z [2024-03-28 23:43:05,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc43c0df-65f3-480e-aa3f-03515344f6df] succeeded in 4.402850704999992s: None 2024-03-28T23:43:05.596952042Z [2024-03-28 23:43:05,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9331041-4086-47bf-8f68-3ff67bda109c] succeeded in 4.423745951000001s: None 2024-03-28T23:44:00.515151687Z [2024-03-28 23:44:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fad0f8f-8a3a-402d-bd27-c491248081e8] received 2024-03-28T23:44:00.520574967Z [2024-03-28 23:44:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a265f5de-5448-4161-8b8b-5aa6dfba35a4] received 2024-03-28T23:44:00.524930600Z [2024-03-28 23:44:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e4d8302-ffe3-4ea1-a306-6aad00303c1a] received 2024-03-28T23:44:00.527927683Z [2024-03-28 23:44:00,527: INFO/ForkPoolWorker-15] [2fad0f8f-8a3a-402d-bd27-c491248081e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:44:00.531894626Z [2024-03-28 23:44:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5ddf2c1-1d93-46dc-97fc-9cfa459fc9bb] received 2024-03-28T23:44:00.533908943Z [2024-03-28 23:44:00,533: INFO/ForkPoolWorker-16] [a265f5de-5448-4161-8b8b-5aa6dfba35a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:44:00.546870466Z [2024-03-28 23:44:00,546: INFO/ForkPoolWorker-2] [f5ddf2c1-1d93-46dc-97fc-9cfa459fc9bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:44:00.547654272Z [2024-03-28 23:44:00,547: INFO/ForkPoolWorker-1] [5e4d8302-ffe3-4ea1-a306-6aad00303c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:44:00.884801134Z [2024-03-28 23:44:00,881: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:44:00.966846677Z [2024-03-28 23:44:00,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:44:00.995671888Z [2024-03-28 23:44:00,991: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:44:01.031737880Z [2024-03-28 23:44:01,027: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:44:01.218575512Z [2024-03-28 23:44:01,218: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:44:01.218600292Z [2024-03-28 23:44:01,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:44:01.222985050Z [2024-03-28 23:44:01,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:44:01.262841054Z [2024-03-28 23:44:01,262: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:44:01.267371417Z [2024-03-28 23:44:01,267: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:44:01.267393175Z [2024-03-28 23:44:01,267: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:44:01.267502725Z [2024-03-28 23:44:01,267: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:44:01.267739402Z [2024-03-28 23:44:01,267: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:44:01.409300783Z [2024-03-28 23:44:01,409: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:44:01.885662687Z [2024-03-28 23:44:01,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fad0f8f-8a3a-402d-bd27-c491248081e8] succeeded in 1.3675502599999163s: None 2024-03-28T23:44:02.241811304Z [2024-03-28 23:44:02,241: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e4d8302-ffe3-4ea1-a306-6aad00303c1a] succeeded in 1.7144832160001897s: None 2024-03-28T23:44:02.586017124Z [2024-03-28 23:44:02,585: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:44:02.590066544Z [2024-03-28 23:44:02,589: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:44:02.627380963Z [2024-03-28 23:44:02,627: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:44:02.635368359Z [2024-03-28 23:44:02,635: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:44:02.635529556Z [2024-03-28 23:44:02,635: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:44:02.635725825Z [2024-03-28 23:44:02,635: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:44:02.635857695Z [2024-03-28 23:44:02,635: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:44:02.636229450Z [2024-03-28 23:44:02,636: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:44:02.636274559Z [2024-03-28 23:44:02,636: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:44:02.655142243Z [2024-03-28 23:44:02,654: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:44:02.658870962Z [2024-03-28 23:44:02,658: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:44:02.707366942Z [2024-03-28 23:44:02,707: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:44:02.711760425Z [2024-03-28 23:44:02,711: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:44:02.714733166Z [2024-03-28 23:44:02,711: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:44:02.715054750Z [2024-03-28 23:44:02,714: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:44:02.715204585Z [2024-03-28 23:44:02,715: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:44:02.717089705Z [2024-03-28 23:44:02,715: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:44:02.717288987Z [2024-03-28 23:44:02,717: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:44:02.778650130Z [2024-03-28 23:44:02,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:44:02.873336120Z [2024-03-28 23:44:02,872: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:44:04.463926551Z [2024-03-28 23:44:04,463: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f5ddf2c1-1d93-46dc-97fc-9cfa459fc9bb] succeeded in 3.9274970030000986s: None 2024-03-28T23:44:04.908252027Z [2024-03-28 23:44:04,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a265f5de-5448-4161-8b8b-5aa6dfba35a4] succeeded in 4.3854908929999965s: None 2024-03-28T23:45:00.357492543Z [2024-03-28 23:45:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd79b514-cc42-464a-beb5-e69ad440c476] received 2024-03-28T23:45:00.362316811Z [2024-03-28 23:45:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54e4e322-c2fb-4c50-ad3b-b1b0ac4c897f] received 2024-03-28T23:45:00.372529831Z [2024-03-28 23:45:00,371: INFO/ForkPoolWorker-16] [54e4e322-c2fb-4c50-ad3b-b1b0ac4c897f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:45:00.374207428Z [2024-03-28 23:45:00,373: INFO/ForkPoolWorker-15] [bd79b514-cc42-464a-beb5-e69ad440c476] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:00.379114567Z [2024-03-28 23:45:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56f546e7-cb23-4e8c-b412-f410637ec516] received 2024-03-28T23:45:00.383612739Z [2024-03-28 23:45:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a35ac93e-1c65-45b4-a097-caa0c8c28bdd] received 2024-03-28T23:45:00.395614275Z [2024-03-28 23:45:00,395: INFO/ForkPoolWorker-2] [a35ac93e-1c65-45b4-a097-caa0c8c28bdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:45:00.411339930Z [2024-03-28 23:45:00,410: INFO/ForkPoolWorker-1] [56f546e7-cb23-4e8c-b412-f410637ec516] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:45:00.687223338Z [2024-03-28 23:45:00,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:45:00.746206915Z [2024-03-28 23:45:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:45:00.828335850Z [2024-03-28 23:45:00,824: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:45:00.879444574Z [2024-03-28 23:45:00,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:45:01.027831376Z [2024-03-28 23:45:01,027: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:45:01.033233127Z [2024-03-28 23:45:01,032: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:01.059613629Z [2024-03-28 23:45:01,059: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:45:01.063333930Z [2024-03-28 23:45:01,063: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:45:01.063390348Z [2024-03-28 23:45:01,063: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:45:01.063399252Z [2024-03-28 23:45:01,063: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:45:01.063582299Z [2024-03-28 23:45:01,063: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:45:01.205630745Z [2024-03-28 23:45:01,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:01.936746086Z [2024-03-28 23:45:01,935: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56f546e7-cb23-4e8c-b412-f410637ec516] succeeded in 1.5473613500000738s: None 2024-03-28T23:45:02.501079700Z [2024-03-28 23:45:02,500: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:45:02.509657017Z [2024-03-28 23:45:02,508: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:02.548266935Z [2024-03-28 23:45:02,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:45:02.553141273Z [2024-03-28 23:45:02,552: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:02.554018254Z [2024-03-28 23:45:02,553: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:02.554389615Z [2024-03-28 23:45:02,554: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:02.554606667Z [2024-03-28 23:45:02,554: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:45:02.555104921Z [2024-03-28 23:45:02,554: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:45:02.555354673Z [2024-03-28 23:45:02,555: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:02.611164341Z [2024-03-28 23:45:02,610: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:45:02.625432823Z [2024-03-28 23:45:02,624: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:02.660878553Z [2024-03-28 23:45:02,660: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:45:02.664696276Z [2024-03-28 23:45:02,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:02.678157125Z [2024-03-28 23:45:02,677: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:45:02.679949798Z [2024-03-28 23:45:02,679: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:02.680045115Z [2024-03-28 23:45:02,679: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:02.680249392Z [2024-03-28 23:45:02,680: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:02.680292365Z [2024-03-28 23:45:02,680: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:45:02.680588241Z [2024-03-28 23:45:02,680: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:45:02.680688189Z [2024-03-28 23:45:02,680: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:02.713273123Z [2024-03-28 23:45:02,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:45:02.717774785Z [2024-03-28 23:45:02,717: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:02.717930902Z [2024-03-28 23:45:02,717: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:02.718250619Z [2024-03-28 23:45:02,717: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:02.718421475Z [2024-03-28 23:45:02,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:45:02.718883194Z [2024-03-28 23:45:02,718: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:45:02.719070713Z [2024-03-28 23:45:02,718: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:02.744265532Z [2024-03-28 23:45:02,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:02.821284865Z [2024-03-28 23:45:02,821: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:02.880289185Z [2024-03-28 23:45:02,878: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:03.759510370Z [2024-03-28 23:45:03,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd79b514-cc42-464a-beb5-e69ad440c476] succeeded in 3.393966798999827s: None 2024-03-28T23:45:04.227153505Z [2024-03-28 23:45:04,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b438cdfb-769b-497a-8928-1e125f8158f7] received 2024-03-28T23:45:04.243175430Z [2024-03-28 23:45:04,242: INFO/ForkPoolWorker-15] [b438cdfb-769b-497a-8928-1e125f8158f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:04.565664974Z [2024-03-28 23:45:04,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:45:04.625761109Z [2024-03-28 23:45:04,625: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a35ac93e-1c65-45b4-a097-caa0c8c28bdd] succeeded in 4.237749308000048s: None 2024-03-28T23:45:04.957862363Z [2024-03-28 23:45:04,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54e4e322-c2fb-4c50-ad3b-b1b0ac4c897f] succeeded in 4.593480256000021s: None 2024-03-28T23:45:05.902867626Z [2024-03-28 23:45:05,902: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:45:05.906691944Z [2024-03-28 23:45:05,906: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:05.935725112Z [2024-03-28 23:45:05,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:45:05.939753274Z [2024-03-28 23:45:05,939: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:05.939949259Z [2024-03-28 23:45:05,939: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:05.940157715Z [2024-03-28 23:45:05,939: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:05.940210929Z [2024-03-28 23:45:05,940: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:45:05.940503131Z [2024-03-28 23:45:05,940: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:45:05.941828222Z [2024-03-28 23:45:05,940: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:06.023157747Z [2024-03-28 23:45:06,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:06.719789761Z [2024-03-28 23:45:06,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b438cdfb-769b-497a-8928-1e125f8158f7] succeeded in 2.4883794140000646s: None 2024-03-28T23:45:06.827090109Z [2024-03-28 23:45:06,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5e3e9eb-2abf-42ac-a051-78de58d43249] received 2024-03-28T23:45:06.846535778Z [2024-03-28 23:45:06,846: INFO/ForkPoolWorker-15] [a5e3e9eb-2abf-42ac-a051-78de58d43249] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:45:07.201804374Z [2024-03-28 23:45:07,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:45:08.658177444Z [2024-03-28 23:45:08,657: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:45:08.661722010Z [2024-03-28 23:45:08,661: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:08.704553141Z [2024-03-28 23:45:08,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:45:08.711922890Z [2024-03-28 23:45:08,711: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:08.712377445Z [2024-03-28 23:45:08,711: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:08.713014602Z [2024-03-28 23:45:08,712: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:08.713586342Z [2024-03-28 23:45:08,713: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:45:08.713977268Z [2024-03-28 23:45:08,713: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:45:08.714560096Z [2024-03-28 23:45:08,713: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:08.799103963Z [2024-03-28 23:45:08,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:09.384114403Z [2024-03-28 23:45:09,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5e3e9eb-2abf-42ac-a051-78de58d43249] succeeded in 2.5531006609999167s: None 2024-03-28T23:45:09.401267570Z [2024-03-28 23:45:09,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e012f514-8592-4dec-a5ef-404662c8c364] received 2024-03-28T23:45:09.408034018Z [2024-03-28 23:45:09,407: INFO/ForkPoolWorker-15] [e012f514-8592-4dec-a5ef-404662c8c364] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:09.688948132Z [2024-03-28 23:45:09,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:45:10.834907628Z [2024-03-28 23:45:10,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:45:10.838779381Z [2024-03-28 23:45:10,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:45:10.867687608Z [2024-03-28 23:45:10,867: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:45:10.870881907Z [2024-03-28 23:45:10,870: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:45:10.871113105Z [2024-03-28 23:45:10,870: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:45:10.871535681Z [2024-03-28 23:45:10,871: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:45:10.871690480Z [2024-03-28 23:45:10,871: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:45:10.872190605Z [2024-03-28 23:45:10,871: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:45:10.872361689Z [2024-03-28 23:45:10,872: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:45:10.967387845Z [2024-03-28 23:45:10,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:45:11.510081138Z [2024-03-28 23:45:11,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e012f514-8592-4dec-a5ef-404662c8c364] succeeded in 2.106416739999986s: None 2024-03-28T23:46:00.351315783Z [2024-03-28 23:46:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[298a5934-b6b5-4ee8-885b-4bf921edd4f3] received 2024-03-28T23:46:00.353139968Z [2024-03-28 23:46:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[282ccaf6-2fbb-4de5-86bc-fbde3a20d647] received 2024-03-28T23:46:00.358560134Z [2024-03-28 23:46:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b1f7f5f-bf6b-4d53-8e99-db0a08750a32] received 2024-03-28T23:46:00.361786067Z [2024-03-28 23:46:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3a58fbf-15d5-4810-b2d7-a7e339b336c9] received 2024-03-28T23:46:00.366396674Z [2024-03-28 23:46:00,365: INFO/ForkPoolWorker-16] [282ccaf6-2fbb-4de5-86bc-fbde3a20d647] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:46:00.391942275Z [2024-03-28 23:46:00,391: INFO/ForkPoolWorker-2] [d3a58fbf-15d5-4810-b2d7-a7e339b336c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:46:00.396422757Z [2024-03-28 23:46:00,395: INFO/ForkPoolWorker-1] [9b1f7f5f-bf6b-4d53-8e99-db0a08750a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:46:00.400715027Z [2024-03-28 23:46:00,400: INFO/ForkPoolWorker-15] [298a5934-b6b5-4ee8-885b-4bf921edd4f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:46:01.077559896Z [2024-03-28 23:46:01,064: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:46:01.292732580Z [2024-03-28 23:46:01,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:46:01.293413047Z [2024-03-28 23:46:01,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:46:01.432515112Z [2024-03-28 23:46:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:46:01.752235563Z [2024-03-28 23:46:01,751: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:46:01.760341483Z [2024-03-28 23:46:01,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:46:01.835610167Z [2024-03-28 23:46:01,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:46:01.838050339Z [2024-03-28 23:46:01,837: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:46:01.838299934Z [2024-03-28 23:46:01,838: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:46:01.838483196Z [2024-03-28 23:46:01,838: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:46:01.838945759Z [2024-03-28 23:46:01,838: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:46:01.929790177Z [2024-03-28 23:46:01,929: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:46:02.044190151Z [2024-03-28 23:46:02,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:46:03.260806818Z [2024-03-28 23:46:03,260: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[282ccaf6-2fbb-4de5-86bc-fbde3a20d647] succeeded in 2.9029090280000673s: None 2024-03-28T23:46:03.548439985Z [2024-03-28 23:46:03,545: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[298a5934-b6b5-4ee8-885b-4bf921edd4f3] succeeded in 3.1908134150000933s: None 2024-03-28T23:46:04.284146300Z [2024-03-28 23:46:04,283: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:46:04.290570020Z [2024-03-28 23:46:04,290: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:46:04.426960521Z [2024-03-28 23:46:04,426: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:46:04.432415342Z [2024-03-28 23:46:04,430: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:46:04.487926131Z [2024-03-28 23:46:04,487: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:46:04.498098979Z [2024-03-28 23:46:04,497: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:46:04.498122129Z [2024-03-28 23:46:04,497: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:46:04.501261370Z [2024-03-28 23:46:04,500: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:46:04.501279496Z [2024-03-28 23:46:04,501: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:46:04.501761466Z [2024-03-28 23:46:04,501: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:46:04.507148233Z [2024-03-28 23:46:04,501: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:46:04.536842610Z [2024-03-28 23:46:04,536: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:46:04.547961367Z [2024-03-28 23:46:04,547: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:46:04.553813246Z [2024-03-28 23:46:04,553: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:46:04.557907002Z [2024-03-28 23:46:04,557: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:46:04.558082417Z [2024-03-28 23:46:04,557: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:46:04.558513626Z [2024-03-28 23:46:04,558: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:46:04.558869603Z [2024-03-28 23:46:04,558: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:46:04.763719163Z [2024-03-28 23:46:04,763: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:46:04.773015879Z [2024-03-28 23:46:04,772: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:46:07.759779199Z [2024-03-28 23:46:07,759: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3a58fbf-15d5-4810-b2d7-a7e339b336c9] succeeded in 7.39486657700013s: None 2024-03-28T23:46:07.967520083Z [2024-03-28 23:46:07,967: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b1f7f5f-bf6b-4d53-8e99-db0a08750a32] succeeded in 7.60501532599983s: None 2024-03-28T23:47:01.217145654Z [2024-03-28 23:47:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6386507-f761-400e-bf03-d37ef1c41ac6] received 2024-03-28T23:47:01.220602690Z [2024-03-28 23:47:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5c1b219-7fd2-4a9a-b1b0-bf2b867b2b97] received 2024-03-28T23:47:01.229539667Z [2024-03-28 23:47:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eab3a899-d392-4fbe-96d2-102b0234b25f] received 2024-03-28T23:47:01.240336120Z [2024-03-28 23:47:01,239: INFO/ForkPoolWorker-16] [a5c1b219-7fd2-4a9a-b1b0-bf2b867b2b97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:47:01.240693537Z [2024-03-28 23:47:01,239: INFO/ForkPoolWorker-15] [c6386507-f761-400e-bf03-d37ef1c41ac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:47:01.247617740Z [2024-03-28 23:47:01,247: INFO/ForkPoolWorker-1] [eab3a899-d392-4fbe-96d2-102b0234b25f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:47:01.580287664Z [2024-03-28 23:47:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:47:01.608414395Z [2024-03-28 23:47:01,604: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:47:01.622900256Z [2024-03-28 23:47:01,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:47:01.819426063Z [2024-03-28 23:47:01,818: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:47:01.824024849Z [2024-03-28 23:47:01,823: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:47:01.860602887Z [2024-03-28 23:47:01,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:47:01.864314046Z [2024-03-28 23:47:01,863: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:47:01.864336488Z [2024-03-28 23:47:01,864: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:47:01.864793413Z [2024-03-28 23:47:01,864: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:47:01.864806643Z [2024-03-28 23:47:01,864: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:47:01.969177112Z [2024-03-28 23:47:01,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:47:02.612732907Z [2024-03-28 23:47:02,612: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6386507-f761-400e-bf03-d37ef1c41ac6] succeeded in 1.3915628859999742s: None 2024-03-28T23:47:02.900113267Z [2024-03-28 23:47:02,899: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:47:02.904256644Z [2024-03-28 23:47:02,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:47:02.926336328Z [2024-03-28 23:47:02,926: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:47:02.927990847Z [2024-03-28 23:47:02,927: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:47:02.928056673Z [2024-03-28 23:47:02,927: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:47:02.928383598Z [2024-03-28 23:47:02,928: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:47:02.928407983Z [2024-03-28 23:47:02,928: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:47:02.928745135Z [2024-03-28 23:47:02,928: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:47:02.928935124Z [2024-03-28 23:47:02,928: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:47:03.036850890Z [2024-03-28 23:47:03,036: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:47:03.131698429Z [2024-03-28 23:47:03,131: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:47:03.135101306Z [2024-03-28 23:47:03,134: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:47:03.159503678Z [2024-03-28 23:47:03,159: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:47:03.160944012Z [2024-03-28 23:47:03,160: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:47:03.161055043Z [2024-03-28 23:47:03,160: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:47:03.161259700Z [2024-03-28 23:47:03,161: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:47:03.161377794Z [2024-03-28 23:47:03,161: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:47:03.161706712Z [2024-03-28 23:47:03,161: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:47:03.161822660Z [2024-03-28 23:47:03,161: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:47:03.256893602Z [2024-03-28 23:47:03,256: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:47:05.260058787Z [2024-03-28 23:47:05,259: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eab3a899-d392-4fbe-96d2-102b0234b25f] succeeded in 4.028591205999874s: None 2024-03-28T23:47:05.880723098Z [2024-03-28 23:47:05,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a5c1b219-7fd2-4a9a-b1b0-bf2b867b2b97] succeeded in 4.657546982000213s: None 2024-03-28T23:48:00.965294862Z [2024-03-28 23:48:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46e503c2-626e-4927-821e-1b1a44446611] received 2024-03-28T23:48:00.970424041Z [2024-03-28 23:48:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99ceefeb-47fc-4ec6-81b3-0cfdb36c74e2] received 2024-03-28T23:48:00.976515666Z [2024-03-28 23:48:00,976: INFO/ForkPoolWorker-15] [46e503c2-626e-4927-821e-1b1a44446611] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:48:00.978412349Z [2024-03-28 23:48:00,978: INFO/ForkPoolWorker-16] [99ceefeb-47fc-4ec6-81b3-0cfdb36c74e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:48:00.992509159Z [2024-03-28 23:48:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e745c1d3-2088-431e-ab39-bf7c032f3ce6] received 2024-03-28T23:48:00.997296850Z [2024-03-28 23:48:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54782b2a-48a6-43a6-8b6e-a06c8c43ff28] received 2024-03-28T23:48:01.007987103Z [2024-03-28 23:48:01,007: INFO/ForkPoolWorker-2] [54782b2a-48a6-43a6-8b6e-a06c8c43ff28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:48:01.012966446Z [2024-03-28 23:48:01,012: INFO/ForkPoolWorker-1] [e745c1d3-2088-431e-ab39-bf7c032f3ce6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:48:01.329043877Z [2024-03-28 23:48:01,325: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:48:01.337769272Z [2024-03-28 23:48:01,334: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:48:01.384457059Z [2024-03-28 23:48:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:48:01.487594468Z [2024-03-28 23:48:01,484: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:48:01.651222222Z [2024-03-28 23:48:01,650: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:48:01.657724371Z [2024-03-28 23:48:01,657: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:48:01.693274724Z [2024-03-28 23:48:01,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:48:01.696255580Z [2024-03-28 23:48:01,695: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:48:01.696386383Z [2024-03-28 23:48:01,696: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:48:01.696459236Z [2024-03-28 23:48:01,696: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:48:01.696860389Z [2024-03-28 23:48:01,696: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:48:01.709208658Z [2024-03-28 23:48:01,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:48:01.863242625Z [2024-03-28 23:48:01,862: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:48:02.368417782Z [2024-03-28 23:48:02,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46e503c2-626e-4927-821e-1b1a44446611] succeeded in 1.3965702689999944s: None 2024-03-28T23:48:02.688752313Z [2024-03-28 23:48:02,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e745c1d3-2088-431e-ab39-bf7c032f3ce6] succeeded in 1.693800210000063s: None 2024-03-28T23:48:03.024381815Z [2024-03-28 23:48:03,023: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:48:03.028799014Z [2024-03-28 23:48:03,027: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:48:03.051876324Z [2024-03-28 23:48:03,051: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:48:03.060402322Z [2024-03-28 23:48:03,060: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:48:03.060800882Z [2024-03-28 23:48:03,060: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:48:03.061118385Z [2024-03-28 23:48:03,060: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:48:03.061353817Z [2024-03-28 23:48:03,061: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:48:03.062551677Z [2024-03-28 23:48:03,062: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:48:03.062785960Z [2024-03-28 23:48:03,062: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:48:03.069155882Z [2024-03-28 23:48:03,068: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:48:03.073237579Z [2024-03-28 23:48:03,072: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:48:03.116021396Z [2024-03-28 23:48:03,115: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:48:03.118278951Z [2024-03-28 23:48:03,117: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:48:03.118601838Z [2024-03-28 23:48:03,118: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:48:03.118997453Z [2024-03-28 23:48:03,118: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:48:03.119150861Z [2024-03-28 23:48:03,118: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:48:03.119860839Z [2024-03-28 23:48:03,119: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:48:03.120000672Z [2024-03-28 23:48:03,119: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:48:03.202302262Z [2024-03-28 23:48:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:48:03.252839693Z [2024-03-28 23:48:03,252: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:48:04.725978877Z [2024-03-28 23:48:04,725: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[54782b2a-48a6-43a6-8b6e-a06c8c43ff28] succeeded in 3.7269546779998564s: None 2024-03-28T23:48:05.196873575Z [2024-03-28 23:48:05,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99ceefeb-47fc-4ec6-81b3-0cfdb36c74e2] succeeded in 4.2243470969999635s: None 2024-03-28T23:49:00.768730722Z [2024-03-28 23:49:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5c4375c-570c-45c0-bc53-ec8353e2d59c] received 2024-03-28T23:49:00.779993522Z [2024-03-28 23:49:00,779: INFO/ForkPoolWorker-15] [a5c4375c-570c-45c0-bc53-ec8353e2d59c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:49:00.780589091Z [2024-03-28 23:49:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9b92305-1b3a-494a-a0ce-c21516b00cda] received 2024-03-28T23:49:00.782290099Z [2024-03-28 23:49:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d187c84a-832d-4c89-9163-835f301ade32] received 2024-03-28T23:49:00.790334658Z [2024-03-28 23:49:00,789: INFO/ForkPoolWorker-16] [c9b92305-1b3a-494a-a0ce-c21516b00cda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:49:00.796954264Z [2024-03-28 23:49:00,796: INFO/ForkPoolWorker-1] [d187c84a-832d-4c89-9163-835f301ade32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:49:01.087760769Z [2024-03-28 23:49:01,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:49:01.155374622Z [2024-03-28 23:49:01,150: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:49:01.170006165Z [2024-03-28 23:49:01,166: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:49:01.340281191Z [2024-03-28 23:49:01,339: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T23:49:01.345606254Z [2024-03-28 23:49:01,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:01.365760564Z [2024-03-28 23:49:01,365: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:49:01.366789855Z [2024-03-28 23:49:01,366: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:49:01.366976453Z [2024-03-28 23:49:01,366: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:49:01.367031182Z [2024-03-28 23:49:01,366: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T23:49:01.367292093Z [2024-03-28 23:49:01,367: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:49:01.461380518Z [2024-03-28 23:49:01,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:02.123253444Z [2024-03-28 23:49:02,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5c4375c-570c-45c0-bc53-ec8353e2d59c] succeeded in 1.35225407300004s: None 2024-03-28T23:49:02.579681163Z [2024-03-28 23:49:02,579: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:49:02.583408580Z [2024-03-28 23:49:02,582: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:02.603789169Z [2024-03-28 23:49:02,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:49:02.605407326Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:02.605468040Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:02.605585848Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:49:02.605606566Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:49:02.605909887Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:49:02.605927256Z [2024-03-28 23:49:02,605: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:02.678887062Z [2024-03-28 23:49:02,678: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:49:02.684767617Z [2024-03-28 23:49:02,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:02.695488858Z [2024-03-28 23:49:02,695: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:02.707567081Z [2024-03-28 23:49:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:49:02.711812349Z [2024-03-28 23:49:02,711: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:02.712002178Z [2024-03-28 23:49:02,711: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:02.712275764Z [2024-03-28 23:49:02,712: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:49:02.712477602Z [2024-03-28 23:49:02,712: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:49:02.712898301Z [2024-03-28 23:49:02,712: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:49:02.713075038Z [2024-03-28 23:49:02,712: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:02.830539910Z [2024-03-28 23:49:02,830: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:04.386664044Z [2024-03-28 23:49:04,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9b92305-1b3a-494a-a0ce-c21516b00cda] succeeded in 3.6028315149999344s: None 2024-03-28T23:49:04.511805651Z [2024-03-28 23:49:04,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d187c84a-832d-4c89-9163-835f301ade32] succeeded in 3.7235228639999605s: None 2024-03-28T23:49:20.786359238Z [2024-03-28 23:49:20,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2573e56-a9e0-4be9-9bc8-7acf4fc57bde] received 2024-03-28T23:49:20.796661467Z [2024-03-28 23:49:20,796: INFO/ForkPoolWorker-15] [a2573e56-a9e0-4be9-9bc8-7acf4fc57bde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:49:21.118198133Z [2024-03-28 23:49:21,115: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:49:22.032145603Z [2024-03-28 23:49:22,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd79e5c6-ce8d-4b5b-b04b-f64a70f456c4] received 2024-03-28T23:49:22.040253542Z [2024-03-28 23:49:22,039: INFO/ForkPoolWorker-16] [bd79e5c6-ce8d-4b5b-b04b-f64a70f456c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:49:22.229834688Z [2024-03-28 23:49:22,229: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:49:22.233136031Z [2024-03-28 23:49:22,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:22.271243973Z [2024-03-28 23:49:22,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:49:22.275600091Z [2024-03-28 23:49:22,275: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:22.275620933Z [2024-03-28 23:49:22,275: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:22.275690910Z [2024-03-28 23:49:22,275: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:22.275830544Z [2024-03-28 23:49:22,275: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:22.275863892Z [2024-03-28 23:49:22,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:49:22.276183743Z [2024-03-28 23:49:22,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:49:22.276197576Z [2024-03-28 23:49:22,276: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:22.280943691Z [2024-03-28 23:49:22,280: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:22.377475472Z [2024-03-28 23:49:22,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:22.435803853Z [2024-03-28 23:49:22,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:49:23.320458230Z [2024-03-28 23:49:23,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b1f2636-6c7b-4ca0-a5bc-3040ee39f8cf] received 2024-03-28T23:49:23.328933026Z [2024-03-28 23:49:23,328: INFO/ForkPoolWorker-1] [8b1f2636-6c7b-4ca0-a5bc-3040ee39f8cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:23.606580539Z [2024-03-28 23:49:23,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:49:23.623228184Z [2024-03-28 23:49:23,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:49:23.627259105Z [2024-03-28 23:49:23,626: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:23.671394035Z [2024-03-28 23:49:23,669: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:49:23.673484458Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:23.673592233Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:23.673619679Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:23.673821268Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:23.673861534Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:49:23.674127188Z [2024-03-28 23:49:23,673: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:49:23.674601588Z [2024-03-28 23:49:23,674: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:23.680037870Z [2024-03-28 23:49:23,679: INFO/ForkPoolWorker-16] Creating DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:23.749467221Z [2024-03-28 23:49:23,749: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:24.129771600Z [2024-03-28 23:49:24,129: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2573e56-a9e0-4be9-9bc8-7acf4fc57bde] succeeded in 3.3384152819999144s: None 2024-03-28T23:49:24.834267107Z [2024-03-28 23:49:24,833: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:49:24.837447896Z [2024-03-28 23:49:24,837: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:24.856930918Z [2024-03-28 23:49:24,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:49:24.858264964Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:24.858296888Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:24.858411603Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:24.858661165Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:24.858684016Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:49:24.858975561Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:49:24.859006600Z [2024-03-28 23:49:24,858: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:24.869261090Z [2024-03-28 23:49:24,868: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:24.938704597Z [2024-03-28 23:49:24,938: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:25.228082003Z [2024-03-28 23:49:25,227: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd79e5c6-ce8d-4b5b-b04b-f64a70f456c4] succeeded in 3.1929778440000973s: None 2024-03-28T23:49:25.513293249Z [2024-03-28 23:49:25,512: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b1f2636-6c7b-4ca0-a5bc-3040ee39f8cf] succeeded in 2.1908494599999813s: None 2024-03-28T23:49:26.159085067Z [2024-03-28 23:49:26,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee422bbe-1817-4eb2-a7ca-ee09bfa31ef9] received 2024-03-28T23:49:26.164697154Z [2024-03-28 23:49:26,164: INFO/ForkPoolWorker-15] [ee422bbe-1817-4eb2-a7ca-ee09bfa31ef9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'split_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:26.444208874Z [2024-03-28 23:49:26,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:49:27.623960516Z [2024-03-28 23:49:27,623: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:49:27.627299046Z [2024-03-28 23:49:27,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:27.646199521Z [2024-03-28 23:49:27,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:49:27.652216183Z [2024-03-28 23:49:27,647: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:27.652257990Z [2024-03-28 23:49:27,647: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:27.652266184Z [2024-03-28 23:49:27,647: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:27.652276086Z [2024-03-28 23:49:27,647: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:27.652307957Z [2024-03-28 23:49:27,647: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:49:27.652315326Z [2024-03-28 23:49:27,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:49:27.652322379Z [2024-03-28 23:49:27,648: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:27.655605937Z [2024-03-28 23:49:27,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:27.724788275Z [2024-03-28 23:49:27,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:28.300158275Z [2024-03-28 23:49:28,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee422bbe-1817-4eb2-a7ca-ee09bfa31ef9] succeeded in 2.1395236649998424s: None 2024-03-28T23:49:28.480794672Z [2024-03-28 23:49:28,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01d2fe03-271a-4fba-80c3-cc6884668614] received 2024-03-28T23:49:28.494518341Z [2024-03-28 23:49:28,494: INFO/ForkPoolWorker-15] [01d2fe03-271a-4fba-80c3-cc6884668614] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'collect_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:49:28.789605911Z [2024-03-28 23:49:28,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:49:29.897594181Z [2024-03-28 23:49:29,897: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:49:29.901518292Z [2024-03-28 23:49:29,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:29.920916345Z [2024-03-28 23:49:29,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:49:29.922383519Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:29.922495489Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:29.922578437Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:29.922742386Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:29.922829828Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:49:29.923157720Z [2024-03-28 23:49:29,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:49:29.923223566Z [2024-03-28 23:49:29,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:29.928995795Z [2024-03-28 23:49:29,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:30.020801818Z [2024-03-28 23:49:30,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:30.494429032Z [2024-03-28 23:49:30,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01d2fe03-271a-4fba-80c3-cc6884668614] succeeded in 2.0105664620000425s: None 2024-03-28T23:49:31.150766671Z [2024-03-28 23:49:31,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa6ca376-f03d-4577-918c-d98c804fb08f] received 2024-03-28T23:49:31.177703666Z [2024-03-28 23:49:31,177: INFO/ForkPoolWorker-15] [fa6ca376-f03d-4577-918c-d98c804fb08f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'send_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:31.465655693Z [2024-03-28 23:49:31,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:49:32.742211967Z [2024-03-28 23:49:32,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:49:32.746171577Z [2024-03-28 23:49:32,745: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:49:32.769016628Z [2024-03-28 23:49:32,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:49:32.770703438Z [2024-03-28 23:49:32,770: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:49:32.770894010Z [2024-03-28 23:49:32,770: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:49:32.770989329Z [2024-03-28 23:49:32,770: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:49:32.771241434Z [2024-03-28 23:49:32,770: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:49:32.771402196Z [2024-03-28 23:49:32,771: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:49:32.771911692Z [2024-03-28 23:49:32,771: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:49:32.772024209Z [2024-03-28 23:49:32,771: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:49:32.779918573Z [2024-03-28 23:49:32,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:49:32.867266259Z [2024-03-28 23:49:32,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:49:33.372375858Z [2024-03-28 23:49:33,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa6ca376-f03d-4577-918c-d98c804fb08f] succeeded in 2.2173399010000594s: None 2024-03-28T23:50:00.715079948Z [2024-03-28 23:50:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac0545d5-3a2e-4e88-a5a4-956310da7710] received 2024-03-28T23:50:00.718094278Z [2024-03-28 23:50:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dad977a2-d728-4e62-88b4-20bdbbf1bb2d] received 2024-03-28T23:50:00.727882642Z [2024-03-28 23:50:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebc04907-df65-47a9-9761-014b10b6586c] received 2024-03-28T23:50:00.729917050Z [2024-03-28 23:50:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db2de972-436c-4afa-adf6-3a3778776194] received 2024-03-28T23:50:00.729962569Z [2024-03-28 23:50:00,729: INFO/ForkPoolWorker-16] [dad977a2-d728-4e62-88b4-20bdbbf1bb2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:00.732079262Z [2024-03-28 23:50:00,731: INFO/ForkPoolWorker-15] [ac0545d5-3a2e-4e88-a5a4-956310da7710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:00.740575681Z [2024-03-28 23:50:00,740: INFO/ForkPoolWorker-1] [ebc04907-df65-47a9-9761-014b10b6586c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:50:00.761853428Z [2024-03-28 23:50:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[156dc060-528b-4148-884d-6fe1c9c14a64] received 2024-03-28T23:50:00.762881510Z [2024-03-28 23:50:00,762: INFO/ForkPoolWorker-2] [db2de972-436c-4afa-adf6-3a3778776194] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:50:00.770428025Z [2024-03-28 23:50:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe857f23-4e28-4bb1-aeae-6f5dbe1f135d] received 2024-03-28T23:50:00.778900975Z [2024-03-28 23:50:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a43d77a-c63e-412f-b117-99192e804ff2] received 2024-03-28T23:50:00.785671698Z [2024-03-28 23:50:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ef3fbb8-e909-4cfb-af73-0ca7b4dc8aa2] received 2024-03-28T23:50:00.789407712Z [2024-03-28 23:50:00,786: INFO/ForkPoolWorker-4] [fe857f23-4e28-4bb1-aeae-6f5dbe1f135d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:50:00.801099698Z [2024-03-28 23:50:00,798: INFO/ForkPoolWorker-3] [156dc060-528b-4148-884d-6fe1c9c14a64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:50:00.802198336Z [2024-03-28 23:50:00,801: INFO/ForkPoolWorker-5] [6a43d77a-c63e-412f-b117-99192e804ff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:50:00.830487589Z [2024-03-28 23:50:00,830: INFO/ForkPoolWorker-6] [6ef3fbb8-e909-4cfb-af73-0ca7b4dc8aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:50:01.568818401Z [2024-03-28 23:50:01,560: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:50:01.689847121Z [2024-03-28 23:50:01,683: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:50:01.750804295Z [2024-03-28 23:50:01,730: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:50:01.799551954Z [2024-03-28 23:50:01,794: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:50:01.840780908Z [2024-03-28 23:50:01,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:02.220350244Z [2024-03-28 23:50:02,206: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:50:02.227045014Z [2024-03-28 23:50:02,222: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:50:02.476454694Z [2024-03-28 23:50:02,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:02.729904992Z [2024-03-28 23:50:02,729: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:02.936190791Z [2024-03-28 23:50:02,935: INFO/ForkPoolWorker-5] Getting SDNC list 2024-03-28T23:50:02.948898715Z [2024-03-28 23:50:02,948: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:03.031657950Z [2024-03-28 23:50:03,031: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T23:50:03.035615932Z [2024-03-28 23:50:03,035: INFO/ForkPoolWorker-5] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:50:03.035886093Z [2024-03-28 23:50:03,035: INFO/ForkPoolWorker-5] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:50:03.036007523Z [2024-03-28 23:50:03,035: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-03-28T23:50:03.036310757Z [2024-03-28 23:50:03,036: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:50:03.229506433Z [2024-03-28 23:50:03,229: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:03.820002646Z [2024-03-28 23:50:03,819: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T23:50:03.823760198Z [2024-03-28 23:50:03,823: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:03.851086543Z [2024-03-28 23:50:03,850: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T23:50:03.856214567Z [2024-03-28 23:50:03,855: INFO/ForkPoolWorker-4] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:03.856545346Z [2024-03-28 23:50:03,856: INFO/ForkPoolWorker-4] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:03.856763836Z [2024-03-28 23:50:03,856: INFO/ForkPoolWorker-4] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:03.857125090Z [2024-03-28 23:50:03,856: INFO/ForkPoolWorker-4] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:03.857380063Z [2024-03-28 23:50:03,857: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T23:50:03.857900209Z [2024-03-28 23:50:03,857: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:50:03.858223891Z [2024-03-28 23:50:03,858: INFO/ForkPoolWorker-4] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:03.870296344Z [2024-03-28 23:50:03,869: INFO/ForkPoolWorker-4] Creating DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:04.023953880Z [2024-03-28 23:50:04,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ebc04907-df65-47a9-9761-014b10b6586c] succeeded in 3.2911839770001734s: None 2024-03-28T23:50:04.049255890Z [2024-03-28 23:50:04,048: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:04.593218574Z [2024-03-28 23:50:04,592: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T23:50:04.597206539Z [2024-03-28 23:50:04,596: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:04.660141863Z [2024-03-28 23:50:04,659: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T23:50:04.662610995Z [2024-03-28 23:50:04,661: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:04.662632859Z [2024-03-28 23:50:04,661: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:04.662639029Z [2024-03-28 23:50:04,662: INFO/ForkPoolWorker-3] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:04.662644787Z [2024-03-28 23:50:04,662: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:04.662650819Z [2024-03-28 23:50:04,662: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T23:50:04.663028250Z [2024-03-28 23:50:04,662: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:50:04.663041702Z [2024-03-28 23:50:04,662: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:04.679471780Z [2024-03-28 23:50:04,679: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[6a43d77a-c63e-412f-b117-99192e804ff2] succeeded in 3.8933633889998873s: None 2024-03-28T23:50:04.698147447Z [2024-03-28 23:50:04,697: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:04.883735391Z [2024-03-28 23:50:04,883: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:05.150800092Z [2024-03-28 23:50:05,150: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:50:05.154948691Z [2024-03-28 23:50:05,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:05.208356969Z [2024-03-28 23:50:05,197: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:50:05.210313613Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:05.210329015Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:05.210333109Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:05.210337207Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:05.210341228Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:50:05.210344365Z [2024-03-28 23:50:05,209: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:50:05.210347442Z [2024-03-28 23:50:05,210: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:05.218550147Z [2024-03-28 23:50:05,215: INFO/ForkPoolWorker-2] Creating DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:05.299074874Z [2024-03-28 23:50:05,298: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:50:05.302864893Z [2024-03-28 23:50:05,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:05.432739053Z [2024-03-28 23:50:05,432: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:50:05.435419275Z [2024-03-28 23:50:05,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:50:05.438012596Z [2024-03-28 23:50:05,437: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:05.439942923Z [2024-03-28 23:50:05,439: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:05.439969474Z [2024-03-28 23:50:05,439: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:05.440028801Z [2024-03-28 23:50:05,439: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:05.440108949Z [2024-03-28 23:50:05,439: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:05.440156093Z [2024-03-28 23:50:05,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:50:05.440411675Z [2024-03-28 23:50:05,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:05.440468525Z [2024-03-28 23:50:05,440: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:05.447349331Z [2024-03-28 23:50:05,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:05.543368205Z [2024-03-28 23:50:05,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:05.567169687Z [2024-03-28 23:50:05,566: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:50:05.569057927Z [2024-03-28 23:50:05,568: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:05.569134250Z [2024-03-28 23:50:05,568: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:05.569139287Z [2024-03-28 23:50:05,569: INFO/ForkPoolWorker-16] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:05.569243699Z [2024-03-28 23:50:05,569: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:05.569277995Z [2024-03-28 23:50:05,569: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:50:05.569497370Z [2024-03-28 23:50:05,569: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:05.569531093Z [2024-03-28 23:50:05,569: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:05.592586351Z [2024-03-28 23:50:05,592: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:05.742547752Z [2024-03-28 23:50:05,724: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:05.862512934Z [2024-03-28 23:50:05,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:06.951557875Z [2024-03-28 23:50:06,951: INFO/ForkPoolWorker-6] Getting VIM list 2024-03-28T23:50:06.972617973Z [2024-03-28 23:50:06,972: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:07.035817051Z [2024-03-28 23:50:07,035: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-03-28T23:50:07.041687998Z [2024-03-28 23:50:07,041: INFO/ForkPoolWorker-6] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:07.041712054Z [2024-03-28 23:50:07,041: INFO/ForkPoolWorker-6] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:07.041716154Z [2024-03-28 23:50:07,041: INFO/ForkPoolWorker-6] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:07.041794190Z [2024-03-28 23:50:07,041: INFO/ForkPoolWorker-6] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:07.041819370Z [2024-03-28 23:50:07,041: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-03-28T23:50:07.042282768Z [2024-03-28 23:50:07,042: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:50:07.042292886Z [2024-03-28 23:50:07,042: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:07.047756822Z [2024-03-28 23:50:07,047: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:07.137772431Z [2024-03-28 23:50:07,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac0545d5-3a2e-4e88-a5a4-956310da7710] succeeded in 6.417567384999984s: None 2024-03-28T23:50:07.230757032Z [2024-03-28 23:50:07,230: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[fe857f23-4e28-4bb1-aeae-6f5dbe1f135d] succeeded in 6.457111276999967s: None 2024-03-28T23:50:07.363930155Z [2024-03-28 23:50:07,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dad977a2-d728-4e62-88b4-20bdbbf1bb2d] succeeded in 6.643186271999866s: None 2024-03-28T23:50:07.411016508Z [2024-03-28 23:50:07,410: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:07.611290433Z [2024-03-28 23:50:07,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f18e9620-c9d1-4824-aca7-a17d97545023] received 2024-03-28T23:50:07.623179147Z [2024-03-28 23:50:07,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53f869e8-844b-441a-ad92-e2a90edfedab] received 2024-03-28T23:50:07.635400680Z [2024-03-28 23:50:07,634: INFO/ForkPoolWorker-15] [f18e9620-c9d1-4824-aca7-a17d97545023] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:07.671314436Z [2024-03-28 23:50:07,670: INFO/ForkPoolWorker-16] [53f869e8-844b-441a-ad92-e2a90edfedab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'split_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:08.192334564Z [2024-03-28 23:50:08,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:08.397823515Z [2024-03-28 23:50:08,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:08.884675628Z [2024-03-28 23:50:08,884: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[156dc060-528b-4148-884d-6fe1c9c14a64] succeeded in 8.113269897999999s: None 2024-03-28T23:50:09.061363657Z [2024-03-28 23:50:09,060: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[db2de972-436c-4afa-adf6-3a3778776194] succeeded in 8.31357802499997s: None 2024-03-28T23:50:09.706634281Z [2024-03-28 23:50:09,705: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[6ef3fbb8-e909-4cfb-af73-0ca7b4dc8aa2] succeeded in 8.909150361000002s: None 2024-03-28T23:50:09.891160020Z [2024-03-28 23:50:09,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:50:09.896749105Z [2024-03-28 23:50:09,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:09.915473648Z [2024-03-28 23:50:09,915: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:50:09.920067479Z [2024-03-28 23:50:09,919: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:09.921778250Z [2024-03-28 23:50:09,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:50:09.923478765Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:09.923499738Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:09.923632386Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:09.923779406Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:09.923793947Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:50:09.924095146Z [2024-03-28 23:50:09,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:09.924107962Z [2024-03-28 23:50:09,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:09.932074645Z [2024-03-28 23:50:09,931: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:09.946994645Z [2024-03-28 23:50:09,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:50:09.948739527Z [2024-03-28 23:50:09,948: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:09.948950896Z [2024-03-28 23:50:09,948: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:09.949093916Z [2024-03-28 23:50:09,948: INFO/ForkPoolWorker-16] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:09.949358483Z [2024-03-28 23:50:09,949: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:09.949534396Z [2024-03-28 23:50:09,949: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:50:09.950045047Z [2024-03-28 23:50:09,949: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:09.950212297Z [2024-03-28 23:50:09,950: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:09.956638968Z [2024-03-28 23:50:09,956: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:10.011603563Z [2024-03-28 23:50:10,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:10.039717411Z [2024-03-28 23:50:10,039: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:10.673852653Z [2024-03-28 23:50:10,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f18e9620-c9d1-4824-aca7-a17d97545023] succeeded in 3.0580132239999784s: None 2024-03-28T23:50:10.800687110Z [2024-03-28 23:50:10,800: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53f869e8-844b-441a-ad92-e2a90edfedab] succeeded in 3.1720134269999107s: None 2024-03-28T23:50:11.015898632Z [2024-03-28 23:50:11,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d36340d-e9a4-41bf-ae1b-c40cf299fc04] received 2024-03-28T23:50:11.019877832Z [2024-03-28 23:50:11,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4768873c-d50a-46a4-b557-ac8ac675a6ae] received 2024-03-28T23:50:11.027154892Z [2024-03-28 23:50:11,026: INFO/ForkPoolWorker-15] [5d36340d-e9a4-41bf-ae1b-c40cf299fc04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'collect_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:50:11.036755389Z [2024-03-28 23:50:11,036: INFO/ForkPoolWorker-16] [4768873c-d50a-46a4-b557-ac8ac675a6ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:50:11.315192241Z [2024-03-28 23:50:11,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:11.348959728Z [2024-03-28 23:50:11,345: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:12.500630577Z [2024-03-28 23:50:12,500: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:50:12.501491857Z [2024-03-28 23:50:12,501: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:50:12.504197334Z [2024-03-28 23:50:12,503: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:12.505262417Z [2024-03-28 23:50:12,504: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:12.525797653Z [2024-03-28 23:50:12,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:50:12.527544179Z [2024-03-28 23:50:12,527: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:12.527558709Z [2024-03-28 23:50:12,527: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:12.527636117Z [2024-03-28 23:50:12,527: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:12.527829661Z [2024-03-28 23:50:12,527: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:12.527894460Z [2024-03-28 23:50:12,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:50:12.528169340Z [2024-03-28 23:50:12,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:12.528201093Z [2024-03-28 23:50:12,528: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:12.532531251Z [2024-03-28 23:50:12,532: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:50:12.533782841Z [2024-03-28 23:50:12,533: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:12.533818347Z [2024-03-28 23:50:12,533: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:12.533890425Z [2024-03-28 23:50:12,533: INFO/ForkPoolWorker-16] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:12.534011220Z [2024-03-28 23:50:12,533: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:12.534046329Z [2024-03-28 23:50:12,533: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:50:12.534287201Z [2024-03-28 23:50:12,534: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:12.534321577Z [2024-03-28 23:50:12,534: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:12.534391358Z [2024-03-28 23:50:12,534: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:12.541460009Z [2024-03-28 23:50:12,541: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:12.616463667Z [2024-03-28 23:50:12,616: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:12.634814664Z [2024-03-28 23:50:12,634: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:13.163801514Z [2024-03-28 23:50:13,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d36340d-e9a4-41bf-ae1b-c40cf299fc04] succeeded in 2.145810431999962s: None 2024-03-28T23:50:13.225866438Z [2024-03-28 23:50:13,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4768873c-d50a-46a4-b557-ac8ac675a6ae] succeeded in 2.200764518999904s: None 2024-03-28T23:50:13.559352565Z [2024-03-28 23:50:13,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31f1fb0b-455f-4781-922c-4358b17b63db] received 2024-03-28T23:50:13.561376528Z [2024-03-28 23:50:13,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2553dd5c-0d3c-47ab-bb46-96c03b563069] received 2024-03-28T23:50:13.568176356Z [2024-03-28 23:50:13,567: INFO/ForkPoolWorker-16] [2553dd5c-0d3c-47ab-bb46-96c03b563069] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'send_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:13.576308773Z [2024-03-28 23:50:13,575: INFO/ForkPoolWorker-15] [31f1fb0b-455f-4781-922c-4358b17b63db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:13.902665261Z [2024-03-28 23:50:13,898: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:13.921140135Z [2024-03-28 23:50:13,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:50:15.098301048Z [2024-03-28 23:50:15,097: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:50:15.101937967Z [2024-03-28 23:50:15,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:15.119295424Z [2024-03-28 23:50:15,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:50:15.122774556Z [2024-03-28 23:50:15,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:50:15.132398982Z [2024-03-28 23:50:15,132: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:50:15.133947822Z [2024-03-28 23:50:15,133: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:15.133960916Z [2024-03-28 23:50:15,133: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:15.133972111Z [2024-03-28 23:50:15,133: INFO/ForkPoolWorker-16] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:15.134111526Z [2024-03-28 23:50:15,133: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:15.134212246Z [2024-03-28 23:50:15,134: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:50:15.134432782Z [2024-03-28 23:50:15,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:15.135415694Z [2024-03-28 23:50:15,135: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:15.143866314Z [2024-03-28 23:50:15,143: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:15.164697577Z [2024-03-28 23:50:15,164: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:50:15.166836810Z [2024-03-28 23:50:15,166: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:50:15.166859326Z [2024-03-28 23:50:15,166: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:50:15.166900917Z [2024-03-28 23:50:15,166: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:50:15.167015789Z [2024-03-28 23:50:15,166: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:50:15.167037887Z [2024-03-28 23:50:15,166: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:50:15.167290626Z [2024-03-28 23:50:15,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:50:15.167334075Z [2024-03-28 23:50:15,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:50:15.174068404Z [2024-03-28 23:50:15,173: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:50:15.279893056Z [2024-03-28 23:50:15,279: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:15.302199913Z [2024-03-28 23:50:15,301: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:50:15.838598878Z [2024-03-28 23:50:15,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31f1fb0b-455f-4781-922c-4358b17b63db] succeeded in 2.2748148749999473s: None 2024-03-28T23:50:15.921533350Z [2024-03-28 23:50:15,920: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2553dd5c-0d3c-47ab-bb46-96c03b563069] succeeded in 2.3588696580000033s: None 2024-03-28T23:51:00.697023579Z [2024-03-28 23:51:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbd65e16-2b71-482e-b5a5-5e245c786f1b] received 2024-03-28T23:51:00.699642021Z [2024-03-28 23:51:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b6a3436-b159-4271-baef-fe44f6dcff48] received 2024-03-28T23:51:00.704589976Z [2024-03-28 23:51:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2424f48-c247-468a-a655-1919eff267e4] received 2024-03-28T23:51:00.706562432Z [2024-03-28 23:51:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40da82d5-71ae-4ff7-a3cb-831672182ea9] received 2024-03-28T23:51:00.712830456Z [2024-03-28 23:51:00,712: INFO/ForkPoolWorker-16] [1b6a3436-b159-4271-baef-fe44f6dcff48] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:51:00.717009394Z [2024-03-28 23:51:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b96d1773-3595-4ecc-8d8d-fd0b512cc781] received 2024-03-28T23:51:00.717031562Z [2024-03-28 23:51:00,716: INFO/ForkPoolWorker-15] [fbd65e16-2b71-482e-b5a5-5e245c786f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:51:00.728598020Z [2024-03-28 23:51:00,728: INFO/ForkPoolWorker-3] [b96d1773-3595-4ecc-8d8d-fd0b512cc781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:51:00.731318629Z [2024-03-28 23:51:00,730: INFO/ForkPoolWorker-2] [40da82d5-71ae-4ff7-a3cb-831672182ea9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:51:00.731526602Z [2024-03-28 23:51:00,731: INFO/ForkPoolWorker-1] [f2424f48-c247-468a-a655-1919eff267e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:51:01.065700646Z [2024-03-28 23:51:01,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:51:01.123465255Z [2024-03-28 23:51:01,120: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:51:01.156051139Z [2024-03-28 23:51:01,152: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:51:01.412044319Z [2024-03-28 23:51:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:51:01.453973576Z [2024-03-28 23:51:01,450: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:51:01.759801650Z [2024-03-28 23:51:01,759: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T23:51:01.764540298Z [2024-03-28 23:51:01,764: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:51:01.805014190Z [2024-03-28 23:51:01,804: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:51:01.810328426Z [2024-03-28 23:51:01,810: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:51:01.813556101Z [2024-03-28 23:51:01,810: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:51:01.813716634Z [2024-03-28 23:51:01,813: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T23:51:01.814155888Z [2024-03-28 23:51:01,813: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:51:02.006531204Z [2024-03-28 23:51:02,006: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:51:02.751234871Z [2024-03-28 23:51:02,750: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T23:51:02.760016812Z [2024-03-28 23:51:02,759: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:51:02.797326373Z [2024-03-28 23:51:02,797: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T23:51:02.800980119Z [2024-03-28 23:51:02,800: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:51:02.801811235Z [2024-03-28 23:51:02,801: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:51:02.802022401Z [2024-03-28 23:51:02,801: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:51:02.802213384Z [2024-03-28 23:51:02,801: INFO/ForkPoolWorker-3] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:51:02.802413071Z [2024-03-28 23:51:02,802: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:51:02.802476349Z [2024-03-28 23:51:02,802: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T23:51:02.802917476Z [2024-03-28 23:51:02,802: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:51:02.803074417Z [2024-03-28 23:51:02,802: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:51:02.805145331Z [2024-03-28 23:51:02,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:51:02.809638506Z [2024-03-28 23:51:02,809: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:51:02.855467080Z [2024-03-28 23:51:02,855: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:51:02.859707621Z [2024-03-28 23:51:02,859: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:51:02.862001833Z [2024-03-28 23:51:02,861: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:51:02.862200694Z [2024-03-28 23:51:02,862: INFO/ForkPoolWorker-15] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:51:02.862480404Z [2024-03-28 23:51:02,862: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:51:02.864811152Z [2024-03-28 23:51:02,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:51:02.865287178Z [2024-03-28 23:51:02,865: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:51:02.865640970Z [2024-03-28 23:51:02,865: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:51:02.871096079Z [2024-03-28 23:51:02,870: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:51:02.988424863Z [2024-03-28 23:51:02,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b6a3436-b159-4271-baef-fe44f6dcff48] succeeded in 2.2840073380000376s: None 2024-03-28T23:51:03.001296652Z [2024-03-28 23:51:03,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:51:03.002778788Z [2024-03-28 23:51:03,002: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:51:03.231317855Z [2024-03-28 23:51:03,230: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:51:03.237826036Z [2024-03-28 23:51:03,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:51:03.249291824Z [2024-03-28 23:51:03,248: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:51:03.253495027Z [2024-03-28 23:51:03,252: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:51:03.266522650Z [2024-03-28 23:51:03,266: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:51:03.269452573Z [2024-03-28 23:51:03,269: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:51:03.270142302Z [2024-03-28 23:51:03,269: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:51:03.270403290Z [2024-03-28 23:51:03,270: INFO/ForkPoolWorker-1] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:51:03.270839407Z [2024-03-28 23:51:03,270: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:51:03.271069942Z [2024-03-28 23:51:03,270: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:51:03.272017626Z [2024-03-28 23:51:03,271: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:51:03.273127259Z [2024-03-28 23:51:03,272: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:51:03.283298103Z [2024-03-28 23:51:03,282: INFO/ForkPoolWorker-1] Creating DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:51:03.285078880Z [2024-03-28 23:51:03,284: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:51:03.287235466Z [2024-03-28 23:51:03,286: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:51:03.287362615Z [2024-03-28 23:51:03,287: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:51:03.287490707Z [2024-03-28 23:51:03,287: INFO/ForkPoolWorker-2] Read VIM 67a6b27a-f372-41de-9ed6-f091deefbd3e (basic_08_vim_test) 2024-03-28T23:51:03.287695595Z [2024-03-28 23:51:03,287: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '67a6b27a-f372-41de-9ed6-f091deefbd3e', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T23:51:03.287812029Z [2024-03-28 23:51:03,287: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:51:03.288288330Z [2024-03-28 23:51:03,288: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:51:03.288424071Z [2024-03-28 23:51:03,288: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:51:03.293556271Z [2024-03-28 23:51:03,293: INFO/ForkPoolWorker-2] Creating DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e 2024-03-28T23:51:03.423495946Z [2024-03-28 23:51:03,423: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:51:03.465941826Z [2024-03-28 23:51:03,465: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:51:05.105913307Z [2024-03-28 23:51:05,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbd65e16-2b71-482e-b5a5-5e245c786f1b] succeeded in 4.404221583000208s: None 2024-03-28T23:51:05.157167374Z [2024-03-28 23:51:05,156: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b96d1773-3595-4ecc-8d8d-fd0b512cc781] succeeded in 4.438539367999965s: None 2024-03-28T23:51:05.218418792Z [2024-03-28 23:51:05,214: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[40da82d5-71ae-4ff7-a3cb-831672182ea9] succeeded in 4.498972328999798s: None 2024-03-28T23:51:05.258397064Z [2024-03-28 23:51:05,257: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2424f48-c247-468a-a655-1919eff267e4] succeeded in 4.549776995999991s: None 2024-03-28T23:52:01.362669919Z [2024-03-28 23:52:01,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffac7ba4-eab4-4f9b-9173-243f301521aa] received 2024-03-28T23:52:01.365819928Z [2024-03-28 23:52:01,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cbef834-8b5d-4a6e-a653-c1498a33bb3d] received 2024-03-28T23:52:01.375520139Z [2024-03-28 23:52:01,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eebaa38-a2b3-4c3e-8f18-93ad501e538c] received 2024-03-28T23:52:01.378957922Z [2024-03-28 23:52:01,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be827057-a845-4e5e-8302-9f329befdd87] received 2024-03-28T23:52:01.385372008Z [2024-03-28 23:52:01,385: INFO/ForkPoolWorker-16] [9cbef834-8b5d-4a6e-a653-c1498a33bb3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:52:01.389443244Z [2024-03-28 23:52:01,389: INFO/ForkPoolWorker-1] [6eebaa38-a2b3-4c3e-8f18-93ad501e538c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:01.390028744Z [2024-03-28 23:52:01,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21eb7f7c-4131-495b-88fa-0e64786dce74] received 2024-03-28T23:52:01.390728122Z [2024-03-28 23:52:01,390: INFO/ForkPoolWorker-2] [be827057-a845-4e5e-8302-9f329befdd87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:01.391023225Z [2024-03-28 23:52:01,390: INFO/ForkPoolWorker-15] [ffac7ba4-eab4-4f9b-9173-243f301521aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:01.399116569Z [2024-03-28 23:52:01,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ac678d-69e3-45b2-8d59-3914bc7d3c14] received 2024-03-28T23:52:01.403695499Z [2024-03-28 23:52:01,403: INFO/ForkPoolWorker-3] [21eb7f7c-4131-495b-88fa-0e64786dce74] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:52:01.407047168Z [2024-03-28 23:52:01,406: INFO/ForkPoolWorker-4] [e6ac678d-69e3-45b2-8d59-3914bc7d3c14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:01.828641833Z [2024-03-28 23:52:01,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:01.830746741Z [2024-03-28 23:52:01,825: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:01.886286164Z [2024-03-28 23:52:01,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:52:02.127445894Z [2024-03-28 23:52:02,123: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:52:02.209861796Z [2024-03-28 23:52:02,208: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:52:02.335734392Z [2024-03-28 23:52:02,330: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:02.418156848Z [2024-03-28 23:52:02,414: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:02.427419891Z [2024-03-28 23:52:02,426: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T23:52:02.449298651Z [2024-03-28 23:52:02,448: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:02.539785482Z [2024-03-28 23:52:02,539: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T23:52:02.544382571Z [2024-03-28 23:52:02,544: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:52:02.544693242Z [2024-03-28 23:52:02,544: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:52:02.545395514Z [2024-03-28 23:52:02,545: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T23:52:02.545907400Z [2024-03-28 23:52:02,545: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:52:02.757531515Z [2024-03-28 23:52:02,757: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:52:03.180381465Z [2024-03-28 23:52:03,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cbef834-8b5d-4a6e-a653-c1498a33bb3d] succeeded in 1.8053638960000171s: None 2024-03-28T23:52:03.594184260Z [2024-03-28 23:52:03,593: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[21eb7f7c-4131-495b-88fa-0e64786dce74] succeeded in 2.2015375510000013s: None 2024-03-28T23:52:03.698210899Z [2024-03-28 23:52:03,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:52:03.702107442Z [2024-03-28 23:52:03,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:03.734422270Z [2024-03-28 23:52:03,734: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:52:03.740082218Z [2024-03-28 23:52:03,739: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:03.740229002Z [2024-03-28 23:52:03,739: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:03.740488057Z [2024-03-28 23:52:03,740: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:03.740602146Z [2024-03-28 23:52:03,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:52:03.741005127Z [2024-03-28 23:52:03,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:52:03.741712475Z [2024-03-28 23:52:03,741: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:03.911036061Z [2024-03-28 23:52:03,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:52:04.178107924Z [2024-03-28 23:52:04,177: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:52:04.182006085Z [2024-03-28 23:52:04,181: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:04.183936129Z [2024-03-28 23:52:04,183: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T23:52:04.188783918Z [2024-03-28 23:52:04,188: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:04.214175586Z [2024-03-28 23:52:04,213: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T23:52:04.216647898Z [2024-03-28 23:52:04,216: INFO/ForkPoolWorker-4] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:04.216871499Z [2024-03-28 23:52:04,216: INFO/ForkPoolWorker-4] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:04.217100606Z [2024-03-28 23:52:04,216: INFO/ForkPoolWorker-4] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:04.217220236Z [2024-03-28 23:52:04,217: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T23:52:04.217712616Z [2024-03-28 23:52:04,217: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:52:04.217880720Z [2024-03-28 23:52:04,217: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:04.227442320Z [2024-03-28 23:52:04,227: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:04.231208244Z [2024-03-28 23:52:04,228: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:04.233698539Z [2024-03-28 23:52:04,233: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T23:52:04.237034128Z [2024-03-28 23:52:04,236: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:04.238715357Z [2024-03-28 23:52:04,238: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:52:04.250778955Z [2024-03-28 23:52:04,248: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:04.251000541Z [2024-03-28 23:52:04,250: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:04.251292706Z [2024-03-28 23:52:04,250: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:04.251372280Z [2024-03-28 23:52:04,251: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:52:04.251828754Z [2024-03-28 23:52:04,251: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:52:04.252436365Z [2024-03-28 23:52:04,251: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:04.260863766Z [2024-03-28 23:52:04,260: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T23:52:04.263181167Z [2024-03-28 23:52:04,262: INFO/ForkPoolWorker-4] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:04.263279634Z [2024-03-28 23:52:04,263: INFO/ForkPoolWorker-4] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:04.263449422Z [2024-03-28 23:52:04,263: INFO/ForkPoolWorker-4] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:04.263534328Z [2024-03-28 23:52:04,263: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T23:52:04.263965121Z [2024-03-28 23:52:04,263: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:52:04.264067264Z [2024-03-28 23:52:04,263: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:04.268748830Z [2024-03-28 23:52:04,268: ERROR/ForkPoolWorker-4] [e6ac678d-69e3-45b2-8d59-3914bc7d3c14] Failed to execute task Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:52:04.268765561Z Traceback (most recent call last): 2024-03-28T23:52:04.268770536Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:52:04.268775485Z args.func(args) 2024-03-28T23:52:04.268779323Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:52:04.268784074Z return func(*args, **kwargs) 2024-03-28T23:52:04.268787515Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:52:04.268790579Z return f(*args, **kwargs) 2024-03-28T23:52:04.268793653Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:52:04.268796790Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:52:04.268799895Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:52:04.268803037Z raise AirflowException( 2024-03-28T23:52:04.268807751Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:52:04.328773738Z [2024-03-28 23:52:04,327: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[e6ac678d-69e3-45b2-8d59-3914bc7d3c14] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e6ac678d-69e3-45b2-8d59-3914bc7d3c14') 2024-03-28T23:52:04.328798654Z Traceback (most recent call last): 2024-03-28T23:52:04.328802864Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:52:04.328806626Z R = retval = fun(*args, **kwargs) 2024-03-28T23:52:04.328809966Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:52:04.328813205Z return self.run(*args, **kwargs) 2024-03-28T23:52:04.328817361Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:52:04.328823331Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:52:04.328826808Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:52:04.328830854Z raise AirflowException(msg) 2024-03-28T23:52:04.328834667Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e6ac678d-69e3-45b2-8d59-3914bc7d3c14 2024-03-28T23:52:04.396303673Z [2024-03-28 23:52:04,395: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:52:04.552869163Z [2024-03-28 23:52:04,552: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:52:04.557141201Z [2024-03-28 23:52:04,556: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:04.578638953Z [2024-03-28 23:52:04,578: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:52:04.580304151Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:04.580353152Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:04.580541216Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:04.580593849Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:52:04.580965378Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:52:04.581018612Z [2024-03-28 23:52:04,580: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:04.589687061Z [2024-03-28 23:52:04,589: WARNING/ForkPoolWorker-2] Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:04.590998405Z [2024-03-28 23:52:04,589: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:04.592085422Z [2024-03-28 23:52:04,591: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:52:04.595286735Z [2024-03-28 23:52:04,594: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:04.607220778Z [2024-03-28 23:52:04,606: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:52:04.608867517Z [2024-03-28 23:52:04,608: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:04.608909578Z [2024-03-28 23:52:04,608: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:04.608991280Z [2024-03-28 23:52:04,608: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:04.609013222Z [2024-03-28 23:52:04,608: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:52:04.609270382Z [2024-03-28 23:52:04,609: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:52:04.609284599Z [2024-03-28 23:52:04,609: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:04.613476694Z [2024-03-28 23:52:04,612: ERROR/ForkPoolWorker-2] [be827057-a845-4e5e-8302-9f329befdd87] Failed to execute task Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:52:04.613505287Z Traceback (most recent call last): 2024-03-28T23:52:04.613517551Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:52:04.613525923Z args.func(args) 2024-03-28T23:52:04.613532751Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:52:04.613541375Z return func(*args, **kwargs) 2024-03-28T23:52:04.613547178Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:52:04.613553316Z return f(*args, **kwargs) 2024-03-28T23:52:04.613560262Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:52:04.613566517Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:52:04.613572450Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:52:04.613578578Z raise AirflowException( 2024-03-28T23:52:04.613586193Z airflow.exceptions.AirflowException: Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:52:04.657326100Z [2024-03-28 23:52:04,656: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be827057-a845-4e5e-8302-9f329befdd87] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id be827057-a845-4e5e-8302-9f329befdd87') 2024-03-28T23:52:04.657348387Z Traceback (most recent call last): 2024-03-28T23:52:04.657353157Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:52:04.657356524Z R = retval = fun(*args, **kwargs) 2024-03-28T23:52:04.657359656Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:52:04.657362876Z return self.run(*args, **kwargs) 2024-03-28T23:52:04.657383266Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:52:04.657387326Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:52:04.657390626Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:52:04.657395123Z raise AirflowException(msg) 2024-03-28T23:52:04.657399486Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id be827057-a845-4e5e-8302-9f329befdd87 2024-03-28T23:52:06.057740032Z [2024-03-28 23:52:06,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffac7ba4-eab4-4f9b-9173-243f301521aa] succeeded in 4.686638902999903s: None 2024-03-28T23:52:08.141035678Z [2024-03-28 23:52:08,140: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6eebaa38-a2b3-4c3e-8f18-93ad501e538c] succeeded in 6.760972931000197s: None 2024-03-28T23:52:14.996742685Z [2024-03-28 23:52:14,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6282931a-e66c-4c88-b710-8b1143e428ab] received 2024-03-28T23:52:15.006343931Z [2024-03-28 23:52:15,006: INFO/ForkPoolWorker-15] [6282931a-e66c-4c88-b710-8b1143e428ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:15.007178247Z [2024-03-28 23:52:15,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abd2229b-178c-4dc9-a67d-5919b52cd0d1] received 2024-03-28T23:52:15.018766780Z [2024-03-28 23:52:15,018: INFO/ForkPoolWorker-16] [abd2229b-178c-4dc9-a67d-5919b52cd0d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:15.345270270Z [2024-03-28 23:52:15,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:15.365495732Z [2024-03-28 23:52:15,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:16.542099636Z [2024-03-28 23:52:16,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:52:16.545168937Z [2024-03-28 23:52:16,544: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:52:16.545535394Z [2024-03-28 23:52:16,545: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:16.548746870Z [2024-03-28 23:52:16,548: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:16.564459852Z [2024-03-28 23:52:16,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:52:16.565740380Z [2024-03-28 23:52:16,565: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:16.565865275Z [2024-03-28 23:52:16,565: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:16.566123249Z [2024-03-28 23:52:16,565: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:16.566261366Z [2024-03-28 23:52:16,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:52:16.566732260Z [2024-03-28 23:52:16,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:52:16.566751963Z [2024-03-28 23:52:16,566: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:16.572345492Z [2024-03-28 23:52:16,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:52:16.573201828Z [2024-03-28 23:52:16,573: WARNING/ForkPoolWorker-16] Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:16.573812367Z [2024-03-28 23:52:16,573: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:16.573842013Z [2024-03-28 23:52:16,573: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:16.573997639Z [2024-03-28 23:52:16,573: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:16.574057422Z [2024-03-28 23:52:16,573: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:52:16.574292061Z [2024-03-28 23:52:16,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:52:16.574299669Z [2024-03-28 23:52:16,573: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:52:16.574384538Z [2024-03-28 23:52:16,574: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:16.575258213Z [2024-03-28 23:52:16,575: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:52:16.578030937Z [2024-03-28 23:52:16,577: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:16.586678985Z [2024-03-28 23:52:16,583: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:16.586690173Z [2024-03-28 23:52:16,583: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:52:16.586696359Z [2024-03-28 23:52:16,585: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:52:16.588554429Z [2024-03-28 23:52:16,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:52:16.597328346Z [2024-03-28 23:52:16,596: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:52:16.597660040Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:16.597685980Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:16.597709444Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:16.597719932Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:52:16.597917537Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:52:16.597966957Z [2024-03-28 23:52:16,597: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:16.601885118Z [2024-03-28 23:52:16,600: ERROR/ForkPoolWorker-16] [abd2229b-178c-4dc9-a67d-5919b52cd0d1] Failed to execute task Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:52:16.602010493Z Traceback (most recent call last): 2024-03-28T23:52:16.602018589Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:52:16.602022601Z args.func(args) 2024-03-28T23:52:16.602026021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:52:16.602030645Z return func(*args, **kwargs) 2024-03-28T23:52:16.602036125Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:52:16.602040781Z return f(*args, **kwargs) 2024-03-28T23:52:16.602046089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:52:16.602095192Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:52:16.602104760Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:52:16.602109885Z raise AirflowException( 2024-03-28T23:52:16.602119825Z airflow.exceptions.AirflowException: Dag 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:52:16.652300462Z [2024-03-28 23:52:16,652: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:52:16.653401744Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:52:16.653433443Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:52:16.653612104Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:52:16.653640636Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:52:16.653937828Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:52:16.653965858Z [2024-03-28 23:52:16,653: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:52:16.657496240Z [2024-03-28 23:52:16,656: ERROR/ForkPoolWorker-15] [6282931a-e66c-4c88-b710-8b1143e428ab] Failed to execute task Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse.. 2024-03-28T23:52:16.657513294Z Traceback (most recent call last): 2024-03-28T23:52:16.657519317Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T23:52:16.657542266Z args.func(args) 2024-03-28T23:52:16.657547702Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T23:52:16.657553230Z return func(*args, **kwargs) 2024-03-28T23:52:16.657558264Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T23:52:16.657562903Z return f(*args, **kwargs) 2024-03-28T23:52:16.657567575Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T23:52:16.657572343Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T23:52:16.657576979Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T23:52:16.657581975Z raise AirflowException( 2024-03-28T23:52:16.657587432Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e' could not be found; either it does not exist or it failed to parse. 2024-03-28T23:52:16.674010558Z [2024-03-28 23:52:16,673: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[abd2229b-178c-4dc9-a67d-5919b52cd0d1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id abd2229b-178c-4dc9-a67d-5919b52cd0d1') 2024-03-28T23:52:16.674032435Z Traceback (most recent call last): 2024-03-28T23:52:16.674037822Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:52:16.674042227Z R = retval = fun(*args, **kwargs) 2024-03-28T23:52:16.674046331Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:52:16.674050501Z return self.run(*args, **kwargs) 2024-03-28T23:52:16.674055226Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:52:16.674060566Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:52:16.674064789Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:52:16.674069448Z raise AirflowException(msg) 2024-03-28T23:52:16.674074220Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id abd2229b-178c-4dc9-a67d-5919b52cd0d1 2024-03-28T23:52:16.695937110Z [2024-03-28 23:52:16,694: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6282931a-e66c-4c88-b710-8b1143e428ab] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6282931a-e66c-4c88-b710-8b1143e428ab') 2024-03-28T23:52:16.695967067Z Traceback (most recent call last): 2024-03-28T23:52:16.695974580Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T23:52:16.695980299Z R = retval = fun(*args, **kwargs) 2024-03-28T23:52:16.695986059Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T23:52:16.695991945Z return self.run(*args, **kwargs) 2024-03-28T23:52:16.695998169Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T23:52:16.696004651Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T23:52:16.696010236Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T23:52:16.696032537Z raise AirflowException(msg) 2024-03-28T23:52:16.696039131Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6282931a-e66c-4c88-b710-8b1143e428ab 2024-03-28T23:53:00.283804309Z [2024-03-28 23:53:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[167dd415-f2dc-4f70-a35d-4d7d82eb9d5f] received 2024-03-28T23:53:00.290434500Z [2024-03-28 23:53:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cee1931-0d0f-44f1-bb7c-e526384c50e5] received 2024-03-28T23:53:00.292081927Z [2024-03-28 23:53:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a65126b-d08f-4302-a4fc-df31c4d42e37] received 2024-03-28T23:53:00.297462330Z [2024-03-28 23:53:00,297: INFO/ForkPoolWorker-15] [167dd415-f2dc-4f70-a35d-4d7d82eb9d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:53:00.308351850Z [2024-03-28 23:53:00,308: INFO/ForkPoolWorker-16] [4cee1931-0d0f-44f1-bb7c-e526384c50e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:53:00.310858139Z [2024-03-28 23:53:00,310: INFO/ForkPoolWorker-1] [4a65126b-d08f-4302-a4fc-df31c4d42e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:53:00.678967404Z [2024-03-28 23:53:00,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:53:00.679706342Z [2024-03-28 23:53:00,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:53:00.712100939Z [2024-03-28 23:53:00,708: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:53:00.918459442Z [2024-03-28 23:53:00,917: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:53:00.935074459Z [2024-03-28 23:53:00,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:53:01.020048312Z [2024-03-28 23:53:01,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:53:01.023434704Z [2024-03-28 23:53:01,023: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:53:01.023827946Z [2024-03-28 23:53:01,023: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:53:01.024031943Z [2024-03-28 23:53:01,023: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:53:01.025059626Z [2024-03-28 23:53:01,024: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:53:01.132523985Z [2024-03-28 23:53:01,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:53:01.997462194Z [2024-03-28 23:53:01,997: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a65126b-d08f-4302-a4fc-df31c4d42e37] succeeded in 1.703786159000174s: None 2024-03-28T23:53:02.249665742Z [2024-03-28 23:53:02,249: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:53:02.253727574Z [2024-03-28 23:53:02,253: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:53:02.277629363Z [2024-03-28 23:53:02,277: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:53:02.279066418Z [2024-03-28 23:53:02,278: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:53:02.279094902Z [2024-03-28 23:53:02,278: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:53:02.279207322Z [2024-03-28 23:53:02,279: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:53:02.279262046Z [2024-03-28 23:53:02,279: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:53:02.279532900Z [2024-03-28 23:53:02,279: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:53:02.279557171Z [2024-03-28 23:53:02,279: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:53:02.370737830Z [2024-03-28 23:53:02,370: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:53:02.422539533Z [2024-03-28 23:53:02,422: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:53:02.426205106Z [2024-03-28 23:53:02,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:53:02.471225582Z [2024-03-28 23:53:02,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:53:02.479352121Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:53:02.479376965Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:53:02.479436605Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:53:02.479484515Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:53:02.479807009Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:53:02.479829942Z [2024-03-28 23:53:02,479: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:53:02.590591118Z [2024-03-28 23:53:02,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:53:04.413914942Z [2024-03-28 23:53:04,413: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cee1931-0d0f-44f1-bb7c-e526384c50e5] succeeded in 4.120985847999918s: None 2024-03-28T23:53:04.877501416Z [2024-03-28 23:53:04,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[167dd415-f2dc-4f70-a35d-4d7d82eb9d5f] succeeded in 4.5916590490001s: None 2024-03-28T23:54:01.092439242Z [2024-03-28 23:54:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52343cdd-ecd3-44c9-a31b-f6e7dbbcd5fc] received 2024-03-28T23:54:01.095104041Z [2024-03-28 23:54:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9148288b-08b0-4571-ac7b-ac29b3e155d9] received 2024-03-28T23:54:01.097505728Z [2024-03-28 23:54:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39eab75a-f2fa-4332-bbd9-b29fba3811ca] received 2024-03-28T23:54:01.100481228Z [2024-03-28 23:54:01,100: INFO/ForkPoolWorker-15] [52343cdd-ecd3-44c9-a31b-f6e7dbbcd5fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:54:01.104631829Z [2024-03-28 23:54:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4888b7-ba98-468a-bac4-1f97d0ef69d6] received 2024-03-28T23:54:01.105374779Z [2024-03-28 23:54:01,105: INFO/ForkPoolWorker-1] [39eab75a-f2fa-4332-bbd9-b29fba3811ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:54:01.116120774Z [2024-03-28 23:54:01,115: INFO/ForkPoolWorker-16] [9148288b-08b0-4571-ac7b-ac29b3e155d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:54:01.124401735Z [2024-03-28 23:54:01,124: INFO/ForkPoolWorker-2] [8a4888b7-ba98-468a-bac4-1f97d0ef69d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:54:01.596389189Z [2024-03-28 23:54:01,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:54:01.702239289Z [2024-03-28 23:54:01,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:54:01.929226931Z [2024-03-28 23:54:01,925: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:54:01.939766397Z [2024-03-28 23:54:01,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:54:02.076455272Z [2024-03-28 23:54:02,075: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:54:02.081312851Z [2024-03-28 23:54:02,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:54:02.125942720Z [2024-03-28 23:54:02,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:54:02.127361598Z [2024-03-28 23:54:02,127: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:54:02.127799734Z [2024-03-28 23:54:02,127: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:54:02.128008844Z [2024-03-28 23:54:02,127: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:54:02.128351726Z [2024-03-28 23:54:02,128: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:54:02.241729795Z [2024-03-28 23:54:02,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:54:02.329768478Z [2024-03-28 23:54:02,329: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:54:03.420809676Z [2024-03-28 23:54:03,420: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39eab75a-f2fa-4332-bbd9-b29fba3811ca] succeeded in 2.3211213469999166s: None 2024-03-28T23:54:03.467241165Z [2024-03-28 23:54:03,466: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9148288b-08b0-4571-ac7b-ac29b3e155d9] succeeded in 2.3680125680002675s: None 2024-03-28T23:54:03.672135890Z [2024-03-28 23:54:03,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:54:03.676503547Z [2024-03-28 23:54:03,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:54:03.705234479Z [2024-03-28 23:54:03,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:54:03.706941504Z [2024-03-28 23:54:03,706: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:54:03.707071953Z [2024-03-28 23:54:03,706: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:54:03.707273304Z [2024-03-28 23:54:03,707: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:54:03.707422954Z [2024-03-28 23:54:03,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:54:03.707819381Z [2024-03-28 23:54:03,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:54:03.707949489Z [2024-03-28 23:54:03,707: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:54:03.797380748Z [2024-03-28 23:54:03,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:54:04.259343931Z [2024-03-28 23:54:04,258: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:54:04.263424634Z [2024-03-28 23:54:04,262: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:54:04.299718259Z [2024-03-28 23:54:04,299: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:54:04.301711540Z [2024-03-28 23:54:04,301: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:54:04.306669662Z [2024-03-28 23:54:04,301: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:54:04.307082053Z [2024-03-28 23:54:04,306: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:54:04.307217182Z [2024-03-28 23:54:04,307: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:54:04.307774578Z [2024-03-28 23:54:04,307: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:54:04.307905400Z [2024-03-28 23:54:04,307: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:54:04.422353803Z [2024-03-28 23:54:04,421: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:54:05.581890574Z [2024-03-28 23:54:05,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52343cdd-ecd3-44c9-a31b-f6e7dbbcd5fc] succeeded in 4.485486517000027s: None 2024-03-28T23:54:07.756252820Z [2024-03-28 23:54:07,755: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8a4888b7-ba98-468a-bac4-1f97d0ef69d6] succeeded in 6.640527811000084s: None 2024-03-28T23:55:00.927123473Z [2024-03-28 23:55:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[255bbf66-cc9c-4529-8824-5a05679eff95] received 2024-03-28T23:55:00.929725443Z [2024-03-28 23:55:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[238cd5f5-c93e-4a1d-8721-eeb25397a486] received 2024-03-28T23:55:00.936744122Z [2024-03-28 23:55:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd3f3417-8e51-43a3-9b21-c52abfa6d74d] received 2024-03-28T23:55:00.939378096Z [2024-03-28 23:55:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78bae502-9f81-44da-b325-f0ee649f99e3] received 2024-03-28T23:55:00.944809733Z [2024-03-28 23:55:00,944: INFO/ForkPoolWorker-15] [255bbf66-cc9c-4529-8824-5a05679eff95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:00.951250954Z [2024-03-28 23:55:00,950: INFO/ForkPoolWorker-16] [238cd5f5-c93e-4a1d-8721-eeb25397a486] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:55:00.952598702Z [2024-03-28 23:55:00,952: INFO/ForkPoolWorker-2] [78bae502-9f81-44da-b325-f0ee649f99e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:55:00.956427252Z [2024-03-28 23:55:00,955: INFO/ForkPoolWorker-1] [cd3f3417-8e51-43a3-9b21-c52abfa6d74d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:55:01.320571937Z [2024-03-28 23:55:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:55:01.351134643Z [2024-03-28 23:55:01,347: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:55:01.404778016Z [2024-03-28 23:55:01,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:55:01.468393882Z [2024-03-28 23:55:01,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:55:01.748666713Z [2024-03-28 23:55:01,748: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T23:55:01.763133380Z [2024-03-28 23:55:01,762: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:01.795893328Z [2024-03-28 23:55:01,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:55:01.798065045Z [2024-03-28 23:55:01,797: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:55:01.798161730Z [2024-03-28 23:55:01,797: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:55:01.798438016Z [2024-03-28 23:55:01,798: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T23:55:01.798752850Z [2024-03-28 23:55:01,798: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:55:01.934027139Z [2024-03-28 23:55:01,933: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:02.718067427Z [2024-03-28 23:55:02,717: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[238cd5f5-c93e-4a1d-8721-eeb25397a486] succeeded in 1.7854752270000063s: None 2024-03-28T23:55:02.830534474Z [2024-03-28 23:55:02,830: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:55:02.834513456Z [2024-03-28 23:55:02,833: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:02.884734131Z [2024-03-28 23:55:02,884: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:55:02.889349102Z [2024-03-28 23:55:02,888: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:02.889552960Z [2024-03-28 23:55:02,889: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:02.889831605Z [2024-03-28 23:55:02,889: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:02.889970739Z [2024-03-28 23:55:02,889: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:55:02.890401920Z [2024-03-28 23:55:02,890: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:55:02.890592450Z [2024-03-28 23:55:02,890: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:03.033546338Z [2024-03-28 23:55:03,033: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:55:03.040650411Z [2024-03-28 23:55:03,039: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:03.051412893Z [2024-03-28 23:55:03,051: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:03.083450972Z [2024-03-28 23:55:03,083: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:55:03.088272142Z [2024-03-28 23:55:03,087: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:03.088325406Z [2024-03-28 23:55:03,088: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:03.088584862Z [2024-03-28 23:55:03,088: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:03.088672714Z [2024-03-28 23:55:03,088: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:55:03.089123931Z [2024-03-28 23:55:03,088: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:55:03.089236415Z [2024-03-28 23:55:03,089: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:03.134685185Z [2024-03-28 23:55:03,134: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:55:03.138961212Z [2024-03-28 23:55:03,138: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:03.171065708Z [2024-03-28 23:55:03,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:55:03.175770275Z [2024-03-28 23:55:03,175: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:03.175792325Z [2024-03-28 23:55:03,175: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:03.175867062Z [2024-03-28 23:55:03,175: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:03.175980523Z [2024-03-28 23:55:03,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:55:03.176329498Z [2024-03-28 23:55:03,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:55:03.176471852Z [2024-03-28 23:55:03,176: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:03.207079734Z [2024-03-28 23:55:03,206: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:03.271903909Z [2024-03-28 23:55:03,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:04.012041285Z [2024-03-28 23:55:04,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[255bbf66-cc9c-4529-8824-5a05679eff95] succeeded in 3.0823947359999693s: None 2024-03-28T23:55:04.778112890Z [2024-03-28 23:55:04,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbfe9be2-4c6a-4afb-97be-49c87fff3f53] received 2024-03-28T23:55:04.789829306Z [2024-03-28 23:55:04,789: INFO/ForkPoolWorker-15] [fbfe9be2-4c6a-4afb-97be-49c87fff3f53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:04.916641661Z [2024-03-28 23:55:04,916: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[78bae502-9f81-44da-b325-f0ee649f99e3] succeeded in 3.975764925999556s: None 2024-03-28T23:55:05.204486781Z [2024-03-28 23:55:05,200: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:55:05.212349481Z [2024-03-28 23:55:05,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd3f3417-8e51-43a3-9b21-c52abfa6d74d] succeeded in 4.2713288009999815s: None 2024-03-28T23:55:06.739541407Z [2024-03-28 23:55:06,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:55:06.743158085Z [2024-03-28 23:55:06,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:06.767278384Z [2024-03-28 23:55:06,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:55:06.768718806Z [2024-03-28 23:55:06,768: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:06.768726316Z [2024-03-28 23:55:06,768: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:06.768907529Z [2024-03-28 23:55:06,768: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:06.769023172Z [2024-03-28 23:55:06,768: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:55:06.769621286Z [2024-03-28 23:55:06,769: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:55:06.769666428Z [2024-03-28 23:55:06,769: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:06.866614573Z [2024-03-28 23:55:06,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:07.700656881Z [2024-03-28 23:55:07,699: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbfe9be2-4c6a-4afb-97be-49c87fff3f53] succeeded in 2.9174258529997132s: None 2024-03-28T23:55:08.563232497Z [2024-03-28 23:55:08,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b83f4390-9f1e-4db6-a725-f0ef6c9698cf] received 2024-03-28T23:55:08.572292633Z [2024-03-28 23:55:08,572: INFO/ForkPoolWorker-15] [b83f4390-9f1e-4db6-a725-f0ef6c9698cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:55:08.862935216Z [2024-03-28 23:55:08,859: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:55:10.045025013Z [2024-03-28 23:55:10,044: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:55:10.048591688Z [2024-03-28 23:55:10,048: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:10.069772518Z [2024-03-28 23:55:10,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:55:10.071096161Z [2024-03-28 23:55:10,070: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:10.071146131Z [2024-03-28 23:55:10,071: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:10.071303905Z [2024-03-28 23:55:10,071: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:10.071391925Z [2024-03-28 23:55:10,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:55:10.071828273Z [2024-03-28 23:55:10,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:55:10.071931527Z [2024-03-28 23:55:10,071: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:10.158209041Z [2024-03-28 23:55:10,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:10.851670825Z [2024-03-28 23:55:10,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b83f4390-9f1e-4db6-a725-f0ef6c9698cf] succeeded in 2.2860408100000313s: None 2024-03-28T23:55:11.031390571Z [2024-03-28 23:55:11,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a235e11-f7fd-43ad-9123-a0daffc7d4fb] received 2024-03-28T23:55:11.051249612Z [2024-03-28 23:55:11,050: INFO/ForkPoolWorker-15] [0a235e11-f7fd-43ad-9123-a0daffc7d4fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:11.415992950Z [2024-03-28 23:55:11,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T23:55:12.758632232Z [2024-03-28 23:55:12,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:55:12.761989019Z [2024-03-28 23:55:12,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:55:12.782717438Z [2024-03-28 23:55:12,782: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:55:12.783953860Z [2024-03-28 23:55:12,783: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:55:12.783980203Z [2024-03-28 23:55:12,783: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:55:12.784150020Z [2024-03-28 23:55:12,783: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:55:12.784309722Z [2024-03-28 23:55:12,784: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:55:12.784592596Z [2024-03-28 23:55:12,784: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T23:55:12.784626332Z [2024-03-28 23:55:12,784: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:55:12.884892223Z [2024-03-28 23:55:12,884: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:55:13.495248836Z [2024-03-28 23:55:13,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a235e11-f7fd-43ad-9123-a0daffc7d4fb] succeeded in 2.459529621999991s: None 2024-03-28T23:56:00.688348198Z [2024-03-28 23:56:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aae01127-7d6a-4740-8bb0-849496c6c79e] received 2024-03-28T23:56:00.691909652Z [2024-03-28 23:56:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f43738f5-20f9-45e0-b4c6-28a4c155c547] received 2024-03-28T23:56:00.694227097Z [2024-03-28 23:56:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52778983-3c3a-4cb2-a354-5432ee3b2098] received 2024-03-28T23:56:00.697315549Z [2024-03-28 23:56:00,696: INFO/ForkPoolWorker-15] [aae01127-7d6a-4740-8bb0-849496c6c79e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:56:00.702255931Z [2024-03-28 23:56:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf75dca-bdcb-4435-ba4c-c212c2757031] received 2024-03-28T23:56:00.705087524Z [2024-03-28 23:56:00,704: INFO/ForkPoolWorker-1] [52778983-3c3a-4cb2-a354-5432ee3b2098] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:56:00.705742484Z [2024-03-28 23:56:00,705: INFO/ForkPoolWorker-16] [f43738f5-20f9-45e0-b4c6-28a4c155c547] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:56:00.714938694Z [2024-03-28 23:56:00,714: INFO/ForkPoolWorker-2] [4cf75dca-bdcb-4435-ba4c-c212c2757031] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:56:01.134833078Z [2024-03-28 23:56:01,130: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:56:01.157249615Z [2024-03-28 23:56:01,153: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:56:01.167149548Z [2024-03-28 23:56:01,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:56:01.192464279Z [2024-03-28 23:56:01,186: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:56:01.457245222Z [2024-03-28 23:56:01,456: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:56:01.463480637Z [2024-03-28 23:56:01,462: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:56:01.484649455Z [2024-03-28 23:56:01,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:56:01.509730425Z [2024-03-28 23:56:01,509: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:56:01.515150363Z [2024-03-28 23:56:01,514: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:56:01.515374733Z [2024-03-28 23:56:01,515: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:56:01.515513074Z [2024-03-28 23:56:01,515: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:56:01.515860949Z [2024-03-28 23:56:01,515: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:56:01.740580745Z [2024-03-28 23:56:01,740: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:56:02.361233588Z [2024-03-28 23:56:02,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aae01127-7d6a-4740-8bb0-849496c6c79e] succeeded in 1.669523018000291s: None 2024-03-28T23:56:02.710003073Z [2024-03-28 23:56:02,709: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52778983-3c3a-4cb2-a354-5432ee3b2098] succeeded in 2.013441495999814s: None 2024-03-28T23:56:03.154054258Z [2024-03-28 23:56:03,153: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:56:03.159038466Z [2024-03-28 23:56:03,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:56:03.182661097Z [2024-03-28 23:56:03,182: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:56:03.184899696Z [2024-03-28 23:56:03,184: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:56:03.185171784Z [2024-03-28 23:56:03,184: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:56:03.185507266Z [2024-03-28 23:56:03,185: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:56:03.185771647Z [2024-03-28 23:56:03,185: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:56:03.186271383Z [2024-03-28 23:56:03,186: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:56:03.186414124Z [2024-03-28 23:56:03,186: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:56:03.285395142Z [2024-03-28 23:56:03,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:56:03.333935872Z [2024-03-28 23:56:03,333: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T23:56:03.337567219Z [2024-03-28 23:56:03,337: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:56:03.362259207Z [2024-03-28 23:56:03,362: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:56:03.363795533Z [2024-03-28 23:56:03,363: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:56:03.364110164Z [2024-03-28 23:56:03,363: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:56:03.364341040Z [2024-03-28 23:56:03,364: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:56:03.364510699Z [2024-03-28 23:56:03,364: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T23:56:03.364967740Z [2024-03-28 23:56:03,364: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:56:03.365084639Z [2024-03-28 23:56:03,364: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:56:03.449450458Z [2024-03-28 23:56:03,449: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:56:05.559657546Z [2024-03-28 23:56:05,559: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4cf75dca-bdcb-4435-ba4c-c212c2757031] succeeded in 4.854300156000136s: None 2024-03-28T23:56:05.931479824Z [2024-03-28 23:56:05,931: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f43738f5-20f9-45e0-b4c6-28a4c155c547] succeeded in 5.237176841999826s: None 2024-03-28T23:57:00.345345726Z [2024-03-28 23:57:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8714f045-30d2-4c76-9667-3f441b926618] received 2024-03-28T23:57:00.348223928Z [2024-03-28 23:57:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d003a1f-444e-4cfb-a68b-bad2c897346e] received 2024-03-28T23:57:00.353045120Z [2024-03-28 23:57:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08776b6e-9ab0-40a5-a611-dd93b47c09dd] received 2024-03-28T23:57:00.355292236Z [2024-03-28 23:57:00,355: INFO/ForkPoolWorker-15] [8714f045-30d2-4c76-9667-3f441b926618] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:57:00.359961008Z [2024-03-28 23:57:00,359: INFO/ForkPoolWorker-16] [9d003a1f-444e-4cfb-a68b-bad2c897346e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:57:00.368485974Z [2024-03-28 23:57:00,368: INFO/ForkPoolWorker-1] [08776b6e-9ab0-40a5-a611-dd93b47c09dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:57:00.648868377Z [2024-03-28 23:57:00,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:57:00.700567192Z [2024-03-28 23:57:00,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:57:00.729781571Z [2024-03-28 23:57:00,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:57:00.885693320Z [2024-03-28 23:57:00,885: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:57:00.890661919Z [2024-03-28 23:57:00,890: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:57:00.915722084Z [2024-03-28 23:57:00,915: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:57:00.917441035Z [2024-03-28 23:57:00,917: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:57:00.917664419Z [2024-03-28 23:57:00,917: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:57:00.917858584Z [2024-03-28 23:57:00,917: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:57:00.918831514Z [2024-03-28 23:57:00,918: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:57:01.030391084Z [2024-03-28 23:57:01,030: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:57:01.607312226Z [2024-03-28 23:57:01,606: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08776b6e-9ab0-40a5-a611-dd93b47c09dd] succeeded in 1.2483372350002355s: None 2024-03-28T23:57:01.983224744Z [2024-03-28 23:57:01,982: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:57:01.986958142Z [2024-03-28 23:57:01,986: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:57:02.021741461Z [2024-03-28 23:57:02,021: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:57:02.023480767Z [2024-03-28 23:57:02,023: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:57:02.023499619Z [2024-03-28 23:57:02,023: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:57:02.023778387Z [2024-03-28 23:57:02,023: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:57:02.023895256Z [2024-03-28 23:57:02,023: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:57:02.024294138Z [2024-03-28 23:57:02,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:57:02.024472025Z [2024-03-28 23:57:02,024: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:57:02.039805360Z [2024-03-28 23:57:02,039: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:57:02.045311839Z [2024-03-28 23:57:02,044: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:57:02.070040190Z [2024-03-28 23:57:02,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:57:02.071678158Z [2024-03-28 23:57:02,071: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:57:02.071842239Z [2024-03-28 23:57:02,071: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:57:02.072125617Z [2024-03-28 23:57:02,071: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:57:02.072226032Z [2024-03-28 23:57:02,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:57:02.072783767Z [2024-03-28 23:57:02,072: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:57:02.072956464Z [2024-03-28 23:57:02,072: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:57:02.113972724Z [2024-03-28 23:57:02,113: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:57:02.191713855Z [2024-03-28 23:57:02,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:57:03.615064134Z [2024-03-28 23:57:03,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d003a1f-444e-4cfb-a68b-bad2c897346e] succeeded in 3.264137828999992s: None 2024-03-28T23:57:04.208988228Z [2024-03-28 23:57:04,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8714f045-30d2-4c76-9667-3f441b926618] succeeded in 3.8589637370000673s: None 2024-03-28T23:58:01.259426717Z [2024-03-28 23:58:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d2998b5-b633-49b0-af80-f314f59c15ab] received 2024-03-28T23:58:01.262895300Z [2024-03-28 23:58:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29e4964e-23a2-49f3-ab6d-3019064be5f7] received 2024-03-28T23:58:01.271382883Z [2024-03-28 23:58:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e66dec67-1294-47b8-897a-be3f67b7f7f4] received 2024-03-28T23:58:01.278999258Z [2024-03-28 23:58:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39af4611-d49b-4ce5-b270-08435501ed89] received 2024-03-28T23:58:01.279998623Z [2024-03-28 23:58:01,279: INFO/ForkPoolWorker-16] [29e4964e-23a2-49f3-ab6d-3019064be5f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:58:01.283534723Z [2024-03-28 23:58:01,283: INFO/ForkPoolWorker-15] [9d2998b5-b633-49b0-af80-f314f59c15ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:58:01.295187934Z [2024-03-28 23:58:01,294: INFO/ForkPoolWorker-1] [e66dec67-1294-47b8-897a-be3f67b7f7f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:58:01.310499330Z [2024-03-28 23:58:01,310: INFO/ForkPoolWorker-2] [39af4611-d49b-4ce5-b270-08435501ed89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:58:01.715169522Z [2024-03-28 23:58:01,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:58:01.783543220Z [2024-03-28 23:58:01,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:58:01.876561465Z [2024-03-28 23:58:01,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T23:58:01.887848768Z [2024-03-28 23:58:01,880: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:58:02.102337429Z [2024-03-28 23:58:02,101: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T23:58:02.107522208Z [2024-03-28 23:58:02,106: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:58:02.131175546Z [2024-03-28 23:58:02,130: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T23:58:02.133515535Z [2024-03-28 23:58:02,133: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:58:02.133711238Z [2024-03-28 23:58:02,133: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:58:02.133848777Z [2024-03-28 23:58:02,133: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T23:58:02.134625461Z [2024-03-28 23:58:02,134: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:58:02.309362453Z [2024-03-28 23:58:02,309: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:58:02.310486097Z [2024-03-28 23:58:02,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:58:03.056775627Z [2024-03-28 23:58:03,056: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39af4611-d49b-4ce5-b270-08435501ed89] succeeded in 1.7674352320000253s: None 2024-03-28T23:58:03.088351853Z [2024-03-28 23:58:03,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d2998b5-b633-49b0-af80-f314f59c15ab] succeeded in 1.8264853380001114s: None 2024-03-28T23:58:03.332746156Z [2024-03-28 23:58:03,332: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:58:03.336487126Z [2024-03-28 23:58:03,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:58:03.355026640Z [2024-03-28 23:58:03,354: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:58:03.356591719Z [2024-03-28 23:58:03,356: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:58:03.356717838Z [2024-03-28 23:58:03,356: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:58:03.356851599Z [2024-03-28 23:58:03,356: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:58:03.357035122Z [2024-03-28 23:58:03,356: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:58:03.357336761Z [2024-03-28 23:58:03,357: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:58:03.357742139Z [2024-03-28 23:58:03,357: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:58:03.417520247Z [2024-03-28 23:58:03,417: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T23:58:03.421205551Z [2024-03-28 23:58:03,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:58:03.441757109Z [2024-03-28 23:58:03,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:58:03.443973885Z [2024-03-28 23:58:03,443: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:58:03.444202637Z [2024-03-28 23:58:03,443: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:58:03.444816805Z [2024-03-28 23:58:03,444: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:58:03.445104386Z [2024-03-28 23:58:03,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T23:58:03.445746019Z [2024-03-28 23:58:03,445: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:58:03.446178119Z [2024-03-28 23:58:03,445: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:58:03.450995690Z [2024-03-28 23:58:03,450: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:58:03.554307471Z [2024-03-28 23:58:03,553: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:58:05.746345832Z [2024-03-28 23:58:05,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29e4964e-23a2-49f3-ab6d-3019064be5f7] succeeded in 4.481246129999818s: None 2024-03-28T23:58:06.185032602Z [2024-03-28 23:58:06,184: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e66dec67-1294-47b8-897a-be3f67b7f7f4] succeeded in 4.903541964999931s: None 2024-03-28T23:59:01.106205417Z [2024-03-28 23:59:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbaa8694-00b4-42dc-a9bd-d19c2a752e6b] received 2024-03-28T23:59:01.108953709Z [2024-03-28 23:59:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[167b7243-5fa4-48bd-927b-6467253c1127] received 2024-03-28T23:59:01.122828470Z [2024-03-28 23:59:01,122: INFO/ForkPoolWorker-15] [bbaa8694-00b4-42dc-a9bd-d19c2a752e6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:59:01.127560345Z [2024-03-28 23:59:01,127: INFO/ForkPoolWorker-16] [167b7243-5fa4-48bd-927b-6467253c1127] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:59:01.128608466Z [2024-03-28 23:59:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffc056ae-58ff-4b57-8836-c2ebc7459bf0] received 2024-03-28T23:59:01.141837668Z [2024-03-28 23:59:01,141: INFO/ForkPoolWorker-1] [ffc056ae-58ff-4b57-8836-c2ebc7459bf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:59:01.478643607Z [2024-03-28 23:59:01,475: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T23:59:01.536751147Z [2024-03-28 23:59:01,532: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T23:59:01.567318144Z [2024-03-28 23:59:01,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T23:59:01.691271880Z [2024-03-28 23:59:01,690: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T23:59:01.695653786Z [2024-03-28 23:59:01,695: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:59:01.731662531Z [2024-03-28 23:59:01,731: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T23:59:01.732819466Z [2024-03-28 23:59:01,732: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-28T23:59:01.732995798Z [2024-03-28 23:59:01,732: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T23:59:01.733080202Z [2024-03-28 23:59:01,732: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T23:59:01.733440525Z [2024-03-28 23:59:01,733: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-28T23:59:01.879440999Z [2024-03-28 23:59:01,879: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:59:02.597472791Z [2024-03-28 23:59:02,597: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ffc056ae-58ff-4b57-8836-c2ebc7459bf0] succeeded in 1.4672168289998808s: None 2024-03-28T23:59:02.889921795Z [2024-03-28 23:59:02,889: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T23:59:02.893458436Z [2024-03-28 23:59:02,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:59:02.915983792Z [2024-03-28 23:59:02,915: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T23:59:02.918406009Z [2024-03-28 23:59:02,918: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:59:02.918624622Z [2024-03-28 23:59:02,918: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:59:02.918963011Z [2024-03-28 23:59:02,918: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:59:02.919293128Z [2024-03-28 23:59:02,918: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T23:59:02.919926960Z [2024-03-28 23:59:02,919: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T23:59:02.920124457Z [2024-03-28 23:59:02,919: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:59:02.998928648Z [2024-03-28 23:59:02,998: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T23:59:03.002591953Z [2024-03-28 23:59:03,002: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T23:59:03.019309360Z [2024-03-28 23:59:03,019: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:59:03.027270409Z [2024-03-28 23:59:03,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T23:59:03.028823101Z [2024-03-28 23:59:03,028: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-28T23:59:03.029020567Z [2024-03-28 23:59:03,028: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-28T23:59:03.029287608Z [2024-03-28 23:59:03,029: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T23:59:03.029454525Z [2024-03-28 23:59:03,029: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T23:59:03.029932269Z [2024-03-28 23:59:03,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T23:59:03.030086436Z [2024-03-28 23:59:03,029: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-28T23:59:03.123008369Z [2024-03-28 23:59:03,122: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T23:59:05.294345846Z [2024-03-28 23:59:05,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbaa8694-00b4-42dc-a9bd-d19c2a752e6b] succeeded in 4.182419168000251s: None 2024-03-28T23:59:05.444305835Z [2024-03-28 23:59:05,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[167b7243-5fa4-48bd-927b-6467253c1127] succeeded in 4.33083864900027s: None 2024-03-29T00:00:01.185694226Z [2024-03-29 00:00:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70f6b054-df0e-49e3-923c-0c9bbe057cd2] received 2024-03-29T00:00:01.188972464Z [2024-03-29 00:00:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03e22d10-c7f8-4034-9526-8c170a1ae898] received 2024-03-29T00:00:01.195733835Z [2024-03-29 00:00:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45da14ef-c71f-4c0e-acf6-debd31bf7c60] received 2024-03-29T00:00:01.215361580Z [2024-03-29 00:00:01,215: INFO/ForkPoolWorker-16] [03e22d10-c7f8-4034-9526-8c170a1ae898] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:00:01.305521118Z [2024-03-29 00:00:01,305: INFO/ForkPoolWorker-15] [70f6b054-df0e-49e3-923c-0c9bbe057cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:01.380851106Z [2024-03-29 00:00:01,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a47a9d1-446a-4fbc-bc69-86220ac5f50e] received 2024-03-29T00:00:01.433951396Z [2024-03-29 00:00:01,433: INFO/ForkPoolWorker-1] [45da14ef-c71f-4c0e-acf6-debd31bf7c60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:00:01.499639890Z [2024-03-29 00:00:01,499: INFO/ForkPoolWorker-2] [5a47a9d1-446a-4fbc-bc69-86220ac5f50e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:00:01.572779935Z [2024-03-29 00:00:01,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a1d25ae-c9a2-4e0c-bda8-2d0893388771] received 2024-03-29T00:00:01.647622530Z [2024-03-29 00:00:01,647: INFO/ForkPoolWorker-3] [4a1d25ae-c9a2-4e0c-bda8-2d0893388771] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:00:02.946205783Z [2024-03-29 00:00:02,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:00:03.221421774Z [2024-03-29 00:00:03,216: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:00:03.236452446Z [2024-03-29 00:00:03,231: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:00:03.761326731Z [2024-03-29 00:00:03,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:00:03.963191345Z [2024-03-29 00:00:03,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:00:05.845870460Z [2024-03-29 00:00:05,841: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:00:05.872390493Z [2024-03-29 00:00:05,846: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:06.191588825Z [2024-03-29 00:00:06,191: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:00:06.207826186Z [2024-03-29 00:00:06,205: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:00:06.207853201Z [2024-03-29 00:00:06,205: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:00:06.207857862Z [2024-03-29 00:00:06,205: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:00:06.207861428Z [2024-03-29 00:00:06,205: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:00:07.465446178Z [2024-03-29 00:00:07,465: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:08.330199368Z [2024-03-29 00:00:08,329: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:10.424641258Z [2024-03-29 00:00:10,424: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45da14ef-c71f-4c0e-acf6-debd31bf7c60] succeeded in 9.226848996999706s: None 2024-03-29T00:00:13.636065202Z [2024-03-29 00:00:13,635: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:00:13.661909278Z [2024-03-29 00:00:13,661: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:13.873576448Z [2024-03-29 00:00:13,873: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:00:13.884733006Z [2024-03-29 00:00:13,884: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:13.884751163Z [2024-03-29 00:00:13,884: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:13.885001400Z [2024-03-29 00:00:13,884: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:13.888067366Z [2024-03-29 00:00:13,884: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:00:13.889381437Z [2024-03-29 00:00:13,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:00:13.889398015Z [2024-03-29 00:00:13,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:15.052980186Z [2024-03-29 00:00:15,052: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:15.263087775Z [2024-03-29 00:00:15,259: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03e22d10-c7f8-4034-9526-8c170a1ae898] succeeded in 14.07011521000004s: None 2024-03-29T00:00:16.698501096Z [2024-03-29 00:00:16,687: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:00:16.740057081Z [2024-03-29 00:00:16,731: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:16.931756822Z [2024-03-29 00:00:16,931: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:00:16.943398180Z [2024-03-29 00:00:16,943: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:16.943682411Z [2024-03-29 00:00:16,943: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T00:00:16.946798212Z [2024-03-29 00:00:16,946: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:16.947896326Z [2024-03-29 00:00:16,947: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:16.948175654Z [2024-03-29 00:00:16,946: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:16.948321874Z [2024-03-29 00:00:16,948: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:00:16.948663292Z [2024-03-29 00:00:16,948: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:00:16.952587923Z [2024-03-29 00:00:16,952: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:17.012161013Z [2024-03-29 00:00:17,011: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T00:00:17.038673282Z [2024-03-29 00:00:17,024: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:17.038873958Z [2024-03-29 00:00:17,038: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:17.039109641Z [2024-03-29 00:00:17,038: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:17.039120302Z [2024-03-29 00:00:17,039: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T00:00:17.039517356Z [2024-03-29 00:00:17,039: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:00:17.039653202Z [2024-03-29 00:00:17,039: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:17.454526842Z [2024-03-29 00:00:17,453: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:17.709472332Z [2024-03-29 00:00:17,709: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:18.120569321Z [2024-03-29 00:00:18,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b06f0e1-96aa-4eca-8131-12c9e5f0fe2a] received 2024-03-29T00:00:18.134540970Z [2024-03-29 00:00:18,131: INFO/ForkPoolWorker-16] [5b06f0e1-96aa-4eca-8131-12c9e5f0fe2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:18.167020478Z [2024-03-29 00:00:18,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70f6b054-df0e-49e3-923c-0c9bbe057cd2] succeeded in 16.97656200900019s: None 2024-03-29T00:00:19.987757764Z [2024-03-29 00:00:19,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:00:21.136016801Z [2024-03-29 00:00:21,135: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4a1d25ae-c9a2-4e0c-bda8-2d0893388771] succeeded in 19.54809827400004s: None 2024-03-29T00:00:21.910470080Z [2024-03-29 00:00:21,910: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a47a9d1-446a-4fbc-bc69-86220ac5f50e] succeeded in 20.471728989999974s: None 2024-03-29T00:00:23.559732389Z [2024-03-29 00:00:23,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:00:23.563771093Z [2024-03-29 00:00:23,563: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:23.626138159Z [2024-03-29 00:00:23,625: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:00:23.631893886Z [2024-03-29 00:00:23,631: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:23.632060664Z [2024-03-29 00:00:23,631: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:23.632240576Z [2024-03-29 00:00:23,632: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:23.632295290Z [2024-03-29 00:00:23,632: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:00:23.632563791Z [2024-03-29 00:00:23,632: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:00:23.633040314Z [2024-03-29 00:00:23,632: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:23.925189251Z [2024-03-29 00:00:23,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:25.449300590Z [2024-03-29 00:00:25,448: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b06f0e1-96aa-4eca-8131-12c9e5f0fe2a] succeeded in 7.326419341000019s: None 2024-03-29T00:00:26.178586979Z [2024-03-29 00:00:26,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b429565-1dc0-488a-a091-53bdf7c064f4] received 2024-03-29T00:00:26.203459422Z [2024-03-29 00:00:26,203: INFO/ForkPoolWorker-15] [9b429565-1dc0-488a-a091-53bdf7c064f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:00:26.553842010Z [2024-03-29 00:00:26,550: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:00:28.207715753Z [2024-03-29 00:00:28,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:00:28.215732016Z [2024-03-29 00:00:28,212: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:28.277175482Z [2024-03-29 00:00:28,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:00:28.279661177Z [2024-03-29 00:00:28,278: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:28.294871762Z [2024-03-29 00:00:28,279: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:28.294962723Z [2024-03-29 00:00:28,294: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:28.295012154Z [2024-03-29 00:00:28,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:00:28.295547223Z [2024-03-29 00:00:28,295: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:00:28.295555574Z [2024-03-29 00:00:28,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:28.410232951Z [2024-03-29 00:00:28,408: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:29.347826173Z [2024-03-29 00:00:29,347: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b429565-1dc0-488a-a091-53bdf7c064f4] succeeded in 3.167175147999842s: None 2024-03-29T00:00:30.178962258Z [2024-03-29 00:00:30,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64a8ac67-aa07-4daf-b6df-562733af2f68] received 2024-03-29T00:00:30.196206634Z [2024-03-29 00:00:30,195: INFO/ForkPoolWorker-15] [64a8ac67-aa07-4daf-b6df-562733af2f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:30.627954342Z [2024-03-29 00:00:30,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:00:33.444404464Z [2024-03-29 00:00:33,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:00:33.448256061Z [2024-03-29 00:00:33,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:00:33.526604309Z [2024-03-29 00:00:33,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:00:33.528719138Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:00:33.528735042Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:00:33.528740808Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:00:33.528745727Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:00:33.528923207Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:00:33.528936014Z [2024-03-29 00:00:33,528: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:00:33.612085986Z [2024-03-29 00:00:33,611: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:00:34.468569352Z [2024-03-29 00:00:34,468: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64a8ac67-aa07-4daf-b6df-562733af2f68] succeeded in 4.287287957999979s: None 2024-03-29T00:01:00.818036529Z [2024-03-29 00:01:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1927e2ba-f957-48bf-a643-da9b6fdbe8ab] received 2024-03-29T00:01:00.821943366Z [2024-03-29 00:01:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3be30a05-cb2c-445a-bbf6-06071d2a71a4] received 2024-03-29T00:01:00.845160587Z [2024-03-29 00:01:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88c80355-39aa-4736-a529-fd91815c9af2] received 2024-03-29T00:01:00.854923702Z [2024-03-29 00:01:00,853: INFO/ForkPoolWorker-15] [1927e2ba-f957-48bf-a643-da9b6fdbe8ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:01:00.855206484Z [2024-03-29 00:01:00,854: INFO/ForkPoolWorker-16] [3be30a05-cb2c-445a-bbf6-06071d2a71a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:01:00.952292225Z [2024-03-29 00:01:00,951: INFO/ForkPoolWorker-1] [88c80355-39aa-4736-a529-fd91815c9af2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:01:01.317656268Z [2024-03-29 00:01:01,311: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:01:01.536265195Z [2024-03-29 00:01:01,530: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:01:02.065742770Z [2024-03-29 00:01:02,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:01:02.289768623Z [2024-03-29 00:01:02,289: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:01:02.300713477Z [2024-03-29 00:01:02,300: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:01:02.393290485Z [2024-03-29 00:01:02,390: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:01:02.396475836Z [2024-03-29 00:01:02,395: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:01:02.398784666Z [2024-03-29 00:01:02,396: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:01:02.399045703Z [2024-03-29 00:01:02,398: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:01:02.400122453Z [2024-03-29 00:01:02,399: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:01:02.781640497Z [2024-03-29 00:01:02,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:01:04.637022707Z [2024-03-29 00:01:04,634: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3be30a05-cb2c-445a-bbf6-06071d2a71a4] succeeded in 3.8100331770001503s: None 2024-03-29T00:01:05.477752107Z [2024-03-29 00:01:05,477: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:01:05.495890261Z [2024-03-29 00:01:05,495: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:01:05.594380906Z [2024-03-29 00:01:05,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:01:05.602750458Z [2024-03-29 00:01:05,602: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:01:05.602826531Z [2024-03-29 00:01:05,602: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:01:05.602971175Z [2024-03-29 00:01:05,602: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:01:05.603053747Z [2024-03-29 00:01:05,602: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:01:05.603446666Z [2024-03-29 00:01:05,603: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:01:05.603504162Z [2024-03-29 00:01:05,603: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:01:05.941982420Z [2024-03-29 00:01:05,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:01:06.095603433Z [2024-03-29 00:01:06,090: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:01:06.099364652Z [2024-03-29 00:01:06,098: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:01:06.278258885Z [2024-03-29 00:01:06,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:01:06.290960713Z [2024-03-29 00:01:06,287: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:01:06.292175540Z [2024-03-29 00:01:06,291: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:01:06.292496045Z [2024-03-29 00:01:06,292: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:01:06.292807962Z [2024-03-29 00:01:06,292: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:01:06.293160159Z [2024-03-29 00:01:06,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:01:06.297072654Z [2024-03-29 00:01:06,293: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:01:06.559386376Z [2024-03-29 00:01:06,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:01:09.043219806Z [2024-03-29 00:01:09,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1927e2ba-f957-48bf-a643-da9b6fdbe8ab] succeeded in 8.21965435500033s: None 2024-03-29T00:01:09.785072956Z [2024-03-29 00:01:09,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88c80355-39aa-4736-a529-fd91815c9af2] succeeded in 8.932438140000158s: None 2024-03-29T00:02:00.777666973Z [2024-03-29 00:02:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5abd2686-daae-4de5-8490-d3ce9d85ce66] received 2024-03-29T00:02:00.789038785Z [2024-03-29 00:02:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85fe7226-53bf-48c3-8235-e2acd64670c8] received 2024-03-29T00:02:00.798510933Z [2024-03-29 00:02:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bc65ebf-fcf9-407f-9cae-1659965fcf72] received 2024-03-29T00:02:00.801833326Z [2024-03-29 00:02:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa80cebe-44c8-40d7-88cf-5c6e38cdb365] received 2024-03-29T00:02:00.817370066Z [2024-03-29 00:02:00,816: INFO/ForkPoolWorker-16] [85fe7226-53bf-48c3-8235-e2acd64670c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:02:00.820162076Z [2024-03-29 00:02:00,819: INFO/ForkPoolWorker-15] [5abd2686-daae-4de5-8490-d3ce9d85ce66] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:02:00.822243804Z [2024-03-29 00:02:00,821: INFO/ForkPoolWorker-1] [5bc65ebf-fcf9-407f-9cae-1659965fcf72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:02:00.833280462Z [2024-03-29 00:02:00,832: INFO/ForkPoolWorker-2] [aa80cebe-44c8-40d7-88cf-5c6e38cdb365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:02:01.191959649Z [2024-03-29 00:02:01,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:02:01.288338427Z [2024-03-29 00:02:01,283: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:02:01.371778338Z [2024-03-29 00:02:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:02:01.456101352Z [2024-03-29 00:02:01,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:02:01.633096196Z [2024-03-29 00:02:01,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:02:01.697607896Z [2024-03-29 00:02:01,697: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:02:01.705505440Z [2024-03-29 00:02:01,704: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:02:01.745706843Z [2024-03-29 00:02:01,745: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:02:01.751998644Z [2024-03-29 00:02:01,751: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:02:01.753149252Z [2024-03-29 00:02:01,752: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:02:01.753653756Z [2024-03-29 00:02:01,753: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:02:01.754355581Z [2024-03-29 00:02:01,754: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:02:01.970147551Z [2024-03-29 00:02:01,969: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:02:02.418756248Z [2024-03-29 00:02:02,418: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5abd2686-daae-4de5-8490-d3ce9d85ce66] succeeded in 1.6254312669998399s: None 2024-03-29T00:02:02.808175877Z [2024-03-29 00:02:02,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85fe7226-53bf-48c3-8235-e2acd64670c8] succeeded in 2.013290254000367s: None 2024-03-29T00:02:02.939616097Z [2024-03-29 00:02:02,939: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:02:02.944158479Z [2024-03-29 00:02:02,943: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:02:02.972868674Z [2024-03-29 00:02:02,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:02:02.975970922Z [2024-03-29 00:02:02,975: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:02:02.976833635Z [2024-03-29 00:02:02,976: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:02:02.977294331Z [2024-03-29 00:02:02,976: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:02:02.977591608Z [2024-03-29 00:02:02,977: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:02:02.978124010Z [2024-03-29 00:02:02,977: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:02:02.979285987Z [2024-03-29 00:02:02,979: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:02:03.127051164Z [2024-03-29 00:02:03,126: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:02:03.277280401Z [2024-03-29 00:02:03,276: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:02:03.281056594Z [2024-03-29 00:02:03,280: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:02:03.302727254Z [2024-03-29 00:02:03,302: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:02:03.304329373Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:02:03.304387004Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:02:03.304606654Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:02:03.304685725Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:02:03.305026830Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:02:03.305046095Z [2024-03-29 00:02:03,304: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:02:03.403268658Z [2024-03-29 00:02:03,402: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:02:04.883376697Z [2024-03-29 00:02:04,882: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aa80cebe-44c8-40d7-88cf-5c6e38cdb365] succeeded in 4.076311613999678s: None 2024-03-29T00:02:05.235086394Z [2024-03-29 00:02:05,234: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5bc65ebf-fcf9-407f-9cae-1659965fcf72] succeeded in 4.432181359000424s: None 2024-03-29T00:03:00.312254627Z [2024-03-29 00:03:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f485fb-a0db-4a67-996a-bc9638eb249e] received 2024-03-29T00:03:00.320312706Z [2024-03-29 00:03:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2426a46-ddc0-4036-b6e0-44543ade1925] received 2024-03-29T00:03:00.326090510Z [2024-03-29 00:03:00,325: INFO/ForkPoolWorker-15] [c5f485fb-a0db-4a67-996a-bc9638eb249e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:03:00.328716488Z [2024-03-29 00:03:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6fb8db8-1949-4039-b790-0edb9ee60867] received 2024-03-29T00:03:00.335265082Z [2024-03-29 00:03:00,334: INFO/ForkPoolWorker-16] [f2426a46-ddc0-4036-b6e0-44543ade1925] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:03:00.372566654Z [2024-03-29 00:03:00,368: INFO/ForkPoolWorker-1] [e6fb8db8-1949-4039-b790-0edb9ee60867] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:03:00.709188780Z [2024-03-29 00:03:00,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:03:00.745889385Z [2024-03-29 00:03:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:03:00.746746111Z [2024-03-29 00:03:00,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:03:00.897941897Z [2024-03-29 00:03:00,897: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:03:00.902483000Z [2024-03-29 00:03:00,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:03:00.933317992Z [2024-03-29 00:03:00,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:03:00.934766309Z [2024-03-29 00:03:00,934: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:03:00.934864373Z [2024-03-29 00:03:00,934: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:03:00.934968583Z [2024-03-29 00:03:00,934: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:03:00.935297844Z [2024-03-29 00:03:00,935: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:03:01.035731131Z [2024-03-29 00:03:01,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:03:01.829935629Z [2024-03-29 00:03:01,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2426a46-ddc0-4036-b6e0-44543ade1925] succeeded in 1.5088285419997192s: None 2024-03-29T00:03:02.295087875Z [2024-03-29 00:03:02,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:03:02.304463573Z [2024-03-29 00:03:02,304: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:03:02.308405608Z [2024-03-29 00:03:02,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:03:02.319678645Z [2024-03-29 00:03:02,319: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:03:02.342037725Z [2024-03-29 00:03:02,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:03:02.344738986Z [2024-03-29 00:03:02,344: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:03:02.345045931Z [2024-03-29 00:03:02,344: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:03:02.345321943Z [2024-03-29 00:03:02,345: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:03:02.345533106Z [2024-03-29 00:03:02,345: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:03:02.346047078Z [2024-03-29 00:03:02,345: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:03:02.346241524Z [2024-03-29 00:03:02,346: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:03:02.362929337Z [2024-03-29 00:03:02,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:03:02.366546946Z [2024-03-29 00:03:02,366: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:03:02.367315695Z [2024-03-29 00:03:02,367: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:03:02.367722441Z [2024-03-29 00:03:02,367: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:03:02.367968639Z [2024-03-29 00:03:02,367: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:03:02.368556614Z [2024-03-29 00:03:02,368: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:03:02.369286057Z [2024-03-29 00:03:02,369: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:03:02.462615594Z [2024-03-29 00:03:02,462: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:03:02.463493547Z [2024-03-29 00:03:02,463: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:03:04.081834923Z [2024-03-29 00:03:04,081: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6fb8db8-1949-4039-b790-0edb9ee60867] succeeded in 3.741157856999962s: None 2024-03-29T00:03:04.492148570Z [2024-03-29 00:03:04,491: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5f485fb-a0db-4a67-996a-bc9638eb249e] succeeded in 4.177727478999714s: None 2024-03-29T00:04:01.167363580Z [2024-03-29 00:04:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89bfd40e-7d12-453a-b955-29758f0faf07] received 2024-03-29T00:04:01.171736813Z [2024-03-29 00:04:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c135f8e-a3c2-4664-80b2-448649c38324] received 2024-03-29T00:04:01.187108186Z [2024-03-29 00:04:01,186: INFO/ForkPoolWorker-15] [89bfd40e-7d12-453a-b955-29758f0faf07] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:04:01.199478394Z [2024-03-29 00:04:01,196: INFO/ForkPoolWorker-16] [9c135f8e-a3c2-4664-80b2-448649c38324] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:04:01.210864120Z [2024-03-29 00:04:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95cc6c1f-cf9b-4387-bf19-2ea0711acb68] received 2024-03-29T00:04:01.220118126Z [2024-03-29 00:04:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34c46de1-079f-4eb1-989d-ce8a18a9a8b3] received 2024-03-29T00:04:01.235504313Z [2024-03-29 00:04:01,234: INFO/ForkPoolWorker-2] [34c46de1-079f-4eb1-989d-ce8a18a9a8b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:04:01.252993395Z [2024-03-29 00:04:01,252: INFO/ForkPoolWorker-1] [95cc6c1f-cf9b-4387-bf19-2ea0711acb68] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:04:01.625496557Z [2024-03-29 00:04:01,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:04:01.656636444Z [2024-03-29 00:04:01,650: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:04:01.820411600Z [2024-03-29 00:04:01,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:04:01.825098114Z [2024-03-29 00:04:01,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:04:02.106559271Z [2024-03-29 00:04:02,106: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:04:02.111031785Z [2024-03-29 00:04:02,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:04:02.117066301Z [2024-03-29 00:04:02,116: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:04:02.134235037Z [2024-03-29 00:04:02,133: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:04:02.135585681Z [2024-03-29 00:04:02,135: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:04:02.135641549Z [2024-03-29 00:04:02,135: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:04:02.135694002Z [2024-03-29 00:04:02,135: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:04:02.136485358Z [2024-03-29 00:04:02,136: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:04:02.241670728Z [2024-03-29 00:04:02,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:04:02.832733035Z [2024-03-29 00:04:02,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89bfd40e-7d12-453a-b955-29758f0faf07] succeeded in 1.6582474209999418s: None 2024-03-29T00:04:03.050605778Z [2024-03-29 00:04:03,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95cc6c1f-cf9b-4387-bf19-2ea0711acb68] succeeded in 1.8175624099999368s: None 2024-03-29T00:04:03.190055224Z [2024-03-29 00:04:03,189: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:04:03.193851969Z [2024-03-29 00:04:03,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:04:03.204644558Z [2024-03-29 00:04:03,204: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:04:03.210045744Z [2024-03-29 00:04:03,208: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:04:03.218159973Z [2024-03-29 00:04:03,217: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:04:03.219947322Z [2024-03-29 00:04:03,219: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:04:03.219963915Z [2024-03-29 00:04:03,219: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:04:03.220097410Z [2024-03-29 00:04:03,219: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:04:03.220138403Z [2024-03-29 00:04:03,220: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:04:03.220481133Z [2024-03-29 00:04:03,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:04:03.220489332Z [2024-03-29 00:04:03,220: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:04:03.238634230Z [2024-03-29 00:04:03,238: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:04:03.240391779Z [2024-03-29 00:04:03,240: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:04:03.240409389Z [2024-03-29 00:04:03,240: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:04:03.240665081Z [2024-03-29 00:04:03,240: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:04:03.240722608Z [2024-03-29 00:04:03,240: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:04:03.241645525Z [2024-03-29 00:04:03,241: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:04:03.241846557Z [2024-03-29 00:04:03,241: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:04:03.354639270Z [2024-03-29 00:04:03,353: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:04:03.373398494Z [2024-03-29 00:04:03,372: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:04:05.353054743Z [2024-03-29 00:04:05,352: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c135f8e-a3c2-4664-80b2-448649c38324] succeeded in 4.178653998999835s: None 2024-03-29T00:04:05.943647220Z [2024-03-29 00:04:05,943: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34c46de1-079f-4eb1-989d-ce8a18a9a8b3] succeeded in 4.721249641000213s: None 2024-03-29T00:05:00.963862175Z [2024-03-29 00:05:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfa554e3-eb71-421c-a257-0e37ce76c353] received 2024-03-29T00:05:00.974174778Z [2024-03-29 00:05:00,973: INFO/ForkPoolWorker-15] [cfa554e3-eb71-421c-a257-0e37ce76c353] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:00.976623004Z [2024-03-29 00:05:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbe7c41c-2ff8-4551-8848-1294f03000f6] received 2024-03-29T00:05:00.978729282Z [2024-03-29 00:05:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22f5d83e-d0ac-40c9-a2ca-1919c3d08eee] received 2024-03-29T00:05:00.982666817Z [2024-03-29 00:05:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88867fbd-6e0c-4007-ad5d-56f855da1c59] received 2024-03-29T00:05:00.993852689Z [2024-03-29 00:05:00,993: INFO/ForkPoolWorker-2] [88867fbd-6e0c-4007-ad5d-56f855da1c59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:05:00.997305526Z [2024-03-29 00:05:00,997: INFO/ForkPoolWorker-1] [22f5d83e-d0ac-40c9-a2ca-1919c3d08eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:05:00.997921645Z [2024-03-29 00:05:00,996: INFO/ForkPoolWorker-16] [dbe7c41c-2ff8-4551-8848-1294f03000f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:05:01.324910322Z [2024-03-29 00:05:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:05:01.392691365Z [2024-03-29 00:05:01,389: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:05:01.442984799Z [2024-03-29 00:05:01,439: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:05:01.485501879Z [2024-03-29 00:05:01,481: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:05:01.556101310Z [2024-03-29 00:05:01,555: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:05:01.560295196Z [2024-03-29 00:05:01,559: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:01.595541539Z [2024-03-29 00:05:01,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:05:01.599421211Z [2024-03-29 00:05:01,599: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:05:01.599448161Z [2024-03-29 00:05:01,599: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:05:01.599460280Z [2024-03-29 00:05:01,599: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:05:01.599684692Z [2024-03-29 00:05:01,599: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:05:01.709201505Z [2024-03-29 00:05:01,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:02.532567791Z [2024-03-29 00:05:02,532: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbe7c41c-2ff8-4551-8848-1294f03000f6] succeeded in 1.5521434060001411s: None 2024-03-29T00:05:02.895323534Z [2024-03-29 00:05:02,894: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:05:02.900540299Z [2024-03-29 00:05:02,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:02.943916889Z [2024-03-29 00:05:02,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:05:02.946896411Z [2024-03-29 00:05:02,946: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:02.947179160Z [2024-03-29 00:05:02,946: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:02.947672606Z [2024-03-29 00:05:02,947: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:02.948036123Z [2024-03-29 00:05:02,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:05:02.949079019Z [2024-03-29 00:05:02,948: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:05:02.949348178Z [2024-03-29 00:05:02,949: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:02.987629600Z [2024-03-29 00:05:02,987: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:05:02.991332487Z [2024-03-29 00:05:02,990: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:03.026840286Z [2024-03-29 00:05:03,026: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:05:03.029423620Z [2024-03-29 00:05:03,029: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:03.029458822Z [2024-03-29 00:05:03,029: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:03.029670233Z [2024-03-29 00:05:03,029: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:03.029797857Z [2024-03-29 00:05:03,029: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:05:03.030183454Z [2024-03-29 00:05:03,030: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:05:03.030328291Z [2024-03-29 00:05:03,030: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:03.049578991Z [2024-03-29 00:05:03,049: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:05:03.053475359Z [2024-03-29 00:05:03,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:03.082680659Z [2024-03-29 00:05:03,082: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:05:03.084780196Z [2024-03-29 00:05:03,084: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:03.084921570Z [2024-03-29 00:05:03,084: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:03.085147525Z [2024-03-29 00:05:03,084: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:03.085263621Z [2024-03-29 00:05:03,085: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:05:03.085614605Z [2024-03-29 00:05:03,085: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:05:03.086200970Z [2024-03-29 00:05:03,085: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:03.092400340Z [2024-03-29 00:05:03,092: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:03.143552271Z [2024-03-29 00:05:03,143: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:03.203686292Z [2024-03-29 00:05:03,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:03.766930765Z [2024-03-29 00:05:03,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2c9caa7-f133-4abf-81de-5362537424d4] received 2024-03-29T00:05:03.782191407Z [2024-03-29 00:05:03,781: INFO/ForkPoolWorker-16] [b2c9caa7-f133-4abf-81de-5362537424d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:03.872945020Z [2024-03-29 00:05:03,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfa554e3-eb71-421c-a257-0e37ce76c353] succeeded in 2.905963146000431s: None 2024-03-29T00:05:04.249691750Z [2024-03-29 00:05:04,246: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:05:05.413638503Z [2024-03-29 00:05:05,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22f5d83e-d0ac-40c9-a2ca-1919c3d08eee] succeeded in 4.432056585999817s: None 2024-03-29T00:05:05.505799174Z [2024-03-29 00:05:05,505: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[88867fbd-6e0c-4007-ad5d-56f855da1c59] succeeded in 4.520112899999731s: None 2024-03-29T00:05:05.845837284Z [2024-03-29 00:05:05,845: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:05:05.864803797Z [2024-03-29 00:05:05,855: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:05.891786248Z [2024-03-29 00:05:05,891: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:05:05.893903117Z [2024-03-29 00:05:05,893: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:05.894118092Z [2024-03-29 00:05:05,893: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:05.894432855Z [2024-03-29 00:05:05,894: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:05.894759533Z [2024-03-29 00:05:05,894: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:05:05.895132087Z [2024-03-29 00:05:05,894: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:05:05.895259524Z [2024-03-29 00:05:05,895: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:05.988127993Z [2024-03-29 00:05:05,987: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:06.739701272Z [2024-03-29 00:05:06,739: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2c9caa7-f133-4abf-81de-5362537424d4] succeeded in 2.9707034080001904s: None 2024-03-29T00:05:07.520707445Z [2024-03-29 00:05:07,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[361e64fd-af9e-42ee-9d85-d9ee556d12d8] received 2024-03-29T00:05:07.536693299Z [2024-03-29 00:05:07,536: INFO/ForkPoolWorker-15] [361e64fd-af9e-42ee-9d85-d9ee556d12d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:05:07.911645889Z [2024-03-29 00:05:07,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:05:09.220438445Z [2024-03-29 00:05:09,219: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:05:09.226099644Z [2024-03-29 00:05:09,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:09.245396466Z [2024-03-29 00:05:09,245: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:05:09.246798155Z [2024-03-29 00:05:09,246: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:09.246965913Z [2024-03-29 00:05:09,246: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:09.247186231Z [2024-03-29 00:05:09,246: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:09.247331790Z [2024-03-29 00:05:09,247: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:05:09.247750986Z [2024-03-29 00:05:09,247: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:05:09.247872380Z [2024-03-29 00:05:09,247: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:09.335738504Z [2024-03-29 00:05:09,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:09.955619786Z [2024-03-29 00:05:09,955: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[361e64fd-af9e-42ee-9d85-d9ee556d12d8] succeeded in 2.4328022919999057s: None 2024-03-29T00:05:10.051278852Z [2024-03-29 00:05:10,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ebd9e9e-23ba-4ea3-b615-d893c459c6f7] received 2024-03-29T00:05:10.058380810Z [2024-03-29 00:05:10,058: INFO/ForkPoolWorker-15] [1ebd9e9e-23ba-4ea3-b615-d893c459c6f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:10.357084471Z [2024-03-29 00:05:10,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:05:11.611163510Z [2024-03-29 00:05:11,610: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:05:11.615012921Z [2024-03-29 00:05:11,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:05:11.638152783Z [2024-03-29 00:05:11,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:05:11.639645251Z [2024-03-29 00:05:11,639: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:05:11.639659589Z [2024-03-29 00:05:11,639: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:05:11.639878989Z [2024-03-29 00:05:11,639: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:05:11.640049204Z [2024-03-29 00:05:11,639: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:05:11.640410540Z [2024-03-29 00:05:11,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:05:11.640525672Z [2024-03-29 00:05:11,640: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:05:11.745593571Z [2024-03-29 00:05:11,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:05:12.478790090Z [2024-03-29 00:05:12,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ebd9e9e-23ba-4ea3-b615-d893c459c6f7] succeeded in 2.4256585460002498s: None 2024-03-29T00:06:00.817845449Z [2024-03-29 00:06:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b08d80c2-47bc-4092-b6d6-d69283c4d109] received 2024-03-29T00:06:00.820578923Z [2024-03-29 00:06:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fed58821-3f95-40d7-a9cb-b3e4949efdbd] received 2024-03-29T00:06:00.830867911Z [2024-03-29 00:06:00,830: INFO/ForkPoolWorker-16] [fed58821-3f95-40d7-a9cb-b3e4949efdbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:06:00.832567396Z [2024-03-29 00:06:00,832: INFO/ForkPoolWorker-15] [b08d80c2-47bc-4092-b6d6-d69283c4d109] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:06:00.840020845Z [2024-03-29 00:06:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b7b4552-2dac-4ec3-8818-cb9fead1301f] received 2024-03-29T00:06:00.851272095Z [2024-03-29 00:06:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28773302-2538-40bd-bcce-ced9520300e5] received 2024-03-29T00:06:00.863310080Z [2024-03-29 00:06:00,862: INFO/ForkPoolWorker-2] [28773302-2538-40bd-bcce-ced9520300e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:06:00.872042858Z [2024-03-29 00:06:00,871: INFO/ForkPoolWorker-1] [1b7b4552-2dac-4ec3-8818-cb9fead1301f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:06:01.263015087Z [2024-03-29 00:06:01,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:06:01.264659218Z [2024-03-29 00:06:01,260: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:06:01.418304848Z [2024-03-29 00:06:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:06:01.430409049Z [2024-03-29 00:06:01,424: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:06:01.506283210Z [2024-03-29 00:06:01,505: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:06:01.510764532Z [2024-03-29 00:06:01,510: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:06:01.548743463Z [2024-03-29 00:06:01,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:06:01.550056994Z [2024-03-29 00:06:01,549: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:06:01.550244864Z [2024-03-29 00:06:01,549: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:06:01.562920727Z [2024-03-29 00:06:01,550: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:06:01.563200983Z [2024-03-29 00:06:01,563: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:06:01.740040086Z [2024-03-29 00:06:01,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:06:01.804053741Z [2024-03-29 00:06:01,803: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:06:02.375104822Z [2024-03-29 00:06:02,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b08d80c2-47bc-4092-b6d6-d69283c4d109] succeeded in 1.5523181690000456s: None 2024-03-29T00:06:02.618788826Z [2024-03-29 00:06:02,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fed58821-3f95-40d7-a9cb-b3e4949efdbd] succeeded in 1.7966012030001366s: None 2024-03-29T00:06:03.016211248Z [2024-03-29 00:06:03,015: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:06:03.025560618Z [2024-03-29 00:06:03,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:06:03.071008122Z [2024-03-29 00:06:03,069: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:06:03.078606502Z [2024-03-29 00:06:03,075: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:06:03.078636837Z [2024-03-29 00:06:03,075: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:06:03.078643253Z [2024-03-29 00:06:03,075: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:06:03.078649219Z [2024-03-29 00:06:03,075: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:06:03.078654288Z [2024-03-29 00:06:03,076: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:06:03.078659612Z [2024-03-29 00:06:03,076: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:06:03.139134541Z [2024-03-29 00:06:03,136: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:06:03.144719067Z [2024-03-29 00:06:03,143: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:06:03.195784807Z [2024-03-29 00:06:03,175: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:06:03.195828542Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:06:03.195833529Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:06:03.195838392Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:06:03.195842856Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:06:03.195846199Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:06:03.195849867Z [2024-03-29 00:06:03,177: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:06:03.249048183Z [2024-03-29 00:06:03,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:06:03.298395951Z [2024-03-29 00:06:03,298: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:06:04.871469031Z [2024-03-29 00:06:04,870: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b7b4552-2dac-4ec3-8818-cb9fead1301f] succeeded in 4.023864644000241s: None 2024-03-29T00:06:05.263979010Z [2024-03-29 00:06:05,263: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[28773302-2538-40bd-bcce-ced9520300e5] succeeded in 4.4087485960003505s: None 2024-03-29T00:07:00.447196988Z [2024-03-29 00:07:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c4e90ec-2e31-40ad-b70b-79fea7c33d1b] received 2024-03-29T00:07:00.455548446Z [2024-03-29 00:07:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1d2bf6e-faad-40d1-8e56-6e4b53ade53f] received 2024-03-29T00:07:00.460084831Z [2024-03-29 00:07:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87ec0a90-0da6-499d-83aa-fa3a94a0f58d] received 2024-03-29T00:07:00.465707970Z [2024-03-29 00:07:00,465: INFO/ForkPoolWorker-16] [b1d2bf6e-faad-40d1-8e56-6e4b53ade53f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:07:00.471680744Z [2024-03-29 00:07:00,471: INFO/ForkPoolWorker-15] [4c4e90ec-2e31-40ad-b70b-79fea7c33d1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:07:00.472315644Z [2024-03-29 00:07:00,472: INFO/ForkPoolWorker-1] [87ec0a90-0da6-499d-83aa-fa3a94a0f58d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:07:00.763220529Z [2024-03-29 00:07:00,759: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:07:00.793239456Z [2024-03-29 00:07:00,789: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:07:00.824346423Z [2024-03-29 00:07:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:07:00.921225260Z [2024-03-29 00:07:00,920: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:07:00.925113080Z [2024-03-29 00:07:00,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:07:00.943082393Z [2024-03-29 00:07:00,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:07:00.944162120Z [2024-03-29 00:07:00,943: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:07:00.944213742Z [2024-03-29 00:07:00,944: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:07:00.944265433Z [2024-03-29 00:07:00,944: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:07:00.944434707Z [2024-03-29 00:07:00,944: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:07:01.060099702Z [2024-03-29 00:07:01,059: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:07:01.662322665Z [2024-03-29 00:07:01,661: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1d2bf6e-faad-40d1-8e56-6e4b53ade53f] succeeded in 1.2041440999996667s: None 2024-03-29T00:07:02.016353161Z [2024-03-29 00:07:02,015: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:07:02.019977772Z [2024-03-29 00:07:02,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:07:02.038481008Z [2024-03-29 00:07:02,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:07:02.039936020Z [2024-03-29 00:07:02,039: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:07:02.040097106Z [2024-03-29 00:07:02,039: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:07:02.040313771Z [2024-03-29 00:07:02,040: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:07:02.040426520Z [2024-03-29 00:07:02,040: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:07:02.040744475Z [2024-03-29 00:07:02,040: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:07:02.040888126Z [2024-03-29 00:07:02,040: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:07:02.059517640Z [2024-03-29 00:07:02,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:07:02.063126553Z [2024-03-29 00:07:02,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:07:02.085266340Z [2024-03-29 00:07:02,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:07:02.086645199Z [2024-03-29 00:07:02,086: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:07:02.086755502Z [2024-03-29 00:07:02,086: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:07:02.086928906Z [2024-03-29 00:07:02,086: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:07:02.087071552Z [2024-03-29 00:07:02,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:07:02.087449252Z [2024-03-29 00:07:02,087: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:07:02.087499008Z [2024-03-29 00:07:02,087: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:07:02.127908104Z [2024-03-29 00:07:02,127: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:07:02.173541048Z [2024-03-29 00:07:02,173: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:07:04.423762617Z [2024-03-29 00:07:04,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87ec0a90-0da6-499d-83aa-fa3a94a0f58d] succeeded in 3.961188583999956s: None 2024-03-29T00:07:04.463044064Z [2024-03-29 00:07:04,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c4e90ec-2e31-40ad-b70b-79fea7c33d1b] succeeded in 4.0115519179998955s: None 2024-03-29T00:08:00.970378024Z [2024-03-29 00:08:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[223cea11-ff5f-424f-977d-53680f064410] received 2024-03-29T00:08:00.972417663Z [2024-03-29 00:08:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4274d983-14c3-4b95-8b13-6d5fdec72d7d] received 2024-03-29T00:08:00.974668623Z [2024-03-29 00:08:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f156672-f8cc-4028-ac4e-3b47518d8f3a] received 2024-03-29T00:08:00.975860882Z [2024-03-29 00:08:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b975bbc-fe4b-4652-9e02-06001c5f6f77] received 2024-03-29T00:08:00.981217323Z [2024-03-29 00:08:00,980: INFO/ForkPoolWorker-1] [8f156672-f8cc-4028-ac4e-3b47518d8f3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:08:00.983630482Z [2024-03-29 00:08:00,983: INFO/ForkPoolWorker-2] [9b975bbc-fe4b-4652-9e02-06001c5f6f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:08:00.988052317Z [2024-03-29 00:08:00,987: INFO/ForkPoolWorker-15] [223cea11-ff5f-424f-977d-53680f064410] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:08:00.989448836Z [2024-03-29 00:08:00,989: INFO/ForkPoolWorker-16] [4274d983-14c3-4b95-8b13-6d5fdec72d7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:08:01.332765859Z [2024-03-29 00:08:01,329: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:08:01.562781506Z [2024-03-29 00:08:01,558: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:08:01.814806638Z [2024-03-29 00:08:01,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:08:01.893630604Z [2024-03-29 00:08:01,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:08:02.222505415Z [2024-03-29 00:08:02,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:08:02.266894373Z [2024-03-29 00:08:02,266: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:08:02.271304149Z [2024-03-29 00:08:02,270: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:08:02.331784391Z [2024-03-29 00:08:02,331: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:08:02.334190694Z [2024-03-29 00:08:02,333: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:08:02.334317967Z [2024-03-29 00:08:02,334: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:08:02.334371968Z [2024-03-29 00:08:02,334: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:08:02.334734155Z [2024-03-29 00:08:02,334: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:08:02.545863198Z [2024-03-29 00:08:02,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:08:03.020468270Z [2024-03-29 00:08:03,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[223cea11-ff5f-424f-977d-53680f064410] succeeded in 2.0446329030000925s: None 2024-03-29T00:08:03.196047135Z [2024-03-29 00:08:03,195: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:08:03.199474583Z [2024-03-29 00:08:03,198: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:08:03.224108257Z [2024-03-29 00:08:03,223: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:08:03.225634078Z [2024-03-29 00:08:03,225: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:08:03.225657805Z [2024-03-29 00:08:03,225: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:08:03.225801889Z [2024-03-29 00:08:03,225: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:08:03.225872489Z [2024-03-29 00:08:03,225: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:08:03.226814106Z [2024-03-29 00:08:03,226: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:08:03.226949898Z [2024-03-29 00:08:03,226: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:08:03.320094132Z [2024-03-29 00:08:03,319: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:08:03.333046090Z [2024-03-29 00:08:03,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4274d983-14c3-4b95-8b13-6d5fdec72d7d] succeeded in 2.356393295000089s: None 2024-03-29T00:08:03.366648910Z [2024-03-29 00:08:03,366: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:08:03.370741021Z [2024-03-29 00:08:03,370: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:08:03.398884171Z [2024-03-29 00:08:03,398: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:08:03.401709172Z [2024-03-29 00:08:03,401: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:08:03.401985286Z [2024-03-29 00:08:03,401: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:08:03.402316229Z [2024-03-29 00:08:03,402: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:08:03.402567781Z [2024-03-29 00:08:03,402: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:08:03.403075667Z [2024-03-29 00:08:03,402: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:08:03.403710329Z [2024-03-29 00:08:03,403: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:08:03.508618201Z [2024-03-29 00:08:03,508: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:08:05.127341183Z [2024-03-29 00:08:05,126: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f156672-f8cc-4028-ac4e-3b47518d8f3a] succeeded in 4.150225460999991s: None 2024-03-29T00:08:05.478233331Z [2024-03-29 00:08:05,477: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9b975bbc-fe4b-4652-9e02-06001c5f6f77] succeeded in 4.498680964999949s: None 2024-03-29T00:09:00.554331194Z [2024-03-29 00:09:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ff2a46a-b0aa-4f77-9525-152f5218a057] received 2024-03-29T00:09:00.557669862Z [2024-03-29 00:09:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe1911da-a57a-4a30-af9b-9719613be34c] received 2024-03-29T00:09:00.564158024Z [2024-03-29 00:09:00,563: INFO/ForkPoolWorker-15] [1ff2a46a-b0aa-4f77-9525-152f5218a057] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:09:00.567463488Z [2024-03-29 00:09:00,567: INFO/ForkPoolWorker-16] [fe1911da-a57a-4a30-af9b-9719613be34c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:09:00.578938988Z [2024-03-29 00:09:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[907eb976-5023-4f02-829f-b471b5639fdf] received 2024-03-29T00:09:00.592788495Z [2024-03-29 00:09:00,592: INFO/ForkPoolWorker-1] [907eb976-5023-4f02-829f-b471b5639fdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:09:00.952944096Z [2024-03-29 00:09:00,948: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:09:00.966055937Z [2024-03-29 00:09:00,962: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:09:01.201258036Z [2024-03-29 00:09:01,196: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:09:01.439485466Z [2024-03-29 00:09:01,438: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:09:01.443955569Z [2024-03-29 00:09:01,443: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:09:01.477699766Z [2024-03-29 00:09:01,477: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:09:01.479060113Z [2024-03-29 00:09:01,478: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:09:01.479271389Z [2024-03-29 00:09:01,479: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:09:01.479465945Z [2024-03-29 00:09:01,479: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:09:01.479826484Z [2024-03-29 00:09:01,479: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:09:01.601551681Z [2024-03-29 00:09:01,601: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:09:02.450865046Z [2024-03-29 00:09:02,450: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:09:02.455500713Z [2024-03-29 00:09:02,454: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:09:02.494720773Z [2024-03-29 00:09:02,486: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:09:02.495894242Z [2024-03-29 00:09:02,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[907eb976-5023-4f02-829f-b471b5639fdf] succeeded in 1.9140808690003723s: None 2024-03-29T00:09:02.500968696Z [2024-03-29 00:09:02,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:09:02.512044304Z [2024-03-29 00:09:02,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:09:02.514046111Z [2024-03-29 00:09:02,513: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:09:02.514337760Z [2024-03-29 00:09:02,513: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:09:02.514620659Z [2024-03-29 00:09:02,514: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:09:02.514777838Z [2024-03-29 00:09:02,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:09:02.515208590Z [2024-03-29 00:09:02,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:09:02.515371939Z [2024-03-29 00:09:02,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:09:02.555243207Z [2024-03-29 00:09:02,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:09:02.557038954Z [2024-03-29 00:09:02,556: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:09:02.557086640Z [2024-03-29 00:09:02,556: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:09:02.557325177Z [2024-03-29 00:09:02,557: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:09:02.557348364Z [2024-03-29 00:09:02,557: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:09:02.557651199Z [2024-03-29 00:09:02,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:09:02.557685312Z [2024-03-29 00:09:02,557: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:09:02.616277750Z [2024-03-29 00:09:02,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:09:02.698201252Z [2024-03-29 00:09:02,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:09:04.431626464Z [2024-03-29 00:09:04,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ff2a46a-b0aa-4f77-9525-152f5218a057] succeeded in 3.875411441000324s: None 2024-03-29T00:09:04.824391263Z [2024-03-29 00:09:04,823: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe1911da-a57a-4a30-af9b-9719613be34c] succeeded in 4.264397745000224s: None 2024-03-29T00:10:00.506928105Z [2024-03-29 00:10:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85a1f991-9e36-436b-a4c0-1cfd4dabfbbc] received 2024-03-29T00:10:00.514192828Z [2024-03-29 00:10:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4372f91-1251-4de8-be3a-c80d371d2dbc] received 2024-03-29T00:10:00.516517201Z [2024-03-29 00:10:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcc258f2-cd45-47a6-9b62-89b8a470cf59] received 2024-03-29T00:10:00.521379357Z [2024-03-29 00:10:00,520: INFO/ForkPoolWorker-15] [85a1f991-9e36-436b-a4c0-1cfd4dabfbbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:00.526300958Z [2024-03-29 00:10:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d62c4b68-eb2f-471a-94d0-878d34a0edb4] received 2024-03-29T00:10:00.529062519Z [2024-03-29 00:10:00,528: INFO/ForkPoolWorker-16] [b4372f91-1251-4de8-be3a-c80d371d2dbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:10:00.533481873Z [2024-03-29 00:10:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[605b61d8-94e3-4b06-bef1-e58258b49acf] received 2024-03-29T00:10:00.541466835Z [2024-03-29 00:10:00,541: INFO/ForkPoolWorker-1] [fcc258f2-cd45-47a6-9b62-89b8a470cf59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:10:00.543280179Z [2024-03-29 00:10:00,542: INFO/ForkPoolWorker-2] [d62c4b68-eb2f-471a-94d0-878d34a0edb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:10:00.566617201Z [2024-03-29 00:10:00,566: INFO/ForkPoolWorker-3] [605b61d8-94e3-4b06-bef1-e58258b49acf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:10:00.960855622Z [2024-03-29 00:10:00,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:10:00.993966337Z [2024-03-29 00:10:00,990: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:10:01.027823963Z [2024-03-29 00:10:01,023: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:10:01.167702095Z [2024-03-29 00:10:01,167: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:10:01.172509974Z [2024-03-29 00:10:01,171: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:01.197449321Z [2024-03-29 00:10:01,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:10:01.209914294Z [2024-03-29 00:10:01,205: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:10:01.215694789Z [2024-03-29 00:10:01,215: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:10:01.219475584Z [2024-03-29 00:10:01,219: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:10:01.219656144Z [2024-03-29 00:10:01,219: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:10:01.219779052Z [2024-03-29 00:10:01,219: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:10:01.220314707Z [2024-03-29 00:10:01,220: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:10:01.410199657Z [2024-03-29 00:10:01,409: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:01.452457760Z [2024-03-29 00:10:01,452: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:02.146627857Z [2024-03-29 00:10:02,146: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d62c4b68-eb2f-471a-94d0-878d34a0edb4] succeeded in 1.616139665999981s: None 2024-03-29T00:10:02.349657617Z [2024-03-29 00:10:02,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b4372f91-1251-4de8-be3a-c80d371d2dbc] succeeded in 1.8302018960002897s: None 2024-03-29T00:10:02.966592344Z [2024-03-29 00:10:02,966: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T00:10:02.971404523Z [2024-03-29 00:10:02,970: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:03.011700858Z [2024-03-29 00:10:03,010: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T00:10:03.014960771Z [2024-03-29 00:10:03,014: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:03.015029442Z [2024-03-29 00:10:03,014: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:03.015305011Z [2024-03-29 00:10:03,015: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:03.015440982Z [2024-03-29 00:10:03,015: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T00:10:03.015927842Z [2024-03-29 00:10:03,015: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:10:03.016013420Z [2024-03-29 00:10:03,015: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:03.179896581Z [2024-03-29 00:10:03,179: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:03.435332526Z [2024-03-29 00:10:03,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:10:03.442563461Z [2024-03-29 00:10:03,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:03.494901276Z [2024-03-29 00:10:03,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:10:03.496741971Z [2024-03-29 00:10:03,496: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:03.496855670Z [2024-03-29 00:10:03,496: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:03.497058573Z [2024-03-29 00:10:03,496: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:03.497131629Z [2024-03-29 00:10:03,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:10:03.497896916Z [2024-03-29 00:10:03,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:10:03.497953842Z [2024-03-29 00:10:03,497: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:03.507736046Z [2024-03-29 00:10:03,507: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:10:03.512080332Z [2024-03-29 00:10:03,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:03.564036659Z [2024-03-29 00:10:03,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:10:03.565950926Z [2024-03-29 00:10:03,565: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:03.565968476Z [2024-03-29 00:10:03,565: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:03.566168712Z [2024-03-29 00:10:03,565: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:03.566184421Z [2024-03-29 00:10:03,566: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:10:03.566912559Z [2024-03-29 00:10:03,566: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:10:03.566927690Z [2024-03-29 00:10:03,566: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:03.641868383Z [2024-03-29 00:10:03,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:03.703492826Z [2024-03-29 00:10:03,703: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:04.558546381Z [2024-03-29 00:10:04,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85a1f991-9e36-436b-a4c0-1cfd4dabfbbc] succeeded in 4.049616444000094s: None 2024-03-29T00:10:04.893419237Z [2024-03-29 00:10:04,892: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[605b61d8-94e3-4b06-bef1-e58258b49acf] succeeded in 4.339408365000054s: None 2024-03-29T00:10:05.288726597Z [2024-03-29 00:10:05,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6cfa519-229c-44e3-a89d-af597dd2e385] received 2024-03-29T00:10:05.309651488Z [2024-03-29 00:10:05,309: INFO/ForkPoolWorker-15] [a6cfa519-229c-44e3-a89d-af597dd2e385] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:05.705903606Z [2024-03-29 00:10:05,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fcc258f2-cd45-47a6-9b62-89b8a470cf59] succeeded in 5.187491059999957s: None 2024-03-29T00:10:05.796617929Z [2024-03-29 00:10:05,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:10:07.858648864Z [2024-03-29 00:10:07,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:10:07.870204722Z [2024-03-29 00:10:07,868: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:07.931232896Z [2024-03-29 00:10:07,930: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:10:07.939384381Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:07.939498155Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:07.939509654Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:07.939514165Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:10:07.942731045Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:10:07.942765750Z [2024-03-29 00:10:07,939: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:08.086029842Z [2024-03-29 00:10:08,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:08.979775060Z [2024-03-29 00:10:08,979: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6cfa519-229c-44e3-a89d-af597dd2e385] succeeded in 3.687166373999844s: None 2024-03-29T00:10:09.620937805Z [2024-03-29 00:10:09,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f8b2788-46e1-4f26-a81f-88b343da905f] received 2024-03-29T00:10:09.636893350Z [2024-03-29 00:10:09,636: INFO/ForkPoolWorker-15] [6f8b2788-46e1-4f26-a81f-88b343da905f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:10:09.938985317Z [2024-03-29 00:10:09,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:10:11.180015704Z [2024-03-29 00:10:11,179: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:10:11.183910488Z [2024-03-29 00:10:11,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:11.205263315Z [2024-03-29 00:10:11,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:10:11.206822802Z [2024-03-29 00:10:11,206: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:11.206922893Z [2024-03-29 00:10:11,206: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:11.207225536Z [2024-03-29 00:10:11,206: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:11.207354655Z [2024-03-29 00:10:11,207: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:10:11.208013084Z [2024-03-29 00:10:11,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:10:11.208237438Z [2024-03-29 00:10:11,207: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:11.311199528Z [2024-03-29 00:10:11,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:12.037009664Z [2024-03-29 00:10:12,036: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f8b2788-46e1-4f26-a81f-88b343da905f] succeeded in 2.4141282610003145s: None 2024-03-29T00:10:13.068032836Z [2024-03-29 00:10:13,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ae7a6b1-0be6-4393-81c4-d4939879cf5a] received 2024-03-29T00:10:13.078775003Z [2024-03-29 00:10:13,078: INFO/ForkPoolWorker-15] [5ae7a6b1-0be6-4393-81c4-d4939879cf5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:13.351781938Z [2024-03-29 00:10:13,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:10:14.497692483Z [2024-03-29 00:10:14,497: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:10:14.501248011Z [2024-03-29 00:10:14,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:10:14.522240756Z [2024-03-29 00:10:14,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:10:14.523387302Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:10:14.523442038Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:10:14.523557104Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:10:14.523586494Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:10:14.523912153Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:10:14.524065408Z [2024-03-29 00:10:14,523: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:10:14.599774828Z [2024-03-29 00:10:14,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:10:15.208032698Z [2024-03-29 00:10:15,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ae7a6b1-0be6-4393-81c4-d4939879cf5a] succeeded in 2.1366992500002198s: None 2024-03-29T00:11:00.405168570Z [2024-03-29 00:11:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d1210db-bd11-45f2-92f9-d2fb09103409] received 2024-03-29T00:11:00.409112317Z [2024-03-29 00:11:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[006b6ca8-7bc5-4e0c-acfc-aa43e9a00ca0] received 2024-03-29T00:11:00.413561990Z [2024-03-29 00:11:00,413: INFO/ForkPoolWorker-15] [2d1210db-bd11-45f2-92f9-d2fb09103409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:11:00.414278953Z [2024-03-29 00:11:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe3656dc-10b3-4d95-9f2b-8d979139572a] received 2024-03-29T00:11:00.422803704Z [2024-03-29 00:11:00,422: INFO/ForkPoolWorker-1] [fe3656dc-10b3-4d95-9f2b-8d979139572a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:11:00.424534618Z [2024-03-29 00:11:00,424: INFO/ForkPoolWorker-16] [006b6ca8-7bc5-4e0c-acfc-aa43e9a00ca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:11:00.726783462Z [2024-03-29 00:11:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:11:00.728887906Z [2024-03-29 00:11:00,725: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:11:00.768243435Z [2024-03-29 00:11:00,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:11:00.916069990Z [2024-03-29 00:11:00,915: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:11:00.920450810Z [2024-03-29 00:11:00,919: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:11:00.945410326Z [2024-03-29 00:11:00,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:11:00.946851683Z [2024-03-29 00:11:00,946: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:11:00.947572793Z [2024-03-29 00:11:00,946: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:11:00.947793522Z [2024-03-29 00:11:00,947: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:11:00.947967590Z [2024-03-29 00:11:00,947: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:11:01.055266249Z [2024-03-29 00:11:01,054: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:11:01.718372116Z [2024-03-29 00:11:01,717: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe3656dc-10b3-4d95-9f2b-8d979139572a] succeeded in 1.3025416650002626s: None 2024-03-29T00:11:01.963497978Z [2024-03-29 00:11:01,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:11:01.967393126Z [2024-03-29 00:11:01,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:11:01.971579601Z [2024-03-29 00:11:01,971: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:11:01.975482744Z [2024-03-29 00:11:01,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:11:01.998901227Z [2024-03-29 00:11:01,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:11:01.999771199Z [2024-03-29 00:11:01,999: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:11:02.000874916Z [2024-03-29 00:11:02,000: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:11:02.001126107Z [2024-03-29 00:11:02,000: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:11:02.001492463Z [2024-03-29 00:11:02,001: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:11:02.001753529Z [2024-03-29 00:11:02,001: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:11:02.002284641Z [2024-03-29 00:11:02,002: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:11:02.002583159Z [2024-03-29 00:11:02,002: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:11:02.009004001Z [2024-03-29 00:11:02,008: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:11:02.009225202Z [2024-03-29 00:11:02,008: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:11:02.009759643Z [2024-03-29 00:11:02,009: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:11:02.010028138Z [2024-03-29 00:11:02,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:11:02.011147353Z [2024-03-29 00:11:02,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:11:02.011387012Z [2024-03-29 00:11:02,011: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:11:02.112996206Z [2024-03-29 00:11:02,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:11:02.135222020Z [2024-03-29 00:11:02,134: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:11:03.660283044Z [2024-03-29 00:11:03,659: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[006b6ca8-7bc5-4e0c-acfc-aa43e9a00ca0] succeeded in 3.249443202999828s: None 2024-03-29T00:11:04.118800804Z [2024-03-29 00:11:04,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d1210db-bd11-45f2-92f9-d2fb09103409] succeeded in 3.7112276149996433s: None 2024-03-29T00:12:00.262375108Z [2024-03-29 00:12:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d916dd5d-0ca9-439d-8a87-3e65ae7c3c24] received 2024-03-29T00:12:00.264842022Z [2024-03-29 00:12:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[044ce870-6cf8-424b-bba9-d61e27260f3e] received 2024-03-29T00:12:00.267029056Z [2024-03-29 00:12:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9a8bc4a-c927-4ab6-9de2-5c629bd79e6d] received 2024-03-29T00:12:00.270219737Z [2024-03-29 00:12:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd7e3231-0922-42ca-868a-32c581ee12b8] received 2024-03-29T00:12:00.273486534Z [2024-03-29 00:12:00,273: INFO/ForkPoolWorker-15] [d916dd5d-0ca9-439d-8a87-3e65ae7c3c24] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:12:00.273503808Z [2024-03-29 00:12:00,273: INFO/ForkPoolWorker-16] [044ce870-6cf8-424b-bba9-d61e27260f3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:12:00.285853344Z [2024-03-29 00:12:00,285: INFO/ForkPoolWorker-1] [b9a8bc4a-c927-4ab6-9de2-5c629bd79e6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:12:00.286677344Z [2024-03-29 00:12:00,286: INFO/ForkPoolWorker-2] [bd7e3231-0922-42ca-868a-32c581ee12b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:12:00.611088428Z [2024-03-29 00:12:00,607: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:12:00.665378454Z [2024-03-29 00:12:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:12:00.738167364Z [2024-03-29 00:12:00,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:12:00.790628635Z [2024-03-29 00:12:00,786: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:12:00.954859300Z [2024-03-29 00:12:00,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:12:01.052762339Z [2024-03-29 00:12:01,052: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:12:01.056902840Z [2024-03-29 00:12:01,056: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:12:01.087532344Z [2024-03-29 00:12:01,087: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:12:01.088938306Z [2024-03-29 00:12:01,088: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:12:01.089138928Z [2024-03-29 00:12:01,088: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:12:01.089280045Z [2024-03-29 00:12:01,089: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:12:01.089611162Z [2024-03-29 00:12:01,089: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:12:01.201841549Z [2024-03-29 00:12:01,201: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:12:01.684686990Z [2024-03-29 00:12:01,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d916dd5d-0ca9-439d-8a87-3e65ae7c3c24] succeeded in 1.4182574639999075s: None 2024-03-29T00:12:01.900885362Z [2024-03-29 00:12:01,900: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bd7e3231-0922-42ca-868a-32c581ee12b8] succeeded in 1.6277360260000933s: None 2024-03-29T00:12:02.054378543Z [2024-03-29 00:12:02,053: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:12:02.057958848Z [2024-03-29 00:12:02,057: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:12:02.081826410Z [2024-03-29 00:12:02,081: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:12:02.083563102Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:12:02.083589121Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:12:02.083736605Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:12:02.083745764Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:12:02.083999612Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:12:02.084009259Z [2024-03-29 00:12:02,083: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:12:02.160361276Z [2024-03-29 00:12:02,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:12:02.163933852Z [2024-03-29 00:12:02,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:12:02.171898638Z [2024-03-29 00:12:02,171: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:12:02.196275417Z [2024-03-29 00:12:02,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:12:02.197808084Z [2024-03-29 00:12:02,197: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:12:02.197922847Z [2024-03-29 00:12:02,197: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:12:02.198159356Z [2024-03-29 00:12:02,197: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:12:02.198254296Z [2024-03-29 00:12:02,198: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:12:02.198764726Z [2024-03-29 00:12:02,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:12:02.198884859Z [2024-03-29 00:12:02,198: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:12:02.288455055Z [2024-03-29 00:12:02,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:12:03.520942859Z [2024-03-29 00:12:03,520: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9a8bc4a-c927-4ab6-9de2-5c629bd79e6d] succeeded in 3.248837414999798s: None 2024-03-29T00:12:04.114130327Z [2024-03-29 00:12:04,112: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[044ce870-6cf8-424b-bba9-d61e27260f3e] succeeded in 3.846480812000209s: None 2024-03-29T00:13:00.969581036Z [2024-03-29 00:13:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fd2adce-05f8-4329-beaa-cc069c880902] received 2024-03-29T00:13:00.971389207Z [2024-03-29 00:13:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4c2e952-bbb9-490b-89e9-c86cc4d06239] received 2024-03-29T00:13:00.979929224Z [2024-03-29 00:13:00,979: INFO/ForkPoolWorker-15] [8fd2adce-05f8-4329-beaa-cc069c880902] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:13:00.981782290Z [2024-03-29 00:13:00,981: INFO/ForkPoolWorker-16] [d4c2e952-bbb9-490b-89e9-c86cc4d06239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:13:00.985454355Z [2024-03-29 00:13:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1c28981-1a22-4ea9-bfd3-f61ed40b6051] received 2024-03-29T00:13:00.997683596Z [2024-03-29 00:13:00,997: INFO/ForkPoolWorker-1] [f1c28981-1a22-4ea9-bfd3-f61ed40b6051] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:13:01.283124555Z [2024-03-29 00:13:01,279: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:13:01.302749492Z [2024-03-29 00:13:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:13:01.347264669Z [2024-03-29 00:13:01,343: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:13:01.525480162Z [2024-03-29 00:13:01,525: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:13:01.529797455Z [2024-03-29 00:13:01,529: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:13:01.554953981Z [2024-03-29 00:13:01,554: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:13:01.557700028Z [2024-03-29 00:13:01,557: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:13:01.557956396Z [2024-03-29 00:13:01,557: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:13:01.558199741Z [2024-03-29 00:13:01,558: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:13:01.558669725Z [2024-03-29 00:13:01,558: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:13:01.649573259Z [2024-03-29 00:13:01,649: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:13:02.320071265Z [2024-03-29 00:13:02,319: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1c28981-1a22-4ea9-bfd3-f61ed40b6051] succeeded in 1.3309973929999614s: None 2024-03-29T00:13:02.499383902Z [2024-03-29 00:13:02,498: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:13:02.503281119Z [2024-03-29 00:13:02,502: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:13:02.539232712Z [2024-03-29 00:13:02,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:13:02.539852790Z [2024-03-29 00:13:02,539: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:13:02.541198026Z [2024-03-29 00:13:02,540: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:13:02.541387324Z [2024-03-29 00:13:02,541: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:13:02.541635471Z [2024-03-29 00:13:02,541: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:13:02.541905657Z [2024-03-29 00:13:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:13:02.542544817Z [2024-03-29 00:13:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:13:02.543306858Z [2024-03-29 00:13:02,542: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:13:02.548286904Z [2024-03-29 00:13:02,547: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:13:02.583526562Z [2024-03-29 00:13:02,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:13:02.585584179Z [2024-03-29 00:13:02,585: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:13:02.585628317Z [2024-03-29 00:13:02,585: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:13:02.585915770Z [2024-03-29 00:13:02,585: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:13:02.585999144Z [2024-03-29 00:13:02,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:13:02.586567400Z [2024-03-29 00:13:02,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:13:02.586685856Z [2024-03-29 00:13:02,586: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:13:02.701317000Z [2024-03-29 00:13:02,700: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:13:02.731524630Z [2024-03-29 00:13:02,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:13:04.259849277Z [2024-03-29 00:13:04,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fd2adce-05f8-4329-beaa-cc069c880902] succeeded in 3.2868485499998314s: None 2024-03-29T00:13:04.707456721Z [2024-03-29 00:13:04,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4c2e952-bbb9-490b-89e9-c86cc4d06239] succeeded in 3.7300967950000086s: None 2024-03-29T00:14:01.239821731Z [2024-03-29 00:14:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eb63946-c8d3-4205-84a3-3722b45e470d] received 2024-03-29T00:14:01.244844886Z [2024-03-29 00:14:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[859704ad-4cac-4f9d-a96a-f3115ed0eb6b] received 2024-03-29T00:14:01.256539769Z [2024-03-29 00:14:01,256: INFO/ForkPoolWorker-15] [9eb63946-c8d3-4205-84a3-3722b45e470d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:14:01.260036579Z [2024-03-29 00:14:01,259: INFO/ForkPoolWorker-16] [859704ad-4cac-4f9d-a96a-f3115ed0eb6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:14:01.260811514Z [2024-03-29 00:14:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59e06b9e-381a-4347-a312-83669c1d4a32] received 2024-03-29T00:14:01.267234683Z [2024-03-29 00:14:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9876b3b5-e57d-437e-9176-6bbcb6c83aa0] received 2024-03-29T00:14:01.273522846Z [2024-03-29 00:14:01,273: INFO/ForkPoolWorker-1] [59e06b9e-381a-4347-a312-83669c1d4a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:14:01.280044169Z [2024-03-29 00:14:01,279: INFO/ForkPoolWorker-2] [9876b3b5-e57d-437e-9176-6bbcb6c83aa0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:14:01.712835028Z [2024-03-29 00:14:01,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:14:01.718220999Z [2024-03-29 00:14:01,713: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:14:01.767537336Z [2024-03-29 00:14:01,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:14:01.808798601Z [2024-03-29 00:14:01,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:14:01.954277468Z [2024-03-29 00:14:01,953: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:14:01.959185309Z [2024-03-29 00:14:01,958: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:14:02.007217896Z [2024-03-29 00:14:02,006: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:14:02.011801048Z [2024-03-29 00:14:02,011: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:14:02.012146628Z [2024-03-29 00:14:02,011: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:14:02.012326374Z [2024-03-29 00:14:02,012: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:14:02.012707405Z [2024-03-29 00:14:02,012: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:14:02.086688342Z [2024-03-29 00:14:02,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:14:02.183513577Z [2024-03-29 00:14:02,183: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:14:02.832196833Z [2024-03-29 00:14:02,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9eb63946-c8d3-4205-84a3-3722b45e470d] succeeded in 1.5845564620003643s: None 2024-03-29T00:14:02.946700228Z [2024-03-29 00:14:02,946: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9876b3b5-e57d-437e-9176-6bbcb6c83aa0] succeeded in 1.6755933849999565s: None 2024-03-29T00:14:03.188709803Z [2024-03-29 00:14:03,188: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:14:03.192591022Z [2024-03-29 00:14:03,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:14:03.231924875Z [2024-03-29 00:14:03,231: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:14:03.236424848Z [2024-03-29 00:14:03,235: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:14:03.236975841Z [2024-03-29 00:14:03,236: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:14:03.239084917Z [2024-03-29 00:14:03,238: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:14:03.239433226Z [2024-03-29 00:14:03,239: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:14:03.240918151Z [2024-03-29 00:14:03,240: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:14:03.241271537Z [2024-03-29 00:14:03,241: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:14:03.353858436Z [2024-03-29 00:14:03,353: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:14:03.427052861Z [2024-03-29 00:14:03,426: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:14:03.430685706Z [2024-03-29 00:14:03,430: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:14:03.460064016Z [2024-03-29 00:14:03,459: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:14:03.463516368Z [2024-03-29 00:14:03,461: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:14:03.463895206Z [2024-03-29 00:14:03,463: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:14:03.464251910Z [2024-03-29 00:14:03,463: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:14:03.464539010Z [2024-03-29 00:14:03,464: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:14:03.465094767Z [2024-03-29 00:14:03,464: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:14:03.466192093Z [2024-03-29 00:14:03,465: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:14:03.588355261Z [2024-03-29 00:14:03,588: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:14:05.923342317Z [2024-03-29 00:14:05,922: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59e06b9e-381a-4347-a312-83669c1d4a32] succeeded in 4.655969648000337s: None 2024-03-29T00:14:06.051129728Z [2024-03-29 00:14:06,050: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[859704ad-4cac-4f9d-a96a-f3115ed0eb6b] succeeded in 4.798057611000331s: None 2024-03-29T00:15:00.618072495Z [2024-03-29 00:15:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b67ca5-475f-4f76-b336-bdd2a5561dd1] received 2024-03-29T00:15:00.622617899Z [2024-03-29 00:15:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a26cab1b-490c-46fc-89fd-750d055b974c] received 2024-03-29T00:15:00.631784923Z [2024-03-29 00:15:00,630: INFO/ForkPoolWorker-15] [c7b67ca5-475f-4f76-b336-bdd2a5561dd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:15:00.632535226Z [2024-03-29 00:15:00,632: INFO/ForkPoolWorker-16] [a26cab1b-490c-46fc-89fd-750d055b974c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:15:00.641136507Z [2024-03-29 00:15:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d273de-6017-4748-87d7-6f6c28d63e1b] received 2024-03-29T00:15:00.646049666Z [2024-03-29 00:15:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99097b62-e088-44e0-a481-da24c8342da9] received 2024-03-29T00:15:00.653704604Z [2024-03-29 00:15:00,653: INFO/ForkPoolWorker-1] [82d273de-6017-4748-87d7-6f6c28d63e1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:00.654031837Z [2024-03-29 00:15:00,653: INFO/ForkPoolWorker-2] [99097b62-e088-44e0-a481-da24c8342da9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:15:01.052999168Z [2024-03-29 00:15:01,049: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:15:01.076551515Z [2024-03-29 00:15:01,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:15:01.196085174Z [2024-03-29 00:15:01,192: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:15:01.230353850Z [2024-03-29 00:15:01,229: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:15:01.234854576Z [2024-03-29 00:15:01,234: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:01.283201077Z [2024-03-29 00:15:01,278: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:15:01.285710488Z [2024-03-29 00:15:01,285: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:15:01.290524674Z [2024-03-29 00:15:01,290: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:15:01.290704395Z [2024-03-29 00:15:01,290: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:15:01.290808408Z [2024-03-29 00:15:01,290: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:15:01.291113892Z [2024-03-29 00:15:01,290: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:15:01.486211063Z [2024-03-29 00:15:01,484: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:02.635860693Z [2024-03-29 00:15:02,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a26cab1b-490c-46fc-89fd-750d055b974c] succeeded in 2.0107565130001603s: None 2024-03-29T00:15:03.207624755Z [2024-03-29 00:15:03,207: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:15:03.213853401Z [2024-03-29 00:15:03,213: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:03.243777489Z [2024-03-29 00:15:03,243: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:15:03.247555522Z [2024-03-29 00:15:03,247: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:03.260742874Z [2024-03-29 00:15:03,260: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:15:03.262926289Z [2024-03-29 00:15:03,262: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:03.263220447Z [2024-03-29 00:15:03,263: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:03.263576509Z [2024-03-29 00:15:03,263: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:03.263946070Z [2024-03-29 00:15:03,263: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:15:03.265044086Z [2024-03-29 00:15:03,264: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:15:03.265378128Z [2024-03-29 00:15:03,265: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:03.271865673Z [2024-03-29 00:15:03,271: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:15:03.273695196Z [2024-03-29 00:15:03,273: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:03.273708711Z [2024-03-29 00:15:03,273: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:03.273862066Z [2024-03-29 00:15:03,273: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:03.273868680Z [2024-03-29 00:15:03,273: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:15:03.274156429Z [2024-03-29 00:15:03,274: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:15:03.274318528Z [2024-03-29 00:15:03,274: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:03.372032821Z [2024-03-29 00:15:03,371: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:03.388196691Z [2024-03-29 00:15:03,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:03.495605556Z [2024-03-29 00:15:03,495: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:15:03.499618626Z [2024-03-29 00:15:03,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:03.534923579Z [2024-03-29 00:15:03,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:15:03.536709318Z [2024-03-29 00:15:03,536: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:03.536743162Z [2024-03-29 00:15:03,536: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:03.536961484Z [2024-03-29 00:15:03,536: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:03.537054540Z [2024-03-29 00:15:03,536: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:15:03.537441345Z [2024-03-29 00:15:03,537: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:15:03.537529805Z [2024-03-29 00:15:03,537: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:03.639867028Z [2024-03-29 00:15:03,639: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:04.205202605Z [2024-03-29 00:15:04,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82d273de-6017-4748-87d7-6f6c28d63e1b] succeeded in 3.562261237000257s: None 2024-03-29T00:15:04.552873612Z [2024-03-29 00:15:04,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f71f34c1-f858-4ed9-8f5e-37f43c3d5992] received 2024-03-29T00:15:04.565170330Z [2024-03-29 00:15:04,564: INFO/ForkPoolWorker-16] [f71f34c1-f858-4ed9-8f5e-37f43c3d5992] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:04.881023205Z [2024-03-29 00:15:04,877: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:15:05.670672017Z [2024-03-29 00:15:05,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7b67ca5-475f-4f76-b336-bdd2a5561dd1] succeeded in 5.050328957000147s: None 2024-03-29T00:15:05.963633360Z [2024-03-29 00:15:05,963: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99097b62-e088-44e0-a481-da24c8342da9] succeeded in 5.315894036999907s: None 2024-03-29T00:15:06.238704640Z [2024-03-29 00:15:06,238: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:15:06.242758163Z [2024-03-29 00:15:06,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:06.268393997Z [2024-03-29 00:15:06,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:15:06.269933478Z [2024-03-29 00:15:06,269: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:06.270058716Z [2024-03-29 00:15:06,269: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:06.270328097Z [2024-03-29 00:15:06,270: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:06.270528234Z [2024-03-29 00:15:06,270: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:15:06.270949332Z [2024-03-29 00:15:06,270: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:15:06.271020563Z [2024-03-29 00:15:06,270: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:06.359241550Z [2024-03-29 00:15:06,358: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:07.117078289Z [2024-03-29 00:15:07,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f71f34c1-f858-4ed9-8f5e-37f43c3d5992] succeeded in 2.561489402999996s: None 2024-03-29T00:15:07.275088834Z [2024-03-29 00:15:07,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5f67f1c-01f1-4ff3-99db-0e81180d60d6] received 2024-03-29T00:15:07.315427377Z [2024-03-29 00:15:07,315: INFO/ForkPoolWorker-15] [e5f67f1c-01f1-4ff3-99db-0e81180d60d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:15:07.729742779Z [2024-03-29 00:15:07,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:15:08.944776588Z [2024-03-29 00:15:08,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:15:08.948206413Z [2024-03-29 00:15:08,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:08.966927914Z [2024-03-29 00:15:08,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:15:08.968425201Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:08.968451438Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:08.968567853Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:08.968583659Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:15:08.968833928Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:15:08.968844504Z [2024-03-29 00:15:08,968: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:09.048729241Z [2024-03-29 00:15:09,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:12.256147411Z [2024-03-29 00:15:12,255: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5f67f1c-01f1-4ff3-99db-0e81180d60d6] succeeded in 4.964785261000088s: None 2024-03-29T00:15:12.864582370Z [2024-03-29 00:15:12,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfae4e40-3170-4f00-a3ec-37c889e155f3] received 2024-03-29T00:15:12.883797500Z [2024-03-29 00:15:12,883: INFO/ForkPoolWorker-15] [dfae4e40-3170-4f00-a3ec-37c889e155f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:13.316895115Z [2024-03-29 00:15:13,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:15:14.494713521Z [2024-03-29 00:15:14,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:15:14.498096451Z [2024-03-29 00:15:14,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:15:14.515518206Z [2024-03-29 00:15:14,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:15:14.516661884Z [2024-03-29 00:15:14,516: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:15:14.516673919Z [2024-03-29 00:15:14,516: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:15:14.516781102Z [2024-03-29 00:15:14,516: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:15:14.516815623Z [2024-03-29 00:15:14,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:15:14.517096576Z [2024-03-29 00:15:14,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:15:14.517139458Z [2024-03-29 00:15:14,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:15:14.600400306Z [2024-03-29 00:15:14,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:15:15.211001114Z [2024-03-29 00:15:15,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfae4e40-3170-4f00-a3ec-37c889e155f3] succeeded in 2.3399789400000373s: None 2024-03-29T00:16:00.376669086Z [2024-03-29 00:16:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbbbdbea-7128-48f6-8a33-cde0514cba8e] received 2024-03-29T00:16:00.382382654Z [2024-03-29 00:16:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4016b286-52d6-432a-8f7a-cd96d1a5f435] received 2024-03-29T00:16:00.383096730Z [2024-03-29 00:16:00,382: INFO/ForkPoolWorker-15] [fbbbdbea-7128-48f6-8a33-cde0514cba8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:16:00.389593196Z [2024-03-29 00:16:00,389: INFO/ForkPoolWorker-16] [4016b286-52d6-432a-8f7a-cd96d1a5f435] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:16:00.395095595Z [2024-03-29 00:16:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31b81878-700f-406e-bd44-de1c2c923bdb] received 2024-03-29T00:16:00.399235148Z [2024-03-29 00:16:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a350316-1c76-4a29-955e-78fb5d5774c9] received 2024-03-29T00:16:00.407980411Z [2024-03-29 00:16:00,407: INFO/ForkPoolWorker-2] [4a350316-1c76-4a29-955e-78fb5d5774c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:16:00.409361849Z [2024-03-29 00:16:00,409: INFO/ForkPoolWorker-1] [31b81878-700f-406e-bd44-de1c2c923bdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:16:00.716690103Z [2024-03-29 00:16:00,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:16:00.763763696Z [2024-03-29 00:16:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:16:00.792318010Z [2024-03-29 00:16:00,789: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:16:00.840913022Z [2024-03-29 00:16:00,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:16:00.970535565Z [2024-03-29 00:16:00,970: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:16:00.974362370Z [2024-03-29 00:16:00,973: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:16:01.005099037Z [2024-03-29 00:16:01,004: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:16:01.006629137Z [2024-03-29 00:16:01,006: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:16:01.006863657Z [2024-03-29 00:16:01,006: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:16:01.007128938Z [2024-03-29 00:16:01,006: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:16:01.007553584Z [2024-03-29 00:16:01,007: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:16:01.099505910Z [2024-03-29 00:16:01,099: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:16:01.151513432Z [2024-03-29 00:16:01,151: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:16:01.819696104Z [2024-03-29 00:16:01,818: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbbbdbea-7128-48f6-8a33-cde0514cba8e] succeeded in 1.4401321010000174s: None 2024-03-29T00:16:01.985968580Z [2024-03-29 00:16:01,985: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4a350316-1c76-4a29-955e-78fb5d5774c9] succeeded in 1.5838128380000853s: None 2024-03-29T00:16:02.221811770Z [2024-03-29 00:16:02,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:16:02.226735761Z [2024-03-29 00:16:02,226: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:16:02.259288413Z [2024-03-29 00:16:02,259: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:16:02.260828548Z [2024-03-29 00:16:02,260: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:16:02.260894532Z [2024-03-29 00:16:02,260: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:16:02.261078062Z [2024-03-29 00:16:02,260: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:16:02.261131998Z [2024-03-29 00:16:02,261: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:16:02.261606724Z [2024-03-29 00:16:02,261: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:16:02.261703001Z [2024-03-29 00:16:02,261: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:16:02.263206063Z [2024-03-29 00:16:02,262: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:16:02.267066935Z [2024-03-29 00:16:02,266: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:16:02.293265274Z [2024-03-29 00:16:02,292: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:16:02.295166021Z [2024-03-29 00:16:02,294: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:16:02.295644235Z [2024-03-29 00:16:02,295: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:16:02.296634381Z [2024-03-29 00:16:02,296: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:16:02.296827005Z [2024-03-29 00:16:02,296: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:16:02.297198174Z [2024-03-29 00:16:02,297: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:16:02.297374217Z [2024-03-29 00:16:02,297: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:16:02.377153637Z [2024-03-29 00:16:02,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:16:02.398703037Z [2024-03-29 00:16:02,395: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:16:04.083398129Z [2024-03-29 00:16:04,082: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31b81878-700f-406e-bd44-de1c2c923bdb] succeeded in 3.6852281149999726s: None 2024-03-29T00:16:04.528490808Z [2024-03-29 00:16:04,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4016b286-52d6-432a-8f7a-cd96d1a5f435] succeeded in 4.143714721999913s: None 2024-03-29T00:17:01.101658362Z [2024-03-29 00:17:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a197d13-d982-4ebe-8d5f-0c102103f423] received 2024-03-29T00:17:01.118754715Z [2024-03-29 00:17:01,118: INFO/ForkPoolWorker-15] [3a197d13-d982-4ebe-8d5f-0c102103f423] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:17:01.137376149Z [2024-03-29 00:17:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[604e1f53-a3f6-4503-90bb-d0922117f89e] received 2024-03-29T00:17:01.140552164Z [2024-03-29 00:17:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8729bc02-fb99-46e5-a9f1-9ff061d5e53d] received 2024-03-29T00:17:01.151404517Z [2024-03-29 00:17:01,150: INFO/ForkPoolWorker-16] [604e1f53-a3f6-4503-90bb-d0922117f89e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:17:01.152183566Z [2024-03-29 00:17:01,151: INFO/ForkPoolWorker-1] [8729bc02-fb99-46e5-a9f1-9ff061d5e53d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:17:01.572609303Z [2024-03-29 00:17:01,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:17:01.586615863Z [2024-03-29 00:17:01,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:17:01.589506247Z [2024-03-29 00:17:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:17:01.784012564Z [2024-03-29 00:17:01,783: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:17:01.788882055Z [2024-03-29 00:17:01,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:17:01.843119231Z [2024-03-29 00:17:01,842: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:17:01.845168031Z [2024-03-29 00:17:01,844: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:17:01.845513707Z [2024-03-29 00:17:01,845: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:17:01.845690039Z [2024-03-29 00:17:01,845: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:17:01.846089434Z [2024-03-29 00:17:01,845: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:17:01.981374979Z [2024-03-29 00:17:01,981: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:17:02.646589915Z [2024-03-29 00:17:02,646: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8729bc02-fb99-46e5-a9f1-9ff061d5e53d] succeeded in 1.5036142109997854s: None 2024-03-29T00:17:03.014835065Z [2024-03-29 00:17:03,014: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:17:03.018516370Z [2024-03-29 00:17:03,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:17:03.043636027Z [2024-03-29 00:17:03,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:17:03.045486435Z [2024-03-29 00:17:03,045: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:17:03.045661965Z [2024-03-29 00:17:03,045: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:17:03.045902117Z [2024-03-29 00:17:03,045: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:17:03.046049870Z [2024-03-29 00:17:03,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:17:03.046473102Z [2024-03-29 00:17:03,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:17:03.047061312Z [2024-03-29 00:17:03,046: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:17:03.095948706Z [2024-03-29 00:17:03,095: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:17:03.102251347Z [2024-03-29 00:17:03,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:17:03.128336368Z [2024-03-29 00:17:03,128: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:17:03.129938136Z [2024-03-29 00:17:03,129: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:17:03.129975267Z [2024-03-29 00:17:03,129: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:17:03.130183640Z [2024-03-29 00:17:03,129: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:17:03.130249763Z [2024-03-29 00:17:03,130: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:17:03.130636561Z [2024-03-29 00:17:03,130: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:17:03.130755592Z [2024-03-29 00:17:03,130: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:17:03.152850271Z [2024-03-29 00:17:03,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:17:03.223739258Z [2024-03-29 00:17:03,223: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:17:05.070930082Z [2024-03-29 00:17:05,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[604e1f53-a3f6-4503-90bb-d0922117f89e] succeeded in 3.9315455740002108s: None 2024-03-29T00:17:05.537487893Z [2024-03-29 00:17:05,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a197d13-d982-4ebe-8d5f-0c102103f423] succeeded in 4.433993918999931s: None 2024-03-29T00:18:00.917179152Z [2024-03-29 00:18:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89767171-40ed-406e-abee-72a369570402] received 2024-03-29T00:18:00.921176677Z [2024-03-29 00:18:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed2252a-50ea-4f17-a0eb-eb47530e96f0] received 2024-03-29T00:18:00.929046668Z [2024-03-29 00:18:00,928: INFO/ForkPoolWorker-16] [bed2252a-50ea-4f17-a0eb-eb47530e96f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:18:00.929070694Z [2024-03-29 00:18:00,928: INFO/ForkPoolWorker-15] [89767171-40ed-406e-abee-72a369570402] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:18:00.937049957Z [2024-03-29 00:18:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da2963ee-03f4-4e9f-8fee-f2dad2dfc63b] received 2024-03-29T00:18:00.942370546Z [2024-03-29 00:18:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[293e1e22-517e-4b7e-8eaf-920ded2b5582] received 2024-03-29T00:18:00.950287231Z [2024-03-29 00:18:00,949: INFO/ForkPoolWorker-1] [da2963ee-03f4-4e9f-8fee-f2dad2dfc63b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:18:00.952646421Z [2024-03-29 00:18:00,952: INFO/ForkPoolWorker-2] [293e1e22-517e-4b7e-8eaf-920ded2b5582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:18:01.298630773Z [2024-03-29 00:18:01,293: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:18:01.486294029Z [2024-03-29 00:18:01,481: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:18:01.497175237Z [2024-03-29 00:18:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:18:01.522150777Z [2024-03-29 00:18:01,515: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:18:01.605959012Z [2024-03-29 00:18:01,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:18:01.725921988Z [2024-03-29 00:18:01,725: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:18:01.731191076Z [2024-03-29 00:18:01,730: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:18:01.774333827Z [2024-03-29 00:18:01,774: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:18:01.779824904Z [2024-03-29 00:18:01,779: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:18:01.780259930Z [2024-03-29 00:18:01,779: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:18:01.780573656Z [2024-03-29 00:18:01,780: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:18:01.781001409Z [2024-03-29 00:18:01,780: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:18:01.910319434Z [2024-03-29 00:18:01,910: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:18:02.371005980Z [2024-03-29 00:18:02,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89767171-40ed-406e-abee-72a369570402] succeeded in 1.4504838589996325s: None 2024-03-29T00:18:02.602530976Z [2024-03-29 00:18:02,601: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da2963ee-03f4-4e9f-8fee-f2dad2dfc63b] succeeded in 1.6615285140001106s: None 2024-03-29T00:18:02.999801208Z [2024-03-29 00:18:02,999: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:18:03.003395676Z [2024-03-29 00:18:03,002: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:18:03.042753454Z [2024-03-29 00:18:03,042: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:18:03.044741417Z [2024-03-29 00:18:03,044: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:18:03.044757112Z [2024-03-29 00:18:03,044: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:18:03.044927742Z [2024-03-29 00:18:03,044: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:18:03.045001498Z [2024-03-29 00:18:03,044: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:18:03.045378243Z [2024-03-29 00:18:03,045: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:18:03.045496123Z [2024-03-29 00:18:03,045: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:18:03.142504683Z [2024-03-29 00:18:03,142: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:18:03.258018070Z [2024-03-29 00:18:03,257: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:18:03.261772605Z [2024-03-29 00:18:03,261: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:18:03.284152003Z [2024-03-29 00:18:03,283: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:18:03.285754373Z [2024-03-29 00:18:03,285: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:18:03.285951267Z [2024-03-29 00:18:03,285: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:18:03.286191891Z [2024-03-29 00:18:03,285: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:18:03.286325603Z [2024-03-29 00:18:03,286: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:18:03.286941280Z [2024-03-29 00:18:03,286: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:18:03.287178248Z [2024-03-29 00:18:03,286: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:18:03.409897568Z [2024-03-29 00:18:03,409: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:18:05.203376457Z [2024-03-29 00:18:05,197: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bed2252a-50ea-4f17-a0eb-eb47530e96f0] succeeded in 4.275264931000038s: None 2024-03-29T00:18:05.222623974Z [2024-03-29 00:18:05,215: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[293e1e22-517e-4b7e-8eaf-920ded2b5582] succeeded in 4.2707983230002355s: None 2024-03-29T00:19:01.166004729Z [2024-03-29 00:19:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b77f4124-06de-46ac-84f7-344065436753] received 2024-03-29T00:19:01.168686415Z [2024-03-29 00:19:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42c241c9-d928-4cc7-8ac6-44a5984e3c80] received 2024-03-29T00:19:01.179741151Z [2024-03-29 00:19:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef1c85db-de74-4bf5-aff7-0c0020b439eb] received 2024-03-29T00:19:01.180016224Z [2024-03-29 00:19:01,179: INFO/ForkPoolWorker-16] [42c241c9-d928-4cc7-8ac6-44a5984e3c80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:19:01.181655660Z [2024-03-29 00:19:01,181: INFO/ForkPoolWorker-15] [b77f4124-06de-46ac-84f7-344065436753] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:19:01.196836275Z [2024-03-29 00:19:01,196: INFO/ForkPoolWorker-1] [ef1c85db-de74-4bf5-aff7-0c0020b439eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:19:01.477813080Z [2024-03-29 00:19:01,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:19:01.503940140Z [2024-03-29 00:19:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:19:01.533871762Z [2024-03-29 00:19:01,530: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:19:01.687533663Z [2024-03-29 00:19:01,687: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:19:01.691926031Z [2024-03-29 00:19:01,691: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:19:01.719111575Z [2024-03-29 00:19:01,718: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:19:01.720796273Z [2024-03-29 00:19:01,720: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:19:01.720933736Z [2024-03-29 00:19:01,720: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:19:01.721010166Z [2024-03-29 00:19:01,720: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:19:01.721297810Z [2024-03-29 00:19:01,721: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:19:01.878771475Z [2024-03-29 00:19:01,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:19:02.624354457Z [2024-03-29 00:19:02,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b77f4124-06de-46ac-84f7-344065436753] succeeded in 1.452768062999894s: None 2024-03-29T00:19:02.870356880Z [2024-03-29 00:19:02,869: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:19:02.874033483Z [2024-03-29 00:19:02,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:19:02.897680357Z [2024-03-29 00:19:02,897: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:19:02.900095052Z [2024-03-29 00:19:02,899: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:19:02.900372042Z [2024-03-29 00:19:02,899: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:19:02.900758001Z [2024-03-29 00:19:02,900: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:19:02.900968869Z [2024-03-29 00:19:02,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:19:02.901571263Z [2024-03-29 00:19:02,901: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:19:02.901829029Z [2024-03-29 00:19:02,901: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:19:02.962263061Z [2024-03-29 00:19:02,961: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:19:02.966148561Z [2024-03-29 00:19:02,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:19:02.992027983Z [2024-03-29 00:19:02,991: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:19:02.993691820Z [2024-03-29 00:19:02,993: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:19:02.993893942Z [2024-03-29 00:19:02,993: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:19:02.994150901Z [2024-03-29 00:19:02,993: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:19:02.994331942Z [2024-03-29 00:19:02,994: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:19:02.994735125Z [2024-03-29 00:19:02,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:19:02.994808509Z [2024-03-29 00:19:02,994: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:19:03.041927894Z [2024-03-29 00:19:03,041: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:19:03.076519404Z [2024-03-29 00:19:03,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:19:04.556286297Z [2024-03-29 00:19:04,555: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef1c85db-de74-4bf5-aff7-0c0020b439eb] succeeded in 3.3695889380001063s: None 2024-03-29T00:19:05.092613672Z [2024-03-29 00:19:05,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42c241c9-d928-4cc7-8ac6-44a5984e3c80] succeeded in 3.9221240069996384s: None 2024-03-29T00:20:00.367928969Z [2024-03-29 00:20:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff43e355-3d55-4e2f-b4e2-66d8e260b8b2] received 2024-03-29T00:20:00.374047547Z [2024-03-29 00:20:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7077cde-3f4d-411d-a066-f9b79644eff2] received 2024-03-29T00:20:00.376618252Z [2024-03-29 00:20:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1119d20-3769-4907-ab24-34d106142698] received 2024-03-29T00:20:00.379142882Z [2024-03-29 00:20:00,378: INFO/ForkPoolWorker-15] [ff43e355-3d55-4e2f-b4e2-66d8e260b8b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:00.380020911Z [2024-03-29 00:20:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dec776ca-d4d6-4aa3-9960-98c7cdfdd115] received 2024-03-29T00:20:00.382265094Z [2024-03-29 00:20:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8738fe0-e2be-4675-a05e-8da118a0eb46] received 2024-03-29T00:20:00.391533364Z [2024-03-29 00:20:00,391: INFO/ForkPoolWorker-16] [f7077cde-3f4d-411d-a066-f9b79644eff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:20:00.396500060Z [2024-03-29 00:20:00,396: INFO/ForkPoolWorker-1] [b1119d20-3769-4907-ab24-34d106142698] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:20:00.399054055Z [2024-03-29 00:20:00,398: INFO/ForkPoolWorker-2] [dec776ca-d4d6-4aa3-9960-98c7cdfdd115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:20:00.404979268Z [2024-03-29 00:20:00,404: INFO/ForkPoolWorker-3] [e8738fe0-e2be-4675-a05e-8da118a0eb46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:20:00.726273732Z [2024-03-29 00:20:00,722: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:20:00.827100708Z [2024-03-29 00:20:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:20:00.928257729Z [2024-03-29 00:20:00,921: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:20:01.022725918Z [2024-03-29 00:20:01,021: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:20:01.028843383Z [2024-03-29 00:20:01,027: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:01.037988820Z [2024-03-29 00:20:01,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:20:01.064240302Z [2024-03-29 00:20:01,064: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:20:01.071013744Z [2024-03-29 00:20:01,070: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:20:01.071744820Z [2024-03-29 00:20:01,071: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:20:01.072025391Z [2024-03-29 00:20:01,071: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:20:01.076368559Z [2024-03-29 00:20:01,076: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:20:01.136558364Z [2024-03-29 00:20:01,128: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:20:01.237555982Z [2024-03-29 00:20:01,237: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:01.357755853Z [2024-03-29 00:20:01,357: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:02.104983510Z [2024-03-29 00:20:02,104: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7077cde-3f4d-411d-a066-f9b79644eff2] succeeded in 1.7254139980000218s: None 2024-03-29T00:20:02.280759199Z [2024-03-29 00:20:02,280: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1119d20-3769-4907-ab24-34d106142698] succeeded in 1.901752708999993s: None 2024-03-29T00:20:02.658865813Z [2024-03-29 00:20:02,658: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:20:02.662957641Z [2024-03-29 00:20:02,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:02.689655168Z [2024-03-29 00:20:02,689: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:20:02.690968055Z [2024-03-29 00:20:02,690: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:02.690993165Z [2024-03-29 00:20:02,690: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:02.691192628Z [2024-03-29 00:20:02,690: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:02.691243284Z [2024-03-29 00:20:02,691: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:20:02.691587328Z [2024-03-29 00:20:02,691: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:20:02.691640661Z [2024-03-29 00:20:02,691: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:02.783537973Z [2024-03-29 00:20:02,783: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T00:20:02.787138296Z [2024-03-29 00:20:02,786: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:02.811444715Z [2024-03-29 00:20:02,811: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T00:20:02.812909688Z [2024-03-29 00:20:02,812: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:02.812924367Z [2024-03-29 00:20:02,812: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:02.813092557Z [2024-03-29 00:20:02,812: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:02.813150505Z [2024-03-29 00:20:02,813: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T00:20:02.813508896Z [2024-03-29 00:20:02,813: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:20:02.813518611Z [2024-03-29 00:20:02,813: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:02.833183523Z [2024-03-29 00:20:02,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:02.916200102Z [2024-03-29 00:20:02,915: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:03.023867302Z [2024-03-29 00:20:03,023: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:20:03.027340637Z [2024-03-29 00:20:03,026: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:03.046694739Z [2024-03-29 00:20:03,046: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:20:03.048338732Z [2024-03-29 00:20:03,048: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:03.048542275Z [2024-03-29 00:20:03,048: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:03.048842323Z [2024-03-29 00:20:03,048: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:03.049025458Z [2024-03-29 00:20:03,048: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:20:03.049459000Z [2024-03-29 00:20:03,049: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:20:03.049652753Z [2024-03-29 00:20:03,049: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:03.178411523Z [2024-03-29 00:20:03,177: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:03.619701883Z [2024-03-29 00:20:03,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff43e355-3d55-4e2f-b4e2-66d8e260b8b2] succeeded in 3.2484489379999104s: None 2024-03-29T00:20:04.586327849Z [2024-03-29 00:20:04,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d11f93d-aae8-43b9-88ae-9d5461c5e811] received 2024-03-29T00:20:04.593950879Z [2024-03-29 00:20:04,593: INFO/ForkPoolWorker-15] [4d11f93d-aae8-43b9-88ae-9d5461c5e811] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:04.772297692Z [2024-03-29 00:20:04,771: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dec776ca-d4d6-4aa3-9960-98c7cdfdd115] succeeded in 4.388977070999772s: None 2024-03-29T00:20:04.916627433Z [2024-03-29 00:20:04,915: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e8738fe0-e2be-4675-a05e-8da118a0eb46] succeeded in 4.527712502000213s: None 2024-03-29T00:20:04.945733433Z [2024-03-29 00:20:04,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:20:06.394044966Z [2024-03-29 00:20:06,393: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:20:06.398007073Z [2024-03-29 00:20:06,397: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:06.444491419Z [2024-03-29 00:20:06,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:20:06.446495054Z [2024-03-29 00:20:06,446: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:06.446671052Z [2024-03-29 00:20:06,446: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:06.446909884Z [2024-03-29 00:20:06,446: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:06.447057789Z [2024-03-29 00:20:06,446: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:20:06.447413956Z [2024-03-29 00:20:06,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:20:06.447580656Z [2024-03-29 00:20:06,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:06.557468577Z [2024-03-29 00:20:06,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:07.496084294Z [2024-03-29 00:20:07,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d11f93d-aae8-43b9-88ae-9d5461c5e811] succeeded in 2.9073552710001422s: None 2024-03-29T00:20:08.430598854Z [2024-03-29 00:20:08,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91b13d33-4aac-4277-9bdf-504e49f81b4b] received 2024-03-29T00:20:08.446755395Z [2024-03-29 00:20:08,446: INFO/ForkPoolWorker-15] [91b13d33-4aac-4277-9bdf-504e49f81b4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:20:08.715157769Z [2024-03-29 00:20:08,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:20:09.879090488Z [2024-03-29 00:20:09,878: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:20:09.882845155Z [2024-03-29 00:20:09,882: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:09.905125505Z [2024-03-29 00:20:09,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:20:09.906722403Z [2024-03-29 00:20:09,906: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:09.906816334Z [2024-03-29 00:20:09,906: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:09.907052315Z [2024-03-29 00:20:09,906: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:09.907098468Z [2024-03-29 00:20:09,906: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:20:09.907582005Z [2024-03-29 00:20:09,907: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:20:09.907848447Z [2024-03-29 00:20:09,907: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:09.992533259Z [2024-03-29 00:20:09,992: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:10.620706094Z [2024-03-29 00:20:10,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91b13d33-4aac-4277-9bdf-504e49f81b4b] succeeded in 2.185431296999923s: None 2024-03-29T00:20:11.199271496Z [2024-03-29 00:20:11,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6712f21-93ec-4d54-b468-564e6559cc5b] received 2024-03-29T00:20:11.212322099Z [2024-03-29 00:20:11,211: INFO/ForkPoolWorker-15] [b6712f21-93ec-4d54-b468-564e6559cc5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:11.523870844Z [2024-03-29 00:20:11,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:20:12.692554110Z [2024-03-29 00:20:12,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:20:12.696222255Z [2024-03-29 00:20:12,695: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:20:12.716092143Z [2024-03-29 00:20:12,715: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:20:12.717848572Z [2024-03-29 00:20:12,717: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:20:12.717877114Z [2024-03-29 00:20:12,717: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:20:12.718137744Z [2024-03-29 00:20:12,717: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:20:12.718341849Z [2024-03-29 00:20:12,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:20:12.718783708Z [2024-03-29 00:20:12,718: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:20:12.718835137Z [2024-03-29 00:20:12,718: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:20:12.803346962Z [2024-03-29 00:20:12,803: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:20:13.379724744Z [2024-03-29 00:20:13,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6712f21-93ec-4d54-b468-564e6559cc5b] succeeded in 2.1780341610001415s: None 2024-03-29T00:21:00.621750146Z [2024-03-29 00:21:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[243ecb8b-ab0b-4610-acb7-f68020bf9077] received 2024-03-29T00:21:00.624814056Z [2024-03-29 00:21:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7ea6bd7-ae80-4d1b-9fac-8789962eebb4] received 2024-03-29T00:21:00.627061509Z [2024-03-29 00:21:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81090012-0c54-40f3-b302-414aea607d88] received 2024-03-29T00:21:00.636608489Z [2024-03-29 00:21:00,636: INFO/ForkPoolWorker-1] [81090012-0c54-40f3-b302-414aea607d88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:21:00.636814036Z [2024-03-29 00:21:00,636: INFO/ForkPoolWorker-15] [243ecb8b-ab0b-4610-acb7-f68020bf9077] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:21:00.636831016Z [2024-03-29 00:21:00,635: INFO/ForkPoolWorker-16] [f7ea6bd7-ae80-4d1b-9fac-8789962eebb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:21:00.974292831Z [2024-03-29 00:21:00,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:21:01.047827487Z [2024-03-29 00:21:01,042: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:21:01.071508769Z [2024-03-29 00:21:01,067: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:21:01.241715963Z [2024-03-29 00:21:01,241: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:21:01.246829439Z [2024-03-29 00:21:01,246: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:21:01.274374743Z [2024-03-29 00:21:01,274: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:21:01.275665714Z [2024-03-29 00:21:01,275: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:21:01.275866557Z [2024-03-29 00:21:01,275: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:21:01.275888376Z [2024-03-29 00:21:01,275: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:21:01.276212406Z [2024-03-29 00:21:01,276: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:21:01.383503942Z [2024-03-29 00:21:01,383: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:21:02.110304166Z [2024-03-29 00:21:02,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81090012-0c54-40f3-b302-414aea607d88] succeeded in 1.4808330410000963s: None 2024-03-29T00:21:02.357783361Z [2024-03-29 00:21:02,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:21:02.361790196Z [2024-03-29 00:21:02,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:21:02.395077391Z [2024-03-29 00:21:02,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:21:02.396760674Z [2024-03-29 00:21:02,396: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:21:02.396956353Z [2024-03-29 00:21:02,396: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:21:02.397230132Z [2024-03-29 00:21:02,396: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:21:02.397401908Z [2024-03-29 00:21:02,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:21:02.397822183Z [2024-03-29 00:21:02,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:21:02.398042271Z [2024-03-29 00:21:02,397: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:21:02.487054838Z [2024-03-29 00:21:02,486: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:21:02.517699659Z [2024-03-29 00:21:02,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:21:02.521652491Z [2024-03-29 00:21:02,521: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:21:02.544400712Z [2024-03-29 00:21:02,543: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:21:02.546647238Z [2024-03-29 00:21:02,546: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:21:02.546719420Z [2024-03-29 00:21:02,546: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:21:02.546892780Z [2024-03-29 00:21:02,546: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:21:02.546984318Z [2024-03-29 00:21:02,546: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:21:02.547370671Z [2024-03-29 00:21:02,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:21:02.547449951Z [2024-03-29 00:21:02,547: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:21:02.652301410Z [2024-03-29 00:21:02,651: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:21:04.016215345Z [2024-03-29 00:21:04,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[243ecb8b-ab0b-4610-acb7-f68020bf9077] succeeded in 3.3920533549999163s: None 2024-03-29T00:21:04.841933934Z [2024-03-29 00:21:04,841: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7ea6bd7-ae80-4d1b-9fac-8789962eebb4] succeeded in 4.213001783999971s: None 2024-03-29T00:22:01.178024563Z [2024-03-29 00:22:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13dbab21-ac46-47c1-9d32-19de3070d411] received 2024-03-29T00:22:01.184744585Z [2024-03-29 00:22:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3f81a03-02d1-4fc8-b112-706ce8df0335] received 2024-03-29T00:22:01.187260963Z [2024-03-29 00:22:01,186: INFO/ForkPoolWorker-15] [13dbab21-ac46-47c1-9d32-19de3070d411] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:22:01.188812787Z [2024-03-29 00:22:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddff83d8-2486-4fee-bfad-5058baabcb92] received 2024-03-29T00:22:01.191190798Z [2024-03-29 00:22:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad21964-3dfe-418b-bde6-732172ef4e0d] received 2024-03-29T00:22:01.191932749Z [2024-03-29 00:22:01,191: INFO/ForkPoolWorker-16] [d3f81a03-02d1-4fc8-b112-706ce8df0335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:22:01.199042578Z [2024-03-29 00:22:01,198: INFO/ForkPoolWorker-1] [ddff83d8-2486-4fee-bfad-5058baabcb92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:22:01.200476530Z [2024-03-29 00:22:01,200: INFO/ForkPoolWorker-2] [5ad21964-3dfe-418b-bde6-732172ef4e0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:22:01.645352583Z [2024-03-29 00:22:01,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:22:01.734712776Z [2024-03-29 00:22:01,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:22:01.815546884Z [2024-03-29 00:22:01,809: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:22:01.815598175Z [2024-03-29 00:22:01,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:22:02.003074418Z [2024-03-29 00:22:01,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:22:02.104116393Z [2024-03-29 00:22:02,103: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:22:02.108575881Z [2024-03-29 00:22:02,107: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:22:02.151655621Z [2024-03-29 00:22:02,150: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:22:02.153347935Z [2024-03-29 00:22:02,153: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:22:02.153509632Z [2024-03-29 00:22:02,153: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:22:02.153640121Z [2024-03-29 00:22:02,153: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:22:02.153989014Z [2024-03-29 00:22:02,153: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:22:02.319014295Z [2024-03-29 00:22:02,318: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:22:02.796294705Z [2024-03-29 00:22:02,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13dbab21-ac46-47c1-9d32-19de3070d411] succeeded in 1.6154813839998496s: None 2024-03-29T00:22:03.153735117Z [2024-03-29 00:22:03,153: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5ad21964-3dfe-418b-bde6-732172ef4e0d] succeeded in 1.9606146529999933s: None 2024-03-29T00:22:03.466160074Z [2024-03-29 00:22:03,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:22:03.469670630Z [2024-03-29 00:22:03,469: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:22:03.489661486Z [2024-03-29 00:22:03,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:22:03.491064113Z [2024-03-29 00:22:03,490: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:22:03.491080141Z [2024-03-29 00:22:03,490: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:22:03.491267044Z [2024-03-29 00:22:03,491: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:22:03.491277855Z [2024-03-29 00:22:03,491: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:22:03.491580995Z [2024-03-29 00:22:03,491: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:22:03.491598243Z [2024-03-29 00:22:03,491: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:22:03.601134771Z [2024-03-29 00:22:03,600: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:22:03.632912438Z [2024-03-29 00:22:03,632: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:22:03.636749972Z [2024-03-29 00:22:03,636: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:22:03.714626935Z [2024-03-29 00:22:03,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:22:03.716037042Z [2024-03-29 00:22:03,715: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:22:03.716136798Z [2024-03-29 00:22:03,716: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:22:03.716314164Z [2024-03-29 00:22:03,716: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:22:03.716363796Z [2024-03-29 00:22:03,716: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:22:03.716713716Z [2024-03-29 00:22:03,716: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:22:03.716823364Z [2024-03-29 00:22:03,716: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:22:03.838153719Z [2024-03-29 00:22:03,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:22:05.881731439Z [2024-03-29 00:22:05,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d3f81a03-02d1-4fc8-b112-706ce8df0335] succeeded in 4.694858872999703s: None 2024-03-29T00:22:06.065505780Z [2024-03-29 00:22:06,065: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ddff83d8-2486-4fee-bfad-5058baabcb92] succeeded in 4.873395399999936s: None 2024-03-29T00:23:00.216406023Z [2024-03-29 00:23:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43b5a1b0-23bf-4c1a-9452-330a1ae5946f] received 2024-03-29T00:23:00.220102758Z [2024-03-29 00:23:00,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35fe3364-4c42-47e4-b271-52dd622b69bf] received 2024-03-29T00:23:00.227038048Z [2024-03-29 00:23:00,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d713193-11e4-4442-9a7b-9185ab2d70f6] received 2024-03-29T00:23:00.227057467Z [2024-03-29 00:23:00,226: INFO/ForkPoolWorker-15] [43b5a1b0-23bf-4c1a-9452-330a1ae5946f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:23:00.231740355Z [2024-03-29 00:23:00,231: INFO/ForkPoolWorker-16] [35fe3364-4c42-47e4-b271-52dd622b69bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:23:00.235260575Z [2024-03-29 00:23:00,235: INFO/ForkPoolWorker-1] [6d713193-11e4-4442-9a7b-9185ab2d70f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:23:00.538269472Z [2024-03-29 00:23:00,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:23:00.550373618Z [2024-03-29 00:23:00,547: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:23:00.557909534Z [2024-03-29 00:23:00,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:23:00.715606317Z [2024-03-29 00:23:00,715: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:23:00.719902033Z [2024-03-29 00:23:00,719: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:23:00.770351902Z [2024-03-29 00:23:00,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:23:00.775849654Z [2024-03-29 00:23:00,775: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:23:00.776161561Z [2024-03-29 00:23:00,775: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:23:00.776285547Z [2024-03-29 00:23:00,776: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:23:00.776582706Z [2024-03-29 00:23:00,776: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:23:00.936268471Z [2024-03-29 00:23:00,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:23:01.660121216Z [2024-03-29 00:23:01,651: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d713193-11e4-4442-9a7b-9185ab2d70f6] succeeded in 1.4224498630001108s: None 2024-03-29T00:23:01.873326111Z [2024-03-29 00:23:01,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:23:01.877452678Z [2024-03-29 00:23:01,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:23:01.903679596Z [2024-03-29 00:23:01,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:23:01.909019253Z [2024-03-29 00:23:01,908: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:23:01.909063975Z [2024-03-29 00:23:01,908: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:23:01.909263627Z [2024-03-29 00:23:01,909: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:23:01.909309936Z [2024-03-29 00:23:01,909: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:23:01.911057770Z [2024-03-29 00:23:01,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:23:01.911080748Z [2024-03-29 00:23:01,910: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:23:02.034975500Z [2024-03-29 00:23:02,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:23:02.136209295Z [2024-03-29 00:23:02,135: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:23:02.140156033Z [2024-03-29 00:23:02,139: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:23:02.167870126Z [2024-03-29 00:23:02,167: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:23:02.169216140Z [2024-03-29 00:23:02,168: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:23:02.169235895Z [2024-03-29 00:23:02,169: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:23:02.169381277Z [2024-03-29 00:23:02,169: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:23:02.169414085Z [2024-03-29 00:23:02,169: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:23:02.169726166Z [2024-03-29 00:23:02,169: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:23:02.169736519Z [2024-03-29 00:23:02,169: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:23:02.285735131Z [2024-03-29 00:23:02,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:23:03.780149856Z [2024-03-29 00:23:03,779: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35fe3364-4c42-47e4-b271-52dd622b69bf] succeeded in 3.557943251999859s: None 2024-03-29T00:23:03.850576167Z [2024-03-29 00:23:03,848: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43b5a1b0-23bf-4c1a-9452-330a1ae5946f] succeeded in 3.6301819140003317s: None 2024-03-29T00:24:01.091598227Z [2024-03-29 00:24:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[202c837e-4951-43ff-8712-6a9a9e982ac2] received 2024-03-29T00:24:01.099306387Z [2024-03-29 00:24:01,098: INFO/ForkPoolWorker-15] [202c837e-4951-43ff-8712-6a9a9e982ac2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:24:01.100133723Z [2024-03-29 00:24:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b28eec5-2af2-4ca7-887f-a7e38eb3a943] received 2024-03-29T00:24:01.103391412Z [2024-03-29 00:24:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc18e4f-7291-401d-805c-8a9c4f03c719] received 2024-03-29T00:24:01.107649893Z [2024-03-29 00:24:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ff68f2d-f280-4fc6-8963-246fa482653a] received 2024-03-29T00:24:01.114708086Z [2024-03-29 00:24:01,114: INFO/ForkPoolWorker-16] [1b28eec5-2af2-4ca7-887f-a7e38eb3a943] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:24:01.126297883Z [2024-03-29 00:24:01,125: INFO/ForkPoolWorker-2] [6ff68f2d-f280-4fc6-8963-246fa482653a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:24:01.127116215Z [2024-03-29 00:24:01,126: INFO/ForkPoolWorker-1] [5dc18e4f-7291-401d-805c-8a9c4f03c719] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:24:01.438841319Z [2024-03-29 00:24:01,423: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:24:01.605648573Z [2024-03-29 00:24:01,601: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:24:01.686204723Z [2024-03-29 00:24:01,681: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:24:01.784280725Z [2024-03-29 00:24:01,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:24:01.834515996Z [2024-03-29 00:24:01,833: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:24:01.839181612Z [2024-03-29 00:24:01,838: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:24:01.874795226Z [2024-03-29 00:24:01,874: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:24:01.876477880Z [2024-03-29 00:24:01,876: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:24:01.876655302Z [2024-03-29 00:24:01,876: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:24:01.876754477Z [2024-03-29 00:24:01,876: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:24:01.877058247Z [2024-03-29 00:24:01,876: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:24:01.907840694Z [2024-03-29 00:24:01,907: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:24:02.021590512Z [2024-03-29 00:24:02,021: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:24:02.684715388Z [2024-03-29 00:24:02,684: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b28eec5-2af2-4ca7-887f-a7e38eb3a943] succeeded in 1.5826749139996537s: None 2024-03-29T00:24:02.842386101Z [2024-03-29 00:24:02,841: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ff68f2d-f280-4fc6-8963-246fa482653a] succeeded in 1.732755447999807s: None 2024-03-29T00:24:03.155604817Z [2024-03-29 00:24:03,155: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:24:03.159422933Z [2024-03-29 00:24:03,158: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:24:03.182517339Z [2024-03-29 00:24:03,182: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:24:03.184421313Z [2024-03-29 00:24:03,184: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:24:03.184549941Z [2024-03-29 00:24:03,184: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:24:03.184707247Z [2024-03-29 00:24:03,184: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:24:03.184811893Z [2024-03-29 00:24:03,184: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:24:03.185089170Z [2024-03-29 00:24:03,184: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:24:03.185197825Z [2024-03-29 00:24:03,185: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:24:03.269387146Z [2024-03-29 00:24:03,269: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:24:03.348743768Z [2024-03-29 00:24:03,348: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:24:03.352606975Z [2024-03-29 00:24:03,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:24:03.379163754Z [2024-03-29 00:24:03,378: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:24:03.380663461Z [2024-03-29 00:24:03,380: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:24:03.380800458Z [2024-03-29 00:24:03,380: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:24:03.381068666Z [2024-03-29 00:24:03,380: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:24:03.381096544Z [2024-03-29 00:24:03,380: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:24:03.381433209Z [2024-03-29 00:24:03,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:24:03.381511212Z [2024-03-29 00:24:03,381: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:24:03.477193271Z [2024-03-29 00:24:03,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:24:05.287651047Z [2024-03-29 00:24:05,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5dc18e4f-7291-401d-805c-8a9c4f03c719] succeeded in 4.182438583000021s: None 2024-03-29T00:24:05.298312710Z [2024-03-29 00:24:05,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[202c837e-4951-43ff-8712-6a9a9e982ac2] succeeded in 4.20525360099964s: None 2024-03-29T00:25:00.295569395Z [2024-03-29 00:25:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bae9673b-1428-4662-94eb-af2ba18c0945] received 2024-03-29T00:25:00.299770254Z [2024-03-29 00:25:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0577f9b8-8ef6-4c5a-954b-670ee586b009] received 2024-03-29T00:25:00.313499424Z [2024-03-29 00:25:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b724f17-2365-49d1-9a37-24918210ad7f] received 2024-03-29T00:25:00.314311757Z [2024-03-29 00:25:00,313: INFO/ForkPoolWorker-15] [bae9673b-1428-4662-94eb-af2ba18c0945] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:25:00.316082950Z [2024-03-29 00:25:00,315: INFO/ForkPoolWorker-16] [0577f9b8-8ef6-4c5a-954b-670ee586b009] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:25:00.332660665Z [2024-03-29 00:25:00,332: INFO/ForkPoolWorker-1] [1b724f17-2365-49d1-9a37-24918210ad7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:00.339780185Z [2024-03-29 00:25:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55826afb-a005-47f4-8102-2d0978b260f9] received 2024-03-29T00:25:00.361086736Z [2024-03-29 00:25:00,360: INFO/ForkPoolWorker-2] [55826afb-a005-47f4-8102-2d0978b260f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:25:00.690711241Z [2024-03-29 00:25:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:25:00.743535254Z [2024-03-29 00:25:00,740: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:25:00.940729894Z [2024-03-29 00:25:00,937: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:25:00.963914318Z [2024-03-29 00:25:00,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:25:01.137901475Z [2024-03-29 00:25:01,137: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:25:01.142409132Z [2024-03-29 00:25:01,141: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:01.187711327Z [2024-03-29 00:25:01,187: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:25:01.191482160Z [2024-03-29 00:25:01,191: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:25:01.191717688Z [2024-03-29 00:25:01,191: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:25:01.191856714Z [2024-03-29 00:25:01,191: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:25:01.192160553Z [2024-03-29 00:25:01,192: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:25:01.309435303Z [2024-03-29 00:25:01,309: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:02.006066971Z [2024-03-29 00:25:02,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[55826afb-a005-47f4-8102-2d0978b260f9] succeeded in 1.6640613949998624s: None 2024-03-29T00:25:02.156945509Z [2024-03-29 00:25:02,156: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:25:02.161083458Z [2024-03-29 00:25:02,160: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:02.189023358Z [2024-03-29 00:25:02,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:25:02.190679100Z [2024-03-29 00:25:02,190: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:02.190829883Z [2024-03-29 00:25:02,190: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:02.190971785Z [2024-03-29 00:25:02,190: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:02.191070498Z [2024-03-29 00:25:02,190: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:25:02.191449003Z [2024-03-29 00:25:02,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:25:02.191645879Z [2024-03-29 00:25:02,191: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:02.192099164Z [2024-03-29 00:25:02,191: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:25:02.195886284Z [2024-03-29 00:25:02,195: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:02.223577617Z [2024-03-29 00:25:02,223: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:25:02.225099158Z [2024-03-29 00:25:02,224: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:02.225112053Z [2024-03-29 00:25:02,225: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:02.225278695Z [2024-03-29 00:25:02,225: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:02.225304186Z [2024-03-29 00:25:02,225: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:25:02.225622784Z [2024-03-29 00:25:02,225: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:25:02.225643327Z [2024-03-29 00:25:02,225: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:02.322136189Z [2024-03-29 00:25:02,321: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:02.351402688Z [2024-03-29 00:25:02,351: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:02.606767826Z [2024-03-29 00:25:02,606: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:25:02.612190584Z [2024-03-29 00:25:02,610: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:02.636757253Z [2024-03-29 00:25:02,636: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:25:02.638375032Z [2024-03-29 00:25:02,638: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:02.638560010Z [2024-03-29 00:25:02,638: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:02.638754779Z [2024-03-29 00:25:02,638: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:02.638786174Z [2024-03-29 00:25:02,638: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:25:02.639118971Z [2024-03-29 00:25:02,638: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:25:02.639650237Z [2024-03-29 00:25:02,639: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:02.773092477Z [2024-03-29 00:25:02,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:03.218658895Z [2024-03-29 00:25:03,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b724f17-2365-49d1-9a37-24918210ad7f] succeeded in 2.8995501700001114s: None 2024-03-29T00:25:03.597270825Z [2024-03-29 00:25:03,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45c677df-25f8-459c-8f61-92a936b9067d] received 2024-03-29T00:25:03.606420698Z [2024-03-29 00:25:03,606: INFO/ForkPoolWorker-1] [45c677df-25f8-459c-8f61-92a936b9067d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:03.957757248Z [2024-03-29 00:25:03,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:25:04.150342583Z [2024-03-29 00:25:04,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0577f9b8-8ef6-4c5a-954b-670ee586b009] succeeded in 3.848869638999986s: None 2024-03-29T00:25:04.776804506Z [2024-03-29 00:25:04,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bae9673b-1428-4662-94eb-af2ba18c0945] succeeded in 4.474215272000038s: None 2024-03-29T00:25:05.456241847Z [2024-03-29 00:25:05,455: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:25:05.464222579Z [2024-03-29 00:25:05,463: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:05.488483329Z [2024-03-29 00:25:05,488: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:25:05.489934659Z [2024-03-29 00:25:05,489: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:05.490012245Z [2024-03-29 00:25:05,489: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:05.490188849Z [2024-03-29 00:25:05,489: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:05.490270185Z [2024-03-29 00:25:05,490: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:25:05.490651733Z [2024-03-29 00:25:05,490: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:25:05.490711377Z [2024-03-29 00:25:05,490: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:05.602122118Z [2024-03-29 00:25:05,601: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:06.533797964Z [2024-03-29 00:25:06,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45c677df-25f8-459c-8f61-92a936b9067d] succeeded in 2.9329330599998684s: None 2024-03-29T00:25:07.218382317Z [2024-03-29 00:25:07,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fc6953f-8599-4017-aca9-bbfe43eb87d6] received 2024-03-29T00:25:07.255158517Z [2024-03-29 00:25:07,253: INFO/ForkPoolWorker-15] [8fc6953f-8599-4017-aca9-bbfe43eb87d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:25:07.702195809Z [2024-03-29 00:25:07,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:25:09.102616510Z [2024-03-29 00:25:09,101: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:25:09.106268495Z [2024-03-29 00:25:09,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:09.128159574Z [2024-03-29 00:25:09,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:25:09.129981851Z [2024-03-29 00:25:09,129: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:09.130150930Z [2024-03-29 00:25:09,129: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:09.130393336Z [2024-03-29 00:25:09,130: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:09.130688055Z [2024-03-29 00:25:09,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:25:09.131130101Z [2024-03-29 00:25:09,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:25:09.131334223Z [2024-03-29 00:25:09,131: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:09.228644003Z [2024-03-29 00:25:09,228: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:09.841224136Z [2024-03-29 00:25:09,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fc6953f-8599-4017-aca9-bbfe43eb87d6] succeeded in 2.614825061999909s: None 2024-03-29T00:25:10.799648930Z [2024-03-29 00:25:10,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e620ca-3198-448d-a1b7-2c5d756b2e27] received 2024-03-29T00:25:10.812865287Z [2024-03-29 00:25:10,811: INFO/ForkPoolWorker-15] [22e620ca-3198-448d-a1b7-2c5d756b2e27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:11.107758173Z [2024-03-29 00:25:11,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:25:12.368268666Z [2024-03-29 00:25:12,367: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:25:12.371986199Z [2024-03-29 00:25:12,371: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:25:12.398679261Z [2024-03-29 00:25:12,398: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:25:12.400394869Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:25:12.400429990Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:25:12.400610535Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:25:12.400633844Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:25:12.401056875Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:25:12.401061899Z [2024-03-29 00:25:12,400: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:25:12.494056677Z [2024-03-29 00:25:12,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:25:13.130153064Z [2024-03-29 00:25:13,129: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22e620ca-3198-448d-a1b7-2c5d756b2e27] succeeded in 2.3276137789998756s: None 2024-03-29T00:26:00.567396079Z [2024-03-29 00:26:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fcae1b3-c72c-4348-b32f-421dfb58d92c] received 2024-03-29T00:26:00.570008331Z [2024-03-29 00:26:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b7bc345-4da6-4ed4-b415-2c0fd2d6f8a6] received 2024-03-29T00:26:00.577654791Z [2024-03-29 00:26:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99b7c5d-6fcb-4fee-884c-fb9017d62c13] received 2024-03-29T00:26:00.578174225Z [2024-03-29 00:26:00,577: INFO/ForkPoolWorker-16] [5b7bc345-4da6-4ed4-b415-2c0fd2d6f8a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:26:00.579392979Z [2024-03-29 00:26:00,578: INFO/ForkPoolWorker-15] [5fcae1b3-c72c-4348-b32f-421dfb58d92c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:26:00.591977579Z [2024-03-29 00:26:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2cbd34d-2110-4b3b-a498-60248f505114] received 2024-03-29T00:26:00.602979080Z [2024-03-29 00:26:00,602: INFO/ForkPoolWorker-1] [c99b7c5d-6fcb-4fee-884c-fb9017d62c13] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:26:00.608127977Z [2024-03-29 00:26:00,607: INFO/ForkPoolWorker-2] [d2cbd34d-2110-4b3b-a498-60248f505114] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:26:01.015077105Z [2024-03-29 00:26:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:26:01.017223623Z [2024-03-29 00:26:01,013: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:26:01.075474853Z [2024-03-29 00:26:01,071: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:26:01.098174244Z [2024-03-29 00:26:01,094: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:26:01.234619962Z [2024-03-29 00:26:01,234: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:26:01.242993306Z [2024-03-29 00:26:01,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:26:01.330586468Z [2024-03-29 00:26:01,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:26:01.333766701Z [2024-03-29 00:26:01,332: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:26:01.334670707Z [2024-03-29 00:26:01,333: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:26:01.337523607Z [2024-03-29 00:26:01,334: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:26:01.337543696Z [2024-03-29 00:26:01,335: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:26:01.486943779Z [2024-03-29 00:26:01,486: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:26:01.629294994Z [2024-03-29 00:26:01,628: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:26:02.671969717Z [2024-03-29 00:26:02,671: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fcae1b3-c72c-4348-b32f-421dfb58d92c] succeeded in 2.100097847000143s: None 2024-03-29T00:26:02.739646797Z [2024-03-29 00:26:02,739: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c99b7c5d-6fcb-4fee-884c-fb9017d62c13] succeeded in 2.152237036000315s: None 2024-03-29T00:26:03.743340155Z [2024-03-29 00:26:03,742: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:26:03.747357934Z [2024-03-29 00:26:03,746: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:26:03.770423497Z [2024-03-29 00:26:03,770: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:26:03.772936739Z [2024-03-29 00:26:03,772: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:26:03.773180246Z [2024-03-29 00:26:03,772: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:26:03.773532557Z [2024-03-29 00:26:03,773: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:26:03.773727874Z [2024-03-29 00:26:03,773: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:26:03.774220866Z [2024-03-29 00:26:03,773: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:26:03.774416013Z [2024-03-29 00:26:03,774: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:26:03.820678470Z [2024-03-29 00:26:03,820: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:26:03.828004183Z [2024-03-29 00:26:03,826: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:26:03.859278644Z [2024-03-29 00:26:03,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:26:03.862179653Z [2024-03-29 00:26:03,861: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:26:03.862766634Z [2024-03-29 00:26:03,862: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:26:03.862936915Z [2024-03-29 00:26:03,862: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:26:03.863502606Z [2024-03-29 00:26:03,863: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:26:03.863917134Z [2024-03-29 00:26:03,863: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:26:03.864156091Z [2024-03-29 00:26:03,864: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:26:03.945600930Z [2024-03-29 00:26:03,945: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:26:04.026913557Z [2024-03-29 00:26:04,026: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:26:06.787270620Z [2024-03-29 00:26:06,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b7bc345-4da6-4ed4-b415-2c0fd2d6f8a6] succeeded in 6.2157369749998s: None 2024-03-29T00:26:07.210541595Z [2024-03-29 00:26:07,209: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d2cbd34d-2110-4b3b-a498-60248f505114] succeeded in 6.615011959000185s: None 2024-03-29T00:27:00.357021454Z [2024-03-29 00:27:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbfb630d-c6c6-428a-9ee4-fa34d5c6b444] received 2024-03-29T00:27:00.364800453Z [2024-03-29 00:27:00,364: INFO/ForkPoolWorker-15] [bbfb630d-c6c6-428a-9ee4-fa34d5c6b444] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:27:00.368416582Z [2024-03-29 00:27:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1276ec3f-6d17-4553-afa7-305d5f066b60] received 2024-03-29T00:27:00.379532971Z [2024-03-29 00:27:00,379: INFO/ForkPoolWorker-16] [1276ec3f-6d17-4553-afa7-305d5f066b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:27:00.385266891Z [2024-03-29 00:27:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad8c3701-2e61-4ecd-9989-a931d1975fc5] received 2024-03-29T00:27:00.403426695Z [2024-03-29 00:27:00,403: INFO/ForkPoolWorker-1] [ad8c3701-2e61-4ecd-9989-a931d1975fc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:27:00.688898059Z [2024-03-29 00:27:00,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:27:00.709708607Z [2024-03-29 00:27:00,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:27:00.816944389Z [2024-03-29 00:27:00,813: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:27:00.920578518Z [2024-03-29 00:27:00,920: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:27:00.924896407Z [2024-03-29 00:27:00,924: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:27:00.963862002Z [2024-03-29 00:27:00,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:27:00.967043683Z [2024-03-29 00:27:00,966: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:27:00.967201755Z [2024-03-29 00:27:00,966: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:27:00.967266181Z [2024-03-29 00:27:00,967: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:27:00.967522853Z [2024-03-29 00:27:00,967: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:27:01.205488854Z [2024-03-29 00:27:01,205: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:27:01.826562267Z [2024-03-29 00:27:01,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbfb630d-c6c6-428a-9ee4-fa34d5c6b444] succeeded in 1.4673114189999978s: None 2024-03-29T00:27:01.953204155Z [2024-03-29 00:27:01,952: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:27:01.956839372Z [2024-03-29 00:27:01,956: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:27:01.986585578Z [2024-03-29 00:27:01,986: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:27:01.988301006Z [2024-03-29 00:27:01,987: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:27:01.988320355Z [2024-03-29 00:27:01,988: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:27:01.988448561Z [2024-03-29 00:27:01,988: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:27:01.988465400Z [2024-03-29 00:27:01,988: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:27:01.988738294Z [2024-03-29 00:27:01,988: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:27:01.988754771Z [2024-03-29 00:27:01,988: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:27:02.084220548Z [2024-03-29 00:27:02,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:27:02.286745368Z [2024-03-29 00:27:02,286: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:27:02.290228918Z [2024-03-29 00:27:02,289: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:27:02.330412826Z [2024-03-29 00:27:02,330: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:27:02.332636289Z [2024-03-29 00:27:02,332: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:27:02.332854017Z [2024-03-29 00:27:02,332: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:27:02.333137236Z [2024-03-29 00:27:02,332: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:27:02.333345085Z [2024-03-29 00:27:02,333: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:27:02.334013376Z [2024-03-29 00:27:02,333: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:27:02.334435212Z [2024-03-29 00:27:02,334: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:27:02.460390210Z [2024-03-29 00:27:02,460: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:27:03.611585080Z [2024-03-29 00:27:03,610: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1276ec3f-6d17-4553-afa7-305d5f066b60] succeeded in 3.2402943919996687s: None 2024-03-29T00:27:04.383911148Z [2024-03-29 00:27:04,383: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad8c3701-2e61-4ecd-9989-a931d1975fc5] succeeded in 3.9957288969999354s: None 2024-03-29T00:28:01.289765298Z [2024-03-29 00:28:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccadbb48-6287-4956-9b93-c9d753bbf767] received 2024-03-29T00:28:01.293587089Z [2024-03-29 00:28:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81be4ba6-9746-4f86-9fc5-1d5e46449f5f] received 2024-03-29T00:28:01.299130960Z [2024-03-29 00:28:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91870630-21d6-45e5-a9c8-be9935c7ce2e] received 2024-03-29T00:28:01.302157420Z [2024-03-29 00:28:01,301: INFO/ForkPoolWorker-16] [81be4ba6-9746-4f86-9fc5-1d5e46449f5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:28:01.303589786Z [2024-03-29 00:28:01,303: INFO/ForkPoolWorker-15] [ccadbb48-6287-4956-9b93-c9d753bbf767] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:28:01.310343041Z [2024-03-29 00:28:01,309: INFO/ForkPoolWorker-1] [91870630-21d6-45e5-a9c8-be9935c7ce2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:28:01.310789864Z [2024-03-29 00:28:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff0976b3-cef9-4e89-bea7-dcbf229bf993] received 2024-03-29T00:28:01.322920185Z [2024-03-29 00:28:01,322: INFO/ForkPoolWorker-2] [ff0976b3-cef9-4e89-bea7-dcbf229bf993] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:28:01.709166108Z [2024-03-29 00:28:01,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:28:01.743049235Z [2024-03-29 00:28:01,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:28:01.865684306Z [2024-03-29 00:28:01,855: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:28:01.876491729Z [2024-03-29 00:28:01,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:28:01.999593694Z [2024-03-29 00:28:01,999: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:28:02.155634090Z [2024-03-29 00:28:02,155: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:28:02.160455703Z [2024-03-29 00:28:02,159: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:28:02.211160724Z [2024-03-29 00:28:02,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:28:02.213776875Z [2024-03-29 00:28:02,213: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:28:02.214056634Z [2024-03-29 00:28:02,213: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:28:02.214176874Z [2024-03-29 00:28:02,213: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:28:02.214877924Z [2024-03-29 00:28:02,214: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:28:02.405806802Z [2024-03-29 00:28:02,405: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:28:02.713145189Z [2024-03-29 00:28:02,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ccadbb48-6287-4956-9b93-c9d753bbf767] succeeded in 1.4165692890001083s: None 2024-03-29T00:28:03.311581380Z [2024-03-29 00:28:03,311: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91870630-21d6-45e5-a9c8-be9935c7ce2e] succeeded in 2.0102054999997563s: None 2024-03-29T00:28:03.357751799Z [2024-03-29 00:28:03,357: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:28:03.362430714Z [2024-03-29 00:28:03,361: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:28:03.389328252Z [2024-03-29 00:28:03,388: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:28:03.391622334Z [2024-03-29 00:28:03,391: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:28:03.391707189Z [2024-03-29 00:28:03,391: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:28:03.391950708Z [2024-03-29 00:28:03,391: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:28:03.392308453Z [2024-03-29 00:28:03,391: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:28:03.392931185Z [2024-03-29 00:28:03,392: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:28:03.393047658Z [2024-03-29 00:28:03,392: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:28:03.503845696Z [2024-03-29 00:28:03,503: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:28:03.719812451Z [2024-03-29 00:28:03,719: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:28:03.724978256Z [2024-03-29 00:28:03,724: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:28:03.747324491Z [2024-03-29 00:28:03,747: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:28:03.748674814Z [2024-03-29 00:28:03,748: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:28:03.748844124Z [2024-03-29 00:28:03,748: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:28:03.749055102Z [2024-03-29 00:28:03,748: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:28:03.749085534Z [2024-03-29 00:28:03,748: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:28:03.749626462Z [2024-03-29 00:28:03,749: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:28:03.749653975Z [2024-03-29 00:28:03,749: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:28:03.827253668Z [2024-03-29 00:28:03,826: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:28:05.819606914Z [2024-03-29 00:28:05,818: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81be4ba6-9746-4f86-9fc5-1d5e46449f5f] succeeded in 4.524282855999445s: None 2024-03-29T00:28:06.253873814Z [2024-03-29 00:28:06,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ff0976b3-cef9-4e89-bea7-dcbf229bf993] succeeded in 4.940093641000203s: None 2024-03-29T00:29:00.278203081Z [2024-03-29 00:29:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6066ae32-b755-43de-9861-f859fb784fd5] received 2024-03-29T00:29:00.279734330Z [2024-03-29 00:29:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35e82579-bbc1-4de6-afd7-302ceb60eb88] received 2024-03-29T00:29:00.290644113Z [2024-03-29 00:29:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5fc8e9b-75d6-4bac-9639-f5b42e96d4b7] received 2024-03-29T00:29:00.292485752Z [2024-03-29 00:29:00,292: INFO/ForkPoolWorker-15] [6066ae32-b755-43de-9861-f859fb784fd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:29:00.299602204Z [2024-03-29 00:29:00,299: INFO/ForkPoolWorker-1] [e5fc8e9b-75d6-4bac-9639-f5b42e96d4b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:29:00.300224339Z [2024-03-29 00:29:00,299: INFO/ForkPoolWorker-16] [35e82579-bbc1-4de6-afd7-302ceb60eb88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:29:00.587660339Z [2024-03-29 00:29:00,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:29:00.602301458Z [2024-03-29 00:29:00,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:29:00.603578169Z [2024-03-29 00:29:00,599: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:29:00.769341997Z [2024-03-29 00:29:00,768: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:29:00.773288251Z [2024-03-29 00:29:00,772: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:29:00.796481188Z [2024-03-29 00:29:00,796: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:29:00.798146307Z [2024-03-29 00:29:00,797: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:29:00.798532039Z [2024-03-29 00:29:00,798: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:29:00.798702086Z [2024-03-29 00:29:00,798: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:29:00.799079875Z [2024-03-29 00:29:00,798: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:29:00.902002302Z [2024-03-29 00:29:00,901: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:29:01.557021645Z [2024-03-29 00:29:01,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35e82579-bbc1-4de6-afd7-302ceb60eb88] succeeded in 1.267969859999539s: None 2024-03-29T00:29:01.817459003Z [2024-03-29 00:29:01,817: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:29:01.820963830Z [2024-03-29 00:29:01,820: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:29:01.840231205Z [2024-03-29 00:29:01,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:29:01.841465239Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:29:01.841479762Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:29:01.841615501Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:29:01.841627876Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:29:01.841916863Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:29:01.841931037Z [2024-03-29 00:29:01,841: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:29:01.920561028Z [2024-03-29 00:29:01,919: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:29:01.924338048Z [2024-03-29 00:29:01,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:29:01.934909679Z [2024-03-29 00:29:01,934: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:29:01.951133264Z [2024-03-29 00:29:01,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:29:01.952969683Z [2024-03-29 00:29:01,952: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:29:01.953038909Z [2024-03-29 00:29:01,952: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:29:01.953377775Z [2024-03-29 00:29:01,953: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:29:01.953538865Z [2024-03-29 00:29:01,953: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:29:01.953966043Z [2024-03-29 00:29:01,953: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:29:01.954579718Z [2024-03-29 00:29:01,954: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:29:02.079623832Z [2024-03-29 00:29:02,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:29:03.553377368Z [2024-03-29 00:29:03,552: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5fc8e9b-75d6-4bac-9639-f5b42e96d4b7] succeeded in 3.259079534999728s: None 2024-03-29T00:29:03.903545072Z [2024-03-29 00:29:03,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6066ae32-b755-43de-9861-f859fb784fd5] succeeded in 3.6220477619999656s: None 2024-03-29T00:30:01.273997444Z [2024-03-29 00:30:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ca961e7-0322-4b6d-909a-0ff8865baab1] received 2024-03-29T00:30:01.276508917Z [2024-03-29 00:30:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed45df8c-3050-482d-bdff-71353a1ff695] received 2024-03-29T00:30:01.279174139Z [2024-03-29 00:30:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa64abb-6750-4ec6-ac92-5fa9a1f07b3e] received 2024-03-29T00:30:01.286143958Z [2024-03-29 00:30:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0842c95-cb99-4851-acd4-f86cd2ac116d] received 2024-03-29T00:30:01.288750813Z [2024-03-29 00:30:01,288: INFO/ForkPoolWorker-15] [9ca961e7-0322-4b6d-909a-0ff8865baab1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:30:01.288784129Z [2024-03-29 00:30:01,288: INFO/ForkPoolWorker-1] [2fa64abb-6750-4ec6-ac92-5fa9a1f07b3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:30:01.291731090Z [2024-03-29 00:30:01,291: INFO/ForkPoolWorker-16] [ed45df8c-3050-482d-bdff-71353a1ff695] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:30:01.296959318Z [2024-03-29 00:30:01,296: INFO/ForkPoolWorker-2] [d0842c95-cb99-4851-acd4-f86cd2ac116d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:01.316093852Z [2024-03-29 00:30:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d5a4952-195e-44d2-bfb3-0caf32d01095] received 2024-03-29T00:30:01.341400063Z [2024-03-29 00:30:01,340: INFO/ForkPoolWorker-3] [7d5a4952-195e-44d2-bfb3-0caf32d01095] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:30:01.644618933Z [2024-03-29 00:30:01,637: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:30:01.785768450Z [2024-03-29 00:30:01,781: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:30:01.835020723Z [2024-03-29 00:30:01,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:30:01.988060897Z [2024-03-29 00:30:01,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:30:02.145391664Z [2024-03-29 00:30:02,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:30:02.384806849Z [2024-03-29 00:30:02,384: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:02.656227809Z [2024-03-29 00:30:02,655: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:30:02.676243188Z [2024-03-29 00:30:02,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:02.755521225Z [2024-03-29 00:30:02,755: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:30:02.756861514Z [2024-03-29 00:30:02,756: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:30:02.757155067Z [2024-03-29 00:30:02,756: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:30:02.757308923Z [2024-03-29 00:30:02,757: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:30:02.757657889Z [2024-03-29 00:30:02,757: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:30:02.876594354Z [2024-03-29 00:30:02,876: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:03.311988208Z [2024-03-29 00:30:03,311: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7d5a4952-195e-44d2-bfb3-0caf32d01095] succeeded in 1.9928075199995874s: None 2024-03-29T00:30:03.481878606Z [2024-03-29 00:30:03,481: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:30:03.486371184Z [2024-03-29 00:30:03,485: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:03.521885590Z [2024-03-29 00:30:03,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:30:03.523623675Z [2024-03-29 00:30:03,523: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:03.523690189Z [2024-03-29 00:30:03,523: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:03.523903387Z [2024-03-29 00:30:03,523: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:03.524028157Z [2024-03-29 00:30:03,523: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:30:03.524391849Z [2024-03-29 00:30:03,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:30:03.524457353Z [2024-03-29 00:30:03,524: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:03.644089434Z [2024-03-29 00:30:03,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:03.688734976Z [2024-03-29 00:30:03,688: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed45df8c-3050-482d-bdff-71353a1ff695] succeeded in 2.4089181950002967s: None 2024-03-29T00:30:03.885510446Z [2024-03-29 00:30:03,885: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:30:03.888848574Z [2024-03-29 00:30:03,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:03.911770634Z [2024-03-29 00:30:03,911: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:30:03.913401465Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:03.913418571Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:03.913543472Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:03.913573446Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:30:03.913822579Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:30:03.913834681Z [2024-03-29 00:30:03,913: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:03.918992788Z [2024-03-29 00:30:03,918: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:30:03.922428567Z [2024-03-29 00:30:03,921: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:03.956521413Z [2024-03-29 00:30:03,956: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:30:03.957925210Z [2024-03-29 00:30:03,957: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:03.957976925Z [2024-03-29 00:30:03,957: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:03.958167503Z [2024-03-29 00:30:03,957: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:03.958300705Z [2024-03-29 00:30:03,958: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:30:03.958767509Z [2024-03-29 00:30:03,958: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:30:03.958782606Z [2024-03-29 00:30:03,958: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:04.046313551Z [2024-03-29 00:30:04,045: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:04.080481778Z [2024-03-29 00:30:04,080: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:04.649719042Z [2024-03-29 00:30:04,649: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d0842c95-cb99-4851-acd4-f86cd2ac116d] succeeded in 3.3597045019996585s: None 2024-03-29T00:30:05.271925957Z [2024-03-29 00:30:05,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ca961e7-0322-4b6d-909a-0ff8865baab1] succeeded in 3.9938370370000484s: None 2024-03-29T00:30:05.427111286Z [2024-03-29 00:30:05,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0364eb61-26e1-4120-a5b2-b8ee0446ae94] received 2024-03-29T00:30:05.440457879Z [2024-03-29 00:30:05,440: INFO/ForkPoolWorker-15] [0364eb61-26e1-4120-a5b2-b8ee0446ae94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:05.834398806Z [2024-03-29 00:30:05,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:30:06.100275152Z [2024-03-29 00:30:06,099: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fa64abb-6750-4ec6-ac92-5fa9a1f07b3e] succeeded in 4.818474038000204s: None 2024-03-29T00:30:07.343254681Z [2024-03-29 00:30:07,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:30:07.347075059Z [2024-03-29 00:30:07,346: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:07.375084667Z [2024-03-29 00:30:07,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:30:07.376349596Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:07.376363585Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:07.376506161Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:07.376537658Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:30:07.376789984Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:30:07.376823140Z [2024-03-29 00:30:07,376: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:07.497187703Z [2024-03-29 00:30:07,496: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:08.086106913Z [2024-03-29 00:30:08,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0364eb61-26e1-4120-a5b2-b8ee0446ae94] succeeded in 2.652922240999942s: None 2024-03-29T00:30:08.202844522Z [2024-03-29 00:30:08,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59e158b5-ae62-47d9-b4f7-30fc21676e37] received 2024-03-29T00:30:08.216299036Z [2024-03-29 00:30:08,215: INFO/ForkPoolWorker-15] [59e158b5-ae62-47d9-b4f7-30fc21676e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:30:08.517558647Z [2024-03-29 00:30:08,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:30:09.735154006Z [2024-03-29 00:30:09,734: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:30:09.741476049Z [2024-03-29 00:30:09,740: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:09.770610110Z [2024-03-29 00:30:09,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:30:09.772202535Z [2024-03-29 00:30:09,771: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:09.772223512Z [2024-03-29 00:30:09,771: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:09.772395458Z [2024-03-29 00:30:09,772: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:09.772433267Z [2024-03-29 00:30:09,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:30:09.772757944Z [2024-03-29 00:30:09,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:30:09.772810996Z [2024-03-29 00:30:09,772: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:09.869515660Z [2024-03-29 00:30:09,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:10.424297705Z [2024-03-29 00:30:10,423: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59e158b5-ae62-47d9-b4f7-30fc21676e37] succeeded in 2.2153624269994907s: None 2024-03-29T00:30:10.521785056Z [2024-03-29 00:30:10,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea6c82f1-ea22-48ee-90a5-1cb3f7df58d3] received 2024-03-29T00:30:10.528990337Z [2024-03-29 00:30:10,528: INFO/ForkPoolWorker-15] [ea6c82f1-ea22-48ee-90a5-1cb3f7df58d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:10.821036033Z [2024-03-29 00:30:10,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:30:11.935873019Z [2024-03-29 00:30:11,935: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:30:11.939506816Z [2024-03-29 00:30:11,939: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:30:11.954902611Z [2024-03-29 00:30:11,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:30:11.956374864Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:30:11.956478753Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:30:11.956626182Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:30:11.956713837Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:30:11.956954130Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:30:11.957051400Z [2024-03-29 00:30:11,956: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:30:12.035509556Z [2024-03-29 00:30:12,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:30:12.575986858Z [2024-03-29 00:30:12,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea6c82f1-ea22-48ee-90a5-1cb3f7df58d3] succeeded in 2.0525238889995308s: None 2024-03-29T00:31:01.081206548Z [2024-03-29 00:31:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[011c3b91-b39c-455c-b754-23c33fcd9c4c] received 2024-03-29T00:31:01.089262182Z [2024-03-29 00:31:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43ac475e-ec45-43f4-80cf-f2a314be55be] received 2024-03-29T00:31:01.089432420Z [2024-03-29 00:31:01,089: INFO/ForkPoolWorker-15] [011c3b91-b39c-455c-b754-23c33fcd9c4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:31:01.097870243Z [2024-03-29 00:31:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e782a6b3-59b0-47b9-a26d-42ae5f772d24] received 2024-03-29T00:31:01.103918827Z [2024-03-29 00:31:01,103: INFO/ForkPoolWorker-16] [43ac475e-ec45-43f4-80cf-f2a314be55be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:31:01.104835280Z [2024-03-29 00:31:01,104: INFO/ForkPoolWorker-1] [e782a6b3-59b0-47b9-a26d-42ae5f772d24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:31:01.444730117Z [2024-03-29 00:31:01,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:31:01.462904312Z [2024-03-29 00:31:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:31:01.463325206Z [2024-03-29 00:31:01,459: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:31:01.659656126Z [2024-03-29 00:31:01,659: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:31:01.664390156Z [2024-03-29 00:31:01,663: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:31:01.687608259Z [2024-03-29 00:31:01,687: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:31:01.689003148Z [2024-03-29 00:31:01,688: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:31:01.689365981Z [2024-03-29 00:31:01,689: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:31:01.689535772Z [2024-03-29 00:31:01,689: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:31:01.689876318Z [2024-03-29 00:31:01,689: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:31:01.789328628Z [2024-03-29 00:31:01,788: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:31:02.504134428Z [2024-03-29 00:31:02,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e782a6b3-59b0-47b9-a26d-42ae5f772d24] succeeded in 1.4040577120003945s: None 2024-03-29T00:31:02.766315412Z [2024-03-29 00:31:02,765: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:31:02.770184925Z [2024-03-29 00:31:02,769: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:31:02.800579590Z [2024-03-29 00:31:02,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:31:02.801925708Z [2024-03-29 00:31:02,801: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:31:02.802071920Z [2024-03-29 00:31:02,801: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:31:02.802334400Z [2024-03-29 00:31:02,802: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:31:02.802475482Z [2024-03-29 00:31:02,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:31:02.802896419Z [2024-03-29 00:31:02,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:31:02.803020370Z [2024-03-29 00:31:02,802: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:31:02.903168648Z [2024-03-29 00:31:02,902: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:31:02.918529764Z [2024-03-29 00:31:02,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:31:02.922114032Z [2024-03-29 00:31:02,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:31:02.951594739Z [2024-03-29 00:31:02,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:31:02.953674224Z [2024-03-29 00:31:02,953: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:31:02.953694063Z [2024-03-29 00:31:02,953: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:31:02.953783381Z [2024-03-29 00:31:02,953: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:31:02.953832776Z [2024-03-29 00:31:02,953: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:31:02.954295665Z [2024-03-29 00:31:02,954: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:31:02.954493655Z [2024-03-29 00:31:02,954: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:31:03.053920641Z [2024-03-29 00:31:03,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:31:04.850542489Z [2024-03-29 00:31:04,850: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[011c3b91-b39c-455c-b754-23c33fcd9c4c] succeeded in 3.7676343090006412s: None 2024-03-29T00:31:05.214835597Z [2024-03-29 00:31:05,210: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43ac475e-ec45-43f4-80cf-f2a314be55be] succeeded in 4.11563362600009s: None 2024-03-29T00:32:00.715869479Z [2024-03-29 00:32:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21ba6371-503f-4984-9d7f-3d641d2e26e0] received 2024-03-29T00:32:00.720435866Z [2024-03-29 00:32:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cccffd22-e853-4c76-976d-c0709b1a77c7] received 2024-03-29T00:32:00.722993268Z [2024-03-29 00:32:00,722: INFO/ForkPoolWorker-15] [21ba6371-503f-4984-9d7f-3d641d2e26e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:32:00.724991419Z [2024-03-29 00:32:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e5807c8-2b98-430d-a81d-84145e412056] received 2024-03-29T00:32:00.734122680Z [2024-03-29 00:32:00,733: INFO/ForkPoolWorker-16] [cccffd22-e853-4c76-976d-c0709b1a77c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:32:00.741993604Z [2024-03-29 00:32:00,741: INFO/ForkPoolWorker-1] [1e5807c8-2b98-430d-a81d-84145e412056] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:32:00.746640068Z [2024-03-29 00:32:00,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3e42cfb-955b-47ea-8511-2f8428080059] received 2024-03-29T00:32:00.763345223Z [2024-03-29 00:32:00,763: INFO/ForkPoolWorker-2] [b3e42cfb-955b-47ea-8511-2f8428080059] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:32:01.052094359Z [2024-03-29 00:32:01,039: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:32:01.089851006Z [2024-03-29 00:32:01,085: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:32:01.090797190Z [2024-03-29 00:32:01,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:32:01.199430288Z [2024-03-29 00:32:01,196: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:32:01.377061371Z [2024-03-29 00:32:01,376: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:32:01.377590252Z [2024-03-29 00:32:01,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:32:01.381393409Z [2024-03-29 00:32:01,380: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:32:01.406207858Z [2024-03-29 00:32:01,406: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:32:01.407652092Z [2024-03-29 00:32:01,407: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:32:01.407905204Z [2024-03-29 00:32:01,407: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:32:01.408067312Z [2024-03-29 00:32:01,407: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:32:01.408688215Z [2024-03-29 00:32:01,408: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:32:01.563696793Z [2024-03-29 00:32:01,563: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:32:01.945928908Z [2024-03-29 00:32:01,945: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21ba6371-503f-4984-9d7f-3d641d2e26e0] succeeded in 1.227757456999825s: None 2024-03-29T00:32:02.214938735Z [2024-03-29 00:32:02,214: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e5807c8-2b98-430d-a81d-84145e412056] succeeded in 1.4876950010002474s: None 2024-03-29T00:32:02.440585810Z [2024-03-29 00:32:02,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:32:02.444604020Z [2024-03-29 00:32:02,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:32:02.472521710Z [2024-03-29 00:32:02,472: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:32:02.474646084Z [2024-03-29 00:32:02,474: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:32:02.475070663Z [2024-03-29 00:32:02,474: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:32:02.475625117Z [2024-03-29 00:32:02,475: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:32:02.475856432Z [2024-03-29 00:32:02,475: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:32:02.476331431Z [2024-03-29 00:32:02,476: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:32:02.476593444Z [2024-03-29 00:32:02,476: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:32:02.593397370Z [2024-03-29 00:32:02,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:32:02.687034669Z [2024-03-29 00:32:02,686: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:32:02.690744648Z [2024-03-29 00:32:02,690: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:32:02.714581328Z [2024-03-29 00:32:02,714: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:32:02.716595970Z [2024-03-29 00:32:02,716: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:32:02.716676589Z [2024-03-29 00:32:02,716: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:32:02.716982563Z [2024-03-29 00:32:02,716: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:32:02.717119799Z [2024-03-29 00:32:02,716: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:32:02.717857648Z [2024-03-29 00:32:02,717: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:32:02.718111556Z [2024-03-29 00:32:02,717: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:32:02.830950714Z [2024-03-29 00:32:02,830: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:32:04.038346229Z [2024-03-29 00:32:04,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cccffd22-e853-4c76-976d-c0709b1a77c7] succeeded in 3.311868241000411s: None 2024-03-29T00:32:04.785732735Z [2024-03-29 00:32:04,785: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b3e42cfb-955b-47ea-8511-2f8428080059] succeeded in 4.036405199999535s: None 2024-03-29T00:33:00.489839207Z [2024-03-29 00:33:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7996725a-1339-4af2-b34a-7911508d80eb] received 2024-03-29T00:33:00.498019329Z [2024-03-29 00:33:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d25f7164-620f-4aa6-80fc-53d52a6eee35] received 2024-03-29T00:33:00.498840836Z [2024-03-29 00:33:00,498: INFO/ForkPoolWorker-15] [7996725a-1339-4af2-b34a-7911508d80eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:33:00.500649657Z [2024-03-29 00:33:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88f8657c-1325-4385-bfb3-61d895cd6410] received 2024-03-29T00:33:00.512139522Z [2024-03-29 00:33:00,511: INFO/ForkPoolWorker-1] [88f8657c-1325-4385-bfb3-61d895cd6410] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:33:00.514935956Z [2024-03-29 00:33:00,514: INFO/ForkPoolWorker-16] [d25f7164-620f-4aa6-80fc-53d52a6eee35] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:33:00.803975726Z [2024-03-29 00:33:00,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:33:00.836105008Z [2024-03-29 00:33:00,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:33:00.857377628Z [2024-03-29 00:33:00,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:33:01.004108441Z [2024-03-29 00:33:01,003: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:33:01.008326114Z [2024-03-29 00:33:01,007: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:33:01.031284757Z [2024-03-29 00:33:01,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:33:01.032508879Z [2024-03-29 00:33:01,032: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:33:01.032704751Z [2024-03-29 00:33:01,032: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:33:01.032712232Z [2024-03-29 00:33:01,032: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:33:01.032982625Z [2024-03-29 00:33:01,032: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:33:01.145353582Z [2024-03-29 00:33:01,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:33:01.834789335Z [2024-03-29 00:33:01,834: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d25f7164-620f-4aa6-80fc-53d52a6eee35] succeeded in 1.3324982589992942s: None 2024-03-29T00:33:02.232012051Z [2024-03-29 00:33:02,231: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:33:02.235835898Z [2024-03-29 00:33:02,235: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:33:02.239102304Z [2024-03-29 00:33:02,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:33:02.242800380Z [2024-03-29 00:33:02,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:33:02.268895926Z [2024-03-29 00:33:02,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:33:02.270803581Z [2024-03-29 00:33:02,270: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:33:02.270844436Z [2024-03-29 00:33:02,270: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:33:02.271014719Z [2024-03-29 00:33:02,270: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:33:02.271054522Z [2024-03-29 00:33:02,270: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:33:02.271447326Z [2024-03-29 00:33:02,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:33:02.271463785Z [2024-03-29 00:33:02,271: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:33:02.273771116Z [2024-03-29 00:33:02,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:33:02.275602248Z [2024-03-29 00:33:02,275: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:33:02.275618985Z [2024-03-29 00:33:02,275: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:33:02.275849347Z [2024-03-29 00:33:02,275: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:33:02.275860678Z [2024-03-29 00:33:02,275: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:33:02.276530860Z [2024-03-29 00:33:02,276: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:33:02.276547226Z [2024-03-29 00:33:02,276: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:33:02.364644074Z [2024-03-29 00:33:02,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:33:02.390355206Z [2024-03-29 00:33:02,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:33:03.890338457Z [2024-03-29 00:33:03,889: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88f8657c-1325-4385-bfb3-61d895cd6410] succeeded in 3.3863619940002536s: None 2024-03-29T00:33:04.603351232Z [2024-03-29 00:33:04,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7996725a-1339-4af2-b34a-7911508d80eb] succeeded in 4.111251776999779s: None 2024-03-29T00:34:00.278373329Z [2024-03-29 00:34:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3631b197-4c61-4304-bff5-a16075e24af2] received 2024-03-29T00:34:00.286461260Z [2024-03-29 00:34:00,286: INFO/ForkPoolWorker-15] [3631b197-4c61-4304-bff5-a16075e24af2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:34:00.291018834Z [2024-03-29 00:34:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee00231a-f1da-4f05-b179-d0f64edcf860] received 2024-03-29T00:34:00.294959422Z [2024-03-29 00:34:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[638b9be5-fe1e-43df-aed5-1e07fb240f05] received 2024-03-29T00:34:00.297651043Z [2024-03-29 00:34:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b11b47d2-315d-43b1-8488-59375d4ade55] received 2024-03-29T00:34:00.307972798Z [2024-03-29 00:34:00,307: INFO/ForkPoolWorker-16] [ee00231a-f1da-4f05-b179-d0f64edcf860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:34:00.314004811Z [2024-03-29 00:34:00,313: INFO/ForkPoolWorker-2] [b11b47d2-315d-43b1-8488-59375d4ade55] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:34:00.314767595Z [2024-03-29 00:34:00,314: INFO/ForkPoolWorker-1] [638b9be5-fe1e-43df-aed5-1e07fb240f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:34:00.756383033Z [2024-03-29 00:34:00,752: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:34:00.821514437Z [2024-03-29 00:34:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:34:01.056749987Z [2024-03-29 00:34:01,053: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:34:01.087610200Z [2024-03-29 00:34:01,087: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:34:01.222105025Z [2024-03-29 00:34:01,221: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:34:01.226289759Z [2024-03-29 00:34:01,225: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:34:01.263266573Z [2024-03-29 00:34:01,263: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:34:01.269299346Z [2024-03-29 00:34:01,269: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:34:01.269548793Z [2024-03-29 00:34:01,269: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:34:01.269756692Z [2024-03-29 00:34:01,269: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:34:01.273654426Z [2024-03-29 00:34:01,273: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:34:01.391914833Z [2024-03-29 00:34:01,387: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:34:01.610026901Z [2024-03-29 00:34:01,609: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:34:01.981001380Z [2024-03-29 00:34:01,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3631b197-4c61-4304-bff5-a16075e24af2] succeeded in 1.7005209890003243s: None 2024-03-29T00:34:02.560190204Z [2024-03-29 00:34:02,559: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:34:02.564116090Z [2024-03-29 00:34:02,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:34:02.619417225Z [2024-03-29 00:34:02,619: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:34:02.645489657Z [2024-03-29 00:34:02,645: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:34:02.645619117Z [2024-03-29 00:34:02,645: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:34:02.645935472Z [2024-03-29 00:34:02,645: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:34:02.645947248Z [2024-03-29 00:34:02,645: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:34:02.646872001Z [2024-03-29 00:34:02,646: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:34:02.647074482Z [2024-03-29 00:34:02,646: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:34:02.749206429Z [2024-03-29 00:34:02,748: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b11b47d2-315d-43b1-8488-59375d4ade55] succeeded in 2.442773106000459s: None 2024-03-29T00:34:02.781789608Z [2024-03-29 00:34:02,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:34:03.116027402Z [2024-03-29 00:34:03,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:34:03.120193056Z [2024-03-29 00:34:03,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:34:03.144813388Z [2024-03-29 00:34:03,144: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:34:03.146481034Z [2024-03-29 00:34:03,146: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:34:03.146672938Z [2024-03-29 00:34:03,146: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:34:03.146925465Z [2024-03-29 00:34:03,146: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:34:03.147087180Z [2024-03-29 00:34:03,146: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:34:03.147507967Z [2024-03-29 00:34:03,147: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:34:03.147677578Z [2024-03-29 00:34:03,147: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:34:03.261636521Z [2024-03-29 00:34:03,261: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:34:05.402043198Z [2024-03-29 00:34:05,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[638b9be5-fe1e-43df-aed5-1e07fb240f05] succeeded in 5.105223522000415s: None 2024-03-29T00:34:06.330951256Z [2024-03-29 00:34:06,291: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee00231a-f1da-4f05-b179-d0f64edcf860] succeeded in 5.9959520439997505s: None 2024-03-29T00:35:00.304058228Z [2024-03-29 00:35:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79180d16-f703-4d52-b42a-14c8fe2c9cc3] received 2024-03-29T00:35:00.308818697Z [2024-03-29 00:35:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2b2e93f-4938-4332-bc7e-56ee463d900d] received 2024-03-29T00:35:00.317518929Z [2024-03-29 00:35:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8012f6e-99b9-45bd-b50d-aaf8577ae6f8] received 2024-03-29T00:35:00.324136804Z [2024-03-29 00:35:00,323: INFO/ForkPoolWorker-15] [79180d16-f703-4d52-b42a-14c8fe2c9cc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:35:00.324156292Z [2024-03-29 00:35:00,323: INFO/ForkPoolWorker-16] [f2b2e93f-4938-4332-bc7e-56ee463d900d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:35:00.330326783Z [2024-03-29 00:35:00,330: INFO/ForkPoolWorker-1] [c8012f6e-99b9-45bd-b50d-aaf8577ae6f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:00.350728552Z [2024-03-29 00:35:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68f7159e-53ba-48b7-8d1c-c5a889a14bba] received 2024-03-29T00:35:00.368825834Z [2024-03-29 00:35:00,368: INFO/ForkPoolWorker-2] [68f7159e-53ba-48b7-8d1c-c5a889a14bba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:35:00.951640375Z [2024-03-29 00:35:00,948: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:35:00.989576166Z [2024-03-29 00:35:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:35:01.106052950Z [2024-03-29 00:35:01,102: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:35:01.201844600Z [2024-03-29 00:35:01,201: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:35:01.206273472Z [2024-03-29 00:35:01,205: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:01.215369040Z [2024-03-29 00:35:01,189: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:35:01.259339555Z [2024-03-29 00:35:01,259: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:35:01.260408941Z [2024-03-29 00:35:01,260: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:35:01.260471692Z [2024-03-29 00:35:01,260: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:35:01.260526374Z [2024-03-29 00:35:01,260: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:35:01.260687893Z [2024-03-29 00:35:01,260: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:35:01.396740008Z [2024-03-29 00:35:01,396: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:02.344240810Z [2024-03-29 00:35:02,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79180d16-f703-4d52-b42a-14c8fe2c9cc3] succeeded in 2.035771392999777s: None 2024-03-29T00:35:02.938480847Z [2024-03-29 00:35:02,938: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:35:02.942932321Z [2024-03-29 00:35:02,942: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:02.989283930Z [2024-03-29 00:35:02,988: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:35:02.991617103Z [2024-03-29 00:35:02,991: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:02.991891252Z [2024-03-29 00:35:02,991: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:03.002824347Z [2024-03-29 00:35:03,002: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:35:03.006773539Z [2024-03-29 00:35:03,006: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:03.017796587Z [2024-03-29 00:35:03,017: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:03.017891509Z [2024-03-29 00:35:03,017: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:35:03.019329171Z [2024-03-29 00:35:03,018: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:35:03.019530148Z [2024-03-29 00:35:03,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:03.048589542Z [2024-03-29 00:35:03,048: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:35:03.051155176Z [2024-03-29 00:35:03,050: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:03.051420705Z [2024-03-29 00:35:03,051: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:03.051943815Z [2024-03-29 00:35:03,051: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:03.052163485Z [2024-03-29 00:35:03,051: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:35:03.052677957Z [2024-03-29 00:35:03,052: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:35:03.053501588Z [2024-03-29 00:35:03,053: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:03.208827883Z [2024-03-29 00:35:03,208: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:03.330586442Z [2024-03-29 00:35:03,330: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:03.367230125Z [2024-03-29 00:35:03,366: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:35:03.370928246Z [2024-03-29 00:35:03,370: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:03.401737025Z [2024-03-29 00:35:03,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:35:03.408393192Z [2024-03-29 00:35:03,408: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:03.408498723Z [2024-03-29 00:35:03,408: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:03.408692109Z [2024-03-29 00:35:03,408: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:03.408828208Z [2024-03-29 00:35:03,408: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:35:03.409204412Z [2024-03-29 00:35:03,409: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:35:03.409316170Z [2024-03-29 00:35:03,409: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:03.704341848Z [2024-03-29 00:35:03,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:05.560026655Z [2024-03-29 00:35:05,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8012f6e-99b9-45bd-b50d-aaf8577ae6f8] succeeded in 5.238529706999543s: None 2024-03-29T00:35:05.711095137Z [2024-03-29 00:35:05,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d2336d2-a124-45cf-b261-042db6babaf8] received 2024-03-29T00:35:05.749405383Z [2024-03-29 00:35:05,749: INFO/ForkPoolWorker-15] [5d2336d2-a124-45cf-b261-042db6babaf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:06.177024148Z [2024-03-29 00:35:06,176: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2b2e93f-4938-4332-bc7e-56ee463d900d] succeeded in 5.864495980999891s: None 2024-03-29T00:35:06.482773190Z [2024-03-29 00:35:06,482: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[68f7159e-53ba-48b7-8d1c-c5a889a14bba] succeeded in 6.128309165999781s: None 2024-03-29T00:35:06.505408584Z [2024-03-29 00:35:06,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:35:09.084391184Z [2024-03-29 00:35:09,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:35:09.095449067Z [2024-03-29 00:35:09,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:09.203226607Z [2024-03-29 00:35:09,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:35:09.208248203Z [2024-03-29 00:35:09,207: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:09.213345133Z [2024-03-29 00:35:09,208: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:09.213959276Z [2024-03-29 00:35:09,213: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:09.221874229Z [2024-03-29 00:35:09,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:35:09.222703520Z [2024-03-29 00:35:09,222: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:35:09.222843178Z [2024-03-29 00:35:09,222: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:09.364154568Z [2024-03-29 00:35:09,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:10.804580916Z [2024-03-29 00:35:10,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d2336d2-a124-45cf-b261-042db6babaf8] succeeded in 5.080151866999586s: None 2024-03-29T00:35:11.132498505Z [2024-03-29 00:35:11,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7b085f0-b710-4932-8362-c302bc047b11] received 2024-03-29T00:35:11.144781111Z [2024-03-29 00:35:11,144: INFO/ForkPoolWorker-15] [a7b085f0-b710-4932-8362-c302bc047b11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:35:11.673378005Z [2024-03-29 00:35:11,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:35:13.673586828Z [2024-03-29 00:35:13,673: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:35:13.677324405Z [2024-03-29 00:35:13,676: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:13.702038711Z [2024-03-29 00:35:13,701: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:35:13.704004261Z [2024-03-29 00:35:13,703: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:13.704238132Z [2024-03-29 00:35:13,703: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:13.704549972Z [2024-03-29 00:35:13,704: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:13.704793422Z [2024-03-29 00:35:13,704: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:35:13.705375340Z [2024-03-29 00:35:13,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:35:13.705590454Z [2024-03-29 00:35:13,705: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:13.799849063Z [2024-03-29 00:35:13,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:14.398164320Z [2024-03-29 00:35:14,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7b085f0-b710-4932-8362-c302bc047b11] succeeded in 3.2638210139994044s: None 2024-03-29T00:35:14.903138762Z [2024-03-29 00:35:14,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37e23f3e-3736-4d25-bd56-fe466c9f45fd] received 2024-03-29T00:35:14.925629606Z [2024-03-29 00:35:14,925: INFO/ForkPoolWorker-15] [37e23f3e-3736-4d25-bd56-fe466c9f45fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:15.357510328Z [2024-03-29 00:35:15,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:35:16.911135653Z [2024-03-29 00:35:16,910: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:35:16.916507137Z [2024-03-29 00:35:16,914: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:35:16.948971654Z [2024-03-29 00:35:16,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:35:16.950113678Z [2024-03-29 00:35:16,949: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:35:16.950142451Z [2024-03-29 00:35:16,950: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:35:16.950266627Z [2024-03-29 00:35:16,950: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:35:16.950311755Z [2024-03-29 00:35:16,950: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:35:16.951375196Z [2024-03-29 00:35:16,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:35:16.951391393Z [2024-03-29 00:35:16,951: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:35:17.155354091Z [2024-03-29 00:35:17,154: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:35:17.976159711Z [2024-03-29 00:35:17,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37e23f3e-3736-4d25-bd56-fe466c9f45fd] succeeded in 3.0680088830004024s: None 2024-03-29T00:36:00.794495278Z [2024-03-29 00:36:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16e460ab-6d6a-43e1-bfa4-f494196fec5a] received 2024-03-29T00:36:00.801496607Z [2024-03-29 00:36:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71969b21-d2a5-4733-a0f9-d49e5150fbe3] received 2024-03-29T00:36:00.811344806Z [2024-03-29 00:36:00,810: INFO/ForkPoolWorker-15] [16e460ab-6d6a-43e1-bfa4-f494196fec5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:36:00.823079087Z [2024-03-29 00:36:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f84e40ff-dc43-469b-b111-ec8a097dc5e7] received 2024-03-29T00:36:00.823102927Z [2024-03-29 00:36:00,822: INFO/ForkPoolWorker-16] [71969b21-d2a5-4733-a0f9-d49e5150fbe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:36:00.826425358Z [2024-03-29 00:36:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71ddd802-7037-4f15-bc4f-1a28f24ee2ea] received 2024-03-29T00:36:00.832052315Z [2024-03-29 00:36:00,831: INFO/ForkPoolWorker-1] [f84e40ff-dc43-469b-b111-ec8a097dc5e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:36:00.835968229Z [2024-03-29 00:36:00,835: INFO/ForkPoolWorker-2] [71ddd802-7037-4f15-bc4f-1a28f24ee2ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:36:01.256420404Z [2024-03-29 00:36:01,251: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:36:01.361067922Z [2024-03-29 00:36:01,357: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:36:01.379090230Z [2024-03-29 00:36:01,375: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:36:01.413854760Z [2024-03-29 00:36:01,409: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:36:01.574543114Z [2024-03-29 00:36:01,573: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:36:01.581763170Z [2024-03-29 00:36:01,580: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:36:01.621497566Z [2024-03-29 00:36:01,621: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:36:01.623002577Z [2024-03-29 00:36:01,622: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:36:01.623120996Z [2024-03-29 00:36:01,622: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:36:01.623221874Z [2024-03-29 00:36:01,623: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:36:01.623495567Z [2024-03-29 00:36:01,623: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:36:01.671231826Z [2024-03-29 00:36:01,670: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:36:01.833659969Z [2024-03-29 00:36:01,833: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:36:02.554658319Z [2024-03-29 00:36:02,554: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f84e40ff-dc43-469b-b111-ec8a097dc5e7] succeeded in 1.7287686999998186s: None 2024-03-29T00:36:02.695275572Z [2024-03-29 00:36:02,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71969b21-d2a5-4733-a0f9-d49e5150fbe3] succeeded in 1.8918186599994442s: None 2024-03-29T00:36:02.875094851Z [2024-03-29 00:36:02,874: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:36:02.878876280Z [2024-03-29 00:36:02,878: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:36:02.901542265Z [2024-03-29 00:36:02,901: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:36:02.903396666Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:36:02.903410086Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:36:02.903546856Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:36:02.903584177Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:36:02.903909624Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:36:02.904043933Z [2024-03-29 00:36:02,903: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:36:03.022964327Z [2024-03-29 00:36:03,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:36:03.192766304Z [2024-03-29 00:36:03,192: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:36:03.196278300Z [2024-03-29 00:36:03,195: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:36:03.224355013Z [2024-03-29 00:36:03,224: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:36:03.226687695Z [2024-03-29 00:36:03,226: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:36:03.226929534Z [2024-03-29 00:36:03,226: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:36:03.227228468Z [2024-03-29 00:36:03,226: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:36:03.227427806Z [2024-03-29 00:36:03,227: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:36:03.228136587Z [2024-03-29 00:36:03,227: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:36:03.228420735Z [2024-03-29 00:36:03,228: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:36:03.366565397Z [2024-03-29 00:36:03,366: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:36:05.070977745Z [2024-03-29 00:36:05,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16e460ab-6d6a-43e1-bfa4-f494196fec5a] succeeded in 4.274631205999867s: None 2024-03-29T00:36:05.421992786Z [2024-03-29 00:36:05,421: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[71ddd802-7037-4f15-bc4f-1a28f24ee2ea] succeeded in 4.593881600999339s: None 2024-03-29T00:37:00.641657798Z [2024-03-29 00:37:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[255004f2-ade0-43d5-838a-ac844c671a9a] received 2024-03-29T00:37:00.654594868Z [2024-03-29 00:37:00,654: INFO/ForkPoolWorker-15] [255004f2-ade0-43d5-838a-ac844c671a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:37:00.669769420Z [2024-03-29 00:37:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed14b2e3-5a74-459c-a63f-efe705f164e9] received 2024-03-29T00:37:00.673994622Z [2024-03-29 00:37:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[935e0cde-3007-4a2b-b163-b7e99c6bed85] received 2024-03-29T00:37:00.683290393Z [2024-03-29 00:37:00,682: INFO/ForkPoolWorker-16] [ed14b2e3-5a74-459c-a63f-efe705f164e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:37:00.684019876Z [2024-03-29 00:37:00,683: INFO/ForkPoolWorker-1] [935e0cde-3007-4a2b-b163-b7e99c6bed85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:37:00.963480449Z [2024-03-29 00:37:00,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:37:01.054109010Z [2024-03-29 00:37:01,050: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:37:01.076369170Z [2024-03-29 00:37:01,072: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:37:01.173826383Z [2024-03-29 00:37:01,173: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:37:01.180569409Z [2024-03-29 00:37:01,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:37:01.207654901Z [2024-03-29 00:37:01,207: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:37:01.209105318Z [2024-03-29 00:37:01,208: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:37:01.209418056Z [2024-03-29 00:37:01,209: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:37:01.209638279Z [2024-03-29 00:37:01,209: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:37:01.210059230Z [2024-03-29 00:37:01,209: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:37:01.307866894Z [2024-03-29 00:37:01,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:37:02.122934507Z [2024-03-29 00:37:02,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[255004f2-ade0-43d5-838a-ac844c671a9a] succeeded in 1.4794574220004506s: None 2024-03-29T00:37:02.547915586Z [2024-03-29 00:37:02,547: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:37:02.551580109Z [2024-03-29 00:37:02,551: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:37:02.571434989Z [2024-03-29 00:37:02,571: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:37:02.573102129Z [2024-03-29 00:37:02,572: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:37:02.573116334Z [2024-03-29 00:37:02,572: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:37:02.573224589Z [2024-03-29 00:37:02,573: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:37:02.573362714Z [2024-03-29 00:37:02,573: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:37:02.573406678Z [2024-03-29 00:37:02,573: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:37:02.573756902Z [2024-03-29 00:37:02,573: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:37:02.573827055Z [2024-03-29 00:37:02,573: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:37:02.576791844Z [2024-03-29 00:37:02,576: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:37:02.596784576Z [2024-03-29 00:37:02,596: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:37:02.598336652Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:37:02.598347890Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:37:02.598503988Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:37:02.598546731Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:37:02.598806066Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:37:02.598812984Z [2024-03-29 00:37:02,598: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:37:02.676467088Z [2024-03-29 00:37:02,676: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:37:02.679149001Z [2024-03-29 00:37:02,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:37:04.605674407Z [2024-03-29 00:37:04,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed14b2e3-5a74-459c-a63f-efe705f164e9] succeeded in 3.933452460000808s: None 2024-03-29T00:37:04.873798937Z [2024-03-29 00:37:04,873: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[935e0cde-3007-4a2b-b163-b7e99c6bed85] succeeded in 4.197871132999353s: None 2024-03-29T00:38:00.459907404Z [2024-03-29 00:38:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64948baa-c490-4ed5-a3d7-f1e98a30185d] received 2024-03-29T00:38:00.467271273Z [2024-03-29 00:38:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d3a1537-6b49-443b-8e35-aa5816eab85b] received 2024-03-29T00:38:00.469931603Z [2024-03-29 00:38:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43172367-3318-4b12-b1ec-7163929fce4e] received 2024-03-29T00:38:00.470062021Z [2024-03-29 00:38:00,469: INFO/ForkPoolWorker-15] [64948baa-c490-4ed5-a3d7-f1e98a30185d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:38:00.473013696Z [2024-03-29 00:38:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe3b796d-0095-4254-87c5-a1578f718adb] received 2024-03-29T00:38:00.480401010Z [2024-03-29 00:38:00,480: INFO/ForkPoolWorker-16] [9d3a1537-6b49-443b-8e35-aa5816eab85b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:38:00.486969585Z [2024-03-29 00:38:00,486: INFO/ForkPoolWorker-2] [fe3b796d-0095-4254-87c5-a1578f718adb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:38:00.490025297Z [2024-03-29 00:38:00,489: INFO/ForkPoolWorker-1] [43172367-3318-4b12-b1ec-7163929fce4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:38:00.901977649Z [2024-03-29 00:38:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:38:00.973360024Z [2024-03-29 00:38:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:38:01.141034864Z [2024-03-29 00:38:01,137: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:38:01.178672826Z [2024-03-29 00:38:01,175: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:38:01.277476101Z [2024-03-29 00:38:01,276: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:38:01.281953558Z [2024-03-29 00:38:01,281: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:38:01.318017367Z [2024-03-29 00:38:01,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:38:01.320028979Z [2024-03-29 00:38:01,319: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:38:01.320363342Z [2024-03-29 00:38:01,320: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:38:01.320551753Z [2024-03-29 00:38:01,320: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:38:01.320997985Z [2024-03-29 00:38:01,320: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:38:01.324325732Z [2024-03-29 00:38:01,323: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:38:01.478614680Z [2024-03-29 00:38:01,478: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:38:02.167484339Z [2024-03-29 00:38:02,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64948baa-c490-4ed5-a3d7-f1e98a30185d] succeeded in 1.7052101150002272s: None 2024-03-29T00:38:02.383868891Z [2024-03-29 00:38:02,383: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d3a1537-6b49-443b-8e35-aa5816eab85b] succeeded in 1.9120705239993185s: None 2024-03-29T00:38:02.807580265Z [2024-03-29 00:38:02,807: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:38:02.811151777Z [2024-03-29 00:38:02,810: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:38:02.835519276Z [2024-03-29 00:38:02,835: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:38:02.837076561Z [2024-03-29 00:38:02,836: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:38:02.837091717Z [2024-03-29 00:38:02,836: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:38:02.837322360Z [2024-03-29 00:38:02,837: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:38:02.837385967Z [2024-03-29 00:38:02,837: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:38:02.837660531Z [2024-03-29 00:38:02,837: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:38:02.837774676Z [2024-03-29 00:38:02,837: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:38:02.935983388Z [2024-03-29 00:38:02,935: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:38:03.212796496Z [2024-03-29 00:38:03,212: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:38:03.216450527Z [2024-03-29 00:38:03,215: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:38:03.258657380Z [2024-03-29 00:38:03,258: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:38:03.264204747Z [2024-03-29 00:38:03,263: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:38:03.264364355Z [2024-03-29 00:38:03,264: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:38:03.264602399Z [2024-03-29 00:38:03,264: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:38:03.264677357Z [2024-03-29 00:38:03,264: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:38:03.265101011Z [2024-03-29 00:38:03,264: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:38:03.265212786Z [2024-03-29 00:38:03,265: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:38:03.376371196Z [2024-03-29 00:38:03,375: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:38:05.093466385Z [2024-03-29 00:38:05,092: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43172367-3318-4b12-b1ec-7163929fce4e] succeeded in 4.62039912399996s: None 2024-03-29T00:38:05.303387329Z [2024-03-29 00:38:05,302: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe3b796d-0095-4254-87c5-a1578f718adb] succeeded in 4.828296128999682s: None 2024-03-29T00:39:00.412260038Z [2024-03-29 00:39:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80bcab96-b6ac-44cf-934f-f9f421b98db9] received 2024-03-29T00:39:00.421772617Z [2024-03-29 00:39:00,421: INFO/ForkPoolWorker-15] [80bcab96-b6ac-44cf-934f-f9f421b98db9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:39:00.427227748Z [2024-03-29 00:39:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6528def-7afe-4ee2-91b1-9d35b5385002] received 2024-03-29T00:39:00.434787700Z [2024-03-29 00:39:00,434: INFO/ForkPoolWorker-16] [a6528def-7afe-4ee2-91b1-9d35b5385002] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:39:00.438130725Z [2024-03-29 00:39:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4daa6ab-6b40-4fb2-8879-4e93d47346b6] received 2024-03-29T00:39:00.458336029Z [2024-03-29 00:39:00,458: INFO/ForkPoolWorker-1] [b4daa6ab-6b40-4fb2-8879-4e93d47346b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:39:00.785784021Z [2024-03-29 00:39:00,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:39:00.816119622Z [2024-03-29 00:39:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:39:00.911259045Z [2024-03-29 00:39:00,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:39:01.112962994Z [2024-03-29 00:39:01,112: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:39:01.120779883Z [2024-03-29 00:39:01,120: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:39:01.179611392Z [2024-03-29 00:39:01,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:39:01.184307322Z [2024-03-29 00:39:01,183: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:39:01.184370708Z [2024-03-29 00:39:01,184: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:39:01.184380834Z [2024-03-29 00:39:01,184: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:39:01.184906714Z [2024-03-29 00:39:01,184: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:39:01.323662780Z [2024-03-29 00:39:01,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:39:02.124484618Z [2024-03-29 00:39:02,124: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6528def-7afe-4ee2-91b1-9d35b5385002] succeeded in 1.6950988279995727s: None 2024-03-29T00:39:02.296309825Z [2024-03-29 00:39:02,295: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:39:02.296433058Z [2024-03-29 00:39:02,296: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:39:02.300152727Z [2024-03-29 00:39:02,299: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:39:02.300455396Z [2024-03-29 00:39:02,299: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:39:02.322915688Z [2024-03-29 00:39:02,322: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:39:02.324532880Z [2024-03-29 00:39:02,324: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:39:02.324853603Z [2024-03-29 00:39:02,324: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:39:02.325068121Z [2024-03-29 00:39:02,324: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:39:02.325208795Z [2024-03-29 00:39:02,325: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:39:02.325624217Z [2024-03-29 00:39:02,325: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:39:02.326286050Z [2024-03-29 00:39:02,326: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:39:02.327517829Z [2024-03-29 00:39:02,327: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:39:02.328857577Z [2024-03-29 00:39:02,328: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:39:02.329027204Z [2024-03-29 00:39:02,328: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:39:02.329210077Z [2024-03-29 00:39:02,329: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:39:02.329321312Z [2024-03-29 00:39:02,329: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:39:02.329653202Z [2024-03-29 00:39:02,329: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:39:02.329791522Z [2024-03-29 00:39:02,329: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:39:02.418021520Z [2024-03-29 00:39:02,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:39:02.437830125Z [2024-03-29 00:39:02,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:39:03.961101873Z [2024-03-29 00:39:03,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4daa6ab-6b40-4fb2-8879-4e93d47346b6] succeeded in 3.5192688470006033s: None 2024-03-29T00:39:04.320123754Z [2024-03-29 00:39:04,319: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80bcab96-b6ac-44cf-934f-f9f421b98db9] succeeded in 3.9040617750006277s: None 2024-03-29T00:40:00.881619364Z [2024-03-29 00:40:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce2c2791-792b-4182-991e-9331513d39b8] received 2024-03-29T00:40:00.897049983Z [2024-03-29 00:40:00,896: INFO/ForkPoolWorker-15] [ce2c2791-792b-4182-991e-9331513d39b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:00.902838728Z [2024-03-29 00:40:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2980cda5-360c-4ded-997c-f1c467618677] received 2024-03-29T00:40:00.907589254Z [2024-03-29 00:40:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94e2668e-4221-43f8-8822-5efbf38ae2f7] received 2024-03-29T00:40:00.909831611Z [2024-03-29 00:40:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74b69b0a-c5c5-437f-abef-621c960ff83d] received 2024-03-29T00:40:00.918265803Z [2024-03-29 00:40:00,917: INFO/ForkPoolWorker-16] [2980cda5-360c-4ded-997c-f1c467618677] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:40:00.923414228Z [2024-03-29 00:40:00,923: INFO/ForkPoolWorker-1] [94e2668e-4221-43f8-8822-5efbf38ae2f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:40:00.956639702Z [2024-03-29 00:40:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9b061eb-12ba-4b0d-8c9d-b72057c0d66e] received 2024-03-29T00:40:00.976478890Z [2024-03-29 00:40:00,976: INFO/ForkPoolWorker-2] [74b69b0a-c5c5-437f-abef-621c960ff83d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:40:00.976626439Z [2024-03-29 00:40:00,976: INFO/ForkPoolWorker-3] [f9b061eb-12ba-4b0d-8c9d-b72057c0d66e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:40:01.346244986Z [2024-03-29 00:40:01,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:40:01.448679417Z [2024-03-29 00:40:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:40:01.553849435Z [2024-03-29 00:40:01,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:40:01.564658721Z [2024-03-29 00:40:01,557: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:40:01.631383970Z [2024-03-29 00:40:01,626: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:40:01.836161792Z [2024-03-29 00:40:01,834: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:01.953687164Z [2024-03-29 00:40:01,953: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T00:40:01.967262352Z [2024-03-29 00:40:01,966: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:02.025552420Z [2024-03-29 00:40:02,025: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T00:40:02.030058560Z [2024-03-29 00:40:02,029: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:40:02.030109015Z [2024-03-29 00:40:02,029: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:40:02.030180010Z [2024-03-29 00:40:02,030: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T00:40:02.030402250Z [2024-03-29 00:40:02,030: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:40:02.176797087Z [2024-03-29 00:40:02,176: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:02.953372418Z [2024-03-29 00:40:02,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2980cda5-360c-4ded-997c-f1c467618677] succeeded in 2.0487314319998404s: None 2024-03-29T00:40:03.282679671Z [2024-03-29 00:40:03,282: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f9b061eb-12ba-4b0d-8c9d-b72057c0d66e] succeeded in 2.3219508069996664s: None 2024-03-29T00:40:03.293309965Z [2024-03-29 00:40:03,292: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:40:03.297469538Z [2024-03-29 00:40:03,296: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:03.329460462Z [2024-03-29 00:40:03,329: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:40:03.330866026Z [2024-03-29 00:40:03,330: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:03.330885946Z [2024-03-29 00:40:03,330: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:03.330994922Z [2024-03-29 00:40:03,330: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:03.331040538Z [2024-03-29 00:40:03,330: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:40:03.331281120Z [2024-03-29 00:40:03,331: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:40:03.331311966Z [2024-03-29 00:40:03,331: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:03.441699763Z [2024-03-29 00:40:03,441: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:03.465471856Z [2024-03-29 00:40:03,465: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:40:03.469813825Z [2024-03-29 00:40:03,469: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:03.502175217Z [2024-03-29 00:40:03,501: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:40:03.504777525Z [2024-03-29 00:40:03,504: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:03.504964389Z [2024-03-29 00:40:03,504: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:03.506657856Z [2024-03-29 00:40:03,505: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:03.507098166Z [2024-03-29 00:40:03,506: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:40:03.507558243Z [2024-03-29 00:40:03,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:40:03.507793165Z [2024-03-29 00:40:03,507: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:03.637398532Z [2024-03-29 00:40:03,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:03.792632780Z [2024-03-29 00:40:03,792: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:40:03.796581535Z [2024-03-29 00:40:03,795: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:03.814024574Z [2024-03-29 00:40:03,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:40:03.815577036Z [2024-03-29 00:40:03,815: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:03.815637210Z [2024-03-29 00:40:03,815: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:03.815791102Z [2024-03-29 00:40:03,815: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:03.815843463Z [2024-03-29 00:40:03,815: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:40:03.816190970Z [2024-03-29 00:40:03,816: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:40:03.816302872Z [2024-03-29 00:40:03,816: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:03.959197548Z [2024-03-29 00:40:03,958: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:04.408235859Z [2024-03-29 00:40:04,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce2c2791-792b-4182-991e-9331513d39b8] succeeded in 3.524318464999851s: None 2024-03-29T00:40:05.292654331Z [2024-03-29 00:40:05,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6647031-af07-48bf-990f-4682c2d4150b] received 2024-03-29T00:40:05.319110296Z [2024-03-29 00:40:05,318: INFO/ForkPoolWorker-15] [f6647031-af07-48bf-990f-4682c2d4150b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:05.766830238Z [2024-03-29 00:40:05,766: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94e2668e-4221-43f8-8822-5efbf38ae2f7] succeeded in 4.855286996999894s: None 2024-03-29T00:40:05.773295681Z [2024-03-29 00:40:05,772: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74b69b0a-c5c5-437f-abef-621c960ff83d] succeeded in 4.823652717999721s: None 2024-03-29T00:40:05.787609104Z [2024-03-29 00:40:05,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:40:07.150619401Z [2024-03-29 00:40:07,150: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:40:07.154250569Z [2024-03-29 00:40:07,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:07.175076803Z [2024-03-29 00:40:07,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:40:07.176427217Z [2024-03-29 00:40:07,176: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:07.176486963Z [2024-03-29 00:40:07,176: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:07.176665505Z [2024-03-29 00:40:07,176: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:07.176714072Z [2024-03-29 00:40:07,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:40:07.177000715Z [2024-03-29 00:40:07,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:40:07.177123038Z [2024-03-29 00:40:07,177: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:07.359287455Z [2024-03-29 00:40:07,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:08.057484250Z [2024-03-29 00:40:08,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6647031-af07-48bf-990f-4682c2d4150b] succeeded in 2.758045151999795s: None 2024-03-29T00:40:08.594712486Z [2024-03-29 00:40:08,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8510494-8585-4947-b950-33e7eb7bd696] received 2024-03-29T00:40:08.606297283Z [2024-03-29 00:40:08,606: INFO/ForkPoolWorker-15] [c8510494-8585-4947-b950-33e7eb7bd696] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:40:08.964895317Z [2024-03-29 00:40:08,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:40:10.448602644Z [2024-03-29 00:40:10,448: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:40:10.452479347Z [2024-03-29 00:40:10,452: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:10.480493528Z [2024-03-29 00:40:10,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:40:10.481874808Z [2024-03-29 00:40:10,481: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:10.482061458Z [2024-03-29 00:40:10,481: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:10.482319574Z [2024-03-29 00:40:10,482: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:10.482436643Z [2024-03-29 00:40:10,482: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:40:10.482779021Z [2024-03-29 00:40:10,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:40:10.482908062Z [2024-03-29 00:40:10,482: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:10.624655709Z [2024-03-29 00:40:10,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:11.367514215Z [2024-03-29 00:40:11,366: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8510494-8585-4947-b950-33e7eb7bd696] succeeded in 2.7690868659992702s: None 2024-03-29T00:40:12.103054172Z [2024-03-29 00:40:12,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebd7c556-b155-467f-8d90-196e6af190c6] received 2024-03-29T00:40:12.124568043Z [2024-03-29 00:40:12,124: INFO/ForkPoolWorker-15] [ebd7c556-b155-467f-8d90-196e6af190c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:12.522051354Z [2024-03-29 00:40:12,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:40:13.993073041Z [2024-03-29 00:40:13,992: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:40:13.997155909Z [2024-03-29 00:40:13,996: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:40:14.048938659Z [2024-03-29 00:40:14,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:40:14.053878198Z [2024-03-29 00:40:14,053: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:40:14.062735355Z [2024-03-29 00:40:14,053: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:40:14.063194303Z [2024-03-29 00:40:14,062: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:40:14.063286161Z [2024-03-29 00:40:14,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:40:14.063862413Z [2024-03-29 00:40:14,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:40:14.065239419Z [2024-03-29 00:40:14,063: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:40:14.293276342Z [2024-03-29 00:40:14,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:40:15.099838041Z [2024-03-29 00:40:15,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ebd7c556-b155-467f-8d90-196e6af190c6] succeeded in 2.9949738719997185s: None 2024-03-29T00:41:01.166403703Z [2024-03-29 00:41:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9581af18-b52c-449c-9003-f432211363b8] received 2024-03-29T00:41:01.171153826Z [2024-03-29 00:41:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d88cf48f-f6a1-444c-8b4b-c2e8047434d9] received 2024-03-29T00:41:01.176530856Z [2024-03-29 00:41:01,176: INFO/ForkPoolWorker-15] [9581af18-b52c-449c-9003-f432211363b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:41:01.179101761Z [2024-03-29 00:41:01,178: INFO/ForkPoolWorker-16] [d88cf48f-f6a1-444c-8b4b-c2e8047434d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:41:01.187211294Z [2024-03-29 00:41:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11e76e18-8885-4467-9f6a-a39187a5e49f] received 2024-03-29T00:41:01.196231064Z [2024-03-29 00:41:01,195: INFO/ForkPoolWorker-1] [11e76e18-8885-4467-9f6a-a39187a5e49f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:41:01.603089392Z [2024-03-29 00:41:01,599: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:41:01.697906134Z [2024-03-29 00:41:01,692: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:41:01.709925819Z [2024-03-29 00:41:01,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:41:01.978281773Z [2024-03-29 00:41:01,977: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:41:01.983018834Z [2024-03-29 00:41:01,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:41:02.023020860Z [2024-03-29 00:41:02,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:41:02.027179146Z [2024-03-29 00:41:02,026: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:41:02.027286829Z [2024-03-29 00:41:02,027: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:41:02.027401313Z [2024-03-29 00:41:02,027: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:41:02.027696244Z [2024-03-29 00:41:02,027: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:41:02.169063577Z [2024-03-29 00:41:02,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:41:03.053717581Z [2024-03-29 00:41:03,053: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9581af18-b52c-449c-9003-f432211363b8] succeeded in 1.8848351269998602s: None 2024-03-29T00:41:03.065616305Z [2024-03-29 00:41:03,065: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:41:03.070892358Z [2024-03-29 00:41:03,070: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:41:03.094006386Z [2024-03-29 00:41:03,093: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:41:03.096167317Z [2024-03-29 00:41:03,095: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:41:03.096443267Z [2024-03-29 00:41:03,096: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:41:03.096746994Z [2024-03-29 00:41:03,096: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:41:03.096948984Z [2024-03-29 00:41:03,096: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:41:03.097373309Z [2024-03-29 00:41:03,097: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:41:03.098019430Z [2024-03-29 00:41:03,097: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:41:03.192950857Z [2024-03-29 00:41:03,192: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:41:03.307556895Z [2024-03-29 00:41:03,307: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:41:03.311230465Z [2024-03-29 00:41:03,310: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:41:03.349609676Z [2024-03-29 00:41:03,349: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:41:03.351708737Z [2024-03-29 00:41:03,351: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:41:03.351730307Z [2024-03-29 00:41:03,351: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:41:03.351812994Z [2024-03-29 00:41:03,351: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:41:03.351839350Z [2024-03-29 00:41:03,351: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:41:03.352148409Z [2024-03-29 00:41:03,352: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:41:03.352213274Z [2024-03-29 00:41:03,352: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:41:03.483854423Z [2024-03-29 00:41:03,483: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:41:05.225942926Z [2024-03-29 00:41:05,225: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[11e76e18-8885-4467-9f6a-a39187a5e49f] succeeded in 4.0370180049994815s: None 2024-03-29T00:41:06.346257353Z [2024-03-29 00:41:06,345: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d88cf48f-f6a1-444c-8b4b-c2e8047434d9] succeeded in 5.173079631999826s: None 2024-03-29T00:42:00.929772210Z [2024-03-29 00:42:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[965425d3-3bf5-4e03-8dfb-23e287f82c2f] received 2024-03-29T00:42:00.932411914Z [2024-03-29 00:42:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a61d411c-33dc-4d72-b9c8-ea1c23e0c45d] received 2024-03-29T00:42:00.934632921Z [2024-03-29 00:42:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c1aa29d-61bd-405a-80eb-590320494722] received 2024-03-29T00:42:00.941661167Z [2024-03-29 00:42:00,941: INFO/ForkPoolWorker-15] [965425d3-3bf5-4e03-8dfb-23e287f82c2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:42:00.942113808Z [2024-03-29 00:42:00,941: INFO/ForkPoolWorker-16] [a61d411c-33dc-4d72-b9c8-ea1c23e0c45d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:42:00.950694191Z [2024-03-29 00:42:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13dbe575-882e-47e4-8ba8-54aa63a25f1a] received 2024-03-29T00:42:00.953686449Z [2024-03-29 00:42:00,953: INFO/ForkPoolWorker-1] [3c1aa29d-61bd-405a-80eb-590320494722] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:42:00.962989247Z [2024-03-29 00:42:00,962: INFO/ForkPoolWorker-2] [13dbe575-882e-47e4-8ba8-54aa63a25f1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:42:01.395409843Z [2024-03-29 00:42:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:42:01.536288445Z [2024-03-29 00:42:01,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:42:01.655956163Z [2024-03-29 00:42:01,652: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:42:01.775209546Z [2024-03-29 00:42:01,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:42:02.267189991Z [2024-03-29 00:42:02,266: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:42:02.276976478Z [2024-03-29 00:42:02,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:42:02.359735834Z [2024-03-29 00:42:02,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:42:02.367069443Z [2024-03-29 00:42:02,366: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:42:02.367676019Z [2024-03-29 00:42:02,366: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:42:02.368118422Z [2024-03-29 00:42:02,367: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:42:02.368575881Z [2024-03-29 00:42:02,368: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:42:02.551935916Z [2024-03-29 00:42:02,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:42:02.638261367Z [2024-03-29 00:42:02,637: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:42:03.533514651Z [2024-03-29 00:42:03,532: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:42:03.553632148Z [2024-03-29 00:42:03,553: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:42:03.565638153Z [2024-03-29 00:42:03,565: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[965425d3-3bf5-4e03-8dfb-23e287f82c2f] succeeded in 2.6338984599997275s: None 2024-03-29T00:42:03.596280872Z [2024-03-29 00:42:03,596: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:42:03.598359509Z [2024-03-29 00:42:03,597: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:42:03.605881146Z [2024-03-29 00:42:03,605: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:42:03.606635539Z [2024-03-29 00:42:03,606: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:42:03.606722936Z [2024-03-29 00:42:03,606: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:42:03.606894712Z [2024-03-29 00:42:03,606: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:42:03.606950373Z [2024-03-29 00:42:03,606: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:42:03.607279828Z [2024-03-29 00:42:03,607: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:42:03.607755257Z [2024-03-29 00:42:03,607: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:42:03.624221585Z [2024-03-29 00:42:03,622: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a61d411c-33dc-4d72-b9c8-ea1c23e0c45d] succeeded in 2.6880655159993694s: None 2024-03-29T00:42:03.661677678Z [2024-03-29 00:42:03,661: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:42:03.663776378Z [2024-03-29 00:42:03,663: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:42:03.664002408Z [2024-03-29 00:42:03,663: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:42:03.664299897Z [2024-03-29 00:42:03,663: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:42:03.664526395Z [2024-03-29 00:42:03,664: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:42:03.665010575Z [2024-03-29 00:42:03,664: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:42:03.665282530Z [2024-03-29 00:42:03,665: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:42:03.697078317Z [2024-03-29 00:42:03,696: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:42:03.777991813Z [2024-03-29 00:42:03,777: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:42:05.558261724Z [2024-03-29 00:42:05,557: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c1aa29d-61bd-405a-80eb-590320494722] succeeded in 4.6185848140003145s: None 2024-03-29T00:42:06.145378162Z [2024-03-29 00:42:06,144: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[13dbe575-882e-47e4-8ba8-54aa63a25f1a] succeeded in 5.189633390000381s: None 2024-03-29T00:43:00.664319901Z [2024-03-29 00:43:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0290fcbc-3381-4886-9d60-f2687e972a86] received 2024-03-29T00:43:00.667331654Z [2024-03-29 00:43:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[176a6a15-bfcc-4f1c-aba3-059df0e08b6b] received 2024-03-29T00:43:00.670122841Z [2024-03-29 00:43:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d73da41-1fd6-4510-903a-18bbbc16e499] received 2024-03-29T00:43:00.672568563Z [2024-03-29 00:43:00,672: INFO/ForkPoolWorker-15] [0290fcbc-3381-4886-9d60-f2687e972a86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:43:00.680135622Z [2024-03-29 00:43:00,679: INFO/ForkPoolWorker-1] [4d73da41-1fd6-4510-903a-18bbbc16e499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:43:00.685762713Z [2024-03-29 00:43:00,685: INFO/ForkPoolWorker-16] [176a6a15-bfcc-4f1c-aba3-059df0e08b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:43:00.990808142Z [2024-03-29 00:43:00,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:43:00.993146406Z [2024-03-29 00:43:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:43:01.114193899Z [2024-03-29 00:43:01,111: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:43:01.275147451Z [2024-03-29 00:43:01,274: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:43:01.279195122Z [2024-03-29 00:43:01,278: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:43:01.303909735Z [2024-03-29 00:43:01,303: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:43:01.307460309Z [2024-03-29 00:43:01,307: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:43:01.307487685Z [2024-03-29 00:43:01,307: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:43:01.307570195Z [2024-03-29 00:43:01,307: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:43:01.307780539Z [2024-03-29 00:43:01,307: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:43:01.419256910Z [2024-03-29 00:43:01,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:43:02.139576816Z [2024-03-29 00:43:02,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[176a6a15-bfcc-4f1c-aba3-059df0e08b6b] succeeded in 1.4688099880004302s: None 2024-03-29T00:43:02.329660014Z [2024-03-29 00:43:02,329: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:43:02.342649612Z [2024-03-29 00:43:02,332: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:43:02.359733121Z [2024-03-29 00:43:02,359: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:43:02.365370363Z [2024-03-29 00:43:02,364: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:43:02.365476049Z [2024-03-29 00:43:02,365: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:43:02.365833540Z [2024-03-29 00:43:02,365: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:43:02.365964091Z [2024-03-29 00:43:02,365: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:43:02.366550246Z [2024-03-29 00:43:02,366: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:43:02.366714912Z [2024-03-29 00:43:02,366: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:43:02.476472182Z [2024-03-29 00:43:02,476: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:43:02.593775896Z [2024-03-29 00:43:02,593: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:43:02.597668174Z [2024-03-29 00:43:02,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:43:02.619455892Z [2024-03-29 00:43:02,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:43:02.620899784Z [2024-03-29 00:43:02,620: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:43:02.620949684Z [2024-03-29 00:43:02,620: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:43:02.621197598Z [2024-03-29 00:43:02,620: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:43:02.621318406Z [2024-03-29 00:43:02,621: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:43:02.621662953Z [2024-03-29 00:43:02,621: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:43:02.621799494Z [2024-03-29 00:43:02,621: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:43:02.726873904Z [2024-03-29 00:43:02,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:43:04.091862130Z [2024-03-29 00:43:04,091: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d73da41-1fd6-4510-903a-18bbbc16e499] succeeded in 3.419867599999634s: None 2024-03-29T00:43:04.709139639Z [2024-03-29 00:43:04,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0290fcbc-3381-4886-9d60-f2687e972a86] succeeded in 4.042743665999296s: None 2024-03-29T00:44:00.209879125Z [2024-03-29 00:44:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d13b471e-8ccc-431e-b6a3-09e6e2372796] received 2024-03-29T00:44:00.221580896Z [2024-03-29 00:44:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72384505-60fb-4c2a-8424-5bd08668d49e] received 2024-03-29T00:44:00.226054429Z [2024-03-29 00:44:00,225: INFO/ForkPoolWorker-15] [d13b471e-8ccc-431e-b6a3-09e6e2372796] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:44:00.230203767Z [2024-03-29 00:44:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e002cdb3-2ce0-4e70-96bc-490810ad46b2] received 2024-03-29T00:44:00.230226986Z [2024-03-29 00:44:00,229: INFO/ForkPoolWorker-16] [72384505-60fb-4c2a-8424-5bd08668d49e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:44:00.234890224Z [2024-03-29 00:44:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a417275d-4f3e-4d0c-b01e-8af5b43fea52] received 2024-03-29T00:44:00.250045298Z [2024-03-29 00:44:00,249: INFO/ForkPoolWorker-2] [a417275d-4f3e-4d0c-b01e-8af5b43fea52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:44:00.252424352Z [2024-03-29 00:44:00,252: INFO/ForkPoolWorker-1] [e002cdb3-2ce0-4e70-96bc-490810ad46b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:44:00.642361230Z [2024-03-29 00:44:00,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:44:00.642809630Z [2024-03-29 00:44:00,639: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:44:00.814069847Z [2024-03-29 00:44:00,811: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:44:00.840932525Z [2024-03-29 00:44:00,837: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:44:00.990385341Z [2024-03-29 00:44:00,989: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:44:00.996499487Z [2024-03-29 00:44:00,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:44:01.047597329Z [2024-03-29 00:44:01,047: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:44:01.048770539Z [2024-03-29 00:44:01,048: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:44:01.048892016Z [2024-03-29 00:44:01,048: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:44:01.049017567Z [2024-03-29 00:44:01,048: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:44:01.049268784Z [2024-03-29 00:44:01,049: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:44:01.066978670Z [2024-03-29 00:44:01,066: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:44:01.148437763Z [2024-03-29 00:44:01,148: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:44:01.914965853Z [2024-03-29 00:44:01,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d13b471e-8ccc-431e-b6a3-09e6e2372796] succeeded in 1.7022812369996245s: None 2024-03-29T00:44:01.945093797Z [2024-03-29 00:44:01,944: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a417275d-4f3e-4d0c-b01e-8af5b43fea52] succeeded in 1.7080782489992998s: None 2024-03-29T00:44:02.223686474Z [2024-03-29 00:44:02,223: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:44:02.227482746Z [2024-03-29 00:44:02,226: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:44:02.263448025Z [2024-03-29 00:44:02,263: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:44:02.265379896Z [2024-03-29 00:44:02,265: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:44:02.265458274Z [2024-03-29 00:44:02,265: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:44:02.265699741Z [2024-03-29 00:44:02,265: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:44:02.265808973Z [2024-03-29 00:44:02,265: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:44:02.266163592Z [2024-03-29 00:44:02,265: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:44:02.266211148Z [2024-03-29 00:44:02,266: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:44:02.329018253Z [2024-03-29 00:44:02,328: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:44:02.332852221Z [2024-03-29 00:44:02,332: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:44:02.357937459Z [2024-03-29 00:44:02,357: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:44:02.359764514Z [2024-03-29 00:44:02,359: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:44:02.359930360Z [2024-03-29 00:44:02,359: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:44:02.360123773Z [2024-03-29 00:44:02,359: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:44:02.360258013Z [2024-03-29 00:44:02,360: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:44:02.360635482Z [2024-03-29 00:44:02,360: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:44:02.360759507Z [2024-03-29 00:44:02,360: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:44:02.361471457Z [2024-03-29 00:44:02,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:44:02.444928802Z [2024-03-29 00:44:02,444: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:44:04.203102398Z [2024-03-29 00:44:04,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72384505-60fb-4c2a-8424-5bd08668d49e] succeeded in 3.9782957099996565s: None 2024-03-29T00:44:04.426251147Z [2024-03-29 00:44:04,425: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e002cdb3-2ce0-4e70-96bc-490810ad46b2] succeeded in 4.190259980000519s: None 2024-03-29T00:45:01.035856344Z [2024-03-29 00:45:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1df6ec08-4c9e-48bf-9956-cd6529fe942c] received 2024-03-29T00:45:01.040817093Z [2024-03-29 00:45:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c54eef87-20fb-4290-ba06-535dccfef2df] received 2024-03-29T00:45:01.046458995Z [2024-03-29 00:45:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2fc0a4-9a2e-47a1-964a-e1eac51b47ec] received 2024-03-29T00:45:01.055786294Z [2024-03-29 00:45:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37cc22f-eae9-492c-939f-80a9355ec251] received 2024-03-29T00:45:01.066633438Z [2024-03-29 00:45:01,066: INFO/ForkPoolWorker-2] [b37cc22f-eae9-492c-939f-80a9355ec251] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:45:01.089050744Z [2024-03-29 00:45:01,088: INFO/ForkPoolWorker-15] [1df6ec08-4c9e-48bf-9956-cd6529fe942c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:45:01.089791269Z [2024-03-29 00:45:01,089: INFO/ForkPoolWorker-16] [c54eef87-20fb-4290-ba06-535dccfef2df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:01.116293567Z [2024-03-29 00:45:01,115: INFO/ForkPoolWorker-1] [0a2fc0a4-9a2e-47a1-964a-e1eac51b47ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:45:01.890998652Z [2024-03-29 00:45:01,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:45:02.278657658Z [2024-03-29 00:45:02,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:45:02.520806115Z [2024-03-29 00:45:02,502: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:45:02.545956829Z [2024-03-29 00:45:02,545: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:45:02.566606605Z [2024-03-29 00:45:02,565: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:02.667695968Z [2024-03-29 00:45:02,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:45:02.896658799Z [2024-03-29 00:45:02,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:45:02.899561137Z [2024-03-29 00:45:02,899: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:45:02.899758680Z [2024-03-29 00:45:02,899: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:45:02.918997919Z [2024-03-29 00:45:02,918: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:45:02.919373355Z [2024-03-29 00:45:02,919: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:45:03.201328616Z [2024-03-29 00:45:03,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:05.892319285Z [2024-03-29 00:45:05,891: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1df6ec08-4c9e-48bf-9956-cd6529fe942c] succeeded in 4.853219356999944s: None 2024-03-29T00:45:06.494235942Z [2024-03-29 00:45:06,493: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:45:06.498514607Z [2024-03-29 00:45:06,497: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:06.531205584Z [2024-03-29 00:45:06,530: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:45:06.533310325Z [2024-03-29 00:45:06,532: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:06.533357720Z [2024-03-29 00:45:06,533: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:06.533976910Z [2024-03-29 00:45:06,533: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:06.534120636Z [2024-03-29 00:45:06,533: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:45:06.534393081Z [2024-03-29 00:45:06,534: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:45:06.534408669Z [2024-03-29 00:45:06,534: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:07.049533029Z [2024-03-29 00:45:07,049: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:09.137412982Z [2024-03-29 00:45:09,136: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:45:09.144698862Z [2024-03-29 00:45:09,144: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:09.232567023Z [2024-03-29 00:45:09,232: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:45:09.244120328Z [2024-03-29 00:45:09,243: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:09.244778525Z [2024-03-29 00:45:09,243: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:09.245001757Z [2024-03-29 00:45:09,244: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:09.245185624Z [2024-03-29 00:45:09,244: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:45:09.245552857Z [2024-03-29 00:45:09,245: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:45:09.245851664Z [2024-03-29 00:45:09,245: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:09.557571269Z [2024-03-29 00:45:09,557: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:10.032902843Z [2024-03-29 00:45:10,032: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c54eef87-20fb-4290-ba06-535dccfef2df] succeeded in 8.988469192000593s: None 2024-03-29T00:45:10.217024236Z [2024-03-29 00:45:10,216: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:45:10.237846737Z [2024-03-29 00:45:10,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:10.381372493Z [2024-03-29 00:45:10,381: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:45:10.387499650Z [2024-03-29 00:45:10,387: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:10.389110107Z [2024-03-29 00:45:10,387: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:10.390810738Z [2024-03-29 00:45:10,390: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:10.391009598Z [2024-03-29 00:45:10,390: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:45:10.391413029Z [2024-03-29 00:45:10,391: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:45:10.394680672Z [2024-03-29 00:45:10,394: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:10.666955684Z [2024-03-29 00:45:10,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a863348e-6861-4af7-8b56-8faafb6c32a0] received 2024-03-29T00:45:10.667641652Z [2024-03-29 00:45:10,667: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:10.681976507Z [2024-03-29 00:45:10,681: INFO/ForkPoolWorker-15] [a863348e-6861-4af7-8b56-8faafb6c32a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:11.951996091Z [2024-03-29 00:45:11,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:45:12.841819868Z [2024-03-29 00:45:12,841: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a2fc0a4-9a2e-47a1-964a-e1eac51b47ec] succeeded in 11.771194269000262s: None 2024-03-29T00:45:13.749015066Z [2024-03-29 00:45:13,748: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b37cc22f-eae9-492c-939f-80a9355ec251] succeeded in 12.690151621999576s: None 2024-03-29T00:45:14.066267303Z [2024-03-29 00:45:14,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:45:14.072192209Z [2024-03-29 00:45:14,071: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:14.102182160Z [2024-03-29 00:45:14,101: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:45:14.107759762Z [2024-03-29 00:45:14,107: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:14.107780739Z [2024-03-29 00:45:14,107: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:14.108036267Z [2024-03-29 00:45:14,107: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:14.108222357Z [2024-03-29 00:45:14,107: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:45:14.109282746Z [2024-03-29 00:45:14,109: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:45:14.109295033Z [2024-03-29 00:45:14,109: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:14.277196840Z [2024-03-29 00:45:14,270: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:15.098236320Z [2024-03-29 00:45:15,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a863348e-6861-4af7-8b56-8faafb6c32a0] succeeded in 4.4255893010004s: None 2024-03-29T00:45:15.392400130Z [2024-03-29 00:45:15,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24ffd7ad-efff-4047-96af-7a6e3489ddd4] received 2024-03-29T00:45:15.404120087Z [2024-03-29 00:45:15,403: INFO/ForkPoolWorker-15] [24ffd7ad-efff-4047-96af-7a6e3489ddd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:45:15.768769376Z [2024-03-29 00:45:15,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:45:17.177859231Z [2024-03-29 00:45:17,177: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:45:17.181725564Z [2024-03-29 00:45:17,181: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:17.276731625Z [2024-03-29 00:45:17,275: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:45:17.283548024Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:17.283642747Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:17.283650124Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:17.283722911Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:45:17.284013918Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:45:17.284077803Z [2024-03-29 00:45:17,283: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:17.466772103Z [2024-03-29 00:45:17,464: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:18.286917657Z [2024-03-29 00:45:18,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24ffd7ad-efff-4047-96af-7a6e3489ddd4] succeeded in 2.892689154999971s: None 2024-03-29T00:45:19.378257986Z [2024-03-29 00:45:19,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[494d780d-3591-419e-8d76-c181ca9de656] received 2024-03-29T00:45:19.391555576Z [2024-03-29 00:45:19,391: INFO/ForkPoolWorker-15] [494d780d-3591-419e-8d76-c181ca9de656] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:19.898059813Z [2024-03-29 00:45:19,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:45:21.370407391Z [2024-03-29 00:45:21,370: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:45:21.374058727Z [2024-03-29 00:45:21,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:45:21.440508078Z [2024-03-29 00:45:21,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:45:21.446576165Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:45:21.446600855Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:45:21.446607855Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:45:21.446612049Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:45:21.446615655Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:45:21.446618897Z [2024-03-29 00:45:21,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:45:21.568479426Z [2024-03-29 00:45:21,568: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:45:22.218869607Z [2024-03-29 00:45:22,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[494d780d-3591-419e-8d76-c181ca9de656] succeeded in 2.838356721999844s: None 2024-03-29T00:46:01.087292949Z [2024-03-29 00:46:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c1059be-c36b-4b57-abc7-01f6602ad8ce] received 2024-03-29T00:46:01.089577651Z [2024-03-29 00:46:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44faf442-b942-4fe8-a28a-35d857e45929] received 2024-03-29T00:46:01.091682105Z [2024-03-29 00:46:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e39876c1-91e3-4b12-94f6-501a0a4ecba6] received 2024-03-29T00:46:01.097400982Z [2024-03-29 00:46:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1906120a-d256-4647-8a82-efbbb027ae2e] received 2024-03-29T00:46:01.098106265Z [2024-03-29 00:46:01,097: INFO/ForkPoolWorker-1] [e39876c1-91e3-4b12-94f6-501a0a4ecba6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:46:01.106369491Z [2024-03-29 00:46:01,106: INFO/ForkPoolWorker-16] [44faf442-b942-4fe8-a28a-35d857e45929] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:46:01.122099054Z [2024-03-29 00:46:01,121: INFO/ForkPoolWorker-2] [1906120a-d256-4647-8a82-efbbb027ae2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:46:01.134963237Z [2024-03-29 00:46:01,134: INFO/ForkPoolWorker-15] [1c1059be-c36b-4b57-abc7-01f6602ad8ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:46:01.424800081Z [2024-03-29 00:46:01,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:46:01.622292972Z [2024-03-29 00:46:01,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:46:01.655546769Z [2024-03-29 00:46:01,655: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:46:01.663079311Z [2024-03-29 00:46:01,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:46:01.663894238Z [2024-03-29 00:46:01,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:46:01.721886100Z [2024-03-29 00:46:01,721: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:46:01.723743899Z [2024-03-29 00:46:01,723: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:46:01.723941938Z [2024-03-29 00:46:01,723: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:46:01.724017889Z [2024-03-29 00:46:01,723: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:46:01.724275238Z [2024-03-29 00:46:01,724: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:46:01.780571697Z [2024-03-29 00:46:01,773: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:46:01.850277835Z [2024-03-29 00:46:01,849: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:46:02.044941477Z [2024-03-29 00:46:02,044: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:46:02.735826819Z [2024-03-29 00:46:02,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44faf442-b942-4fe8-a28a-35d857e45929] succeeded in 1.6435128470002383s: None 2024-03-29T00:46:02.881621688Z [2024-03-29 00:46:02,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c1059be-c36b-4b57-abc7-01f6602ad8ce] succeeded in 1.7913155699998242s: None 2024-03-29T00:46:03.225760837Z [2024-03-29 00:46:03,225: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:46:03.229699680Z [2024-03-29 00:46:03,229: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:46:03.258059303Z [2024-03-29 00:46:03,257: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:46:03.260355813Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:46:03.260401957Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:46:03.260478836Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:46:03.260540286Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:46:03.260864727Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:46:03.260951145Z [2024-03-29 00:46:03,260: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:46:03.359064513Z [2024-03-29 00:46:03,358: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:46:03.493995104Z [2024-03-29 00:46:03,493: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:46:03.497563198Z [2024-03-29 00:46:03,497: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:46:03.517185362Z [2024-03-29 00:46:03,516: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:46:03.518782743Z [2024-03-29 00:46:03,518: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:46:03.519022935Z [2024-03-29 00:46:03,518: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:46:03.519967911Z [2024-03-29 00:46:03,519: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:46:03.520167064Z [2024-03-29 00:46:03,520: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:46:03.520555142Z [2024-03-29 00:46:03,520: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:46:03.520752448Z [2024-03-29 00:46:03,520: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:46:03.635989962Z [2024-03-29 00:46:03,635: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:46:05.027344616Z [2024-03-29 00:46:05,024: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e39876c1-91e3-4b12-94f6-501a0a4ecba6] succeeded in 3.931996676000381s: None 2024-03-29T00:46:05.840687443Z [2024-03-29 00:46:05,840: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1906120a-d256-4647-8a82-efbbb027ae2e] succeeded in 4.732419656999809s: None 2024-03-29T00:47:00.807699703Z [2024-03-29 00:47:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff6805d5-8bd6-4e86-ba43-0879cc9b5347] received 2024-03-29T00:47:00.815921268Z [2024-03-29 00:47:00,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d532ec43-f5ef-43e6-bc1d-55c63d373d3e] received 2024-03-29T00:47:00.818374787Z [2024-03-29 00:47:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4567d443-c021-41aa-9aa0-c168e06cd7a6] received 2024-03-29T00:47:00.819139869Z [2024-03-29 00:47:00,818: INFO/ForkPoolWorker-15] [ff6805d5-8bd6-4e86-ba43-0879cc9b5347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:47:00.827093597Z [2024-03-29 00:47:00,826: INFO/ForkPoolWorker-16] [d532ec43-f5ef-43e6-bc1d-55c63d373d3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:47:00.847187908Z [2024-03-29 00:47:00,846: INFO/ForkPoolWorker-1] [4567d443-c021-41aa-9aa0-c168e06cd7a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:47:01.187825082Z [2024-03-29 00:47:01,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:47:01.225380640Z [2024-03-29 00:47:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:47:01.270050468Z [2024-03-29 00:47:01,266: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:47:01.412088524Z [2024-03-29 00:47:01,411: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:47:01.416889238Z [2024-03-29 00:47:01,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:47:01.440974111Z [2024-03-29 00:47:01,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:47:01.442189338Z [2024-03-29 00:47:01,441: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:47:01.442313849Z [2024-03-29 00:47:01,442: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:47:01.442544257Z [2024-03-29 00:47:01,442: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:47:01.442817277Z [2024-03-29 00:47:01,442: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:47:01.560658811Z [2024-03-29 00:47:01,560: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:47:02.419420863Z [2024-03-29 00:47:02,418: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d532ec43-f5ef-43e6-bc1d-55c63d373d3e] succeeded in 1.600682993999726s: None 2024-03-29T00:47:02.749161686Z [2024-03-29 00:47:02,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:47:02.753081592Z [2024-03-29 00:47:02,752: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:47:02.783684472Z [2024-03-29 00:47:02,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:47:02.785266331Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:47:02.785292651Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:47:02.785495087Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:47:02.785591433Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:47:02.785925923Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:47:02.785963381Z [2024-03-29 00:47:02,785: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:47:02.877321644Z [2024-03-29 00:47:02,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:47:02.888576446Z [2024-03-29 00:47:02,888: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:47:02.892687092Z [2024-03-29 00:47:02,892: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:47:02.916736717Z [2024-03-29 00:47:02,916: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:47:02.918178392Z [2024-03-29 00:47:02,917: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:47:02.918287210Z [2024-03-29 00:47:02,918: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:47:02.918496728Z [2024-03-29 00:47:02,918: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:47:02.918580608Z [2024-03-29 00:47:02,918: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:47:02.918951486Z [2024-03-29 00:47:02,918: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:47:02.919064894Z [2024-03-29 00:47:02,918: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:47:03.022759382Z [2024-03-29 00:47:03,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:47:04.824284251Z [2024-03-29 00:47:04,823: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4567d443-c021-41aa-9aa0-c168e06cd7a6] succeeded in 4.000290269999823s: None 2024-03-29T00:47:05.007635663Z [2024-03-29 00:47:05,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff6805d5-8bd6-4e86-ba43-0879cc9b5347] succeeded in 4.197815503999664s: None 2024-03-29T00:48:00.655193883Z [2024-03-29 00:48:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0960113-c404-4d18-bc3a-fd65fac19e4d] received 2024-03-29T00:48:00.657294904Z [2024-03-29 00:48:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4066ec6b-3743-46ce-997c-b13ef3a87b96] received 2024-03-29T00:48:00.663179452Z [2024-03-29 00:48:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbe8d596-b655-4c17-909c-9549869b7518] received 2024-03-29T00:48:00.666255895Z [2024-03-29 00:48:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9ae04d9-44e7-4f1b-bbbe-1d56e89ed5a6] received 2024-03-29T00:48:00.670530101Z [2024-03-29 00:48:00,670: INFO/ForkPoolWorker-1] [dbe8d596-b655-4c17-909c-9549869b7518] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:48:00.671778285Z [2024-03-29 00:48:00,671: INFO/ForkPoolWorker-15] [f0960113-c404-4d18-bc3a-fd65fac19e4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:48:00.672729403Z [2024-03-29 00:48:00,672: INFO/ForkPoolWorker-16] [4066ec6b-3743-46ce-997c-b13ef3a87b96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:48:00.675852648Z [2024-03-29 00:48:00,675: INFO/ForkPoolWorker-2] [e9ae04d9-44e7-4f1b-bbbe-1d56e89ed5a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:48:01.115800060Z [2024-03-29 00:48:01,111: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:48:01.140655014Z [2024-03-29 00:48:01,137: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:48:01.242671920Z [2024-03-29 00:48:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:48:01.557498582Z [2024-03-29 00:48:01,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:48:01.799252233Z [2024-03-29 00:48:01,774: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:48:02.080788711Z [2024-03-29 00:48:02,080: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:48:02.085141289Z [2024-03-29 00:48:02,084: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:48:02.141328392Z [2024-03-29 00:48:02,141: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:48:02.146414210Z [2024-03-29 00:48:02,146: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:48:02.146542806Z [2024-03-29 00:48:02,146: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:48:02.146548406Z [2024-03-29 00:48:02,146: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:48:02.146842005Z [2024-03-29 00:48:02,146: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:48:02.315089189Z [2024-03-29 00:48:02,314: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:48:02.435982401Z [2024-03-29 00:48:02,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0960113-c404-4d18-bc3a-fd65fac19e4d] succeeded in 1.7772554740004125s: None 2024-03-29T00:48:03.238002812Z [2024-03-29 00:48:03,237: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9ae04d9-44e7-4f1b-bbbe-1d56e89ed5a6] succeeded in 2.5679439690002255s: None 2024-03-29T00:48:03.300958329Z [2024-03-29 00:48:03,300: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:48:03.306856003Z [2024-03-29 00:48:03,306: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:48:03.331404473Z [2024-03-29 00:48:03,331: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:48:03.332939853Z [2024-03-29 00:48:03,332: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:48:03.332960629Z [2024-03-29 00:48:03,332: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:48:03.333196874Z [2024-03-29 00:48:03,332: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:48:03.333283987Z [2024-03-29 00:48:03,333: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:48:03.333650345Z [2024-03-29 00:48:03,333: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:48:03.333695251Z [2024-03-29 00:48:03,333: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:48:03.413065338Z [2024-03-29 00:48:03,412: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:48:03.419991553Z [2024-03-29 00:48:03,419: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:48:03.448714317Z [2024-03-29 00:48:03,448: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:48:03.453850314Z [2024-03-29 00:48:03,453: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:48:03.457411748Z [2024-03-29 00:48:03,455: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:48:03.457429891Z [2024-03-29 00:48:03,455: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:48:03.457434364Z [2024-03-29 00:48:03,455: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:48:03.457451594Z [2024-03-29 00:48:03,455: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:48:03.457455235Z [2024-03-29 00:48:03,455: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:48:03.457458674Z [2024-03-29 00:48:03,456: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:48:03.572248661Z [2024-03-29 00:48:03,571: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:48:05.255626984Z [2024-03-29 00:48:05,255: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4066ec6b-3743-46ce-997c-b13ef3a87b96] succeeded in 4.595630893000816s: None 2024-03-29T00:48:05.718484457Z [2024-03-29 00:48:05,717: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbe8d596-b655-4c17-909c-9549869b7518] succeeded in 5.05260390300009s: None 2024-03-29T00:49:01.215217073Z [2024-03-29 00:49:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa27a82f-f4f7-4649-9a66-a803a6b8d813] received 2024-03-29T00:49:01.218670238Z [2024-03-29 00:49:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[910e17f8-2111-4458-80e7-ce0bfc301434] received 2024-03-29T00:49:01.221773893Z [2024-03-29 00:49:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[452e2253-4ec5-47c8-b695-3781d434f2f7] received 2024-03-29T00:49:01.223924194Z [2024-03-29 00:49:01,223: INFO/ForkPoolWorker-15] [aa27a82f-f4f7-4649-9a66-a803a6b8d813] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:49:01.233491591Z [2024-03-29 00:49:01,232: INFO/ForkPoolWorker-16] [910e17f8-2111-4458-80e7-ce0bfc301434] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:49:01.234373215Z [2024-03-29 00:49:01,234: INFO/ForkPoolWorker-1] [452e2253-4ec5-47c8-b695-3781d434f2f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:49:01.535422031Z [2024-03-29 00:49:01,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:49:01.550398929Z [2024-03-29 00:49:01,547: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:49:01.584992422Z [2024-03-29 00:49:01,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:49:01.743121581Z [2024-03-29 00:49:01,742: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:49:01.747302077Z [2024-03-29 00:49:01,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:49:01.775354201Z [2024-03-29 00:49:01,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:49:01.776787484Z [2024-03-29 00:49:01,776: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:49:01.776882083Z [2024-03-29 00:49:01,776: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:49:01.776955337Z [2024-03-29 00:49:01,776: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:49:01.777210486Z [2024-03-29 00:49:01,777: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:49:01.869201025Z [2024-03-29 00:49:01,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:49:02.522115237Z [2024-03-29 00:49:02,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa27a82f-f4f7-4649-9a66-a803a6b8d813] succeeded in 1.3049292530004095s: None 2024-03-29T00:49:02.917206243Z [2024-03-29 00:49:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:49:02.920838249Z [2024-03-29 00:49:02,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:49:02.942080745Z [2024-03-29 00:49:02,941: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:49:02.943795195Z [2024-03-29 00:49:02,943: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:49:02.943967877Z [2024-03-29 00:49:02,943: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:49:02.944157571Z [2024-03-29 00:49:02,943: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:49:02.944287253Z [2024-03-29 00:49:02,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:49:02.944613821Z [2024-03-29 00:49:02,944: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:49:02.944773819Z [2024-03-29 00:49:02,944: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:49:03.029582640Z [2024-03-29 00:49:03,029: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:49:03.033566915Z [2024-03-29 00:49:03,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:49:03.042499169Z [2024-03-29 00:49:03,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:49:03.103198792Z [2024-03-29 00:49:03,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:49:03.105904898Z [2024-03-29 00:49:03,105: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:49:03.105924063Z [2024-03-29 00:49:03,105: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:49:03.105995808Z [2024-03-29 00:49:03,105: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:49:03.106052261Z [2024-03-29 00:49:03,105: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:49:03.106422368Z [2024-03-29 00:49:03,106: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:49:03.106437409Z [2024-03-29 00:49:03,106: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:49:03.259029254Z [2024-03-29 00:49:03,258: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:49:05.458989859Z [2024-03-29 00:49:05,458: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[910e17f8-2111-4458-80e7-ce0bfc301434] succeeded in 4.2372923749999245s: None 2024-03-29T00:49:05.909198353Z [2024-03-29 00:49:05,908: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[452e2253-4ec5-47c8-b695-3781d434f2f7] succeeded in 4.685628572000496s: None 2024-03-29T00:50:01.052202196Z [2024-03-29 00:50:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9777a40a-0052-4794-a54c-7654161522be] received 2024-03-29T00:50:01.056904096Z [2024-03-29 00:50:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87ae39aa-42d1-42da-abfe-3e19df09038b] received 2024-03-29T00:50:01.058851755Z [2024-03-29 00:50:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11a483f6-3104-4a9d-8961-17ce5bc375ba] received 2024-03-29T00:50:01.063140620Z [2024-03-29 00:50:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79f21693-c20b-41b1-824c-961a92c6b005] received 2024-03-29T00:50:01.064676253Z [2024-03-29 00:50:01,064: INFO/ForkPoolWorker-15] [9777a40a-0052-4794-a54c-7654161522be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:50:01.069583860Z [2024-03-29 00:50:01,069: INFO/ForkPoolWorker-16] [87ae39aa-42d1-42da-abfe-3e19df09038b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:01.079630387Z [2024-03-29 00:50:01,079: INFO/ForkPoolWorker-2] [79f21693-c20b-41b1-824c-961a92c6b005] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:50:01.080302568Z [2024-03-29 00:50:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56b17f83-a374-40a2-925e-80c3daedf165] received 2024-03-29T00:50:01.104989013Z [2024-03-29 00:50:01,104: INFO/ForkPoolWorker-1] [11a483f6-3104-4a9d-8961-17ce5bc375ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:50:01.135989573Z [2024-03-29 00:50:01,135: INFO/ForkPoolWorker-3] [56b17f83-a374-40a2-925e-80c3daedf165] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:50:01.589948674Z [2024-03-29 00:50:01,586: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:50:01.914602243Z [2024-03-29 00:50:01,914: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:02.219398801Z [2024-03-29 00:50:02,203: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:50:02.332901395Z [2024-03-29 00:50:02,329: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:50:02.380470368Z [2024-03-29 00:50:02,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:50:02.451757486Z [2024-03-29 00:50:02,434: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:50:02.529704916Z [2024-03-29 00:50:02,529: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:50:02.534198607Z [2024-03-29 00:50:02,533: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:02.572215398Z [2024-03-29 00:50:02,571: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:50:02.582583860Z [2024-03-29 00:50:02,582: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:50:02.582761836Z [2024-03-29 00:50:02,582: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:50:02.582904043Z [2024-03-29 00:50:02,582: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:50:02.583241832Z [2024-03-29 00:50:02,583: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:50:02.728260899Z [2024-03-29 00:50:02,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:02.835603764Z [2024-03-29 00:50:02,835: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[79f21693-c20b-41b1-824c-961a92c6b005] succeeded in 1.7695673360003639s: None 2024-03-29T00:50:03.743994044Z [2024-03-29 00:50:03,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[11a483f6-3104-4a9d-8961-17ce5bc375ba] succeeded in 2.6752365789998294s: None 2024-03-29T00:50:04.257638652Z [2024-03-29 00:50:04,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:50:04.261561667Z [2024-03-29 00:50:04,261: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:04.288268263Z [2024-03-29 00:50:04,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:50:04.296103953Z [2024-03-29 00:50:04,295: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:04.296210778Z [2024-03-29 00:50:04,295: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:04.296374387Z [2024-03-29 00:50:04,296: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:04.296427694Z [2024-03-29 00:50:04,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:50:04.296727451Z [2024-03-29 00:50:04,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:50:04.296834115Z [2024-03-29 00:50:04,296: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:04.366821838Z [2024-03-29 00:50:04,365: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T00:50:04.379986783Z [2024-03-29 00:50:04,379: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:04.457465966Z [2024-03-29 00:50:04,457: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T00:50:04.459978369Z [2024-03-29 00:50:04,459: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:04.460127348Z [2024-03-29 00:50:04,459: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:04.460500802Z [2024-03-29 00:50:04,460: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:04.460684969Z [2024-03-29 00:50:04,460: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T00:50:04.461222183Z [2024-03-29 00:50:04,460: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:50:04.461692302Z [2024-03-29 00:50:04,461: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:04.533281890Z [2024-03-29 00:50:04,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:04.598853436Z [2024-03-29 00:50:04,598: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:04.680186471Z [2024-03-29 00:50:04,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:50:04.691323542Z [2024-03-29 00:50:04,688: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:04.766870327Z [2024-03-29 00:50:04,766: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:50:04.776142764Z [2024-03-29 00:50:04,775: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:04.776164347Z [2024-03-29 00:50:04,776: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:04.776333796Z [2024-03-29 00:50:04,776: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:04.776389026Z [2024-03-29 00:50:04,776: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:50:04.776768535Z [2024-03-29 00:50:04,776: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:50:04.776776876Z [2024-03-29 00:50:04,776: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:04.861855098Z [2024-03-29 00:50:04,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:06.000945357Z [2024-03-29 00:50:06,000: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87ae39aa-42d1-42da-abfe-3e19df09038b] succeeded in 4.9411208100000295s: None 2024-03-29T00:50:06.732288346Z [2024-03-29 00:50:06,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9777a40a-0052-4794-a54c-7654161522be] succeeded in 5.676655645999745s: None 2024-03-29T00:50:06.782628782Z [2024-03-29 00:50:06,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9bef7a-6834-4b7c-aca8-7da4bd9a1e66] received 2024-03-29T00:50:06.790369300Z [2024-03-29 00:50:06,790: INFO/ForkPoolWorker-15] [5d9bef7a-6834-4b7c-aca8-7da4bd9a1e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:07.148962773Z [2024-03-29 00:50:07,148: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[56b17f83-a374-40a2-925e-80c3daedf165] succeeded in 6.063397083000382s: None 2024-03-29T00:50:07.222068329Z [2024-03-29 00:50:07,219: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:50:08.490942166Z [2024-03-29 00:50:08,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:50:08.494683316Z [2024-03-29 00:50:08,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:08.513362564Z [2024-03-29 00:50:08,513: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:50:08.514744472Z [2024-03-29 00:50:08,514: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:08.514776472Z [2024-03-29 00:50:08,514: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:08.514864695Z [2024-03-29 00:50:08,514: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:08.514910549Z [2024-03-29 00:50:08,514: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:50:08.515188782Z [2024-03-29 00:50:08,515: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:50:08.515211611Z [2024-03-29 00:50:08,515: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:08.593769714Z [2024-03-29 00:50:08,593: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:09.160912075Z [2024-03-29 00:50:09,160: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d9bef7a-6834-4b7c-aca8-7da4bd9a1e66] succeeded in 2.3761235230003876s: None 2024-03-29T00:50:09.727355906Z [2024-03-29 00:50:09,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3efda2b1-b057-41a2-866d-58701ce2527e] received 2024-03-29T00:50:09.734693605Z [2024-03-29 00:50:09,734: INFO/ForkPoolWorker-15] [3efda2b1-b057-41a2-866d-58701ce2527e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:50:10.057867234Z [2024-03-29 00:50:10,054: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:50:11.267839771Z [2024-03-29 00:50:11,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:50:11.271490637Z [2024-03-29 00:50:11,271: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:11.290194860Z [2024-03-29 00:50:11,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:50:11.291590946Z [2024-03-29 00:50:11,291: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:11.291805712Z [2024-03-29 00:50:11,291: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:11.292024289Z [2024-03-29 00:50:11,291: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:11.292118372Z [2024-03-29 00:50:11,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:50:11.292408014Z [2024-03-29 00:50:11,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:50:11.292613661Z [2024-03-29 00:50:11,292: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:11.374047805Z [2024-03-29 00:50:11,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:11.906628028Z [2024-03-29 00:50:11,906: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3efda2b1-b057-41a2-866d-58701ce2527e] succeeded in 2.177407616999517s: None 2024-03-29T00:50:12.044144173Z [2024-03-29 00:50:12,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ccabd50-b1af-44c7-9d06-5908849acdf0] received 2024-03-29T00:50:12.050377595Z [2024-03-29 00:50:12,050: INFO/ForkPoolWorker-15] [0ccabd50-b1af-44c7-9d06-5908849acdf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:12.321271530Z [2024-03-29 00:50:12,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:50:13.479570101Z [2024-03-29 00:50:13,479: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:50:13.482926723Z [2024-03-29 00:50:13,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:50:13.498999546Z [2024-03-29 00:50:13,498: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:50:13.500277908Z [2024-03-29 00:50:13,499: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:50:13.500294388Z [2024-03-29 00:50:13,500: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:50:13.500332983Z [2024-03-29 00:50:13,500: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:50:13.500358442Z [2024-03-29 00:50:13,500: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:50:13.500704176Z [2024-03-29 00:50:13,500: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:50:13.500766779Z [2024-03-29 00:50:13,500: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:50:13.586179146Z [2024-03-29 00:50:13,585: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:50:14.146190640Z [2024-03-29 00:50:14,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ccabd50-b1af-44c7-9d06-5908849acdf0] succeeded in 2.100610067999696s: None 2024-03-29T00:51:00.967461493Z [2024-03-29 00:51:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85e42933-b539-41d6-9e60-2a840682a69a] received 2024-03-29T00:51:00.969021322Z [2024-03-29 00:51:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3639cb83-1a6a-4439-a451-95f6fe300ba5] received 2024-03-29T00:51:00.971426514Z [2024-03-29 00:51:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c92f2ea-84fc-49d8-8cd5-ef6f052eff2d] received 2024-03-29T00:51:00.977941529Z [2024-03-29 00:51:00,977: INFO/ForkPoolWorker-15] [85e42933-b539-41d6-9e60-2a840682a69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:51:00.980823340Z [2024-03-29 00:51:00,980: INFO/ForkPoolWorker-16] [3639cb83-1a6a-4439-a451-95f6fe300ba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:51:00.990107430Z [2024-03-29 00:51:00,987: INFO/ForkPoolWorker-1] [3c92f2ea-84fc-49d8-8cd5-ef6f052eff2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:51:01.281828670Z [2024-03-29 00:51:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:51:01.315693556Z [2024-03-29 00:51:01,311: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:51:01.449488887Z [2024-03-29 00:51:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:51:01.494793729Z [2024-03-29 00:51:01,494: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:51:01.499545244Z [2024-03-29 00:51:01,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:51:01.525097676Z [2024-03-29 00:51:01,524: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:51:01.526744047Z [2024-03-29 00:51:01,526: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:51:01.527092904Z [2024-03-29 00:51:01,526: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:51:01.527377406Z [2024-03-29 00:51:01,527: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:51:01.527782192Z [2024-03-29 00:51:01,527: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:51:01.668583435Z [2024-03-29 00:51:01,668: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:51:02.461865341Z [2024-03-29 00:51:02,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c92f2ea-84fc-49d8-8cd5-ef6f052eff2d] succeeded in 1.4881285880001087s: None 2024-03-29T00:51:02.632183999Z [2024-03-29 00:51:02,631: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:51:02.635742244Z [2024-03-29 00:51:02,635: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:51:02.658080908Z [2024-03-29 00:51:02,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:51:02.660376869Z [2024-03-29 00:51:02,659: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:51:02.660456228Z [2024-03-29 00:51:02,660: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:51:02.660484369Z [2024-03-29 00:51:02,660: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:51:02.660495393Z [2024-03-29 00:51:02,660: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:51:02.660810243Z [2024-03-29 00:51:02,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:51:02.660832547Z [2024-03-29 00:51:02,660: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:51:02.757065239Z [2024-03-29 00:51:02,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:51:02.784525779Z [2024-03-29 00:51:02,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:51:02.788345007Z [2024-03-29 00:51:02,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:51:02.811916834Z [2024-03-29 00:51:02,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:51:02.813546647Z [2024-03-29 00:51:02,813: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:51:02.813670869Z [2024-03-29 00:51:02,813: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:51:02.813887144Z [2024-03-29 00:51:02,813: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:51:02.814020932Z [2024-03-29 00:51:02,813: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:51:02.814435546Z [2024-03-29 00:51:02,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:51:02.814589155Z [2024-03-29 00:51:02,814: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:51:02.915225428Z [2024-03-29 00:51:02,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:51:04.430568717Z [2024-03-29 00:51:04,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85e42933-b539-41d6-9e60-2a840682a69a] succeeded in 3.4600344130003577s: None 2024-03-29T00:51:04.647038827Z [2024-03-29 00:51:04,646: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3639cb83-1a6a-4439-a451-95f6fe300ba5] succeeded in 3.676649009999892s: None 2024-03-29T00:52:00.771578020Z [2024-03-29 00:52:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e964e2f5-f1c3-4e7e-88e6-713b2801fdc1] received 2024-03-29T00:52:00.773800175Z [2024-03-29 00:52:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1ab9f2f-29ac-46a4-9be0-46ca14f1c71f] received 2024-03-29T00:52:00.782332466Z [2024-03-29 00:52:00,781: INFO/ForkPoolWorker-15] [e964e2f5-f1c3-4e7e-88e6-713b2801fdc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:52:00.782586863Z [2024-03-29 00:52:00,782: INFO/ForkPoolWorker-16] [a1ab9f2f-29ac-46a4-9be0-46ca14f1c71f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:52:00.789296818Z [2024-03-29 00:52:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[702e8c9d-b909-4acd-be03-be972484cc7b] received 2024-03-29T00:52:00.795887257Z [2024-03-29 00:52:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de3fb1dc-f05a-4b87-8485-fbbf1f7dede5] received 2024-03-29T00:52:00.801125586Z [2024-03-29 00:52:00,800: INFO/ForkPoolWorker-1] [702e8c9d-b909-4acd-be03-be972484cc7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:52:00.847486862Z [2024-03-29 00:52:00,847: INFO/ForkPoolWorker-2] [de3fb1dc-f05a-4b87-8485-fbbf1f7dede5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:52:01.287071412Z [2024-03-29 00:52:01,281: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:52:01.302607860Z [2024-03-29 00:52:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:52:01.458855024Z [2024-03-29 00:52:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:52:01.496011138Z [2024-03-29 00:52:01,495: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:52:01.500826225Z [2024-03-29 00:52:01,500: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:52:01.546999133Z [2024-03-29 00:52:01,541: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:52:01.576527283Z [2024-03-29 00:52:01,576: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:52:01.579445276Z [2024-03-29 00:52:01,579: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:52:01.579529932Z [2024-03-29 00:52:01,579: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:52:01.579766031Z [2024-03-29 00:52:01,579: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:52:01.580132111Z [2024-03-29 00:52:01,579: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:52:01.768487145Z [2024-03-29 00:52:01,768: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:52:02.063901256Z [2024-03-29 00:52:02,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:52:02.507647076Z [2024-03-29 00:52:02,507: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[de3fb1dc-f05a-4b87-8485-fbbf1f7dede5] succeeded in 1.6994924290002018s: None 2024-03-29T00:52:02.811244127Z [2024-03-29 00:52:02,810: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[702e8c9d-b909-4acd-be03-be972484cc7b] succeeded in 2.0196083750006437s: None 2024-03-29T00:52:03.037024483Z [2024-03-29 00:52:03,036: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:52:03.041286405Z [2024-03-29 00:52:03,040: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:52:03.063091366Z [2024-03-29 00:52:03,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:52:03.064452338Z [2024-03-29 00:52:03,064: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:52:03.064642407Z [2024-03-29 00:52:03,064: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:52:03.064847591Z [2024-03-29 00:52:03,064: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:52:03.064991712Z [2024-03-29 00:52:03,064: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:52:03.065350795Z [2024-03-29 00:52:03,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:52:03.065466082Z [2024-03-29 00:52:03,065: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:52:03.068695200Z [2024-03-29 00:52:03,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:52:03.072731137Z [2024-03-29 00:52:03,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:52:03.093129815Z [2024-03-29 00:52:03,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:52:03.094580627Z [2024-03-29 00:52:03,094: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:52:03.094602539Z [2024-03-29 00:52:03,094: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:52:03.094742400Z [2024-03-29 00:52:03,094: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:52:03.094797952Z [2024-03-29 00:52:03,094: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:52:03.095093345Z [2024-03-29 00:52:03,094: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:52:03.095127051Z [2024-03-29 00:52:03,095: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:52:03.177958216Z [2024-03-29 00:52:03,177: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:52:03.191953498Z [2024-03-29 00:52:03,191: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:52:04.806742358Z [2024-03-29 00:52:04,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e964e2f5-f1c3-4e7e-88e6-713b2801fdc1] succeeded in 4.032428405999781s: None 2024-03-29T00:52:05.070640033Z [2024-03-29 00:52:05,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1ab9f2f-29ac-46a4-9be0-46ca14f1c71f] succeeded in 4.294254622000153s: None 2024-03-29T00:53:00.428561159Z [2024-03-29 00:53:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe1daada-f3bb-4cc3-8f6a-a0090df10f03] received 2024-03-29T00:53:00.430247366Z [2024-03-29 00:53:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dc87813-4de1-4dfd-b4db-2c532135ff4b] received 2024-03-29T00:53:00.437714425Z [2024-03-29 00:53:00,437: INFO/ForkPoolWorker-16] [9dc87813-4de1-4dfd-b4db-2c532135ff4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:53:00.439945065Z [2024-03-29 00:53:00,439: INFO/ForkPoolWorker-15] [fe1daada-f3bb-4cc3-8f6a-a0090df10f03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:53:00.446493273Z [2024-03-29 00:53:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8606a378-01ac-408f-a7d0-0b2986d906e5] received 2024-03-29T00:53:00.452691091Z [2024-03-29 00:53:00,452: INFO/ForkPoolWorker-1] [8606a378-01ac-408f-a7d0-0b2986d906e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:53:00.734967717Z [2024-03-29 00:53:00,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:53:00.751833556Z [2024-03-29 00:53:00,748: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:53:00.854526869Z [2024-03-29 00:53:00,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:53:00.901962181Z [2024-03-29 00:53:00,901: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:53:00.906721593Z [2024-03-29 00:53:00,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:53:00.933079738Z [2024-03-29 00:53:00,932: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:53:00.934274410Z [2024-03-29 00:53:00,934: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:53:00.934592739Z [2024-03-29 00:53:00,934: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:53:00.935059706Z [2024-03-29 00:53:00,934: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:53:00.935946884Z [2024-03-29 00:53:00,935: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:53:01.029775372Z [2024-03-29 00:53:01,029: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:53:01.601700804Z [2024-03-29 00:53:01,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dc87813-4de1-4dfd-b4db-2c532135ff4b] succeeded in 1.1698830040004395s: None 2024-03-29T00:53:01.948430561Z [2024-03-29 00:53:01,947: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:53:01.952126614Z [2024-03-29 00:53:01,951: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:53:01.971422402Z [2024-03-29 00:53:01,971: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:53:01.972727356Z [2024-03-29 00:53:01,972: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:53:01.972755519Z [2024-03-29 00:53:01,972: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:53:01.972770524Z [2024-03-29 00:53:01,972: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:53:01.972832285Z [2024-03-29 00:53:01,972: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:53:01.973104476Z [2024-03-29 00:53:01,972: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:53:01.973113394Z [2024-03-29 00:53:01,973: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:53:02.075829555Z [2024-03-29 00:53:02,075: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:53:02.152554333Z [2024-03-29 00:53:02,151: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:53:02.156396525Z [2024-03-29 00:53:02,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:53:02.178890434Z [2024-03-29 00:53:02,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:53:02.180202533Z [2024-03-29 00:53:02,179: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:53:02.180210906Z [2024-03-29 00:53:02,180: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:53:02.180308745Z [2024-03-29 00:53:02,180: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:53:02.180318739Z [2024-03-29 00:53:02,180: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:53:02.180577895Z [2024-03-29 00:53:02,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:53:02.180584604Z [2024-03-29 00:53:02,180: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:53:02.268667732Z [2024-03-29 00:53:02,268: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:53:03.811356908Z [2024-03-29 00:53:03,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe1daada-f3bb-4cc3-8f6a-a0090df10f03] succeeded in 3.3796315310000864s: None 2024-03-29T00:53:04.220337588Z [2024-03-29 00:53:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8606a378-01ac-408f-a7d0-0b2986d906e5] succeeded in 3.7723649500003376s: None 2024-03-29T00:54:00.685034187Z [2024-03-29 00:54:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36faf5d7-6f66-4ea3-894f-8b10961d3a2c] received 2024-03-29T00:54:00.688955111Z [2024-03-29 00:54:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[864e9aaf-8596-46b7-8c2a-2ba972301e0f] received 2024-03-29T00:54:00.695456591Z [2024-03-29 00:54:00,695: INFO/ForkPoolWorker-15] [36faf5d7-6f66-4ea3-894f-8b10961d3a2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:54:00.699313766Z [2024-03-29 00:54:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8da8a6a2-8cb4-492c-8dd6-7a20fe271102] received 2024-03-29T00:54:00.700069029Z [2024-03-29 00:54:00,699: INFO/ForkPoolWorker-16] [864e9aaf-8596-46b7-8c2a-2ba972301e0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:54:00.712097642Z [2024-03-29 00:54:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3d62d33-8ffa-456b-875e-425178e74441] received 2024-03-29T00:54:00.713929948Z [2024-03-29 00:54:00,713: INFO/ForkPoolWorker-1] [8da8a6a2-8cb4-492c-8dd6-7a20fe271102] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:54:00.718928191Z [2024-03-29 00:54:00,718: INFO/ForkPoolWorker-2] [c3d62d33-8ffa-456b-875e-425178e74441] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:54:01.070389797Z [2024-03-29 00:54:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:54:01.106161817Z [2024-03-29 00:54:01,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:54:01.142991536Z [2024-03-29 00:54:01,139: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:54:01.189444110Z [2024-03-29 00:54:01,186: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:54:01.408500452Z [2024-03-29 00:54:01,408: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:54:01.416599442Z [2024-03-29 00:54:01,416: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:54:01.423807575Z [2024-03-29 00:54:01,423: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:54:01.472067825Z [2024-03-29 00:54:01,471: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:54:01.474872135Z [2024-03-29 00:54:01,474: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:54:01.474992750Z [2024-03-29 00:54:01,474: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:54:01.475072213Z [2024-03-29 00:54:01,474: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:54:01.475371600Z [2024-03-29 00:54:01,475: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:54:01.604391024Z [2024-03-29 00:54:01,604: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:54:02.199132897Z [2024-03-29 00:54:02,198: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[864e9aaf-8596-46b7-8c2a-2ba972301e0f] succeeded in 1.5071920109994608s: None 2024-03-29T00:54:02.316974269Z [2024-03-29 00:54:02,316: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8da8a6a2-8cb4-492c-8dd6-7a20fe271102] succeeded in 1.6083560050001324s: None 2024-03-29T00:54:02.629439995Z [2024-03-29 00:54:02,629: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:54:02.633255584Z [2024-03-29 00:54:02,632: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:54:02.663795800Z [2024-03-29 00:54:02,663: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:54:02.666286265Z [2024-03-29 00:54:02,665: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:54:02.666538809Z [2024-03-29 00:54:02,666: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:54:02.666807281Z [2024-03-29 00:54:02,666: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:54:02.666967432Z [2024-03-29 00:54:02,666: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:54:02.667482144Z [2024-03-29 00:54:02,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:54:02.667663659Z [2024-03-29 00:54:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:54:02.701179979Z [2024-03-29 00:54:02,700: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:54:02.704864936Z [2024-03-29 00:54:02,704: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:54:02.728967171Z [2024-03-29 00:54:02,728: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:54:02.731428458Z [2024-03-29 00:54:02,731: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:54:02.731453001Z [2024-03-29 00:54:02,731: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:54:02.731796274Z [2024-03-29 00:54:02,731: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:54:02.731842315Z [2024-03-29 00:54:02,731: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:54:02.732484061Z [2024-03-29 00:54:02,732: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:54:02.732659837Z [2024-03-29 00:54:02,732: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:54:02.789659301Z [2024-03-29 00:54:02,788: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:54:02.864836019Z [2024-03-29 00:54:02,864: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:54:04.473471247Z [2024-03-29 00:54:04,472: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3d62d33-8ffa-456b-875e-425178e74441] succeeded in 3.7593886329996167s: None 2024-03-29T00:54:04.721204261Z [2024-03-29 00:54:04,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36faf5d7-6f66-4ea3-894f-8b10961d3a2c] succeeded in 4.030448949999482s: None 2024-03-29T00:55:00.749464663Z [2024-03-29 00:55:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[542b6a4b-c326-41dd-b469-8cbe398a5305] received 2024-03-29T00:55:00.753211423Z [2024-03-29 00:55:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63a62060-ccad-4dff-bac3-84838f7e4d23] received 2024-03-29T00:55:00.762666323Z [2024-03-29 00:55:00,762: INFO/ForkPoolWorker-16] [63a62060-ccad-4dff-bac3-84838f7e4d23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:55:00.769546829Z [2024-03-29 00:55:00,768: INFO/ForkPoolWorker-15] [542b6a4b-c326-41dd-b469-8cbe398a5305] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:00.774427298Z [2024-03-29 00:55:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56935533-282d-4568-9789-1f70e1574a96] received 2024-03-29T00:55:00.779994949Z [2024-03-29 00:55:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20689fdb-e380-48d9-9ff0-c8ef6b034b61] received 2024-03-29T00:55:00.788650782Z [2024-03-29 00:55:00,788: INFO/ForkPoolWorker-1] [56935533-282d-4568-9789-1f70e1574a96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:55:00.790396798Z [2024-03-29 00:55:00,790: INFO/ForkPoolWorker-2] [20689fdb-e380-48d9-9ff0-c8ef6b034b61] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:55:01.157257731Z [2024-03-29 00:55:01,154: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:55:01.180348591Z [2024-03-29 00:55:01,176: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:55:01.185034702Z [2024-03-29 00:55:01,181: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:55:01.320177125Z [2024-03-29 00:55:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:55:01.382003037Z [2024-03-29 00:55:01,381: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T00:55:01.387728887Z [2024-03-29 00:55:01,387: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:01.430218840Z [2024-03-29 00:55:01,429: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:55:01.433991107Z [2024-03-29 00:55:01,433: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:55:01.434242117Z [2024-03-29 00:55:01,433: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:55:01.434375745Z [2024-03-29 00:55:01,434: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T00:55:01.434789304Z [2024-03-29 00:55:01,434: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:55:01.570174598Z [2024-03-29 00:55:01,569: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:02.278903040Z [2024-03-29 00:55:02,278: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20689fdb-e380-48d9-9ff0-c8ef6b034b61] succeeded in 1.496320979000302s: None 2024-03-29T00:55:02.713957251Z [2024-03-29 00:55:02,713: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:55:02.720046503Z [2024-03-29 00:55:02,719: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:02.739052341Z [2024-03-29 00:55:02,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:55:02.740326728Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:02.740341396Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:02.740452303Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:02.740467530Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:55:02.740802304Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:55:02.740841929Z [2024-03-29 00:55:02,740: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:02.823725766Z [2024-03-29 00:55:02,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:02.850172462Z [2024-03-29 00:55:02,849: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:55:02.854272213Z [2024-03-29 00:55:02,853: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:02.873457588Z [2024-03-29 00:55:02,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:55:02.874917794Z [2024-03-29 00:55:02,874: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:02.875085847Z [2024-03-29 00:55:02,874: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:02.875265199Z [2024-03-29 00:55:02,875: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:02.875371855Z [2024-03-29 00:55:02,875: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:55:02.875667745Z [2024-03-29 00:55:02,875: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:55:02.875780136Z [2024-03-29 00:55:02,875: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:02.933299499Z [2024-03-29 00:55:02,932: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:55:02.937455572Z [2024-03-29 00:55:02,936: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:02.969414828Z [2024-03-29 00:55:02,969: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:02.977755931Z [2024-03-29 00:55:02,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:55:02.979614887Z [2024-03-29 00:55:02,979: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:02.979630035Z [2024-03-29 00:55:02,979: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:02.979807780Z [2024-03-29 00:55:02,979: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:02.979910406Z [2024-03-29 00:55:02,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:55:02.980199745Z [2024-03-29 00:55:02,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:55:02.980265536Z [2024-03-29 00:55:02,980: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:03.079290715Z [2024-03-29 00:55:03,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:03.846496684Z [2024-03-29 00:55:03,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[542b6a4b-c326-41dd-b469-8cbe398a5305] succeeded in 3.0907262640002955s: None 2024-03-29T00:55:04.583248585Z [2024-03-29 00:55:04,582: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56935533-282d-4568-9789-1f70e1574a96] succeeded in 3.8048475499999768s: None 2024-03-29T00:55:04.754599629Z [2024-03-29 00:55:04,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56a75fe0-641f-4737-832d-20f560b8710a] received 2024-03-29T00:55:04.781621886Z [2024-03-29 00:55:04,781: INFO/ForkPoolWorker-15] [56a75fe0-641f-4737-832d-20f560b8710a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:05.040576540Z [2024-03-29 00:55:05,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63a62060-ccad-4dff-bac3-84838f7e4d23] succeeded in 4.285612141000456s: None 2024-03-29T00:55:05.202574501Z [2024-03-29 00:55:05,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:55:06.518932048Z [2024-03-29 00:55:06,518: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:55:06.522673298Z [2024-03-29 00:55:06,522: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:06.552616748Z [2024-03-29 00:55:06,552: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:55:06.555360851Z [2024-03-29 00:55:06,555: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:06.555899607Z [2024-03-29 00:55:06,555: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:06.556320340Z [2024-03-29 00:55:06,556: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:06.556574450Z [2024-03-29 00:55:06,556: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:55:06.557461492Z [2024-03-29 00:55:06,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:55:06.557682740Z [2024-03-29 00:55:06,557: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:06.722149651Z [2024-03-29 00:55:06,721: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:07.545555910Z [2024-03-29 00:55:07,545: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56a75fe0-641f-4737-832d-20f560b8710a] succeeded in 2.791754132999813s: None 2024-03-29T00:55:07.581305849Z [2024-03-29 00:55:07,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[938157cf-3300-456c-b214-81ea254bb106] received 2024-03-29T00:55:07.589300649Z [2024-03-29 00:55:07,589: INFO/ForkPoolWorker-15] [938157cf-3300-456c-b214-81ea254bb106] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:55:07.897587970Z [2024-03-29 00:55:07,894: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:55:09.092514748Z [2024-03-29 00:55:09,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:55:09.096050833Z [2024-03-29 00:55:09,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:09.115177344Z [2024-03-29 00:55:09,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:55:09.116688641Z [2024-03-29 00:55:09,116: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:09.116869277Z [2024-03-29 00:55:09,116: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:09.117116017Z [2024-03-29 00:55:09,116: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:09.117304474Z [2024-03-29 00:55:09,117: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:55:09.117830688Z [2024-03-29 00:55:09,117: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:55:09.117984132Z [2024-03-29 00:55:09,117: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:09.207367843Z [2024-03-29 00:55:09,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:09.718908356Z [2024-03-29 00:55:09,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88d7e0bf-1b7a-4a9a-925a-3bcc4c427550] received 2024-03-29T00:55:09.729033727Z [2024-03-29 00:55:09,728: INFO/ForkPoolWorker-16] [88d7e0bf-1b7a-4a9a-925a-3bcc4c427550] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:09.762407454Z [2024-03-29 00:55:09,761: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[938157cf-3300-456c-b214-81ea254bb106] succeeded in 2.179543219000152s: None 2024-03-29T00:55:09.989634738Z [2024-03-29 00:55:09,986: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T00:55:11.100037274Z [2024-03-29 00:55:11,099: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:55:11.105904599Z [2024-03-29 00:55:11,105: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:55:11.127016529Z [2024-03-29 00:55:11,126: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:55:11.128440221Z [2024-03-29 00:55:11,128: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:55:11.128500895Z [2024-03-29 00:55:11,128: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:55:11.128666402Z [2024-03-29 00:55:11,128: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:55:11.128771976Z [2024-03-29 00:55:11,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:55:11.129172526Z [2024-03-29 00:55:11,128: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T00:55:11.129368008Z [2024-03-29 00:55:11,129: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:55:11.219250915Z [2024-03-29 00:55:11,218: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:55:11.745587085Z [2024-03-29 00:55:11,744: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[88d7e0bf-1b7a-4a9a-925a-3bcc4c427550] succeeded in 2.0242851639995934s: None 2024-03-29T00:56:00.644664958Z [2024-03-29 00:56:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73aae440-b9fe-436a-8dd0-f210f47d44c2] received 2024-03-29T00:56:00.650197938Z [2024-03-29 00:56:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f6f395c-756f-43ce-8f8a-632448659173] received 2024-03-29T00:56:00.659686191Z [2024-03-29 00:56:00,659: INFO/ForkPoolWorker-16] [2f6f395c-756f-43ce-8f8a-632448659173] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:56:00.666403859Z [2024-03-29 00:56:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7834315-a327-48e3-8ecd-aa4c81331e96] received 2024-03-29T00:56:00.672082599Z [2024-03-29 00:56:00,671: INFO/ForkPoolWorker-15] [73aae440-b9fe-436a-8dd0-f210f47d44c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:56:00.673575304Z [2024-03-29 00:56:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67a1d287-8962-49af-aba6-56faefbab7f0] received 2024-03-29T00:56:00.678841369Z [2024-03-29 00:56:00,678: INFO/ForkPoolWorker-1] [d7834315-a327-48e3-8ecd-aa4c81331e96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:56:00.698683523Z [2024-03-29 00:56:00,698: INFO/ForkPoolWorker-2] [67a1d287-8962-49af-aba6-56faefbab7f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:56:00.979012638Z [2024-03-29 00:56:00,974: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:56:01.017801274Z [2024-03-29 00:56:01,013: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:56:01.116429718Z [2024-03-29 00:56:01,111: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:56:01.139880666Z [2024-03-29 00:56:01,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:56:01.395417573Z [2024-03-29 00:56:01,394: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:56:01.399976350Z [2024-03-29 00:56:01,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:56:01.452304200Z [2024-03-29 00:56:01,451: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:56:01.457929832Z [2024-03-29 00:56:01,457: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:56:01.458012263Z [2024-03-29 00:56:01,457: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:56:01.458163354Z [2024-03-29 00:56:01,457: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:56:01.458772818Z [2024-03-29 00:56:01,458: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:56:01.553482723Z [2024-03-29 00:56:01,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:56:01.624171647Z [2024-03-29 00:56:01,623: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:56:02.340379844Z [2024-03-29 00:56:02,339: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73aae440-b9fe-436a-8dd0-f210f47d44c2] succeeded in 1.6888208829996074s: None 2024-03-29T00:56:02.572123464Z [2024-03-29 00:56:02,571: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7834315-a327-48e3-8ecd-aa4c81331e96] succeeded in 1.9024393469999268s: None 2024-03-29T00:56:02.682310632Z [2024-03-29 00:56:02,681: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:56:02.686089278Z [2024-03-29 00:56:02,685: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:56:02.726303459Z [2024-03-29 00:56:02,725: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:56:02.730315631Z [2024-03-29 00:56:02,730: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:56:02.730914767Z [2024-03-29 00:56:02,730: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:56:02.730938770Z [2024-03-29 00:56:02,730: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:56:02.732158405Z [2024-03-29 00:56:02,730: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:56:02.733842319Z [2024-03-29 00:56:02,733: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:56:02.735252674Z [2024-03-29 00:56:02,733: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:56:02.821287810Z [2024-03-29 00:56:02,820: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:56:02.825073647Z [2024-03-29 00:56:02,824: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:56:02.843429821Z [2024-03-29 00:56:02,843: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:56:02.849578676Z [2024-03-29 00:56:02,849: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:56:02.851175603Z [2024-03-29 00:56:02,850: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:56:02.851213267Z [2024-03-29 00:56:02,851: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:56:02.851346911Z [2024-03-29 00:56:02,851: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:56:02.851395844Z [2024-03-29 00:56:02,851: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:56:02.851707826Z [2024-03-29 00:56:02,851: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:56:02.851725269Z [2024-03-29 00:56:02,851: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:56:02.955994660Z [2024-03-29 00:56:02,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:56:04.695920774Z [2024-03-29 00:56:04,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f6f395c-756f-43ce-8f8a-632448659173] succeeded in 4.042405263999171s: None 2024-03-29T00:56:04.897887715Z [2024-03-29 00:56:04,897: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67a1d287-8962-49af-aba6-56faefbab7f0] succeeded in 4.218343862999973s: None 2024-03-29T00:57:00.432929743Z [2024-03-29 00:57:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e97ead38-4ec9-4617-a774-84ed3c336300] received 2024-03-29T00:57:00.438610499Z [2024-03-29 00:57:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[982107fe-fb17-4941-ab4e-12c73146e049] received 2024-03-29T00:57:00.442505080Z [2024-03-29 00:57:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fb3f246-fd69-4f51-81c4-d242159bfe21] received 2024-03-29T00:57:00.444748653Z [2024-03-29 00:57:00,444: INFO/ForkPoolWorker-15] [e97ead38-4ec9-4617-a774-84ed3c336300] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:57:00.447298117Z [2024-03-29 00:57:00,446: INFO/ForkPoolWorker-16] [982107fe-fb17-4941-ab4e-12c73146e049] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:57:00.449736882Z [2024-03-29 00:57:00,449: INFO/ForkPoolWorker-1] [8fb3f246-fd69-4f51-81c4-d242159bfe21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:57:00.716540058Z [2024-03-29 00:57:00,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:57:00.744287765Z [2024-03-29 00:57:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:57:00.783918404Z [2024-03-29 00:57:00,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:57:00.997875934Z [2024-03-29 00:57:00,997: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T00:57:01.006176990Z [2024-03-29 00:57:01,004: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:57:01.041535494Z [2024-03-29 00:57:01,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:57:01.049325994Z [2024-03-29 00:57:01,042: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:57:01.049349483Z [2024-03-29 00:57:01,043: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:57:01.049353063Z [2024-03-29 00:57:01,043: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T00:57:01.049356247Z [2024-03-29 00:57:01,043: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:57:01.171351840Z [2024-03-29 00:57:01,171: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:57:01.893582003Z [2024-03-29 00:57:01,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fb3f246-fd69-4f51-81c4-d242159bfe21] succeeded in 1.4483812899998156s: None 2024-03-29T00:57:02.046094550Z [2024-03-29 00:57:02,045: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:57:02.050104969Z [2024-03-29 00:57:02,049: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:57:02.070032344Z [2024-03-29 00:57:02,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:57:02.072141521Z [2024-03-29 00:57:02,071: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:57:02.072159618Z [2024-03-29 00:57:02,072: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:57:02.072329793Z [2024-03-29 00:57:02,072: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:57:02.072381797Z [2024-03-29 00:57:02,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:57:02.072972943Z [2024-03-29 00:57:02,072: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:57:02.072989427Z [2024-03-29 00:57:02,072: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:57:02.160104184Z [2024-03-29 00:57:02,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:57:02.181042654Z [2024-03-29 00:57:02,180: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:57:02.184912431Z [2024-03-29 00:57:02,184: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:57:02.207510676Z [2024-03-29 00:57:02,207: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:57:02.208827892Z [2024-03-29 00:57:02,208: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:57:02.208848941Z [2024-03-29 00:57:02,208: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:57:02.208939449Z [2024-03-29 00:57:02,208: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:57:02.208991417Z [2024-03-29 00:57:02,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:57:02.209267689Z [2024-03-29 00:57:02,209: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:57:02.209279051Z [2024-03-29 00:57:02,209: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:57:02.287999691Z [2024-03-29 00:57:02,287: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:57:04.017120383Z [2024-03-29 00:57:04,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e97ead38-4ec9-4617-a774-84ed3c336300] succeeded in 3.5792406669997945s: None 2024-03-29T00:57:04.417538326Z [2024-03-29 00:57:04,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[982107fe-fb17-4941-ab4e-12c73146e049] succeeded in 3.9768859300002077s: None 2024-03-29T00:58:00.275625113Z [2024-03-29 00:58:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[129143cd-600d-415b-9561-206020c0391f] received 2024-03-29T00:58:00.279611682Z [2024-03-29 00:58:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffe81389-91a7-41bc-b605-80f89594677c] received 2024-03-29T00:58:00.282420781Z [2024-03-29 00:58:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18828e81-b83e-4529-a99f-2de78d6499c1] received 2024-03-29T00:58:00.289790507Z [2024-03-29 00:58:00,289: INFO/ForkPoolWorker-16] [ffe81389-91a7-41bc-b605-80f89594677c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:58:00.290666568Z [2024-03-29 00:58:00,290: INFO/ForkPoolWorker-1] [18828e81-b83e-4529-a99f-2de78d6499c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:58:00.295612760Z [2024-03-29 00:58:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f32c8d5-5261-4b9d-b5a4-0ac77066aa82] received 2024-03-29T00:58:00.298224446Z [2024-03-29 00:58:00,298: INFO/ForkPoolWorker-15] [129143cd-600d-415b-9561-206020c0391f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:58:00.303101390Z [2024-03-29 00:58:00,302: INFO/ForkPoolWorker-2] [4f32c8d5-5261-4b9d-b5a4-0ac77066aa82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:58:00.666501493Z [2024-03-29 00:58:00,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T00:58:00.718623297Z [2024-03-29 00:58:00,703: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:58:00.911666413Z [2024-03-29 00:58:00,908: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:58:01.038289087Z [2024-03-29 00:58:01,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:58:01.108916857Z [2024-03-29 00:58:01,108: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:58:01.117942614Z [2024-03-29 00:58:01,117: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T00:58:01.122139619Z [2024-03-29 00:58:01,121: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:58:01.174716292Z [2024-03-29 00:58:01,174: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:58:01.175961814Z [2024-03-29 00:58:01,175: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:58:01.181401864Z [2024-03-29 00:58:01,181: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:58:01.181459863Z [2024-03-29 00:58:01,181: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T00:58:01.181782934Z [2024-03-29 00:58:01,181: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:58:01.459790113Z [2024-03-29 00:58:01,459: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:58:02.049768864Z [2024-03-29 00:58:02,049: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18828e81-b83e-4529-a99f-2de78d6499c1] succeeded in 1.7658758119996492s: None 2024-03-29T00:58:02.623726096Z [2024-03-29 00:58:02,623: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ffe81389-91a7-41bc-b605-80f89594677c] succeeded in 2.3421337330000824s: None 2024-03-29T00:58:03.054892576Z [2024-03-29 00:58:03,054: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T00:58:03.058589401Z [2024-03-29 00:58:03,058: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:58:03.087570171Z [2024-03-29 00:58:03,087: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T00:58:03.089340002Z [2024-03-29 00:58:03,089: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:58:03.089475530Z [2024-03-29 00:58:03,089: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:58:03.089713210Z [2024-03-29 00:58:03,089: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:58:03.089888652Z [2024-03-29 00:58:03,089: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T00:58:03.090392235Z [2024-03-29 00:58:03,090: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:58:03.090705790Z [2024-03-29 00:58:03,090: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:58:03.203020856Z [2024-03-29 00:58:03,202: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:58:03.427492760Z [2024-03-29 00:58:03,426: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T00:58:03.431237221Z [2024-03-29 00:58:03,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:58:03.459721316Z [2024-03-29 00:58:03,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:58:03.461307744Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:58:03.461377363Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:58:03.461498945Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:58:03.461558142Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T00:58:03.461877381Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:58:03.461925888Z [2024-03-29 00:58:03,461: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:58:03.578404465Z [2024-03-29 00:58:03,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:58:05.020549566Z [2024-03-29 00:58:05,020: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f32c8d5-5261-4b9d-b5a4-0ac77066aa82] succeeded in 4.723159662999933s: None 2024-03-29T00:58:05.389660104Z [2024-03-29 00:58:05,389: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[129143cd-600d-415b-9561-206020c0391f] succeeded in 5.11001248499997s: None 2024-03-29T00:59:00.943206591Z [2024-03-29 00:59:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a962bac4-7eea-4fa3-bea7-a4068134835d] received 2024-03-29T00:59:00.950519574Z [2024-03-29 00:59:00,950: INFO/ForkPoolWorker-15] [a962bac4-7eea-4fa3-bea7-a4068134835d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:59:00.967193161Z [2024-03-29 00:59:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acbe78cd-d10f-4876-9d00-72326c90f7e9] received 2024-03-29T00:59:00.968724117Z [2024-03-29 00:59:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a938decf-7ee4-4236-9f5e-f1eed001ac7b] received 2024-03-29T00:59:00.977593819Z [2024-03-29 00:59:00,977: INFO/ForkPoolWorker-16] [acbe78cd-d10f-4876-9d00-72326c90f7e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:59:00.977931739Z [2024-03-29 00:59:00,977: INFO/ForkPoolWorker-1] [a938decf-7ee4-4236-9f5e-f1eed001ac7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:59:01.285859667Z [2024-03-29 00:59:01,282: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T00:59:01.318704821Z [2024-03-29 00:59:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T00:59:01.478720542Z [2024-03-29 00:59:01,478: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T00:59:01.482699626Z [2024-03-29 00:59:01,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:59:01.513146266Z [2024-03-29 00:59:01,512: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T00:59:01.515303594Z [2024-03-29 00:59:01,514: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T00:59:01.515752737Z [2024-03-29 00:59:01,515: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T00:59:01.516090447Z [2024-03-29 00:59:01,515: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T00:59:01.516749525Z [2024-03-29 00:59:01,516: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T00:59:01.529696105Z [2024-03-29 00:59:01,526: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T00:59:01.634363720Z [2024-03-29 00:59:01,634: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:59:02.404044683Z [2024-03-29 00:59:02,403: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a962bac4-7eea-4fa3-bea7-a4068134835d] succeeded in 1.4593676120002783s: None 2024-03-29T00:59:02.496503049Z [2024-03-29 00:59:02,496: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T00:59:02.500263289Z [2024-03-29 00:59:02,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:59:02.523526575Z [2024-03-29 00:59:02,523: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T00:59:02.525165911Z [2024-03-29 00:59:02,524: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:59:02.525180294Z [2024-03-29 00:59:02,525: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:59:02.525315243Z [2024-03-29 00:59:02,525: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:59:02.525331877Z [2024-03-29 00:59:02,525: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T00:59:02.525610296Z [2024-03-29 00:59:02,525: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T00:59:02.525654989Z [2024-03-29 00:59:02,525: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:59:02.621134498Z [2024-03-29 00:59:02,620: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:59:03.040337023Z [2024-03-29 00:59:03,039: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T00:59:03.046580925Z [2024-03-29 00:59:03,043: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T00:59:03.080283912Z [2024-03-29 00:59:03,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T00:59:03.081639177Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T00:59:03.081655558Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T00:59:03.081675175Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T00:59:03.081741130Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T00:59:03.081986070Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T00:59:03.081998863Z [2024-03-29 00:59:03,081: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T00:59:03.185018505Z [2024-03-29 00:59:03,184: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T00:59:05.573786863Z [2024-03-29 00:59:05,573: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a938decf-7ee4-4236-9f5e-f1eed001ac7b] succeeded in 4.603344455000297s: None 2024-03-29T00:59:05.882596914Z [2024-03-29 00:59:05,879: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acbe78cd-d10f-4876-9d00-72326c90f7e9] succeeded in 4.909218849000354s: None 2024-03-29T01:00:00.341687498Z [2024-03-29 01:00:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c76d9d39-675d-475c-97ab-5aa3502f3d2f] received 2024-03-29T01:00:00.343923852Z [2024-03-29 01:00:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a913929-13a7-41e4-88cb-2290e309c479] received 2024-03-29T01:00:00.345776190Z [2024-03-29 01:00:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a404f7e-3470-42b4-bce2-160ba5e378a5] received 2024-03-29T01:00:00.347723581Z [2024-03-29 01:00:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[638e3784-2990-49f6-9e83-e9106e03fecc] received 2024-03-29T01:00:00.359970796Z [2024-03-29 01:00:00,359: INFO/ForkPoolWorker-2] [638e3784-2990-49f6-9e83-e9106e03fecc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:00:00.360906936Z [2024-03-29 01:00:00,360: INFO/ForkPoolWorker-16] [8a913929-13a7-41e4-88cb-2290e309c479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:00:00.361395000Z [2024-03-29 01:00:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35f542d1-ab4b-4723-8520-afa0caeef751] received 2024-03-29T01:00:00.372045718Z [2024-03-29 01:00:00,371: INFO/ForkPoolWorker-1] [0a404f7e-3470-42b4-bce2-160ba5e378a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:00.377925222Z [2024-03-29 01:00:00,377: INFO/ForkPoolWorker-15] [c76d9d39-675d-475c-97ab-5aa3502f3d2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:00:00.378118836Z [2024-03-29 01:00:00,377: INFO/ForkPoolWorker-3] [35f542d1-ab4b-4723-8520-afa0caeef751] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:00:00.759977747Z [2024-03-29 01:00:00,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:00:00.767291066Z [2024-03-29 01:00:00,763: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:00:00.801837106Z [2024-03-29 01:00:00,794: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:00:01.064524278Z [2024-03-29 01:00:01,064: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:01.214384389Z [2024-03-29 01:00:01,209: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:00:01.291187775Z [2024-03-29 01:00:01,284: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:00:01.424831913Z [2024-03-29 01:00:01,424: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:00:01.429273896Z [2024-03-29 01:00:01,428: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:01.467476442Z [2024-03-29 01:00:01,467: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:00:01.471267305Z [2024-03-29 01:00:01,470: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:00:01.471573312Z [2024-03-29 01:00:01,471: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:00:01.471781326Z [2024-03-29 01:00:01,471: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:00:01.472190993Z [2024-03-29 01:00:01,472: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:00:01.688742767Z [2024-03-29 01:00:01,688: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:01.854466539Z [2024-03-29 01:00:01,854: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[638e3784-2990-49f6-9e83-e9106e03fecc] succeeded in 1.5035785079999187s: None 2024-03-29T01:00:02.513080207Z [2024-03-29 01:00:02,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c76d9d39-675d-475c-97ab-5aa3502f3d2f] succeeded in 2.1604212959991855s: None 2024-03-29T01:00:02.599387937Z [2024-03-29 01:00:02,598: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:00:02.603427388Z [2024-03-29 01:00:02,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:02.647545620Z [2024-03-29 01:00:02,647: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:00:02.651765750Z [2024-03-29 01:00:02,651: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:02.651981698Z [2024-03-29 01:00:02,651: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:02.652188449Z [2024-03-29 01:00:02,651: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:02.652274198Z [2024-03-29 01:00:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:00:02.652600181Z [2024-03-29 01:00:02,652: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:00:02.652672644Z [2024-03-29 01:00:02,652: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:02.669767489Z [2024-03-29 01:00:02,669: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:00:02.673761890Z [2024-03-29 01:00:02,673: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:02.715264315Z [2024-03-29 01:00:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:00:02.719433469Z [2024-03-29 01:00:02,719: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:02.719492570Z [2024-03-29 01:00:02,719: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:02.719764085Z [2024-03-29 01:00:02,719: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:02.719801861Z [2024-03-29 01:00:02,719: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:00:02.720359626Z [2024-03-29 01:00:02,720: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:00:02.720435052Z [2024-03-29 01:00:02,720: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:02.753379808Z [2024-03-29 01:00:02,753: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:02.856975237Z [2024-03-29 01:00:02,856: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:03.181191004Z [2024-03-29 01:00:03,180: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T01:00:03.185199699Z [2024-03-29 01:00:03,184: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:03.216398922Z [2024-03-29 01:00:03,216: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:00:03.220275893Z [2024-03-29 01:00:03,219: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:03.220601574Z [2024-03-29 01:00:03,220: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:03.220953000Z [2024-03-29 01:00:03,220: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:03.221238719Z [2024-03-29 01:00:03,221: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T01:00:03.222112548Z [2024-03-29 01:00:03,221: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:00:03.222432981Z [2024-03-29 01:00:03,222: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:03.346705753Z [2024-03-29 01:00:03,346: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:03.523613169Z [2024-03-29 01:00:03,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a404f7e-3470-42b4-bce2-160ba5e378a5] succeeded in 3.1755016269999032s: None 2024-03-29T01:00:03.671436919Z [2024-03-29 01:00:03,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9327570-b0f8-4ce0-a3a6-1c9337c5801d] received 2024-03-29T01:00:03.681779062Z [2024-03-29 01:00:03,681: INFO/ForkPoolWorker-15] [e9327570-b0f8-4ce0-a3a6-1c9337c5801d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:04.108376230Z [2024-03-29 01:00:04,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:00:04.457814694Z [2024-03-29 01:00:04,457: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a913929-13a7-41e4-88cb-2290e309c479] succeeded in 4.108688598000299s: None 2024-03-29T01:00:05.446566834Z [2024-03-29 01:00:05,446: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[35f542d1-ab4b-4723-8520-afa0caeef751] succeeded in 5.082634887000495s: None 2024-03-29T01:00:05.786322998Z [2024-03-29 01:00:05,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:00:05.790527810Z [2024-03-29 01:00:05,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:05.835600919Z [2024-03-29 01:00:05,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:00:05.838716120Z [2024-03-29 01:00:05,837: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:05.838742041Z [2024-03-29 01:00:05,838: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:05.840382374Z [2024-03-29 01:00:05,840: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:05.840516124Z [2024-03-29 01:00:05,840: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:00:05.840964213Z [2024-03-29 01:00:05,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:00:05.841111562Z [2024-03-29 01:00:05,840: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:06.011214858Z [2024-03-29 01:00:06,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:07.082137339Z [2024-03-29 01:00:07,081: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9327570-b0f8-4ce0-a3a6-1c9337c5801d] succeeded in 3.40852687899951s: None 2024-03-29T01:00:07.544046866Z [2024-03-29 01:00:07,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae8dca6-75b1-46f4-95f7-372915d982d1] received 2024-03-29T01:00:07.555506398Z [2024-03-29 01:00:07,555: INFO/ForkPoolWorker-15] [2ae8dca6-75b1-46f4-95f7-372915d982d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:00:07.950483999Z [2024-03-29 01:00:07,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:00:09.495710325Z [2024-03-29 01:00:09,495: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:00:09.499485030Z [2024-03-29 01:00:09,499: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:09.527059632Z [2024-03-29 01:00:09,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:00:09.528691744Z [2024-03-29 01:00:09,528: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:09.529007667Z [2024-03-29 01:00:09,528: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:09.529291271Z [2024-03-29 01:00:09,529: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:09.529479023Z [2024-03-29 01:00:09,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:00:09.530094671Z [2024-03-29 01:00:09,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:00:09.530345434Z [2024-03-29 01:00:09,530: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:09.629069297Z [2024-03-29 01:00:09,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:10.280397195Z [2024-03-29 01:00:10,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ae8dca6-75b1-46f4-95f7-372915d982d1] succeeded in 2.7339856990001863s: None 2024-03-29T01:00:10.368783682Z [2024-03-29 01:00:10,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5795a6-4a37-400c-896e-76aa5cf62793] received 2024-03-29T01:00:10.375079848Z [2024-03-29 01:00:10,374: INFO/ForkPoolWorker-15] [aa5795a6-4a37-400c-896e-76aa5cf62793] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:10.700902786Z [2024-03-29 01:00:10,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:00:11.959826439Z [2024-03-29 01:00:11,959: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:00:11.963589303Z [2024-03-29 01:00:11,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:00:11.983443573Z [2024-03-29 01:00:11,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:00:11.984830106Z [2024-03-29 01:00:11,984: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:00:11.984853083Z [2024-03-29 01:00:11,984: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:00:11.985049681Z [2024-03-29 01:00:11,984: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:00:11.985077716Z [2024-03-29 01:00:11,984: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:00:11.985400938Z [2024-03-29 01:00:11,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:00:11.985508627Z [2024-03-29 01:00:11,985: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:00:12.079889357Z [2024-03-29 01:00:12,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:00:12.689638277Z [2024-03-29 01:00:12,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa5795a6-4a37-400c-896e-76aa5cf62793] succeeded in 2.318093487000624s: None 2024-03-29T01:01:00.712621620Z [2024-03-29 01:01:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae322914-8b31-4017-9521-1b4bc3e17777] received 2024-03-29T01:01:00.727537824Z [2024-03-29 01:01:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71a864fd-40b3-4162-9f2c-a35bb14ae6da] received 2024-03-29T01:01:00.732558947Z [2024-03-29 01:01:00,732: INFO/ForkPoolWorker-15] [ae322914-8b31-4017-9521-1b4bc3e17777] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:01:00.734624834Z [2024-03-29 01:01:00,734: INFO/ForkPoolWorker-16] [71a864fd-40b3-4162-9f2c-a35bb14ae6da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:01:00.744774951Z [2024-03-29 01:01:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a486e0bf-e649-4789-b632-6d6737606a66] received 2024-03-29T01:01:00.752450008Z [2024-03-29 01:01:00,752: INFO/ForkPoolWorker-1] [a486e0bf-e649-4789-b632-6d6737606a66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:01:01.074973745Z [2024-03-29 01:01:01,072: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:01:01.089075432Z [2024-03-29 01:01:01,085: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:01:01.130010614Z [2024-03-29 01:01:01,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:01:01.315774186Z [2024-03-29 01:01:01,315: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:01:01.319929657Z [2024-03-29 01:01:01,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:01:01.355652624Z [2024-03-29 01:01:01,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:01:01.357709695Z [2024-03-29 01:01:01,357: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:01:01.357994244Z [2024-03-29 01:01:01,357: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:01:01.358128533Z [2024-03-29 01:01:01,357: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:01:01.358428357Z [2024-03-29 01:01:01,358: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:01:01.507784383Z [2024-03-29 01:01:01,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:01:02.332493266Z [2024-03-29 01:01:02,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae322914-8b31-4017-9521-1b4bc3e17777] succeeded in 1.612759210999684s: None 2024-03-29T01:01:02.541320661Z [2024-03-29 01:01:02,540: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:01:02.544240227Z [2024-03-29 01:01:02,543: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:01:02.545281738Z [2024-03-29 01:01:02,544: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:01:02.549046483Z [2024-03-29 01:01:02,548: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:01:02.575983154Z [2024-03-29 01:01:02,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:01:02.582636817Z [2024-03-29 01:01:02,582: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:01:02.584087470Z [2024-03-29 01:01:02,581: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:01:02.584347270Z [2024-03-29 01:01:02,584: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:01:02.584706582Z [2024-03-29 01:01:02,584: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:01:02.584920911Z [2024-03-29 01:01:02,584: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:01:02.585352980Z [2024-03-29 01:01:02,585: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:01:02.585533537Z [2024-03-29 01:01:02,585: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:01:02.587149883Z [2024-03-29 01:01:02,586: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:01:02.587353726Z [2024-03-29 01:01:02,587: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:01:02.587614382Z [2024-03-29 01:01:02,587: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:01:02.587862518Z [2024-03-29 01:01:02,587: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:01:02.588970554Z [2024-03-29 01:01:02,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:01:02.589217772Z [2024-03-29 01:01:02,589: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:01:02.717319586Z [2024-03-29 01:01:02,716: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:01:02.748790428Z [2024-03-29 01:01:02,748: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:01:04.402114041Z [2024-03-29 01:01:04,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71a864fd-40b3-4162-9f2c-a35bb14ae6da] succeeded in 3.6724003790004645s: None 2024-03-29T01:01:04.656635234Z [2024-03-29 01:01:04,656: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a486e0bf-e649-4789-b632-6d6737606a66] succeeded in 3.909365311000329s: None 2024-03-29T01:02:00.285039906Z [2024-03-29 01:02:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2654924-3463-4c50-91e3-8651682227e4] received 2024-03-29T01:02:00.287043402Z [2024-03-29 01:02:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86d7ccb9-1be7-4e02-98ca-63b60f94e04e] received 2024-03-29T01:02:00.296878084Z [2024-03-29 01:02:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00c7478d-b40d-4360-b1f3-395de36eda39] received 2024-03-29T01:02:00.298110779Z [2024-03-29 01:02:00,296: INFO/ForkPoolWorker-15] [d2654924-3463-4c50-91e3-8651682227e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:02:00.299634480Z [2024-03-29 01:02:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5450791-ce17-4d39-a7c4-e1f4c76baa13] received 2024-03-29T01:02:00.300161282Z [2024-03-29 01:02:00,299: INFO/ForkPoolWorker-16] [86d7ccb9-1be7-4e02-98ca-63b60f94e04e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:02:00.308572058Z [2024-03-29 01:02:00,308: INFO/ForkPoolWorker-1] [00c7478d-b40d-4360-b1f3-395de36eda39] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:02:00.310573433Z [2024-03-29 01:02:00,310: INFO/ForkPoolWorker-2] [a5450791-ce17-4d39-a7c4-e1f4c76baa13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:02:00.625018817Z [2024-03-29 01:02:00,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:02:00.690183468Z [2024-03-29 01:02:00,687: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:02:00.785548364Z [2024-03-29 01:02:00,785: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:02:00.789541464Z [2024-03-29 01:02:00,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:02:00.838013274Z [2024-03-29 01:02:00,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:02:00.839712261Z [2024-03-29 01:02:00,839: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:02:00.839910369Z [2024-03-29 01:02:00,839: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:02:00.840012273Z [2024-03-29 01:02:00,839: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:02:00.840362485Z [2024-03-29 01:02:00,840: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:02:00.868702991Z [2024-03-29 01:02:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:02:00.895420522Z [2024-03-29 01:02:00,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:02:01.021206910Z [2024-03-29 01:02:01,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:02:01.188729095Z [2024-03-29 01:02:01,188: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:02:01.700548113Z [2024-03-29 01:02:01,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2654924-3463-4c50-91e3-8651682227e4] succeeded in 1.413597844000833s: None 2024-03-29T01:02:01.817589081Z [2024-03-29 01:02:01,817: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00c7478d-b40d-4360-b1f3-395de36eda39] succeeded in 1.5182832919999782s: None 2024-03-29T01:02:02.132384601Z [2024-03-29 01:02:02,131: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:02:02.136071341Z [2024-03-29 01:02:02,135: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:02:02.157817341Z [2024-03-29 01:02:02,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:02:02.160085992Z [2024-03-29 01:02:02,159: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:02:02.160389241Z [2024-03-29 01:02:02,160: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:02:02.160738026Z [2024-03-29 01:02:02,160: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:02:02.160974688Z [2024-03-29 01:02:02,160: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:02:02.161579295Z [2024-03-29 01:02:02,161: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:02:02.161753229Z [2024-03-29 01:02:02,161: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:02:02.259723680Z [2024-03-29 01:02:02,259: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:02:02.263202049Z [2024-03-29 01:02:02,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:02:02.266936918Z [2024-03-29 01:02:02,266: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:02:02.292286644Z [2024-03-29 01:02:02,292: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:02:02.293845666Z [2024-03-29 01:02:02,293: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:02:02.293935130Z [2024-03-29 01:02:02,293: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:02:02.294160297Z [2024-03-29 01:02:02,293: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:02:02.294251215Z [2024-03-29 01:02:02,294: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:02:02.294621148Z [2024-03-29 01:02:02,294: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:02:02.294704626Z [2024-03-29 01:02:02,294: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:02:02.391528275Z [2024-03-29 01:02:02,391: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:02:03.922976720Z [2024-03-29 01:02:03,922: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86d7ccb9-1be7-4e02-98ca-63b60f94e04e] succeeded in 3.633633712000119s: None 2024-03-29T01:02:04.652466775Z [2024-03-29 01:02:04,651: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a5450791-ce17-4d39-a7c4-e1f4c76baa13] succeeded in 4.350610946000415s: None 2024-03-29T01:03:01.067918990Z [2024-03-29 01:03:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb27b0ca-3e6f-4657-9f1d-08a87adc9d0e] received 2024-03-29T01:03:01.071017780Z [2024-03-29 01:03:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bd1ba71-c621-49fd-a487-1c50065b1796] received 2024-03-29T01:03:01.078788599Z [2024-03-29 01:03:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9484e0be-3b39-49c1-9b79-a819a5850fe7] received 2024-03-29T01:03:01.080290410Z [2024-03-29 01:03:01,080: INFO/ForkPoolWorker-16] [3bd1ba71-c621-49fd-a487-1c50065b1796] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:03:01.083259576Z [2024-03-29 01:03:01,082: INFO/ForkPoolWorker-15] [fb27b0ca-3e6f-4657-9f1d-08a87adc9d0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:03:01.090163503Z [2024-03-29 01:03:01,089: INFO/ForkPoolWorker-1] [9484e0be-3b39-49c1-9b79-a819a5850fe7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:03:01.402315632Z [2024-03-29 01:03:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:03:01.412097727Z [2024-03-29 01:03:01,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:03:01.421731191Z [2024-03-29 01:03:01,418: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:03:01.599495159Z [2024-03-29 01:03:01,599: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:03:01.603721744Z [2024-03-29 01:03:01,603: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:03:01.627091646Z [2024-03-29 01:03:01,626: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:03:01.628330602Z [2024-03-29 01:03:01,628: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:03:01.628562639Z [2024-03-29 01:03:01,628: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:03:01.628753104Z [2024-03-29 01:03:01,628: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:03:01.628965972Z [2024-03-29 01:03:01,628: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:03:01.719105847Z [2024-03-29 01:03:01,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:03:02.302090383Z [2024-03-29 01:03:02,301: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bd1ba71-c621-49fd-a487-1c50065b1796] succeeded in 1.2296663519991853s: None 2024-03-29T01:03:02.636565015Z [2024-03-29 01:03:02,636: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:03:02.639781100Z [2024-03-29 01:03:02,639: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:03:02.660814041Z [2024-03-29 01:03:02,660: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:03:02.662041596Z [2024-03-29 01:03:02,661: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:03:02.662200666Z [2024-03-29 01:03:02,661: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:03:02.662384932Z [2024-03-29 01:03:02,662: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:03:02.662564992Z [2024-03-29 01:03:02,662: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:03:02.663007847Z [2024-03-29 01:03:02,662: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:03:02.663198248Z [2024-03-29 01:03:02,663: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:03:02.749301413Z [2024-03-29 01:03:02,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:03:02.754488119Z [2024-03-29 01:03:02,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:03:02.758131282Z [2024-03-29 01:03:02,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:03:02.790718564Z [2024-03-29 01:03:02,790: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:03:02.792299065Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:03:02.792308133Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:03:02.792375233Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:03:02.792408941Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:03:02.792700068Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:03:02.792708923Z [2024-03-29 01:03:02,792: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:03:02.893476773Z [2024-03-29 01:03:02,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:03:04.341014002Z [2024-03-29 01:03:04,340: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9484e0be-3b39-49c1-9b79-a819a5850fe7] succeeded in 3.259653060000346s: None 2024-03-29T01:03:04.813612205Z [2024-03-29 01:03:04,813: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb27b0ca-3e6f-4657-9f1d-08a87adc9d0e] succeeded in 3.740420060999895s: None 2024-03-29T01:04:00.611193184Z [2024-03-29 01:04:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb8407e4-82a0-485b-925b-21703e920d18] received 2024-03-29T01:04:00.616288982Z [2024-03-29 01:04:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[998709f5-839a-4a59-a082-0cd2cb01a475] received 2024-03-29T01:04:00.618070617Z [2024-03-29 01:04:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a197ca47-f976-41fc-990c-4ac16aa0ea5a] received 2024-03-29T01:04:00.619697786Z [2024-03-29 01:04:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63dffbc9-1380-48c4-b1f9-3409af96f7d1] received 2024-03-29T01:04:00.621010535Z [2024-03-29 01:04:00,620: INFO/ForkPoolWorker-15] [eb8407e4-82a0-485b-925b-21703e920d18] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:04:00.627575608Z [2024-03-29 01:04:00,627: INFO/ForkPoolWorker-16] [998709f5-839a-4a59-a082-0cd2cb01a475] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:04:00.628279213Z [2024-03-29 01:04:00,628: INFO/ForkPoolWorker-1] [a197ca47-f976-41fc-990c-4ac16aa0ea5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:04:00.630637346Z [2024-03-29 01:04:00,630: INFO/ForkPoolWorker-2] [63dffbc9-1380-48c4-b1f9-3409af96f7d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:04:00.921897863Z [2024-03-29 01:04:00,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:04:00.980429505Z [2024-03-29 01:04:00,976: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:04:01.043025123Z [2024-03-29 01:04:01,039: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:04:01.054208816Z [2024-03-29 01:04:01,051: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:04:01.181801820Z [2024-03-29 01:04:01,181: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:04:01.217731557Z [2024-03-29 01:04:01,217: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:04:01.221758481Z [2024-03-29 01:04:01,221: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:04:01.250961627Z [2024-03-29 01:04:01,250: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:04:01.252194820Z [2024-03-29 01:04:01,251: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:04:01.252391078Z [2024-03-29 01:04:01,252: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:04:01.252596665Z [2024-03-29 01:04:01,252: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:04:01.252898157Z [2024-03-29 01:04:01,252: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:04:01.355729590Z [2024-03-29 01:04:01,355: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:04:01.813161126Z [2024-03-29 01:04:01,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb8407e4-82a0-485b-925b-21703e920d18] succeeded in 1.1981608599999163s: None 2024-03-29T01:04:02.028625097Z [2024-03-29 01:04:02,028: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[63dffbc9-1380-48c4-b1f9-3409af96f7d1] succeeded in 1.4073102230004224s: None 2024-03-29T01:04:02.412103554Z [2024-03-29 01:04:02,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:04:02.416176238Z [2024-03-29 01:04:02,415: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:04:02.434264866Z [2024-03-29 01:04:02,433: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:04:02.437699252Z [2024-03-29 01:04:02,437: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:04:02.438390565Z [2024-03-29 01:04:02,437: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:04:02.439316485Z [2024-03-29 01:04:02,439: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:04:02.439344897Z [2024-03-29 01:04:02,439: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:04:02.439536056Z [2024-03-29 01:04:02,439: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:04:02.439693317Z [2024-03-29 01:04:02,439: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:04:02.440180801Z [2024-03-29 01:04:02,439: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:04:02.440192944Z [2024-03-29 01:04:02,440: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:04:02.458850478Z [2024-03-29 01:04:02,458: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:04:02.460345660Z [2024-03-29 01:04:02,460: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:04:02.460499076Z [2024-03-29 01:04:02,460: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:04:02.460743000Z [2024-03-29 01:04:02,460: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:04:02.460851849Z [2024-03-29 01:04:02,460: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:04:02.461296689Z [2024-03-29 01:04:02,461: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:04:02.461456179Z [2024-03-29 01:04:02,461: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:04:02.532360735Z [2024-03-29 01:04:02,531: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:04:02.554905673Z [2024-03-29 01:04:02,554: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:04:04.081354091Z [2024-03-29 01:04:04,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[998709f5-839a-4a59-a082-0cd2cb01a475] succeeded in 3.462987715000054s: None 2024-03-29T01:04:04.442128531Z [2024-03-29 01:04:04,441: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a197ca47-f976-41fc-990c-4ac16aa0ea5a] succeeded in 3.8218766090003555s: None 2024-03-29T01:05:00.967535263Z [2024-03-29 01:05:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5000021-ddbe-4d21-a0ce-0eae912f56b0] received 2024-03-29T01:05:00.971831161Z [2024-03-29 01:05:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0105e7b-afbc-41c1-93e5-cf11aabeffbc] received 2024-03-29T01:05:00.973891740Z [2024-03-29 01:05:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b529d27a-38c5-4f0a-9ca7-d56454350547] received 2024-03-29T01:05:00.977798771Z [2024-03-29 01:05:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59dec3a5-fcc5-4c54-9056-c1507425d27e] received 2024-03-29T01:05:00.978088102Z [2024-03-29 01:05:00,977: INFO/ForkPoolWorker-15] [f5000021-ddbe-4d21-a0ce-0eae912f56b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:00.984913809Z [2024-03-29 01:05:00,983: INFO/ForkPoolWorker-16] [f0105e7b-afbc-41c1-93e5-cf11aabeffbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:05:00.987526686Z [2024-03-29 01:05:00,987: INFO/ForkPoolWorker-2] [59dec3a5-fcc5-4c54-9056-c1507425d27e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:05:00.989265104Z [2024-03-29 01:05:00,988: INFO/ForkPoolWorker-1] [b529d27a-38c5-4f0a-9ca7-d56454350547] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:05:01.332962898Z [2024-03-29 01:05:01,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:05:01.344864062Z [2024-03-29 01:05:01,341: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:05:01.365062534Z [2024-03-29 01:05:01,360: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:05:01.398006769Z [2024-03-29 01:05:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:05:01.558102441Z [2024-03-29 01:05:01,557: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:05:01.568659043Z [2024-03-29 01:05:01,568: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:01.616725000Z [2024-03-29 01:05:01,616: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:05:01.617859870Z [2024-03-29 01:05:01,617: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:05:01.617993080Z [2024-03-29 01:05:01,617: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:05:01.618100067Z [2024-03-29 01:05:01,617: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:05:01.618361983Z [2024-03-29 01:05:01,618: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:05:01.799373309Z [2024-03-29 01:05:01,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:02.637988884Z [2024-03-29 01:05:02,637: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0105e7b-afbc-41c1-93e5-cf11aabeffbc] succeeded in 1.664518347000012s: None 2024-03-29T01:05:02.846330545Z [2024-03-29 01:05:02,845: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:05:02.849919287Z [2024-03-29 01:05:02,849: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:02.874274592Z [2024-03-29 01:05:02,874: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:05:02.875988749Z [2024-03-29 01:05:02,875: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:02.876002939Z [2024-03-29 01:05:02,875: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:02.876247362Z [2024-03-29 01:05:02,875: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:02.876471448Z [2024-03-29 01:05:02,876: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:05:02.876857561Z [2024-03-29 01:05:02,876: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:05:02.877568837Z [2024-03-29 01:05:02,876: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:02.963833378Z [2024-03-29 01:05:02,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:05:02.967663649Z [2024-03-29 01:05:02,967: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:02.977093738Z [2024-03-29 01:05:02,976: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:03.005861572Z [2024-03-29 01:05:03,005: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:05:03.007474247Z [2024-03-29 01:05:03,007: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:03.007663179Z [2024-03-29 01:05:03,007: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:03.007972262Z [2024-03-29 01:05:03,007: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:03.008224365Z [2024-03-29 01:05:03,007: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:05:03.008630293Z [2024-03-29 01:05:03,008: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:05:03.008772287Z [2024-03-29 01:05:03,008: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:03.098743801Z [2024-03-29 01:05:03,098: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:03.125151139Z [2024-03-29 01:05:03,124: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:05:03.130155120Z [2024-03-29 01:05:03,129: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:03.159096170Z [2024-03-29 01:05:03,158: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:05:03.160475729Z [2024-03-29 01:05:03,160: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:03.160637667Z [2024-03-29 01:05:03,160: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:03.160847208Z [2024-03-29 01:05:03,160: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:03.160993489Z [2024-03-29 01:05:03,160: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:05:03.161337428Z [2024-03-29 01:05:03,161: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:05:03.161489998Z [2024-03-29 01:05:03,161: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:03.260275624Z [2024-03-29 01:05:03,260: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:03.772271674Z [2024-03-29 01:05:03,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5000021-ddbe-4d21-a0ce-0eae912f56b0] succeeded in 2.8028480740003943s: None 2024-03-29T01:05:04.262914474Z [2024-03-29 01:05:04,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22ce4c66-36aa-49b0-8192-1916394204c7] received 2024-03-29T01:05:04.271116199Z [2024-03-29 01:05:04,270: INFO/ForkPoolWorker-15] [22ce4c66-36aa-49b0-8192-1916394204c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:04.574862736Z [2024-03-29 01:05:04,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:05:04.590263050Z [2024-03-29 01:05:04,589: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[59dec3a5-fcc5-4c54-9056-c1507425d27e] succeeded in 3.6107332539995696s: None 2024-03-29T01:05:05.254306575Z [2024-03-29 01:05:05,253: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b529d27a-38c5-4f0a-9ca7-d56454350547] succeeded in 4.278360941999381s: None 2024-03-29T01:05:05.951020396Z [2024-03-29 01:05:05,950: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:05:05.955839879Z [2024-03-29 01:05:05,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:05.982281033Z [2024-03-29 01:05:05,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:05:05.984033062Z [2024-03-29 01:05:05,983: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:05.984188857Z [2024-03-29 01:05:05,983: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:05.984481841Z [2024-03-29 01:05:05,984: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:05.984628777Z [2024-03-29 01:05:05,984: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:05:05.984977541Z [2024-03-29 01:05:05,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:05:05.985112065Z [2024-03-29 01:05:05,984: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:06.074373515Z [2024-03-29 01:05:06,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:06.842968450Z [2024-03-29 01:05:06,842: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22ce4c66-36aa-49b0-8192-1916394204c7] succeeded in 2.577248683999642s: None 2024-03-29T01:05:07.026918076Z [2024-03-29 01:05:07,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3793fdd-5b09-4547-91dd-6087e9ead790] received 2024-03-29T01:05:07.038430140Z [2024-03-29 01:05:07,038: INFO/ForkPoolWorker-15] [d3793fdd-5b09-4547-91dd-6087e9ead790] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:05:07.459796030Z [2024-03-29 01:05:07,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:05:08.702900290Z [2024-03-29 01:05:08,702: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:05:08.706208811Z [2024-03-29 01:05:08,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:08.723169496Z [2024-03-29 01:05:08,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:05:08.724466506Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:08.724484234Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:08.724686982Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:08.724739237Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:05:08.725010203Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:05:08.725077483Z [2024-03-29 01:05:08,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:08.798968121Z [2024-03-29 01:05:08,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:09.276377265Z [2024-03-29 01:05:09,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3793fdd-5b09-4547-91dd-6087e9ead790] succeeded in 2.2473208380006326s: None 2024-03-29T01:05:09.391363441Z [2024-03-29 01:05:09,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47d366ce-a922-4ba0-b304-50684b7231a5] received 2024-03-29T01:05:09.398768220Z [2024-03-29 01:05:09,398: INFO/ForkPoolWorker-15] [47d366ce-a922-4ba0-b304-50684b7231a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:09.733978910Z [2024-03-29 01:05:09,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:05:10.863223567Z [2024-03-29 01:05:10,862: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:05:10.866713460Z [2024-03-29 01:05:10,866: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:05:10.884696895Z [2024-03-29 01:05:10,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:05:10.885911906Z [2024-03-29 01:05:10,885: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:05:10.885932462Z [2024-03-29 01:05:10,885: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:05:10.886104510Z [2024-03-29 01:05:10,885: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:05:10.886155997Z [2024-03-29 01:05:10,886: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:05:10.886417742Z [2024-03-29 01:05:10,886: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:05:10.886497362Z [2024-03-29 01:05:10,886: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:05:10.970480607Z [2024-03-29 01:05:10,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:05:11.534404729Z [2024-03-29 01:05:11,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47d366ce-a922-4ba0-b304-50684b7231a5] succeeded in 2.1412013030003436s: None 2024-03-29T01:06:00.507516684Z [2024-03-29 01:06:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7396b16e-ba4a-4590-afcd-8de10d096eb0] received 2024-03-29T01:06:00.517876844Z [2024-03-29 01:06:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1803ac82-ed2b-413b-b470-2ea49804f46b] received 2024-03-29T01:06:00.524587537Z [2024-03-29 01:06:00,524: INFO/ForkPoolWorker-15] [7396b16e-ba4a-4590-afcd-8de10d096eb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:06:00.525869926Z [2024-03-29 01:06:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1914b0e-7eea-4611-9964-8b52e867f596] received 2024-03-29T01:06:00.526619380Z [2024-03-29 01:06:00,526: INFO/ForkPoolWorker-16] [1803ac82-ed2b-413b-b470-2ea49804f46b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:06:00.527848070Z [2024-03-29 01:06:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3110a0ab-fea7-44e9-b9ec-5740b2ae99bb] received 2024-03-29T01:06:00.539323253Z [2024-03-29 01:06:00,538: INFO/ForkPoolWorker-1] [b1914b0e-7eea-4611-9964-8b52e867f596] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:06:00.545697157Z [2024-03-29 01:06:00,545: INFO/ForkPoolWorker-2] [3110a0ab-fea7-44e9-b9ec-5740b2ae99bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:06:00.870411460Z [2024-03-29 01:06:00,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:06:00.922801608Z [2024-03-29 01:06:00,919: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:06:00.943132268Z [2024-03-29 01:06:00,936: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:06:00.946428684Z [2024-03-29 01:06:00,943: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:06:01.166280665Z [2024-03-29 01:06:01,165: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:06:01.173123783Z [2024-03-29 01:06:01,172: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:06:01.219264070Z [2024-03-29 01:06:01,218: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:06:01.223551670Z [2024-03-29 01:06:01,223: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:06:01.226531098Z [2024-03-29 01:06:01,223: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:06:01.226749969Z [2024-03-29 01:06:01,226: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:06:01.228130903Z [2024-03-29 01:06:01,227: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:06:01.288889068Z [2024-03-29 01:06:01,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:06:01.378135220Z [2024-03-29 01:06:01,377: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:06:02.093508521Z [2024-03-29 01:06:02,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1803ac82-ed2b-413b-b470-2ea49804f46b] succeeded in 1.5735381419999612s: None 2024-03-29T01:06:02.259330930Z [2024-03-29 01:06:02,258: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3110a0ab-fea7-44e9-b9ec-5740b2ae99bb] succeeded in 1.7270739019995744s: None 2024-03-29T01:06:02.601744992Z [2024-03-29 01:06:02,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:06:02.605890368Z [2024-03-29 01:06:02,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:06:02.629324961Z [2024-03-29 01:06:02,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:06:02.630912102Z [2024-03-29 01:06:02,630: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:06:02.631131924Z [2024-03-29 01:06:02,630: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:06:02.631407621Z [2024-03-29 01:06:02,631: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:06:02.631425883Z [2024-03-29 01:06:02,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:06:02.631938331Z [2024-03-29 01:06:02,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:06:02.632081995Z [2024-03-29 01:06:02,631: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:06:02.720448403Z [2024-03-29 01:06:02,720: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:06:02.851126737Z [2024-03-29 01:06:02,850: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:06:02.855332726Z [2024-03-29 01:06:02,854: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:06:02.887480474Z [2024-03-29 01:06:02,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:06:02.889024204Z [2024-03-29 01:06:02,888: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:06:02.889046458Z [2024-03-29 01:06:02,888: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:06:02.889256725Z [2024-03-29 01:06:02,889: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:06:02.889344119Z [2024-03-29 01:06:02,889: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:06:02.889736151Z [2024-03-29 01:06:02,889: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:06:02.889845897Z [2024-03-29 01:06:02,889: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:06:02.996731733Z [2024-03-29 01:06:02,996: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:06:04.451822056Z [2024-03-29 01:06:04,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1914b0e-7eea-4611-9964-8b52e867f596] succeeded in 3.922091200000068s: None 2024-03-29T01:06:04.571803245Z [2024-03-29 01:06:04,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7396b16e-ba4a-4590-afcd-8de10d096eb0] succeeded in 4.0610607790004s: None 2024-03-29T01:07:00.812252037Z [2024-03-29 01:07:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee72843c-887c-4d35-805e-62c3a03c1ac1] received 2024-03-29T01:07:00.827449955Z [2024-03-29 01:07:00,826: INFO/ForkPoolWorker-15] [ee72843c-887c-4d35-805e-62c3a03c1ac1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:07:00.832856471Z [2024-03-29 01:07:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d36be98e-12ce-460d-97a9-b4de2d3af000] received 2024-03-29T01:07:00.834864274Z [2024-03-29 01:07:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[335e28db-13f6-414c-ac66-f616ca9ff455] received 2024-03-29T01:07:00.841746806Z [2024-03-29 01:07:00,841: INFO/ForkPoolWorker-1] [335e28db-13f6-414c-ac66-f616ca9ff455] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:07:00.863514033Z [2024-03-29 01:07:00,863: INFO/ForkPoolWorker-16] [d36be98e-12ce-460d-97a9-b4de2d3af000] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:07:01.370082031Z [2024-03-29 01:07:01,364: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:07:01.422041283Z [2024-03-29 01:07:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:07:01.480562951Z [2024-03-29 01:07:01,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:07:01.604539517Z [2024-03-29 01:07:01,604: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:07:01.609186223Z [2024-03-29 01:07:01,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:07:01.629542271Z [2024-03-29 01:07:01,629: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:07:01.631124950Z [2024-03-29 01:07:01,630: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:07:01.631184016Z [2024-03-29 01:07:01,631: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:07:01.631245654Z [2024-03-29 01:07:01,631: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:07:01.631489845Z [2024-03-29 01:07:01,631: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:07:01.755919708Z [2024-03-29 01:07:01,755: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:07:02.515512623Z [2024-03-29 01:07:02,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[335e28db-13f6-414c-ac66-f616ca9ff455] succeeded in 1.679181709999284s: None 2024-03-29T01:07:02.900976393Z [2024-03-29 01:07:02,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:07:02.904870703Z [2024-03-29 01:07:02,904: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:07:02.925066513Z [2024-03-29 01:07:02,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:07:02.926447492Z [2024-03-29 01:07:02,926: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:07:02.926559238Z [2024-03-29 01:07:02,926: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:07:02.926722346Z [2024-03-29 01:07:02,926: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:07:02.926731392Z [2024-03-29 01:07:02,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:07:02.927425420Z [2024-03-29 01:07:02,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:07:02.927509141Z [2024-03-29 01:07:02,927: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:07:03.044311665Z [2024-03-29 01:07:03,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:07:03.068911125Z [2024-03-29 01:07:03,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:07:03.072857140Z [2024-03-29 01:07:03,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:07:03.093728878Z [2024-03-29 01:07:03,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:07:03.097219435Z [2024-03-29 01:07:03,096: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:07:03.097253949Z [2024-03-29 01:07:03,097: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:07:03.097544098Z [2024-03-29 01:07:03,097: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:07:03.097658483Z [2024-03-29 01:07:03,097: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:07:03.098153323Z [2024-03-29 01:07:03,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:07:03.098285211Z [2024-03-29 01:07:03,098: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:07:03.181866614Z [2024-03-29 01:07:03,181: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:07:05.278195900Z [2024-03-29 01:07:05,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee72843c-887c-4d35-805e-62c3a03c1ac1] succeeded in 4.463378561000354s: None 2024-03-29T01:07:05.386319847Z [2024-03-29 01:07:05,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d36be98e-12ce-460d-97a9-b4de2d3af000] succeeded in 4.5501302419997955s: None 2024-03-29T01:08:00.482319610Z [2024-03-29 01:08:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73995aff-7b0a-48a4-b573-a570fa73a293] received 2024-03-29T01:08:00.486260327Z [2024-03-29 01:08:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225c14f0-b2a1-4355-9519-2b8320f34caa] received 2024-03-29T01:08:00.492111102Z [2024-03-29 01:08:00,491: INFO/ForkPoolWorker-15] [73995aff-7b0a-48a4-b573-a570fa73a293] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:08:00.492845998Z [2024-03-29 01:08:00,492: INFO/ForkPoolWorker-16] [225c14f0-b2a1-4355-9519-2b8320f34caa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:08:00.495347506Z [2024-03-29 01:08:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f6d0fa0-1268-4226-9b77-11b187304796] received 2024-03-29T01:08:00.498281993Z [2024-03-29 01:08:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f0b4631-2a7f-4c01-8d43-863b42bf10bc] received 2024-03-29T01:08:00.501462640Z [2024-03-29 01:08:00,501: INFO/ForkPoolWorker-1] [2f6d0fa0-1268-4226-9b77-11b187304796] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:08:00.504834581Z [2024-03-29 01:08:00,504: INFO/ForkPoolWorker-2] [4f0b4631-2a7f-4c01-8d43-863b42bf10bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:08:00.887541611Z [2024-03-29 01:08:00,884: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:08:00.891155970Z [2024-03-29 01:08:00,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:08:00.970843936Z [2024-03-29 01:08:00,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:08:00.991999837Z [2024-03-29 01:08:00,987: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:08:01.262506363Z [2024-03-29 01:08:01,262: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:08:01.269417278Z [2024-03-29 01:08:01,268: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:08:01.311656007Z [2024-03-29 01:08:01,311: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:08:01.318023360Z [2024-03-29 01:08:01,317: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:08:01.318566668Z [2024-03-29 01:08:01,318: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:08:01.318731822Z [2024-03-29 01:08:01,318: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:08:01.319071647Z [2024-03-29 01:08:01,318: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:08:01.378127141Z [2024-03-29 01:08:01,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:08:01.482628593Z [2024-03-29 01:08:01,482: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:08:02.152944910Z [2024-03-29 01:08:02,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73995aff-7b0a-48a4-b573-a570fa73a293] succeeded in 1.6684596960003546s: None 2024-03-29T01:08:02.315089314Z [2024-03-29 01:08:02,314: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f0b4631-2a7f-4c01-8d43-863b42bf10bc] succeeded in 1.8149564129998907s: None 2024-03-29T01:08:02.468224443Z [2024-03-29 01:08:02,467: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:08:02.472013743Z [2024-03-29 01:08:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:08:02.516025824Z [2024-03-29 01:08:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:08:02.517959551Z [2024-03-29 01:08:02,517: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:08:02.518243554Z [2024-03-29 01:08:02,518: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:08:02.518585381Z [2024-03-29 01:08:02,518: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:08:02.518984258Z [2024-03-29 01:08:02,518: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:08:02.519395661Z [2024-03-29 01:08:02,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:08:02.520011076Z [2024-03-29 01:08:02,519: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:08:02.612394057Z [2024-03-29 01:08:02,612: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:08:02.673915816Z [2024-03-29 01:08:02,673: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:08:02.677740777Z [2024-03-29 01:08:02,677: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:08:02.706730520Z [2024-03-29 01:08:02,706: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:08:02.708322480Z [2024-03-29 01:08:02,708: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:08:02.708415807Z [2024-03-29 01:08:02,708: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:08:02.708629728Z [2024-03-29 01:08:02,708: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:08:02.708792859Z [2024-03-29 01:08:02,708: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:08:02.709158736Z [2024-03-29 01:08:02,708: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:08:02.709197859Z [2024-03-29 01:08:02,709: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:08:02.818615020Z [2024-03-29 01:08:02,818: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:08:04.337750577Z [2024-03-29 01:08:04,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[225c14f0-b2a1-4355-9519-2b8320f34caa] succeeded in 3.8497786890002317s: None 2024-03-29T01:08:04.931474991Z [2024-03-29 01:08:04,931: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f6d0fa0-1268-4226-9b77-11b187304796] succeeded in 4.434483220999937s: None 2024-03-29T01:09:00.271765854Z [2024-03-29 01:09:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73d8364b-acc4-4712-864b-66014b7450df] received 2024-03-29T01:09:00.273449290Z [2024-03-29 01:09:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb638af4-309f-4467-9b65-9fca5b7b4ba0] received 2024-03-29T01:09:00.275479805Z [2024-03-29 01:09:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[931e4053-1d0c-49b6-97a0-83f7a35ee562] received 2024-03-29T01:09:00.284836124Z [2024-03-29 01:09:00,284: INFO/ForkPoolWorker-1] [931e4053-1d0c-49b6-97a0-83f7a35ee562] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:09:00.287046228Z [2024-03-29 01:09:00,286: INFO/ForkPoolWorker-15] [73d8364b-acc4-4712-864b-66014b7450df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:09:00.288546038Z [2024-03-29 01:09:00,288: INFO/ForkPoolWorker-16] [cb638af4-309f-4467-9b65-9fca5b7b4ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:09:00.589501539Z [2024-03-29 01:09:00,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:09:00.589657953Z [2024-03-29 01:09:00,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:09:00.621986392Z [2024-03-29 01:09:00,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:09:00.844089882Z [2024-03-29 01:09:00,843: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:09:00.849137500Z [2024-03-29 01:09:00,847: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:09:00.869848178Z [2024-03-29 01:09:00,869: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:09:00.871268508Z [2024-03-29 01:09:00,871: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:09:00.871332088Z [2024-03-29 01:09:00,871: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:09:00.871386953Z [2024-03-29 01:09:00,871: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:09:00.871554518Z [2024-03-29 01:09:00,871: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:09:00.960424475Z [2024-03-29 01:09:00,960: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:09:01.522955436Z [2024-03-29 01:09:01,522: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[931e4053-1d0c-49b6-97a0-83f7a35ee562] succeeded in 1.2454288489998362s: None 2024-03-29T01:09:01.747185773Z [2024-03-29 01:09:01,746: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:09:01.751176147Z [2024-03-29 01:09:01,750: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:09:01.772592937Z [2024-03-29 01:09:01,772: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:09:01.774129967Z [2024-03-29 01:09:01,773: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:09:01.774330455Z [2024-03-29 01:09:01,774: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:09:01.774609495Z [2024-03-29 01:09:01,774: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:09:01.774784976Z [2024-03-29 01:09:01,774: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:09:01.775221629Z [2024-03-29 01:09:01,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:09:01.775393393Z [2024-03-29 01:09:01,775: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:09:01.801982254Z [2024-03-29 01:09:01,801: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:09:01.805747935Z [2024-03-29 01:09:01,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:09:01.828174836Z [2024-03-29 01:09:01,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:09:01.830013492Z [2024-03-29 01:09:01,829: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:09:01.830078259Z [2024-03-29 01:09:01,829: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:09:01.830278490Z [2024-03-29 01:09:01,830: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:09:01.830896011Z [2024-03-29 01:09:01,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:09:01.831391624Z [2024-03-29 01:09:01,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:09:01.831504430Z [2024-03-29 01:09:01,831: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:09:01.857246484Z [2024-03-29 01:09:01,856: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:09:01.926125306Z [2024-03-29 01:09:01,925: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:09:03.546153275Z [2024-03-29 01:09:03,545: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73d8364b-acc4-4712-864b-66014b7450df] succeeded in 3.271216656999968s: None 2024-03-29T01:09:04.173580826Z [2024-03-29 01:09:04,173: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb638af4-309f-4467-9b65-9fca5b7b4ba0] succeeded in 3.897871106999446s: None 2024-03-29T01:10:00.514351692Z [2024-03-29 01:10:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e8de585-bfc8-484a-8575-a67427cc1515] received 2024-03-29T01:10:00.517168566Z [2024-03-29 01:10:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9bb13f3-fc5e-49c9-b082-40f9d859f733] received 2024-03-29T01:10:00.519655063Z [2024-03-29 01:10:00,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ed95440-11f8-483b-ae11-13f071cdbb39] received 2024-03-29T01:10:00.521887895Z [2024-03-29 01:10:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8530f0f-333a-43bc-b170-20644412745f] received 2024-03-29T01:10:00.527372358Z [2024-03-29 01:10:00,527: INFO/ForkPoolWorker-15] [8e8de585-bfc8-484a-8575-a67427cc1515] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:10:00.530247012Z [2024-03-29 01:10:00,529: INFO/ForkPoolWorker-1] [7ed95440-11f8-483b-ae11-13f071cdbb39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:10:00.530392357Z [2024-03-29 01:10:00,530: INFO/ForkPoolWorker-2] [e8530f0f-333a-43bc-b170-20644412745f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:10:00.531883981Z [2024-03-29 01:10:00,531: INFO/ForkPoolWorker-16] [b9bb13f3-fc5e-49c9-b082-40f9d859f733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:00.536262503Z [2024-03-29 01:10:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e49232ab-cb03-4c85-91e0-c7d864ee57e8] received 2024-03-29T01:10:00.561368381Z [2024-03-29 01:10:00,560: INFO/ForkPoolWorker-3] [e49232ab-cb03-4c85-91e0-c7d864ee57e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:10:00.927063218Z [2024-03-29 01:10:00,923: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:10:00.944091352Z [2024-03-29 01:10:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:10:01.083838600Z [2024-03-29 01:10:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:10:01.183839628Z [2024-03-29 01:10:01,179: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:10:01.189376243Z [2024-03-29 01:10:01,185: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:10:01.204312114Z [2024-03-29 01:10:01,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:01.214294614Z [2024-03-29 01:10:01,214: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:01.268855140Z [2024-03-29 01:10:01,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:10:01.276150536Z [2024-03-29 01:10:01,275: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:10:01.277140059Z [2024-03-29 01:10:01,276: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:10:01.277408449Z [2024-03-29 01:10:01,277: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:10:01.281434042Z [2024-03-29 01:10:01,281: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:10:01.401658358Z [2024-03-29 01:10:01,389: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:10:01.539986409Z [2024-03-29 01:10:01,539: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:01.987161553Z [2024-03-29 01:10:01,986: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e8530f0f-333a-43bc-b170-20644412745f] succeeded in 1.4636302569997497s: None 2024-03-29T01:10:02.837731155Z [2024-03-29 01:10:02,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e8de585-bfc8-484a-8575-a67427cc1515] succeeded in 2.3211562360002063s: None 2024-03-29T01:10:03.152258112Z [2024-03-29 01:10:03,151: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:10:03.157692845Z [2024-03-29 01:10:03,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:03.188169728Z [2024-03-29 01:10:03,187: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:10:03.189665227Z [2024-03-29 01:10:03,189: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:03.189792902Z [2024-03-29 01:10:03,189: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:03.190253865Z [2024-03-29 01:10:03,190: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:03.190757523Z [2024-03-29 01:10:03,190: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:10:03.191183960Z [2024-03-29 01:10:03,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:10:03.191772419Z [2024-03-29 01:10:03,191: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:03.197762093Z [2024-03-29 01:10:03,197: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:10:03.202435868Z [2024-03-29 01:10:03,201: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:03.228536391Z [2024-03-29 01:10:03,228: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:10:03.229874778Z [2024-03-29 01:10:03,229: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:03.229887796Z [2024-03-29 01:10:03,229: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:03.229990238Z [2024-03-29 01:10:03,229: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:03.230069989Z [2024-03-29 01:10:03,229: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:10:03.230275934Z [2024-03-29 01:10:03,230: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:10:03.230316400Z [2024-03-29 01:10:03,230: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:03.244485194Z [2024-03-29 01:10:03,244: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T01:10:03.248794412Z [2024-03-29 01:10:03,248: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:03.271733270Z [2024-03-29 01:10:03,271: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:10:03.273357506Z [2024-03-29 01:10:03,273: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:03.273564779Z [2024-03-29 01:10:03,273: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:03.274105139Z [2024-03-29 01:10:03,273: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:03.274253373Z [2024-03-29 01:10:03,274: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T01:10:03.275015643Z [2024-03-29 01:10:03,274: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:10:03.275177790Z [2024-03-29 01:10:03,275: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:03.300312852Z [2024-03-29 01:10:03,299: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:03.315164765Z [2024-03-29 01:10:03,314: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:03.397954486Z [2024-03-29 01:10:03,397: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:03.947316908Z [2024-03-29 01:10:03,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e86a3051-d649-4c2f-8cfc-cb43c518b33e] received 2024-03-29T01:10:03.963088375Z [2024-03-29 01:10:03,962: INFO/ForkPoolWorker-15] [e86a3051-d649-4c2f-8cfc-cb43c518b33e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:04.004548176Z [2024-03-29 01:10:04,004: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9bb13f3-fc5e-49c9-b082-40f9d859f733] succeeded in 3.4852843329999814s: None 2024-03-29T01:10:04.382251696Z [2024-03-29 01:10:04,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:10:04.794573762Z [2024-03-29 01:10:04,794: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ed95440-11f8-483b-ae11-13f071cdbb39] succeeded in 4.273283843000172s: None 2024-03-29T01:10:05.407221221Z [2024-03-29 01:10:05,406: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e49232ab-cb03-4c85-91e0-c7d864ee57e8] succeeded in 4.867704180000146s: None 2024-03-29T01:10:05.904958215Z [2024-03-29 01:10:05,903: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:10:05.908782362Z [2024-03-29 01:10:05,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:05.949395353Z [2024-03-29 01:10:05,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:10:05.949433448Z [2024-03-29 01:10:05,944: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:05.949438494Z [2024-03-29 01:10:05,944: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:05.949444377Z [2024-03-29 01:10:05,944: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:05.949449161Z [2024-03-29 01:10:05,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:10:05.949452553Z [2024-03-29 01:10:05,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:10:05.949456358Z [2024-03-29 01:10:05,945: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:06.067371223Z [2024-03-29 01:10:06,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:06.823066440Z [2024-03-29 01:10:06,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e86a3051-d649-4c2f-8cfc-cb43c518b33e] succeeded in 2.871943198999361s: None 2024-03-29T01:10:07.829363923Z [2024-03-29 01:10:07,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae6691a-7383-4573-9f37-7877db20f1ad] received 2024-03-29T01:10:07.846111797Z [2024-03-29 01:10:07,845: INFO/ForkPoolWorker-15] [2ae6691a-7383-4573-9f37-7877db20f1ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:10:08.213571661Z [2024-03-29 01:10:08,209: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:10:09.465143683Z [2024-03-29 01:10:09,464: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:10:09.468594083Z [2024-03-29 01:10:09,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:09.487124236Z [2024-03-29 01:10:09,486: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:10:09.488448807Z [2024-03-29 01:10:09,488: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:09.488565136Z [2024-03-29 01:10:09,488: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:09.488731181Z [2024-03-29 01:10:09,488: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:09.488830829Z [2024-03-29 01:10:09,488: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:10:09.489119528Z [2024-03-29 01:10:09,488: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:10:09.489229017Z [2024-03-29 01:10:09,489: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:09.580218047Z [2024-03-29 01:10:09,579: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:10.087635628Z [2024-03-29 01:10:10,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ae6691a-7383-4573-9f37-7877db20f1ad] succeeded in 2.2557196329998987s: None 2024-03-29T01:10:10.140695048Z [2024-03-29 01:10:10,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc2dabb0-ebcd-4369-ba33-9d1f8bfd3406] received 2024-03-29T01:10:10.154309269Z [2024-03-29 01:10:10,154: INFO/ForkPoolWorker-15] [fc2dabb0-ebcd-4369-ba33-9d1f8bfd3406] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:10.457998353Z [2024-03-29 01:10:10,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:10:11.683429034Z [2024-03-29 01:10:11,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:10:11.689523570Z [2024-03-29 01:10:11,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:10:11.713143984Z [2024-03-29 01:10:11,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:10:11.714608277Z [2024-03-29 01:10:11,714: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:10:11.714783996Z [2024-03-29 01:10:11,714: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:10:11.715055217Z [2024-03-29 01:10:11,714: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:10:11.715178049Z [2024-03-29 01:10:11,715: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:10:11.715502242Z [2024-03-29 01:10:11,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:10:11.715742428Z [2024-03-29 01:10:11,715: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:10:11.821274520Z [2024-03-29 01:10:11,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:10:12.409856693Z [2024-03-29 01:10:12,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc2dabb0-ebcd-4369-ba33-9d1f8bfd3406] succeeded in 2.266412656000284s: None 2024-03-29T01:11:00.691321047Z [2024-03-29 01:11:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45f45246-c14b-4371-8ad3-7d3d2c9850c7] received 2024-03-29T01:11:00.696824579Z [2024-03-29 01:11:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ad2bda6-a8f0-4ca0-b492-d5c57a9ccf14] received 2024-03-29T01:11:00.701074773Z [2024-03-29 01:11:00,700: INFO/ForkPoolWorker-15] [45f45246-c14b-4371-8ad3-7d3d2c9850c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:11:00.701764547Z [2024-03-29 01:11:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a68083f-a1b8-4722-b130-53de1c842c13] received 2024-03-29T01:11:00.722018765Z [2024-03-29 01:11:00,721: INFO/ForkPoolWorker-16] [0ad2bda6-a8f0-4ca0-b492-d5c57a9ccf14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:11:00.722712110Z [2024-03-29 01:11:00,722: INFO/ForkPoolWorker-1] [1a68083f-a1b8-4722-b130-53de1c842c13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:11:01.051170445Z [2024-03-29 01:11:01,047: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:11:01.123896522Z [2024-03-29 01:11:01,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:11:01.124069284Z [2024-03-29 01:11:01,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:11:01.294316557Z [2024-03-29 01:11:01,293: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:11:01.298435105Z [2024-03-29 01:11:01,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:11:01.318964466Z [2024-03-29 01:11:01,318: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:11:01.320098363Z [2024-03-29 01:11:01,319: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:11:01.320619532Z [2024-03-29 01:11:01,320: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:11:01.320756184Z [2024-03-29 01:11:01,320: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:11:01.321066572Z [2024-03-29 01:11:01,320: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:11:01.437925442Z [2024-03-29 01:11:01,437: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:11:02.183522817Z [2024-03-29 01:11:02,183: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ad2bda6-a8f0-4ca0-b492-d5c57a9ccf14] succeeded in 1.4757806539992089s: None 2024-03-29T01:11:02.447585443Z [2024-03-29 01:11:02,447: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:11:02.451311570Z [2024-03-29 01:11:02,450: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:11:02.484432385Z [2024-03-29 01:11:02,484: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:11:02.492105064Z [2024-03-29 01:11:02,491: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:11:02.495029655Z [2024-03-29 01:11:02,491: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:11:02.495220142Z [2024-03-29 01:11:02,494: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:11:02.495299231Z [2024-03-29 01:11:02,495: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:11:02.495723441Z [2024-03-29 01:11:02,495: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:11:02.495737745Z [2024-03-29 01:11:02,495: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:11:02.509358210Z [2024-03-29 01:11:02,508: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:11:02.513010961Z [2024-03-29 01:11:02,512: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:11:02.536705435Z [2024-03-29 01:11:02,536: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:11:02.538117478Z [2024-03-29 01:11:02,537: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:11:02.538127507Z [2024-03-29 01:11:02,538: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:11:02.538375515Z [2024-03-29 01:11:02,538: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:11:02.538385746Z [2024-03-29 01:11:02,538: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:11:02.539723601Z [2024-03-29 01:11:02,539: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:11:02.539737384Z [2024-03-29 01:11:02,539: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:11:02.592784631Z [2024-03-29 01:11:02,592: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:11:02.630302838Z [2024-03-29 01:11:02,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:11:04.802333982Z [2024-03-29 01:11:04,799: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45f45246-c14b-4371-8ad3-7d3d2c9850c7] succeeded in 4.105715288999818s: None 2024-03-29T01:11:05.551660866Z [2024-03-29 01:11:05,551: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a68083f-a1b8-4722-b130-53de1c842c13] succeeded in 4.841158954999628s: None 2024-03-29T01:12:00.965794295Z [2024-03-29 01:12:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7da3727f-5b05-497b-9513-367e7449547f] received 2024-03-29T01:12:00.974009793Z [2024-03-29 01:12:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df3f62d6-3dff-4589-8c36-341f6298394b] received 2024-03-29T01:12:00.977602223Z [2024-03-29 01:12:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[732cf6b5-e46c-458b-ac52-7aad3940e3d2] received 2024-03-29T01:12:00.992886600Z [2024-03-29 01:12:00,992: INFO/ForkPoolWorker-1] [732cf6b5-e46c-458b-ac52-7aad3940e3d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:12:00.993458607Z [2024-03-29 01:12:00,993: INFO/ForkPoolWorker-16] [df3f62d6-3dff-4589-8c36-341f6298394b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:12:00.995442870Z [2024-03-29 01:12:00,995: INFO/ForkPoolWorker-15] [7da3727f-5b05-497b-9513-367e7449547f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:12:01.003080614Z [2024-03-29 01:12:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c527d98d-1975-4096-b250-c99cc493d39e] received 2024-03-29T01:12:01.025446842Z [2024-03-29 01:12:01,024: INFO/ForkPoolWorker-2] [c527d98d-1975-4096-b250-c99cc493d39e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:12:01.352553592Z [2024-03-29 01:12:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:12:01.396974888Z [2024-03-29 01:12:01,392: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:12:01.438939996Z [2024-03-29 01:12:01,435: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:12:01.582715636Z [2024-03-29 01:12:01,579: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:12:01.608247580Z [2024-03-29 01:12:01,607: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:12:01.612901704Z [2024-03-29 01:12:01,612: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:12:01.647955406Z [2024-03-29 01:12:01,647: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:12:01.650546922Z [2024-03-29 01:12:01,650: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:12:01.651122874Z [2024-03-29 01:12:01,650: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:12:01.651259712Z [2024-03-29 01:12:01,651: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:12:01.653084645Z [2024-03-29 01:12:01,652: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:12:01.664384522Z [2024-03-29 01:12:01,664: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:12:01.776081506Z [2024-03-29 01:12:01,775: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:12:02.480912265Z [2024-03-29 01:12:02,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7da3727f-5b05-497b-9513-367e7449547f] succeeded in 1.5115268669997022s: None 2024-03-29T01:12:02.609365381Z [2024-03-29 01:12:02,608: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df3f62d6-3dff-4589-8c36-341f6298394b] succeeded in 1.6287365230000432s: None 2024-03-29T01:12:02.851657040Z [2024-03-29 01:12:02,851: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:12:02.855694919Z [2024-03-29 01:12:02,855: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:12:02.878019286Z [2024-03-29 01:12:02,877: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:12:02.879629022Z [2024-03-29 01:12:02,879: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:12:02.879648293Z [2024-03-29 01:12:02,879: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:12:02.879939013Z [2024-03-29 01:12:02,879: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:12:02.879951025Z [2024-03-29 01:12:02,879: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:12:02.880327507Z [2024-03-29 01:12:02,880: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:12:02.880346583Z [2024-03-29 01:12:02,880: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:12:02.965979809Z [2024-03-29 01:12:02,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:12:03.185570812Z [2024-03-29 01:12:03,185: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:12:03.189352244Z [2024-03-29 01:12:03,188: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:12:03.224013901Z [2024-03-29 01:12:03,223: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:12:03.225653234Z [2024-03-29 01:12:03,225: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:12:03.225685441Z [2024-03-29 01:12:03,225: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:12:03.225812708Z [2024-03-29 01:12:03,225: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:12:03.225822001Z [2024-03-29 01:12:03,225: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:12:03.226078327Z [2024-03-29 01:12:03,225: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:12:03.226084949Z [2024-03-29 01:12:03,226: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:12:03.328451908Z [2024-03-29 01:12:03,328: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:12:05.021594474Z [2024-03-29 01:12:05,019: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c527d98d-1975-4096-b250-c99cc493d39e] succeeded in 4.007848416999877s: None 2024-03-29T01:12:05.239064424Z [2024-03-29 01:12:05,238: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[732cf6b5-e46c-458b-ac52-7aad3940e3d2] succeeded in 4.2585718660002385s: None 2024-03-29T01:13:00.479582838Z [2024-03-29 01:13:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ccefebf-2a55-494f-b715-230b7fab371a] received 2024-03-29T01:13:00.488778723Z [2024-03-29 01:13:00,488: INFO/ForkPoolWorker-15] [2ccefebf-2a55-494f-b715-230b7fab371a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:13:00.488942288Z [2024-03-29 01:13:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be9ddcd0-66d3-4299-924f-9c202d5ce7ea] received 2024-03-29T01:13:00.491009453Z [2024-03-29 01:13:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a39facb-1b7f-40ca-90d7-89afecad9cd5] received 2024-03-29T01:13:00.496097800Z [2024-03-29 01:13:00,495: INFO/ForkPoolWorker-16] [be9ddcd0-66d3-4299-924f-9c202d5ce7ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:13:00.505421610Z [2024-03-29 01:13:00,505: INFO/ForkPoolWorker-1] [5a39facb-1b7f-40ca-90d7-89afecad9cd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:13:00.765458573Z [2024-03-29 01:13:00,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:13:00.805846480Z [2024-03-29 01:13:00,801: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:13:00.876312840Z [2024-03-29 01:13:00,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:13:00.927294884Z [2024-03-29 01:13:00,926: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:13:00.931826172Z [2024-03-29 01:13:00,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:13:00.954986669Z [2024-03-29 01:13:00,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:13:00.955999545Z [2024-03-29 01:13:00,955: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:13:00.956147809Z [2024-03-29 01:13:00,955: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:13:00.956274690Z [2024-03-29 01:13:00,956: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:13:00.956491850Z [2024-03-29 01:13:00,956: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:13:01.041108320Z [2024-03-29 01:13:01,040: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:13:01.564135191Z [2024-03-29 01:13:01,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ccefebf-2a55-494f-b715-230b7fab371a] succeeded in 1.0825639909999154s: None 2024-03-29T01:13:02.016057928Z [2024-03-29 01:13:02,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:13:02.019618700Z [2024-03-29 01:13:02,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:13:02.040198992Z [2024-03-29 01:13:02,039: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:13:02.041478699Z [2024-03-29 01:13:02,041: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:13:02.041664890Z [2024-03-29 01:13:02,041: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:13:02.041908099Z [2024-03-29 01:13:02,041: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:13:02.042020948Z [2024-03-29 01:13:02,041: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:13:02.042337661Z [2024-03-29 01:13:02,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:13:02.042518278Z [2024-03-29 01:13:02,042: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:13:02.132094980Z [2024-03-29 01:13:02,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:13:02.150453821Z [2024-03-29 01:13:02,150: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:13:02.153812011Z [2024-03-29 01:13:02,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:13:02.175009488Z [2024-03-29 01:13:02,174: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:13:02.179797818Z [2024-03-29 01:13:02,179: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:13:02.179941284Z [2024-03-29 01:13:02,179: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:13:02.180181343Z [2024-03-29 01:13:02,179: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:13:02.180311498Z [2024-03-29 01:13:02,180: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:13:02.180691026Z [2024-03-29 01:13:02,180: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:13:02.180857563Z [2024-03-29 01:13:02,180: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:13:02.272747844Z [2024-03-29 01:13:02,272: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:13:05.003884941Z [2024-03-29 01:13:04,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be9ddcd0-66d3-4299-924f-9c202d5ce7ea] succeeded in 4.509760188000655s: None 2024-03-29T01:13:05.017372995Z [2024-03-29 01:13:05,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a39facb-1b7f-40ca-90d7-89afecad9cd5] succeeded in 4.522236148999582s: None 2024-03-29T01:13:25.752818755Z [2024-03-29 01:13:25,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d257ce-08ee-417c-981c-82174b483158] received 2024-03-29T01:13:25.762567894Z [2024-03-29 01:13:25,762: INFO/ForkPoolWorker-15] [82d257ce-08ee-417c-981c-82174b483158] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:13:26.077299510Z [2024-03-29 01:13:26,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:13:26.261533274Z [2024-03-29 01:13:26,261: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:13:26.265207951Z [2024-03-29 01:13:26,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:13:26.284565555Z [2024-03-29 01:13:26,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:13:26.285539471Z [2024-03-29 01:13:26,285: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:13:26.285549699Z [2024-03-29 01:13:26,285: INFO/ForkPoolWorker-15] Read SDNC 0c55f103-1888-4383-bae8-2e05f81656c8 (epa_03) 2024-03-29T01:13:26.285694131Z [2024-03-29 01:13:26,285: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '0c55f103-1888-4383-bae8-2e05f81656c8', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-29T01:13:26.285703852Z [2024-03-29 01:13:26,285: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:13:26.285948832Z [2024-03-29 01:13:26,285: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:13:26.292148290Z [2024-03-29 01:13:26,291: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 2024-03-29T01:13:26.391516769Z [2024-03-29 01:13:26,391: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:13:27.023843849Z [2024-03-29 01:13:27,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82d257ce-08ee-417c-981c-82174b483158] succeeded in 1.2691515950000394s: None 2024-03-29T01:14:00.337201503Z [2024-03-29 01:14:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0185a1f3-91a7-40ab-b455-bd56d08b98fd] received 2024-03-29T01:14:00.338620186Z [2024-03-29 01:14:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c716b496-46e6-427e-865d-f9fe3e1763cf] received 2024-03-29T01:14:00.339970603Z [2024-03-29 01:14:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b43c1a9-d395-405e-8e95-5df86e5182cd] received 2024-03-29T01:14:00.341292163Z [2024-03-29 01:14:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a848ffb0-9d82-43c6-9e5f-38250f180f0d] received 2024-03-29T01:14:00.342483164Z [2024-03-29 01:14:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[369a7779-e3d1-463b-a653-1dfb427c7548] received 2024-03-29T01:14:00.353059856Z [2024-03-29 01:14:00,352: INFO/ForkPoolWorker-16] [c716b496-46e6-427e-865d-f9fe3e1763cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:14:00.353800853Z [2024-03-29 01:14:00,353: INFO/ForkPoolWorker-2] [a848ffb0-9d82-43c6-9e5f-38250f180f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:14:00.355157809Z [2024-03-29 01:14:00,354: INFO/ForkPoolWorker-15] [0185a1f3-91a7-40ab-b455-bd56d08b98fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:14:00.358998950Z [2024-03-29 01:14:00,358: INFO/ForkPoolWorker-1] [6b43c1a9-d395-405e-8e95-5df86e5182cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:14:00.366832200Z [2024-03-29 01:14:00,366: INFO/ForkPoolWorker-3] [369a7779-e3d1-463b-a653-1dfb427c7548] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:14:00.652142685Z [2024-03-29 01:14:00,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:14:00.734162994Z [2024-03-29 01:14:00,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:14:00.761842331Z [2024-03-29 01:14:00,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:14:00.817004764Z [2024-03-29 01:14:00,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:14:00.989907542Z [2024-03-29 01:14:00,986: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:14:01.052927702Z [2024-03-29 01:14:01,052: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:14:01.057129586Z [2024-03-29 01:14:01,056: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:14:01.086138370Z [2024-03-29 01:14:01,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:14:01.089456118Z [2024-03-29 01:14:01,089: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:14:01.089569772Z [2024-03-29 01:14:01,089: INFO/ForkPoolWorker-15] Read SDNC 0c55f103-1888-4383-bae8-2e05f81656c8 (epa_03) 2024-03-29T01:14:01.089836134Z [2024-03-29 01:14:01,089: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '0c55f103-1888-4383-bae8-2e05f81656c8', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-29T01:14:01.089954197Z [2024-03-29 01:14:01,089: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:14:01.090393090Z [2024-03-29 01:14:01,090: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:14:01.110776550Z [2024-03-29 01:14:01,110: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 2024-03-29T01:14:01.150196317Z [2024-03-29 01:14:01,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:14:01.218165526Z [2024-03-29 01:14:01,217: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:14:01.285485486Z [2024-03-29 01:14:01,285: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T01:14:01.289518769Z [2024-03-29 01:14:01,289: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:14:01.329649632Z [2024-03-29 01:14:01,329: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:14:01.333844357Z [2024-03-29 01:14:01,333: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:14:01.333894507Z [2024-03-29 01:14:01,333: INFO/ForkPoolWorker-3] Read SDNC 0c55f103-1888-4383-bae8-2e05f81656c8 (epa_03) 2024-03-29T01:14:01.334114234Z [2024-03-29 01:14:01,333: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '0c55f103-1888-4383-bae8-2e05f81656c8', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-29T01:14:01.334234155Z [2024-03-29 01:14:01,334: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T01:14:01.334549152Z [2024-03-29 01:14:01,334: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:14:01.341993285Z [2024-03-29 01:14:01,341: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 2024-03-29T01:14:01.472893211Z [2024-03-29 01:14:01,472: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:14:02.084361702Z [2024-03-29 01:14:02,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c716b496-46e6-427e-865d-f9fe3e1763cf] succeeded in 1.7370688529999825s: None 2024-03-29T01:14:02.175696326Z [2024-03-29 01:14:02,175: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0185a1f3-91a7-40ab-b455-bd56d08b98fd] succeeded in 1.8339550230002715s: None 2024-03-29T01:14:02.304474386Z [2024-03-29 01:14:02,304: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:14:02.309700388Z [2024-03-29 01:14:02,309: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:14:02.342314740Z [2024-03-29 01:14:02,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:14:02.344410124Z [2024-03-29 01:14:02,344: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:14:02.344858927Z [2024-03-29 01:14:02,344: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:14:02.345269503Z [2024-03-29 01:14:02,344: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:14:02.345598700Z [2024-03-29 01:14:02,345: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:14:02.346181964Z [2024-03-29 01:14:02,345: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:14:02.347056087Z [2024-03-29 01:14:02,346: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:14:02.363781730Z [2024-03-29 01:14:02,363: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[369a7779-e3d1-463b-a653-1dfb427c7548] succeeded in 2.014088048999838s: None 2024-03-29T01:14:02.473687263Z [2024-03-29 01:14:02,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:14:02.657312690Z [2024-03-29 01:14:02,656: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:14:02.660936407Z [2024-03-29 01:14:02,660: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:14:02.677626932Z [2024-03-29 01:14:02,677: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:14:02.679386500Z [2024-03-29 01:14:02,679: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:14:02.679506396Z [2024-03-29 01:14:02,679: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:14:02.679646857Z [2024-03-29 01:14:02,679: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:14:02.679720807Z [2024-03-29 01:14:02,679: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:14:02.680015903Z [2024-03-29 01:14:02,679: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:14:02.680118163Z [2024-03-29 01:14:02,680: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:14:02.766527773Z [2024-03-29 01:14:02,766: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:14:04.322596231Z [2024-03-29 01:14:04,322: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a848ffb0-9d82-43c6-9e5f-38250f180f0d] succeeded in 3.977930256000036s: None 2024-03-29T01:14:04.803355759Z [2024-03-29 01:14:04,802: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b43c1a9-d395-405e-8e95-5df86e5182cd] succeeded in 4.459866940000211s: None 2024-03-29T01:15:00.736718939Z [2024-03-29 01:15:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5db1701d-c794-4eba-a2df-20a502089cd2] received 2024-03-29T01:15:00.743545448Z [2024-03-29 01:15:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33d65a2f-b884-4f44-9912-583b9e3d657c] received 2024-03-29T01:15:00.745395930Z [2024-03-29 01:15:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f4f1e53-266f-4365-9f73-590855533e70] received 2024-03-29T01:15:00.749626377Z [2024-03-29 01:15:00,749: INFO/ForkPoolWorker-15] [5db1701d-c794-4eba-a2df-20a502089cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:00.754453872Z [2024-03-29 01:15:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a2329eb-7baa-4fcb-9c6e-b25a85af19c5] received 2024-03-29T01:15:00.755965927Z [2024-03-29 01:15:00,755: INFO/ForkPoolWorker-1] [9f4f1e53-266f-4365-9f73-590855533e70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:15:00.762498876Z [2024-03-29 01:15:00,762: INFO/ForkPoolWorker-16] [33d65a2f-b884-4f44-9912-583b9e3d657c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:00.769527424Z [2024-03-29 01:15:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdfe6126-3495-481a-93b8-9a1ea8e18d5f] received 2024-03-29T01:15:00.769668020Z [2024-03-29 01:15:00,769: INFO/ForkPoolWorker-2] [2a2329eb-7baa-4fcb-9c6e-b25a85af19c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:00.776804713Z [2024-03-29 01:15:00,776: INFO/ForkPoolWorker-3] [cdfe6126-3495-481a-93b8-9a1ea8e18d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:15:01.141030565Z [2024-03-29 01:15:01,137: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:01.239153130Z [2024-03-29 01:15:01,232: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:15:01.259924742Z [2024-03-29 01:15:01,255: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:15:01.311203210Z [2024-03-29 01:15:01,310: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:15:01.315681796Z [2024-03-29 01:15:01,315: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:01.343302069Z [2024-03-29 01:15:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:01.355899958Z [2024-03-29 01:15:01,355: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:15:01.357675096Z [2024-03-29 01:15:01,357: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:15:01.357776005Z [2024-03-29 01:15:01,357: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:15:01.357861684Z [2024-03-29 01:15:01,357: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:15:01.358105685Z [2024-03-29 01:15:01,357: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:15:01.476857676Z [2024-03-29 01:15:01,476: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:01.487608814Z [2024-03-29 01:15:01,481: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:15:01.573923510Z [2024-03-29 01:15:01,573: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:15:01.578623277Z [2024-03-29 01:15:01,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:01.609507249Z [2024-03-29 01:15:01,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:15:01.611337055Z [2024-03-29 01:15:01,611: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:15:01.611504294Z [2024-03-29 01:15:01,611: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:15:01.611619805Z [2024-03-29 01:15:01,611: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:15:01.612429405Z [2024-03-29 01:15:01,612: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:15:01.622822613Z [2024-03-29 01:15:01,622: WARNING/ForkPoolWorker-16] Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:01.623116558Z [2024-03-29 01:15:01,622: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:01.624332112Z [2024-03-29 01:15:01,624: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:15:01.627504185Z [2024-03-29 01:15:01,627: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:01.673364005Z [2024-03-29 01:15:01,673: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:15:01.679942637Z [2024-03-29 01:15:01,679: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:15:01.680049042Z [2024-03-29 01:15:01,679: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:15:01.680142396Z [2024-03-29 01:15:01,680: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:15:01.680472804Z [2024-03-29 01:15:01,680: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:15:01.685133316Z [2024-03-29 01:15:01,683: ERROR/ForkPoolWorker-16] [33d65a2f-b884-4f44-9912-583b9e3d657c] Failed to execute task Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' could not be found; either it does not exist or it failed to parse.. 2024-03-29T01:15:01.685154550Z Traceback (most recent call last): 2024-03-29T01:15:01.685160785Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T01:15:01.685166150Z args.func(args) 2024-03-29T01:15:01.685171321Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T01:15:01.685176541Z return func(*args, **kwargs) 2024-03-29T01:15:01.685181529Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T01:15:01.685186216Z return f(*args, **kwargs) 2024-03-29T01:15:01.685190671Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T01:15:01.685195111Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T01:15:01.685199465Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T01:15:01.685203843Z raise AirflowException( 2024-03-29T01:15:01.685209291Z airflow.exceptions.AirflowException: Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' could not be found; either it does not exist or it failed to parse. 2024-03-29T01:15:01.718412956Z [2024-03-29 01:15:01,717: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33d65a2f-b884-4f44-9912-583b9e3d657c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 33d65a2f-b884-4f44-9912-583b9e3d657c') 2024-03-29T01:15:01.718474237Z Traceback (most recent call last): 2024-03-29T01:15:01.718483454Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T01:15:01.718488317Z R = retval = fun(*args, **kwargs) 2024-03-29T01:15:01.718492779Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T01:15:01.718497867Z return self.run(*args, **kwargs) 2024-03-29T01:15:01.718502867Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T01:15:01.718507816Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T01:15:01.718512168Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T01:15:01.718517338Z raise AirflowException(msg) 2024-03-29T01:15:01.718522986Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 33d65a2f-b884-4f44-9912-583b9e3d657c 2024-03-29T01:15:02.348161724Z [2024-03-29 01:15:02,347: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2a2329eb-7baa-4fcb-9c6e-b25a85af19c5] succeeded in 1.583199937000245s: None 2024-03-29T01:15:02.930617592Z [2024-03-29 01:15:02,930: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T01:15:02.934966175Z [2024-03-29 01:15:02,934: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:02.958887659Z [2024-03-29 01:15:02,958: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:15:02.960263266Z [2024-03-29 01:15:02,960: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:02.960396688Z [2024-03-29 01:15:02,960: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:02.960708216Z [2024-03-29 01:15:02,960: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:02.960851234Z [2024-03-29 01:15:02,960: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T01:15:02.961386392Z [2024-03-29 01:15:02,961: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:15:02.961501589Z [2024-03-29 01:15:02,961: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:03.068245095Z [2024-03-29 01:15:03,067: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:03.086499787Z [2024-03-29 01:15:03,085: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:15:03.106061138Z [2024-03-29 01:15:03,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:03.141068094Z [2024-03-29 01:15:03,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:15:03.147158304Z [2024-03-29 01:15:03,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:03.169662774Z [2024-03-29 01:15:03,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:15:03.171194867Z [2024-03-29 01:15:03,170: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:03.171210765Z [2024-03-29 01:15:03,171: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:03.171331271Z [2024-03-29 01:15:03,171: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:03.171341466Z [2024-03-29 01:15:03,171: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:15:03.171814661Z [2024-03-29 01:15:03,171: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:15:03.171879750Z [2024-03-29 01:15:03,171: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:03.194499236Z [2024-03-29 01:15:03,194: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:15:03.196336682Z [2024-03-29 01:15:03,196: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:03.196668605Z [2024-03-29 01:15:03,196: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:03.196818752Z [2024-03-29 01:15:03,196: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:03.196892873Z [2024-03-29 01:15:03,196: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:15:03.197199151Z [2024-03-29 01:15:03,197: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:15:03.197241721Z [2024-03-29 01:15:03,197: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:03.291371493Z [2024-03-29 01:15:03,291: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:03.300223077Z [2024-03-29 01:15:03,299: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:04.008793619Z [2024-03-29 01:15:04,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5db1701d-c794-4eba-a2df-20a502089cd2] succeeded in 3.268562751999525s: None 2024-03-29T01:15:04.433837255Z [2024-03-29 01:15:04,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d2ce4e5-c0bb-4e9e-a2a7-105abaa388a7] received 2024-03-29T01:15:04.442083058Z [2024-03-29 01:15:04,441: INFO/ForkPoolWorker-15] [4d2ce4e5-c0bb-4e9e-a2a7-105abaa388a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:04.759487720Z [2024-03-29 01:15:04,755: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:15:04.869881024Z [2024-03-29 01:15:04,869: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f4f1e53-266f-4365-9f73-590855533e70] succeeded in 4.1194473579998885s: None 2024-03-29T01:15:05.310221505Z [2024-03-29 01:15:05,309: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cdfe6126-3495-481a-93b8-9a1ea8e18d5f] succeeded in 4.5389015869996s: None 2024-03-29T01:15:06.322996209Z [2024-03-29 01:15:06,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:15:06.326833002Z [2024-03-29 01:15:06,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:06.355645591Z [2024-03-29 01:15:06,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:15:06.357045543Z [2024-03-29 01:15:06,356: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:06.357095938Z [2024-03-29 01:15:06,356: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:06.357183237Z [2024-03-29 01:15:06,357: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:06.357232102Z [2024-03-29 01:15:06,357: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:15:06.357436141Z [2024-03-29 01:15:06,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:15:06.357493164Z [2024-03-29 01:15:06,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:06.470594202Z [2024-03-29 01:15:06,470: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:07.119099402Z [2024-03-29 01:15:07,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d2ce4e5-c0bb-4e9e-a2a7-105abaa388a7] succeeded in 2.6836125059999176s: None 2024-03-29T01:15:07.222456430Z [2024-03-29 01:15:07,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[731681fd-8587-48b4-a824-ebff6e04e6fb] received 2024-03-29T01:15:07.250615659Z [2024-03-29 01:15:07,248: INFO/ForkPoolWorker-15] [731681fd-8587-48b4-a824-ebff6e04e6fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:15:07.681829328Z [2024-03-29 01:15:07,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:15:09.021294721Z [2024-03-29 01:15:09,020: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:15:09.024736259Z [2024-03-29 01:15:09,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:09.043522091Z [2024-03-29 01:15:09,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:15:09.044714097Z [2024-03-29 01:15:09,044: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:09.044789980Z [2024-03-29 01:15:09,044: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:09.044948329Z [2024-03-29 01:15:09,044: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:09.045024080Z [2024-03-29 01:15:09,044: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:15:09.045295471Z [2024-03-29 01:15:09,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:15:09.045327079Z [2024-03-29 01:15:09,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:09.129038238Z [2024-03-29 01:15:09,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:09.770196135Z [2024-03-29 01:15:09,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[731681fd-8587-48b4-a824-ebff6e04e6fb] succeeded in 2.546357911999621s: None 2024-03-29T01:15:09.824389170Z [2024-03-29 01:15:09,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc1b6d37-4ce0-465e-9142-fc4c316aba62] received 2024-03-29T01:15:09.831190228Z [2024-03-29 01:15:09,830: INFO/ForkPoolWorker-15] [bc1b6d37-4ce0-465e-9142-fc4c316aba62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:10.264620939Z [2024-03-29 01:15:10,260: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:15:11.570169586Z [2024-03-29 01:15:11,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:15:11.573725652Z [2024-03-29 01:15:11,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:11.597114340Z [2024-03-29 01:15:11,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:15:11.598670381Z [2024-03-29 01:15:11,598: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:15:11.598869634Z [2024-03-29 01:15:11,598: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:15:11.599068239Z [2024-03-29 01:15:11,598: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:15:11.599157215Z [2024-03-29 01:15:11,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:15:11.599500506Z [2024-03-29 01:15:11,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:15:11.599602845Z [2024-03-29 01:15:11,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:15:11.703052536Z [2024-03-29 01:15:11,702: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:15:12.279749383Z [2024-03-29 01:15:12,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[131564b0-90b5-4619-b5b9-409d38422d92] received 2024-03-29T01:15:12.291556690Z [2024-03-29 01:15:12,289: INFO/ForkPoolWorker-16] [131564b0-90b5-4619-b5b9-409d38422d92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:12.322410602Z [2024-03-29 01:15:12,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc1b6d37-4ce0-465e-9142-fc4c316aba62] succeeded in 2.4961274560000675s: None 2024-03-29T01:15:12.576255862Z [2024-03-29 01:15:12,572: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:12.746700792Z [2024-03-29 01:15:12,746: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:15:12.751682073Z [2024-03-29 01:15:12,750: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:12.774328000Z [2024-03-29 01:15:12,773: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:15:12.775645154Z [2024-03-29 01:15:12,775: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:15:12.775740803Z [2024-03-29 01:15:12,775: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:15:12.775824196Z [2024-03-29 01:15:12,775: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:15:12.776147956Z [2024-03-29 01:15:12,775: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:15:12.787216250Z [2024-03-29 01:15:12,786: WARNING/ForkPoolWorker-16] Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:12.787429084Z [2024-03-29 01:15:12,787: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:15:12.788417689Z [2024-03-29 01:15:12,788: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:15:12.791231917Z [2024-03-29 01:15:12,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:15:12.806627674Z [2024-03-29 01:15:12,806: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:15:12.808071450Z [2024-03-29 01:15:12,807: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:15:12.808299685Z [2024-03-29 01:15:12,807: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:15:12.808478339Z [2024-03-29 01:15:12,808: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:15:12.808791617Z [2024-03-29 01:15:12,808: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:15:12.813531678Z [2024-03-29 01:15:12,812: ERROR/ForkPoolWorker-16] [131564b0-90b5-4619-b5b9-409d38422d92] Failed to execute task Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' could not be found; either it does not exist or it failed to parse.. 2024-03-29T01:15:12.813608465Z Traceback (most recent call last): 2024-03-29T01:15:12.813613441Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T01:15:12.813617759Z args.func(args) 2024-03-29T01:15:12.813623225Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T01:15:12.813630625Z return func(*args, **kwargs) 2024-03-29T01:15:12.813635310Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T01:15:12.813639851Z return f(*args, **kwargs) 2024-03-29T01:15:12.813644993Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T01:15:12.813649750Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T01:15:12.813653292Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T01:15:12.813656494Z raise AirflowException( 2024-03-29T01:15:12.813661636Z airflow.exceptions.AirflowException: Dag 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8' could not be found; either it does not exist or it failed to parse. 2024-03-29T01:15:12.841758410Z [2024-03-29 01:15:12,840: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[131564b0-90b5-4619-b5b9-409d38422d92] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 131564b0-90b5-4619-b5b9-409d38422d92') 2024-03-29T01:15:12.841783910Z Traceback (most recent call last): 2024-03-29T01:15:12.841788985Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T01:15:12.841792371Z R = retval = fun(*args, **kwargs) 2024-03-29T01:15:12.841795786Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T01:15:12.841799184Z return self.run(*args, **kwargs) 2024-03-29T01:15:12.841819614Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T01:15:12.841824805Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T01:15:12.841828019Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T01:15:12.841832917Z raise AirflowException(msg) 2024-03-29T01:15:12.841837147Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 131564b0-90b5-4619-b5b9-409d38422d92 2024-03-29T01:16:01.017015422Z [2024-03-29 01:16:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9dbbbea-4f67-417f-8d42-b961cd90a631] received 2024-03-29T01:16:01.025372461Z [2024-03-29 01:16:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2393294b-90e9-4f67-a78b-cf93fb99e761] received 2024-03-29T01:16:01.027747998Z [2024-03-29 01:16:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea0a19cc-8d2e-46a6-a59e-9c5ad353f222] received 2024-03-29T01:16:01.032505514Z [2024-03-29 01:16:01,032: INFO/ForkPoolWorker-15] [b9dbbbea-4f67-417f-8d42-b961cd90a631] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:16:01.036170356Z [2024-03-29 01:16:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[410a08d4-9c36-4dcf-9bd1-4a39f4f95dec] received 2024-03-29T01:16:01.037047893Z [2024-03-29 01:16:01,036: INFO/ForkPoolWorker-1] [ea0a19cc-8d2e-46a6-a59e-9c5ad353f222] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:16:01.046437526Z [2024-03-29 01:16:01,046: INFO/ForkPoolWorker-2] [410a08d4-9c36-4dcf-9bd1-4a39f4f95dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:16:01.048830878Z [2024-03-29 01:16:01,048: INFO/ForkPoolWorker-16] [2393294b-90e9-4f67-a78b-cf93fb99e761] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:16:01.434894609Z [2024-03-29 01:16:01,431: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:16:01.454556568Z [2024-03-29 01:16:01,450: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:16:01.679140826Z [2024-03-29 01:16:01,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:16:01.692464004Z [2024-03-29 01:16:01,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:16:01.949774547Z [2024-03-29 01:16:01,949: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:16:01.965142890Z [2024-03-29 01:16:01,960: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:16:01.965459048Z [2024-03-29 01:16:01,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:16:02.040378223Z [2024-03-29 01:16:02,040: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:16:02.043165150Z [2024-03-29 01:16:02,042: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:16:02.043974759Z [2024-03-29 01:16:02,043: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:16:02.044292516Z [2024-03-29 01:16:02,043: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:16:02.045702440Z [2024-03-29 01:16:02,044: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:16:02.207446951Z [2024-03-29 01:16:02,207: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:16:02.722691967Z [2024-03-29 01:16:02,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9dbbbea-4f67-417f-8d42-b961cd90a631] succeeded in 1.7019850489996315s: None 2024-03-29T01:16:02.902399547Z [2024-03-29 01:16:02,901: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:16:02.908192521Z [2024-03-29 01:16:02,907: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:16:02.914381219Z [2024-03-29 01:16:02,913: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2393294b-90e9-4f67-a78b-cf93fb99e761] succeeded in 1.8869949589998214s: None 2024-03-29T01:16:02.930987528Z [2024-03-29 01:16:02,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:16:02.932777051Z [2024-03-29 01:16:02,932: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:16:02.932795975Z [2024-03-29 01:16:02,932: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:16:02.932952410Z [2024-03-29 01:16:02,932: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:16:02.933017140Z [2024-03-29 01:16:02,932: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:16:02.933327592Z [2024-03-29 01:16:02,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:16:02.933478067Z [2024-03-29 01:16:02,933: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:16:03.048024996Z [2024-03-29 01:16:03,047: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:16:03.143395193Z [2024-03-29 01:16:03,143: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:16:03.148740955Z [2024-03-29 01:16:03,148: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:16:03.197977293Z [2024-03-29 01:16:03,197: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:16:03.199423694Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:16:03.199440033Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:16:03.199621947Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:16:03.199659902Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:16:03.199988434Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:16:03.200092496Z [2024-03-29 01:16:03,199: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:16:03.302428884Z [2024-03-29 01:16:03,302: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:16:04.632088658Z [2024-03-29 01:16:04,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea0a19cc-8d2e-46a6-a59e-9c5ad353f222] succeeded in 3.601932427000065s: None 2024-03-29T01:16:05.372189041Z [2024-03-29 01:16:05,371: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[410a08d4-9c36-4dcf-9bd1-4a39f4f95dec] succeeded in 4.33176628199999s: None 2024-03-29T01:17:01.185170103Z [2024-03-29 01:17:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f38af210-a180-4c5e-8bb6-0ec47be46af2] received 2024-03-29T01:17:01.194853585Z [2024-03-29 01:17:01,194: INFO/ForkPoolWorker-15] [f38af210-a180-4c5e-8bb6-0ec47be46af2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:17:01.200306984Z [2024-03-29 01:17:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6316cc67-c93c-4fd4-8110-0582ba16f84b] received 2024-03-29T01:17:01.202130619Z [2024-03-29 01:17:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf7bfc74-ff67-4ef2-b4de-3871333ae06d] received 2024-03-29T01:17:01.209407798Z [2024-03-29 01:17:01,209: INFO/ForkPoolWorker-1] [bf7bfc74-ff67-4ef2-b4de-3871333ae06d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:17:01.226763602Z [2024-03-29 01:17:01,226: INFO/ForkPoolWorker-16] [6316cc67-c93c-4fd4-8110-0582ba16f84b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:17:01.561152258Z [2024-03-29 01:17:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:17:01.638153047Z [2024-03-29 01:17:01,633: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:17:01.778864795Z [2024-03-29 01:17:01,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:17:01.806617455Z [2024-03-29 01:17:01,806: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:17:01.816214619Z [2024-03-29 01:17:01,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:17:01.854538898Z [2024-03-29 01:17:01,854: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:17:01.855810316Z [2024-03-29 01:17:01,855: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:17:01.855866246Z [2024-03-29 01:17:01,855: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:17:01.855919900Z [2024-03-29 01:17:01,855: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:17:01.856120436Z [2024-03-29 01:17:01,856: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:17:01.982159654Z [2024-03-29 01:17:01,981: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:17:02.795218660Z [2024-03-29 01:17:02,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f38af210-a180-4c5e-8bb6-0ec47be46af2] succeeded in 1.607665415000156s: None 2024-03-29T01:17:03.481426600Z [2024-03-29 01:17:03,480: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:17:03.485828667Z [2024-03-29 01:17:03,485: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:17:03.522885190Z [2024-03-29 01:17:03,522: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:17:03.529884672Z [2024-03-29 01:17:03,529: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:17:03.529984538Z [2024-03-29 01:17:03,529: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:17:03.530010444Z [2024-03-29 01:17:03,529: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:17:03.530022643Z [2024-03-29 01:17:03,529: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:17:03.530395673Z [2024-03-29 01:17:03,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:17:03.530406175Z [2024-03-29 01:17:03,530: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:17:03.576885625Z [2024-03-29 01:17:03,576: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:17:03.592830247Z [2024-03-29 01:17:03,581: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:17:03.638754777Z [2024-03-29 01:17:03,638: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:17:03.643466703Z [2024-03-29 01:17:03,643: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:17:03.643689475Z [2024-03-29 01:17:03,643: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:17:03.643981181Z [2024-03-29 01:17:03,643: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:17:03.644227491Z [2024-03-29 01:17:03,644: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:17:03.644650201Z [2024-03-29 01:17:03,644: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:17:03.644853461Z [2024-03-29 01:17:03,644: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:17:03.708650558Z [2024-03-29 01:17:03,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:17:03.782085576Z [2024-03-29 01:17:03,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:17:06.613486067Z [2024-03-29 01:17:06,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf7bfc74-ff67-4ef2-b4de-3871333ae06d] succeeded in 5.407106775000102s: None 2024-03-29T01:17:08.061904282Z [2024-03-29 01:17:08,061: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6316cc67-c93c-4fd4-8110-0582ba16f84b] succeeded in 6.8584979429997475s: None 2024-03-29T01:18:00.450057916Z [2024-03-29 01:18:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b412ac48-437e-4482-a78b-bf7aea461ad1] received 2024-03-29T01:18:00.452855927Z [2024-03-29 01:18:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65c4bc4e-a2a1-4adf-b761-7db8c7e6fd3e] received 2024-03-29T01:18:00.456883683Z [2024-03-29 01:18:00,456: INFO/ForkPoolWorker-15] [b412ac48-437e-4482-a78b-bf7aea461ad1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:18:00.459625080Z [2024-03-29 01:18:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a53a1408-d932-4c1c-a7ba-cd6b75268b8d] received 2024-03-29T01:18:00.461617021Z [2024-03-29 01:18:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e07d4bee-d2ad-458f-9056-5c4ec23919cd] received 2024-03-29T01:18:00.466909336Z [2024-03-29 01:18:00,466: INFO/ForkPoolWorker-16] [65c4bc4e-a2a1-4adf-b761-7db8c7e6fd3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:18:00.473300509Z [2024-03-29 01:18:00,473: INFO/ForkPoolWorker-1] [a53a1408-d932-4c1c-a7ba-cd6b75268b8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:18:00.474256556Z [2024-03-29 01:18:00,473: INFO/ForkPoolWorker-2] [e07d4bee-d2ad-458f-9056-5c4ec23919cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:18:00.840294639Z [2024-03-29 01:18:00,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:18:00.849726410Z [2024-03-29 01:18:00,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:18:00.937057603Z [2024-03-29 01:18:00,933: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:18:00.958163406Z [2024-03-29 01:18:00,955: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:18:01.090116456Z [2024-03-29 01:18:01,089: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:18:01.097862201Z [2024-03-29 01:18:01,097: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:18:01.103699725Z [2024-03-29 01:18:01,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:18:01.130453494Z [2024-03-29 01:18:01,130: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:18:01.132178063Z [2024-03-29 01:18:01,131: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:18:01.132199919Z [2024-03-29 01:18:01,132: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:18:01.132268818Z [2024-03-29 01:18:01,132: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:18:01.132611465Z [2024-03-29 01:18:01,132: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:18:01.244073342Z [2024-03-29 01:18:01,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:18:01.838029283Z [2024-03-29 01:18:01,837: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a53a1408-d932-4c1c-a7ba-cd6b75268b8d] succeeded in 1.3764564809998774s: None 2024-03-29T01:18:02.127517721Z [2024-03-29 01:18:02,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b412ac48-437e-4482-a78b-bf7aea461ad1] succeeded in 1.6757971970000654s: None 2024-03-29T01:18:02.500459256Z [2024-03-29 01:18:02,500: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:18:02.504414690Z [2024-03-29 01:18:02,503: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:18:02.527090219Z [2024-03-29 01:18:02,526: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:18:02.528989764Z [2024-03-29 01:18:02,528: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:18:02.529458696Z [2024-03-29 01:18:02,529: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:18:02.529713848Z [2024-03-29 01:18:02,529: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:18:02.529851104Z [2024-03-29 01:18:02,529: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:18:02.530182213Z [2024-03-29 01:18:02,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:18:02.530806276Z [2024-03-29 01:18:02,530: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:18:02.633831045Z [2024-03-29 01:18:02,633: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:18:02.654138488Z [2024-03-29 01:18:02,653: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:18:02.657685476Z [2024-03-29 01:18:02,657: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:18:02.678896628Z [2024-03-29 01:18:02,678: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:18:02.680585028Z [2024-03-29 01:18:02,680: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:18:02.680608405Z [2024-03-29 01:18:02,680: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:18:02.680841160Z [2024-03-29 01:18:02,680: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:18:02.680939701Z [2024-03-29 01:18:02,680: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:18:02.681305134Z [2024-03-29 01:18:02,681: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:18:02.681384495Z [2024-03-29 01:18:02,681: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:18:02.796776111Z [2024-03-29 01:18:02,796: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:18:04.074329437Z [2024-03-29 01:18:04,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65c4bc4e-a2a1-4adf-b761-7db8c7e6fd3e] succeeded in 3.6198110420000376s: None 2024-03-29T01:18:04.630569272Z [2024-03-29 01:18:04,630: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e07d4bee-d2ad-458f-9056-5c4ec23919cd] succeeded in 4.164816305999921s: None 2024-03-29T01:19:00.944476064Z [2024-03-29 01:19:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[320df1b0-26de-4723-83df-21d79f50e338] received 2024-03-29T01:19:00.952293834Z [2024-03-29 01:19:00,952: INFO/ForkPoolWorker-15] [320df1b0-26de-4723-83df-21d79f50e338] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:19:00.958135268Z [2024-03-29 01:19:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20aadbf7-27ea-44b9-ae21-74ced35a64aa] received 2024-03-29T01:19:00.962676538Z [2024-03-29 01:19:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b255f25-176c-4317-b6b8-5874ef2e74d7] received 2024-03-29T01:19:00.971912312Z [2024-03-29 01:19:00,971: INFO/ForkPoolWorker-16] [20aadbf7-27ea-44b9-ae21-74ced35a64aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:19:00.974623387Z [2024-03-29 01:19:00,974: INFO/ForkPoolWorker-1] [6b255f25-176c-4317-b6b8-5874ef2e74d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:19:01.293995738Z [2024-03-29 01:19:01,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:19:01.397425176Z [2024-03-29 01:19:01,394: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:19:01.461480464Z [2024-03-29 01:19:01,451: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:19:01.474536586Z [2024-03-29 01:19:01,474: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:19:01.478504008Z [2024-03-29 01:19:01,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:19:01.516580011Z [2024-03-29 01:19:01,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:19:01.518586728Z [2024-03-29 01:19:01,518: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:19:01.519069661Z [2024-03-29 01:19:01,518: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:19:01.519139624Z [2024-03-29 01:19:01,519: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:19:01.519397060Z [2024-03-29 01:19:01,519: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:19:01.617289982Z [2024-03-29 01:19:01,617: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:19:02.356776009Z [2024-03-29 01:19:02,356: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20aadbf7-27ea-44b9-ae21-74ced35a64aa] succeeded in 1.396372679999331s: None 2024-03-29T01:19:02.721754012Z [2024-03-29 01:19:02,721: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:19:02.727302098Z [2024-03-29 01:19:02,726: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:19:02.757354168Z [2024-03-29 01:19:02,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:19:02.759059314Z [2024-03-29 01:19:02,758: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:19:02.760258693Z [2024-03-29 01:19:02,758: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:19:02.760796316Z [2024-03-29 01:19:02,760: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:19:02.760964310Z [2024-03-29 01:19:02,760: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:19:02.761327996Z [2024-03-29 01:19:02,761: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:19:02.761449839Z [2024-03-29 01:19:02,761: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:19:02.853181981Z [2024-03-29 01:19:02,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:19:02.857285964Z [2024-03-29 01:19:02,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:19:02.860247347Z [2024-03-29 01:19:02,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:19:02.880046565Z [2024-03-29 01:19:02,879: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:19:02.881370336Z [2024-03-29 01:19:02,881: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:19:02.881515827Z [2024-03-29 01:19:02,881: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:19:02.881696529Z [2024-03-29 01:19:02,881: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:19:02.881825240Z [2024-03-29 01:19:02,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:19:02.882117324Z [2024-03-29 01:19:02,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:19:02.882238502Z [2024-03-29 01:19:02,882: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:19:02.971410358Z [2024-03-29 01:19:02,971: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:19:04.548815390Z [2024-03-29 01:19:04,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[320df1b0-26de-4723-83df-21d79f50e338] succeeded in 3.6024316709999766s: None 2024-03-29T01:19:04.830296630Z [2024-03-29 01:19:04,829: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b255f25-176c-4317-b6b8-5874ef2e74d7] succeeded in 3.861081557000034s: None 2024-03-29T01:20:00.435216147Z [2024-03-29 01:20:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e37e515-0256-4158-b353-0b6c60f24cc5] received 2024-03-29T01:20:00.437635179Z [2024-03-29 01:20:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a9e836-7695-425e-b916-7f783178edae] received 2024-03-29T01:20:00.446837351Z [2024-03-29 01:20:00,446: INFO/ForkPoolWorker-16] [a0a9e836-7695-425e-b916-7f783178edae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:20:00.448299671Z [2024-03-29 01:20:00,448: INFO/ForkPoolWorker-15] [1e37e515-0256-4158-b353-0b6c60f24cc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:00.453392281Z [2024-03-29 01:20:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bbf29ca-6c81-4a90-8f22-59567d4ca343] received 2024-03-29T01:20:00.456039357Z [2024-03-29 01:20:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9422e4f1-108d-4879-8aff-c987b871ac66] received 2024-03-29T01:20:00.457552270Z [2024-03-29 01:20:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54ac65c8-4034-4038-9c0d-89082bd23eae] received 2024-03-29T01:20:00.463142637Z [2024-03-29 01:20:00,462: INFO/ForkPoolWorker-1] [7bbf29ca-6c81-4a90-8f22-59567d4ca343] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:20:00.466278278Z [2024-03-29 01:20:00,465: INFO/ForkPoolWorker-2] [9422e4f1-108d-4879-8aff-c987b871ac66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:20:00.476687401Z [2024-03-29 01:20:00,476: INFO/ForkPoolWorker-3] [54ac65c8-4034-4038-9c0d-89082bd23eae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:20:00.825236515Z [2024-03-29 01:20:00,821: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:20:00.841853854Z [2024-03-29 01:20:00,834: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:20:00.982041648Z [2024-03-29 01:20:00,978: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:20:00.987784106Z [2024-03-29 01:20:00,976: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:20:01.081540087Z [2024-03-29 01:20:01,081: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:20:01.085827653Z [2024-03-29 01:20:01,085: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:01.125596898Z [2024-03-29 01:20:01,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:20:01.125867793Z [2024-03-29 01:20:01,125: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:20:01.127506316Z [2024-03-29 01:20:01,127: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:20:01.127763569Z [2024-03-29 01:20:01,127: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:20:01.127990580Z [2024-03-29 01:20:01,127: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:20:01.129086221Z [2024-03-29 01:20:01,128: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:20:01.281259739Z [2024-03-29 01:20:01,280: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:01.575756754Z [2024-03-29 01:20:01,575: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:02.294291238Z [2024-03-29 01:20:02,293: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9422e4f1-108d-4879-8aff-c987b871ac66] succeeded in 1.8338698399993518s: None 2024-03-29T01:20:02.466080669Z [2024-03-29 01:20:02,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0a9e836-7695-425e-b916-7f783178edae] succeeded in 2.0264197269998476s: None 2024-03-29T01:20:02.519932563Z [2024-03-29 01:20:02,519: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:20:02.523921402Z [2024-03-29 01:20:02,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:02.552722498Z [2024-03-29 01:20:02,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:20:02.554076902Z [2024-03-29 01:20:02,553: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:02.554095082Z [2024-03-29 01:20:02,554: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:02.554216975Z [2024-03-29 01:20:02,554: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:02.554231231Z [2024-03-29 01:20:02,554: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:20:02.554590762Z [2024-03-29 01:20:02,554: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:20:02.554604007Z [2024-03-29 01:20:02,554: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:02.658875741Z [2024-03-29 01:20:02,658: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:02.944872119Z [2024-03-29 01:20:02,944: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T01:20:02.948765873Z [2024-03-29 01:20:02,948: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:02.976630714Z [2024-03-29 01:20:02,976: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:20:02.985719872Z [2024-03-29 01:20:02,985: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:02.986024166Z [2024-03-29 01:20:02,985: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:02.986426341Z [2024-03-29 01:20:02,986: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:02.986833993Z [2024-03-29 01:20:02,986: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T01:20:02.987586464Z [2024-03-29 01:20:02,987: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:20:02.987790226Z [2024-03-29 01:20:02,987: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:03.046435947Z [2024-03-29 01:20:03,045: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:20:03.050235436Z [2024-03-29 01:20:03,049: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:03.085348080Z [2024-03-29 01:20:03,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:20:03.089972430Z [2024-03-29 01:20:03,089: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:03.090343045Z [2024-03-29 01:20:03,090: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:03.090547681Z [2024-03-29 01:20:03,090: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:03.090568927Z [2024-03-29 01:20:03,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:20:03.090850244Z [2024-03-29 01:20:03,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:20:03.090868331Z [2024-03-29 01:20:03,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:03.101295678Z [2024-03-29 01:20:03,101: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:03.179401546Z [2024-03-29 01:20:03,179: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:03.874172555Z [2024-03-29 01:20:03,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e37e515-0256-4158-b353-0b6c60f24cc5] succeeded in 3.4364067080005043s: None 2024-03-29T01:20:04.620652789Z [2024-03-29 01:20:04,620: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[54ac65c8-4034-4038-9c0d-89082bd23eae] succeeded in 4.160274167999887s: None 2024-03-29T01:20:04.795743635Z [2024-03-29 01:20:04,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4df136c6-441a-48a1-8bf0-3d2832f7c8af] received 2024-03-29T01:20:04.819588996Z [2024-03-29 01:20:04,819: INFO/ForkPoolWorker-15] [4df136c6-441a-48a1-8bf0-3d2832f7c8af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:05.318998361Z [2024-03-29 01:20:05,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:20:05.395930756Z [2024-03-29 01:20:05,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bbf29ca-6c81-4a90-8f22-59567d4ca343] succeeded in 4.940727561999665s: None 2024-03-29T01:20:06.926345015Z [2024-03-29 01:20:06,925: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:20:06.934414425Z [2024-03-29 01:20:06,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:06.983355428Z [2024-03-29 01:20:06,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:20:06.992893830Z [2024-03-29 01:20:06,992: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:06.993093401Z [2024-03-29 01:20:06,992: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:06.993373422Z [2024-03-29 01:20:06,993: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:06.993486312Z [2024-03-29 01:20:06,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:20:06.994029037Z [2024-03-29 01:20:06,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:20:06.994148919Z [2024-03-29 01:20:06,994: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:07.148658535Z [2024-03-29 01:20:07,148: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:07.957207619Z [2024-03-29 01:20:07,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4df136c6-441a-48a1-8bf0-3d2832f7c8af] succeeded in 3.1596871470001133s: None 2024-03-29T01:20:08.663531818Z [2024-03-29 01:20:08,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4f83a03-b9aa-404d-9c87-3e777f3e1825] received 2024-03-29T01:20:08.672986858Z [2024-03-29 01:20:08,672: INFO/ForkPoolWorker-15] [f4f83a03-b9aa-404d-9c87-3e777f3e1825] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:20:08.967914216Z [2024-03-29 01:20:08,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:20:10.137204006Z [2024-03-29 01:20:10,136: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:20:10.140676267Z [2024-03-29 01:20:10,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:10.167800226Z [2024-03-29 01:20:10,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:20:10.169891804Z [2024-03-29 01:20:10,169: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:10.170105921Z [2024-03-29 01:20:10,169: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:10.170397213Z [2024-03-29 01:20:10,170: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:10.170604051Z [2024-03-29 01:20:10,170: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:20:10.171178790Z [2024-03-29 01:20:10,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:20:10.171219263Z [2024-03-29 01:20:10,170: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:10.281623609Z [2024-03-29 01:20:10,281: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:10.818265296Z [2024-03-29 01:20:10,817: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4f83a03-b9aa-404d-9c87-3e777f3e1825] succeeded in 2.151173856999776s: None 2024-03-29T01:20:11.002884194Z [2024-03-29 01:20:11,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4548b535-d06a-4e09-9793-0d14e6abc317] received 2024-03-29T01:20:11.014655693Z [2024-03-29 01:20:11,014: INFO/ForkPoolWorker-15] [4548b535-d06a-4e09-9793-0d14e6abc317] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:11.356875034Z [2024-03-29 01:20:11,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:20:12.650673447Z [2024-03-29 01:20:12,650: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:20:12.656510094Z [2024-03-29 01:20:12,655: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:20:12.686872755Z [2024-03-29 01:20:12,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:20:12.688455220Z [2024-03-29 01:20:12,688: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:20:12.688525210Z [2024-03-29 01:20:12,688: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:20:12.688784844Z [2024-03-29 01:20:12,688: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:20:12.688888721Z [2024-03-29 01:20:12,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:20:12.689401392Z [2024-03-29 01:20:12,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:20:12.689486203Z [2024-03-29 01:20:12,689: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:20:12.801756851Z [2024-03-29 01:20:12,801: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:20:13.450479286Z [2024-03-29 01:20:13,450: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4548b535-d06a-4e09-9793-0d14e6abc317] succeeded in 2.4458593370000017s: None 2024-03-29T01:21:00.571989309Z [2024-03-29 01:21:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d510dbc1-9b23-4f63-831e-5dccfb55fdb3] received 2024-03-29T01:21:00.579557637Z [2024-03-29 01:21:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae933a62-3d05-41e2-91d8-38f07572a5ad] received 2024-03-29T01:21:00.581718653Z [2024-03-29 01:21:00,581: INFO/ForkPoolWorker-15] [d510dbc1-9b23-4f63-831e-5dccfb55fdb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:21:00.588762895Z [2024-03-29 01:21:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36b5221d-b087-46aa-b54b-e30a4fd8c6e9] received 2024-03-29T01:21:00.603882079Z [2024-03-29 01:21:00,603: INFO/ForkPoolWorker-16] [ae933a62-3d05-41e2-91d8-38f07572a5ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:21:00.608273356Z [2024-03-29 01:21:00,607: INFO/ForkPoolWorker-1] [36b5221d-b087-46aa-b54b-e30a4fd8c6e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:21:00.955480684Z [2024-03-29 01:21:00,952: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:21:00.999425631Z [2024-03-29 01:21:00,996: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:21:01.013776387Z [2024-03-29 01:21:01,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:21:01.164343570Z [2024-03-29 01:21:01,163: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:21:01.169679216Z [2024-03-29 01:21:01,169: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:21:01.205333745Z [2024-03-29 01:21:01,204: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:21:01.206880850Z [2024-03-29 01:21:01,206: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:21:01.207248130Z [2024-03-29 01:21:01,206: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:21:01.207496019Z [2024-03-29 01:21:01,207: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:21:01.207859241Z [2024-03-29 01:21:01,207: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:21:01.339802674Z [2024-03-29 01:21:01,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:21:02.116498703Z [2024-03-29 01:21:02,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae933a62-3d05-41e2-91d8-38f07572a5ad] succeeded in 1.525972826000725s: None 2024-03-29T01:21:02.316090413Z [2024-03-29 01:21:02,315: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:21:02.320067819Z [2024-03-29 01:21:02,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:21:02.341402030Z [2024-03-29 01:21:02,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:21:02.343093356Z [2024-03-29 01:21:02,342: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:21:02.343293376Z [2024-03-29 01:21:02,343: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:21:02.343574940Z [2024-03-29 01:21:02,343: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:21:02.343831639Z [2024-03-29 01:21:02,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:21:02.344312800Z [2024-03-29 01:21:02,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:21:02.344566832Z [2024-03-29 01:21:02,344: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:21:02.448256412Z [2024-03-29 01:21:02,447: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:21:02.539245070Z [2024-03-29 01:21:02,538: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:21:02.545214416Z [2024-03-29 01:21:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:21:02.573511742Z [2024-03-29 01:21:02,573: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:21:02.575348057Z [2024-03-29 01:21:02,575: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:21:02.575425328Z [2024-03-29 01:21:02,575: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:21:02.575671792Z [2024-03-29 01:21:02,575: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:21:02.575739361Z [2024-03-29 01:21:02,575: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:21:02.576153641Z [2024-03-29 01:21:02,575: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:21:02.576315067Z [2024-03-29 01:21:02,576: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:21:02.716442512Z [2024-03-29 01:21:02,716: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:21:04.284189313Z [2024-03-29 01:21:04,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d510dbc1-9b23-4f63-831e-5dccfb55fdb3] succeeded in 3.7105941840000014s: None 2024-03-29T01:21:04.469910334Z [2024-03-29 01:21:04,469: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36b5221d-b087-46aa-b54b-e30a4fd8c6e9] succeeded in 3.873581341999852s: None 2024-03-29T01:22:00.218069211Z [2024-03-29 01:22:00,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[689f2bf3-0c3e-4312-80ab-3677143ea1ea] received 2024-03-29T01:22:00.221550952Z [2024-03-29 01:22:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f54a8b-9142-44c1-9981-e620d196517b] received 2024-03-29T01:22:00.223564437Z [2024-03-29 01:22:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d08b80c2-e3d0-4c43-8bac-3203608c382f] received 2024-03-29T01:22:00.225584303Z [2024-03-29 01:22:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b247115d-56c9-45d4-96ff-cc397abb8a4d] received 2024-03-29T01:22:00.230747656Z [2024-03-29 01:22:00,230: INFO/ForkPoolWorker-15] [689f2bf3-0c3e-4312-80ab-3677143ea1ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:22:00.239095788Z [2024-03-29 01:22:00,238: INFO/ForkPoolWorker-16] [75f54a8b-9142-44c1-9981-e620d196517b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:22:00.242071883Z [2024-03-29 01:22:00,241: INFO/ForkPoolWorker-1] [d08b80c2-e3d0-4c43-8bac-3203608c382f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:22:00.250471124Z [2024-03-29 01:22:00,250: INFO/ForkPoolWorker-2] [b247115d-56c9-45d4-96ff-cc397abb8a4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:22:00.522250102Z [2024-03-29 01:22:00,518: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:22:00.584571934Z [2024-03-29 01:22:00,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:22:00.594245396Z [2024-03-29 01:22:00,590: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:22:00.649030533Z [2024-03-29 01:22:00,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:22:00.849795875Z [2024-03-29 01:22:00,849: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:22:00.860598980Z [2024-03-29 01:22:00,860: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:22:00.865310442Z [2024-03-29 01:22:00,864: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:22:00.904108547Z [2024-03-29 01:22:00,903: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:22:00.911897341Z [2024-03-29 01:22:00,911: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:22:00.912391281Z [2024-03-29 01:22:00,911: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:22:00.912682052Z [2024-03-29 01:22:00,912: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:22:00.913070167Z [2024-03-29 01:22:00,912: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:22:01.045095945Z [2024-03-29 01:22:01,044: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:22:01.407698636Z [2024-03-29 01:22:01,407: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d08b80c2-e3d0-4c43-8bac-3203608c382f] succeeded in 1.1819325219994425s: None 2024-03-29T01:22:01.739808120Z [2024-03-29 01:22:01,739: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b247115d-56c9-45d4-96ff-cc397abb8a4d] succeeded in 1.5115584519999175s: None 2024-03-29T01:22:01.895526737Z [2024-03-29 01:22:01,895: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:22:01.904638002Z [2024-03-29 01:22:01,903: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:22:01.971785325Z [2024-03-29 01:22:01,971: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:22:01.977089788Z [2024-03-29 01:22:01,974: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:22:01.977326888Z [2024-03-29 01:22:01,977: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:22:01.978175101Z [2024-03-29 01:22:01,977: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:22:01.981329759Z [2024-03-29 01:22:01,978: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:22:01.982978837Z [2024-03-29 01:22:01,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:22:01.983698597Z [2024-03-29 01:22:01,983: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:22:02.044096275Z [2024-03-29 01:22:02,043: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:22:02.048059644Z [2024-03-29 01:22:02,047: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:22:02.071515583Z [2024-03-29 01:22:02,071: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:22:02.072958498Z [2024-03-29 01:22:02,072: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:22:02.072982641Z [2024-03-29 01:22:02,072: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:22:02.073049587Z [2024-03-29 01:22:02,072: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:22:02.073092052Z [2024-03-29 01:22:02,073: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:22:02.073410174Z [2024-03-29 01:22:02,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:22:02.073425404Z [2024-03-29 01:22:02,073: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:22:02.118036157Z [2024-03-29 01:22:02,117: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:22:02.191082312Z [2024-03-29 01:22:02,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:22:03.876512691Z [2024-03-29 01:22:03,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[689f2bf3-0c3e-4312-80ab-3677143ea1ea] succeeded in 3.655440484999417s: None 2024-03-29T01:22:04.958616610Z [2024-03-29 01:22:04,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75f54a8b-9142-44c1-9981-e620d196517b] succeeded in 4.734735977999662s: None 2024-03-29T01:23:01.122226217Z [2024-03-29 01:23:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7db55e13-91df-4f77-8b8b-e18b0a0444a2] received 2024-03-29T01:23:01.127331146Z [2024-03-29 01:23:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67758b5d-aa1d-430e-af5c-fc276f43ca01] received 2024-03-29T01:23:01.134498252Z [2024-03-29 01:23:01,134: INFO/ForkPoolWorker-15] [7db55e13-91df-4f77-8b8b-e18b0a0444a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:23:01.136041344Z [2024-03-29 01:23:01,135: INFO/ForkPoolWorker-16] [67758b5d-aa1d-430e-af5c-fc276f43ca01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:23:01.137527375Z [2024-03-29 01:23:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb9cceac-26fa-4c52-85c4-7f3cfd32daad] received 2024-03-29T01:23:01.154308655Z [2024-03-29 01:23:01,153: INFO/ForkPoolWorker-1] [bb9cceac-26fa-4c52-85c4-7f3cfd32daad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:23:01.489761008Z [2024-03-29 01:23:01,486: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:23:01.566439227Z [2024-03-29 01:23:01,563: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:23:01.658230910Z [2024-03-29 01:23:01,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:23:01.663909045Z [2024-03-29 01:23:01,663: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:23:01.667967291Z [2024-03-29 01:23:01,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:23:01.686695386Z [2024-03-29 01:23:01,686: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:23:01.687738154Z [2024-03-29 01:23:01,687: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:23:01.687755587Z [2024-03-29 01:23:01,687: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:23:01.687809308Z [2024-03-29 01:23:01,687: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:23:01.688060870Z [2024-03-29 01:23:01,687: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:23:01.801886709Z [2024-03-29 01:23:01,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:23:02.531288708Z [2024-03-29 01:23:02,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67758b5d-aa1d-430e-af5c-fc276f43ca01] succeeded in 1.4011162199994942s: None 2024-03-29T01:23:02.933928949Z [2024-03-29 01:23:02,933: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:23:02.937588986Z [2024-03-29 01:23:02,937: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:23:02.957710068Z [2024-03-29 01:23:02,957: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:23:02.959741617Z [2024-03-29 01:23:02,959: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:23:02.960027693Z [2024-03-29 01:23:02,959: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:23:02.960413868Z [2024-03-29 01:23:02,960: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:23:02.960721162Z [2024-03-29 01:23:02,960: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:23:02.961338050Z [2024-03-29 01:23:02,960: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:23:02.961595014Z [2024-03-29 01:23:02,961: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:23:03.001560453Z [2024-03-29 01:23:03,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:23:03.010682060Z [2024-03-29 01:23:03,010: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:23:03.035835179Z [2024-03-29 01:23:03,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:23:03.037819143Z [2024-03-29 01:23:03,037: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:23:03.038160785Z [2024-03-29 01:23:03,037: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:23:03.038545559Z [2024-03-29 01:23:03,038: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:23:03.038754932Z [2024-03-29 01:23:03,038: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:23:03.039258095Z [2024-03-29 01:23:03,038: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:23:03.039801521Z [2024-03-29 01:23:03,039: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:23:03.092840168Z [2024-03-29 01:23:03,092: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:23:03.152972914Z [2024-03-29 01:23:03,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:23:04.949419923Z [2024-03-29 01:23:04,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7db55e13-91df-4f77-8b8b-e18b0a0444a2] succeeded in 3.8238975590002156s: None 2024-03-29T01:23:05.180376251Z [2024-03-29 01:23:05,178: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb9cceac-26fa-4c52-85c4-7f3cfd32daad] succeeded in 4.039235686000211s: None 2024-03-29T01:24:00.640976127Z [2024-03-29 01:24:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d55ba727-8701-471b-bdf9-78cac7888952] received 2024-03-29T01:24:00.642817159Z [2024-03-29 01:24:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e6d0f5e-c208-45b7-8ec1-83ee192689a3] received 2024-03-29T01:24:00.644750747Z [2024-03-29 01:24:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86f0368e-2372-4e70-bcef-7d000716e977] received 2024-03-29T01:24:00.646522284Z [2024-03-29 01:24:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db8afa0e-e277-40df-bfe7-169aebe03897] received 2024-03-29T01:24:00.654544353Z [2024-03-29 01:24:00,654: INFO/ForkPoolWorker-15] [d55ba727-8701-471b-bdf9-78cac7888952] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:24:00.656907754Z [2024-03-29 01:24:00,656: INFO/ForkPoolWorker-2] [db8afa0e-e277-40df-bfe7-169aebe03897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:24:00.657588219Z [2024-03-29 01:24:00,657: INFO/ForkPoolWorker-16] [6e6d0f5e-c208-45b7-8ec1-83ee192689a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:24:00.658082431Z [2024-03-29 01:24:00,657: INFO/ForkPoolWorker-1] [86f0368e-2372-4e70-bcef-7d000716e977] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:24:01.048681207Z [2024-03-29 01:24:01,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:24:01.069758082Z [2024-03-29 01:24:01,066: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:24:01.113897574Z [2024-03-29 01:24:01,110: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:24:01.137511105Z [2024-03-29 01:24:01,133: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:24:01.221905538Z [2024-03-29 01:24:01,221: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:24:01.226589645Z [2024-03-29 01:24:01,226: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:24:01.254948327Z [2024-03-29 01:24:01,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:24:01.256347121Z [2024-03-29 01:24:01,256: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:24:01.256617619Z [2024-03-29 01:24:01,256: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:24:01.256730912Z [2024-03-29 01:24:01,256: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:24:01.257007947Z [2024-03-29 01:24:01,256: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:24:01.388222767Z [2024-03-29 01:24:01,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:24:01.453033554Z [2024-03-29 01:24:01,452: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:24:02.107566605Z [2024-03-29 01:24:02,107: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e6d0f5e-c208-45b7-8ec1-83ee192689a3] succeeded in 1.4617443569995885s: None 2024-03-29T01:24:02.174892216Z [2024-03-29 01:24:02,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d55ba727-8701-471b-bdf9-78cac7888952] succeeded in 1.5312846819997503s: None 2024-03-29T01:24:02.470002466Z [2024-03-29 01:24:02,469: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:24:02.473548778Z [2024-03-29 01:24:02,473: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:24:02.494509178Z [2024-03-29 01:24:02,494: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:24:02.495766841Z [2024-03-29 01:24:02,495: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:24:02.495791489Z [2024-03-29 01:24:02,495: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:24:02.495953671Z [2024-03-29 01:24:02,495: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:24:02.495993459Z [2024-03-29 01:24:02,495: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:24:02.496286019Z [2024-03-29 01:24:02,496: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:24:02.496332040Z [2024-03-29 01:24:02,496: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:24:02.536075776Z [2024-03-29 01:24:02,535: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:24:02.539709826Z [2024-03-29 01:24:02,539: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:24:02.564072455Z [2024-03-29 01:24:02,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:24:02.566960505Z [2024-03-29 01:24:02,566: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:24:02.567169087Z [2024-03-29 01:24:02,566: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:24:02.567481047Z [2024-03-29 01:24:02,567: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:24:02.567679613Z [2024-03-29 01:24:02,567: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:24:02.568229147Z [2024-03-29 01:24:02,567: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:24:02.568413694Z [2024-03-29 01:24:02,568: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:24:02.588017992Z [2024-03-29 01:24:02,587: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:24:02.661135349Z [2024-03-29 01:24:02,660: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:24:04.107977934Z [2024-03-29 01:24:04,107: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[db8afa0e-e277-40df-bfe7-169aebe03897] succeeded in 3.459536438000214s: None 2024-03-29T01:24:04.689195324Z [2024-03-29 01:24:04,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86f0368e-2372-4e70-bcef-7d000716e977] succeeded in 4.040167385000132s: None 2024-03-29T01:25:01.116559064Z [2024-03-29 01:25:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9e4dd2d-5551-4e1b-9110-42de980bc3e1] received 2024-03-29T01:25:01.118100529Z [2024-03-29 01:25:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10f4a5e4-fff7-4970-a8dd-4659e4478c15] received 2024-03-29T01:25:01.123146399Z [2024-03-29 01:25:01,122: INFO/ForkPoolWorker-15] [d9e4dd2d-5551-4e1b-9110-42de980bc3e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:25:01.126369499Z [2024-03-29 01:25:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6492ac23-d577-475d-89de-deb1ef75f1d8] received 2024-03-29T01:25:01.129380656Z [2024-03-29 01:25:01,129: INFO/ForkPoolWorker-16] [10f4a5e4-fff7-4970-a8dd-4659e4478c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:25:01.135817950Z [2024-03-29 01:25:01,135: INFO/ForkPoolWorker-1] [6492ac23-d577-475d-89de-deb1ef75f1d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:01.136387434Z [2024-03-29 01:25:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b524aad-9c0f-469a-bde4-fb5a8aecb03c] received 2024-03-29T01:25:01.146788226Z [2024-03-29 01:25:01,146: INFO/ForkPoolWorker-2] [2b524aad-9c0f-469a-bde4-fb5a8aecb03c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:25:01.457261744Z [2024-03-29 01:25:01,453: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:25:01.499145507Z [2024-03-29 01:25:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:25:01.512198648Z [2024-03-29 01:25:01,507: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:25:01.518231587Z [2024-03-29 01:25:01,515: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:25:01.700802559Z [2024-03-29 01:25:01,700: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:25:01.706384972Z [2024-03-29 01:25:01,705: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:01.760256948Z [2024-03-29 01:25:01,759: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:25:01.763598546Z [2024-03-29 01:25:01,763: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:25:01.763965036Z [2024-03-29 01:25:01,763: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:25:01.764239144Z [2024-03-29 01:25:01,764: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:25:01.765184890Z [2024-03-29 01:25:01,764: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:25:01.920376454Z [2024-03-29 01:25:01,919: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:02.722978522Z [2024-03-29 01:25:02,722: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b524aad-9c0f-469a-bde4-fb5a8aecb03c] succeeded in 1.5843820870004492s: None 2024-03-29T01:25:03.098157905Z [2024-03-29 01:25:03,097: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:25:03.105012922Z [2024-03-29 01:25:03,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:03.155269941Z [2024-03-29 01:25:03,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:25:03.159859165Z [2024-03-29 01:25:03,159: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:03.160157190Z [2024-03-29 01:25:03,159: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:25:03.164650311Z [2024-03-29 01:25:03,164: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:03.165086460Z [2024-03-29 01:25:03,164: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:03.165564942Z [2024-03-29 01:25:03,165: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:03.165870906Z [2024-03-29 01:25:03,165: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:25:03.166580380Z [2024-03-29 01:25:03,166: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:25:03.167099162Z [2024-03-29 01:25:03,166: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:03.210238253Z [2024-03-29 01:25:03,209: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:25:03.215352154Z [2024-03-29 01:25:03,214: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:03.215384307Z [2024-03-29 01:25:03,215: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:03.216334474Z [2024-03-29 01:25:03,215: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:03.216355083Z [2024-03-29 01:25:03,216: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:25:03.217286997Z [2024-03-29 01:25:03,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:25:03.217333416Z [2024-03-29 01:25:03,217: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:03.349477272Z [2024-03-29 01:25:03,349: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:03.367695375Z [2024-03-29 01:25:03,367: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:03.450156194Z [2024-03-29 01:25:03,449: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:25:03.456115020Z [2024-03-29 01:25:03,455: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:03.484460969Z [2024-03-29 01:25:03,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:25:03.486355934Z [2024-03-29 01:25:03,486: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:03.486680694Z [2024-03-29 01:25:03,486: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:03.486966348Z [2024-03-29 01:25:03,486: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:03.487201168Z [2024-03-29 01:25:03,487: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:25:03.487655767Z [2024-03-29 01:25:03,487: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:25:03.487893035Z [2024-03-29 01:25:03,487: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:03.609764952Z [2024-03-29 01:25:03,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:04.220355092Z [2024-03-29 01:25:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6492ac23-d577-475d-89de-deb1ef75f1d8] succeeded in 3.0917905720007184s: None 2024-03-29T01:25:04.481045515Z [2024-03-29 01:25:04,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ae27cc2-bc81-4d20-8448-b78ab74bf62f] received 2024-03-29T01:25:04.490484281Z [2024-03-29 01:25:04,490: INFO/ForkPoolWorker-1] [4ae27cc2-bc81-4d20-8448-b78ab74bf62f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:04.924178069Z [2024-03-29 01:25:04,919: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:25:05.432338746Z [2024-03-29 01:25:05,429: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9e4dd2d-5551-4e1b-9110-42de980bc3e1] succeeded in 4.311452833000658s: None 2024-03-29T01:25:05.538182315Z [2024-03-29 01:25:05,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10f4a5e4-fff7-4970-a8dd-4659e4478c15] succeeded in 4.418158145999769s: None 2024-03-29T01:25:06.728769109Z [2024-03-29 01:25:06,728: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:25:06.732703668Z [2024-03-29 01:25:06,732: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:06.760764800Z [2024-03-29 01:25:06,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:25:06.762569065Z [2024-03-29 01:25:06,762: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:06.762737988Z [2024-03-29 01:25:06,762: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:06.762955094Z [2024-03-29 01:25:06,762: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:06.763126364Z [2024-03-29 01:25:06,762: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:25:06.763582983Z [2024-03-29 01:25:06,763: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:25:06.763712472Z [2024-03-29 01:25:06,763: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:06.930218963Z [2024-03-29 01:25:06,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:07.943977038Z [2024-03-29 01:25:07,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ae27cc2-bc81-4d20-8448-b78ab74bf62f] succeeded in 3.4609527239999807s: None 2024-03-29T01:25:08.344676254Z [2024-03-29 01:25:08,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de909c6f-3e77-4e83-b750-1b763dce119a] received 2024-03-29T01:25:08.371467994Z [2024-03-29 01:25:08,371: INFO/ForkPoolWorker-15] [de909c6f-3e77-4e83-b750-1b763dce119a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:25:08.713149112Z [2024-03-29 01:25:08,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:25:09.894403113Z [2024-03-29 01:25:09,893: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:25:09.898562220Z [2024-03-29 01:25:09,897: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:09.930000755Z [2024-03-29 01:25:09,929: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:25:09.932227028Z [2024-03-29 01:25:09,931: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:09.932378039Z [2024-03-29 01:25:09,932: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:09.932643786Z [2024-03-29 01:25:09,932: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:09.932841681Z [2024-03-29 01:25:09,932: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:25:09.933687377Z [2024-03-29 01:25:09,933: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:25:09.933808251Z [2024-03-29 01:25:09,933: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:10.044133769Z [2024-03-29 01:25:10,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:10.608725138Z [2024-03-29 01:25:10,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de909c6f-3e77-4e83-b750-1b763dce119a] succeeded in 2.2607156479998594s: None 2024-03-29T01:25:11.091409291Z [2024-03-29 01:25:11,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f016093-876c-4164-8d38-4fba4145dbc3] received 2024-03-29T01:25:11.098853138Z [2024-03-29 01:25:11,098: INFO/ForkPoolWorker-15] [8f016093-876c-4164-8d38-4fba4145dbc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:11.392248684Z [2024-03-29 01:25:11,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:25:12.590529844Z [2024-03-29 01:25:12,589: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:25:12.594823480Z [2024-03-29 01:25:12,594: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:25:12.617899885Z [2024-03-29 01:25:12,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:25:12.619334262Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:25:12.619349300Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:25:12.619502413Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:25:12.619508208Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:25:12.619869842Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:25:12.619894124Z [2024-03-29 01:25:12,619: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:25:12.707117872Z [2024-03-29 01:25:12,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:25:13.312022438Z [2024-03-29 01:25:13,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f016093-876c-4164-8d38-4fba4145dbc3] succeeded in 2.218072893000681s: None 2024-03-29T01:26:00.392313987Z [2024-03-29 01:26:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bce3ffe0-8bc4-48cc-ba8e-3db2e4e97c53] received 2024-03-29T01:26:00.397945240Z [2024-03-29 01:26:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76ba16cd-6a4f-432c-9566-de80a81a1b88] received 2024-03-29T01:26:00.400875820Z [2024-03-29 01:26:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f912de-0cff-4809-8e70-8c90b14de89d] received 2024-03-29T01:26:00.403994313Z [2024-03-29 01:26:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[374ba75f-577f-4d2e-a990-ac3f0251d50a] received 2024-03-29T01:26:00.414332423Z [2024-03-29 01:26:00,414: INFO/ForkPoolWorker-16] [76ba16cd-6a4f-432c-9566-de80a81a1b88] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:26:00.414391443Z [2024-03-29 01:26:00,414: INFO/ForkPoolWorker-1] [e0f912de-0cff-4809-8e70-8c90b14de89d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:26:00.416160836Z [2024-03-29 01:26:00,415: INFO/ForkPoolWorker-2] [374ba75f-577f-4d2e-a990-ac3f0251d50a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:26:00.416343243Z [2024-03-29 01:26:00,415: INFO/ForkPoolWorker-15] [bce3ffe0-8bc4-48cc-ba8e-3db2e4e97c53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:26:00.726063937Z [2024-03-29 01:26:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:26:01.048479409Z [2024-03-29 01:26:01,043: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:26:01.082589468Z [2024-03-29 01:26:01,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:26:01.137240896Z [2024-03-29 01:26:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:26:01.474168383Z [2024-03-29 01:26:01,473: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:26:01.478660759Z [2024-03-29 01:26:01,478: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:26:01.537483084Z [2024-03-29 01:26:01,537: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:26:01.540111226Z [2024-03-29 01:26:01,539: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:26:01.540279508Z [2024-03-29 01:26:01,539: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:26:01.540408966Z [2024-03-29 01:26:01,540: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:26:01.540841257Z [2024-03-29 01:26:01,540: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:26:01.674992869Z [2024-03-29 01:26:01,674: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:26:01.683176159Z [2024-03-29 01:26:01,682: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:26:02.599061247Z [2024-03-29 01:26:02,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76ba16cd-6a4f-432c-9566-de80a81a1b88] succeeded in 2.1992221350001273s: None 2024-03-29T01:26:02.734910216Z [2024-03-29 01:26:02,734: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:26:02.738385158Z [2024-03-29 01:26:02,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:26:02.775634124Z [2024-03-29 01:26:02,775: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:26:02.777980208Z [2024-03-29 01:26:02,777: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:26:02.777999261Z [2024-03-29 01:26:02,777: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:26:02.778138162Z [2024-03-29 01:26:02,777: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:26:02.778153561Z [2024-03-29 01:26:02,778: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:26:02.778401570Z [2024-03-29 01:26:02,778: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:26:02.778415205Z [2024-03-29 01:26:02,778: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:26:02.836749366Z [2024-03-29 01:26:02,836: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[374ba75f-577f-4d2e-a990-ac3f0251d50a] succeeded in 2.430690549999781s: None 2024-03-29T01:26:02.876546873Z [2024-03-29 01:26:02,875: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:26:02.885018034Z [2024-03-29 01:26:02,884: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:26:02.887746457Z [2024-03-29 01:26:02,887: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:26:02.921782932Z [2024-03-29 01:26:02,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:26:02.923301401Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:26:02.923330886Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:26:02.923526332Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:26:02.923591206Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:26:02.923908101Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:26:02.923922973Z [2024-03-29 01:26:02,923: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:26:03.066305936Z [2024-03-29 01:26:03,065: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:26:04.873707644Z [2024-03-29 01:26:04,873: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0f912de-0cff-4809-8e70-8c90b14de89d] succeeded in 4.469404628999655s: None 2024-03-29T01:26:06.715950220Z [2024-03-29 01:26:06,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bce3ffe0-8bc4-48cc-ba8e-3db2e4e97c53] succeeded in 6.3210283879998315s: None 2024-03-29T01:27:00.847788662Z [2024-03-29 01:27:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[754d7ce1-fe77-445c-a9e7-320dbd993630] received 2024-03-29T01:27:00.856577826Z [2024-03-29 01:27:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae4f1822-4af1-43c1-862d-28b1d1006ec3] received 2024-03-29T01:27:00.858660695Z [2024-03-29 01:27:00,858: INFO/ForkPoolWorker-15] [754d7ce1-fe77-445c-a9e7-320dbd993630] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:27:00.863849408Z [2024-03-29 01:27:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[218256ec-4ceb-46ef-96a9-04c29b94c601] received 2024-03-29T01:27:00.901944488Z [2024-03-29 01:27:00,901: INFO/ForkPoolWorker-16] [ae4f1822-4af1-43c1-862d-28b1d1006ec3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:27:00.902594760Z [2024-03-29 01:27:00,902: INFO/ForkPoolWorker-1] [218256ec-4ceb-46ef-96a9-04c29b94c601] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:27:01.232361271Z [2024-03-29 01:27:01,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:27:01.326126260Z [2024-03-29 01:27:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:27:01.394982896Z [2024-03-29 01:27:01,389: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:27:01.512269405Z [2024-03-29 01:27:01,511: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:27:01.517060414Z [2024-03-29 01:27:01,516: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:27:01.550671747Z [2024-03-29 01:27:01,550: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:27:01.552017041Z [2024-03-29 01:27:01,551: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:27:01.552154159Z [2024-03-29 01:27:01,551: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:27:01.552264946Z [2024-03-29 01:27:01,552: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:27:01.552559487Z [2024-03-29 01:27:01,552: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:27:01.687833226Z [2024-03-29 01:27:01,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:27:02.387711719Z [2024-03-29 01:27:02,387: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae4f1822-4af1-43c1-862d-28b1d1006ec3] succeeded in 1.5273658280002564s: None 2024-03-29T01:27:02.834549698Z [2024-03-29 01:27:02,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:27:02.839120315Z [2024-03-29 01:27:02,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:27:02.860830986Z [2024-03-29 01:27:02,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:27:02.862207305Z [2024-03-29 01:27:02,861: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:27:02.862242401Z [2024-03-29 01:27:02,862: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:27:02.862434441Z [2024-03-29 01:27:02,862: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:27:02.862576582Z [2024-03-29 01:27:02,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:27:02.862950390Z [2024-03-29 01:27:02,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:27:02.863155069Z [2024-03-29 01:27:02,862: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:27:02.886000693Z [2024-03-29 01:27:02,885: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:27:02.889881825Z [2024-03-29 01:27:02,889: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:27:02.917572083Z [2024-03-29 01:27:02,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:27:02.919835178Z [2024-03-29 01:27:02,919: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:27:02.920117720Z [2024-03-29 01:27:02,919: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:27:02.920463031Z [2024-03-29 01:27:02,920: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:27:02.920847041Z [2024-03-29 01:27:02,920: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:27:02.921402370Z [2024-03-29 01:27:02,921: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:27:02.922282143Z [2024-03-29 01:27:02,921: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:27:02.953317860Z [2024-03-29 01:27:02,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:27:03.056179446Z [2024-03-29 01:27:03,055: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:27:05.547781689Z [2024-03-29 01:27:05,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[218256ec-4ceb-46ef-96a9-04c29b94c601] succeeded in 4.680873463000353s: None 2024-03-29T01:27:06.166076494Z [2024-03-29 01:27:06,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[754d7ce1-fe77-445c-a9e7-320dbd993630] succeeded in 5.314183604000391s: None 2024-03-29T01:28:01.292553310Z [2024-03-29 01:28:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a44f88d-af8e-4853-9668-fa36f4d75713] received 2024-03-29T01:28:01.294698673Z [2024-03-29 01:28:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e53fa75b-02a3-4f06-9cce-bc78c8c9da3c] received 2024-03-29T01:28:01.296685665Z [2024-03-29 01:28:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3882ea7-4f74-4021-9c6d-7743f3046e3b] received 2024-03-29T01:28:01.298318386Z [2024-03-29 01:28:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0956618b-a509-4a36-8094-b49a4198d5bd] received 2024-03-29T01:28:01.306167695Z [2024-03-29 01:28:01,305: INFO/ForkPoolWorker-16] [e53fa75b-02a3-4f06-9cce-bc78c8c9da3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:28:01.311796581Z [2024-03-29 01:28:01,311: INFO/ForkPoolWorker-15] [0a44f88d-af8e-4853-9668-fa36f4d75713] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:28:01.312322048Z [2024-03-29 01:28:01,312: INFO/ForkPoolWorker-1] [d3882ea7-4f74-4021-9c6d-7743f3046e3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:28:01.318129221Z [2024-03-29 01:28:01,317: INFO/ForkPoolWorker-2] [0956618b-a509-4a36-8094-b49a4198d5bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:28:01.683608030Z [2024-03-29 01:28:01,680: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:28:01.844916611Z [2024-03-29 01:28:01,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:28:01.891535541Z [2024-03-29 01:28:01,890: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:28:01.896536356Z [2024-03-29 01:28:01,896: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:28:01.922414850Z [2024-03-29 01:28:01,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:28:01.931489847Z [2024-03-29 01:28:01,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:28:01.933098713Z [2024-03-29 01:28:01,932: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:28:01.933257846Z [2024-03-29 01:28:01,933: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:28:01.933383261Z [2024-03-29 01:28:01,933: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:28:01.933610891Z [2024-03-29 01:28:01,933: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:28:02.053333855Z [2024-03-29 01:28:02,052: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:28:02.114302736Z [2024-03-29 01:28:02,109: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:28:02.223498035Z [2024-03-29 01:28:02,223: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:28:02.932447062Z [2024-03-29 01:28:02,931: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3882ea7-4f74-4021-9c6d-7743f3046e3b] succeeded in 1.6317670309999812s: None 2024-03-29T01:28:03.146534112Z [2024-03-29 01:28:03,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e53fa75b-02a3-4f06-9cce-bc78c8c9da3c] succeeded in 1.8465016560003278s: None 2024-03-29T01:28:03.674577878Z [2024-03-29 01:28:03,674: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:28:03.677813936Z [2024-03-29 01:28:03,677: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:28:03.699642298Z [2024-03-29 01:28:03,699: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:28:03.703938572Z [2024-03-29 01:28:03,703: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:28:03.704079292Z [2024-03-29 01:28:03,703: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:28:03.704457556Z [2024-03-29 01:28:03,704: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:28:03.704661077Z [2024-03-29 01:28:03,704: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:28:03.705170855Z [2024-03-29 01:28:03,704: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:28:03.705450368Z [2024-03-29 01:28:03,705: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:28:03.753607506Z [2024-03-29 01:28:03,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:28:03.757522245Z [2024-03-29 01:28:03,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:28:03.782855938Z [2024-03-29 01:28:03,781: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:28:03.796187184Z [2024-03-29 01:28:03,795: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:28:03.796220946Z [2024-03-29 01:28:03,796: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:28:03.796314727Z [2024-03-29 01:28:03,796: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:28:03.796364238Z [2024-03-29 01:28:03,796: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:28:03.796733025Z [2024-03-29 01:28:03,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:28:03.796796453Z [2024-03-29 01:28:03,796: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:28:03.833819717Z [2024-03-29 01:28:03,833: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:28:03.888403079Z [2024-03-29 01:28:03,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:28:06.463682818Z [2024-03-29 01:28:06,463: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0956618b-a509-4a36-8094-b49a4198d5bd] succeeded in 5.162412700999994s: None 2024-03-29T01:28:06.949371263Z [2024-03-29 01:28:06,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a44f88d-af8e-4853-9668-fa36f4d75713] succeeded in 5.652933915000176s: None 2024-03-29T01:29:00.682539901Z [2024-03-29 01:29:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe5db056-f857-4d0e-83b7-e7e3a0479f78] received 2024-03-29T01:29:00.693592773Z [2024-03-29 01:29:00,693: INFO/ForkPoolWorker-15] [fe5db056-f857-4d0e-83b7-e7e3a0479f78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:29:00.700555501Z [2024-03-29 01:29:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eacb687a-445d-4948-a359-f807410cdd58] received 2024-03-29T01:29:00.710730871Z [2024-03-29 01:29:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de342f1d-92ff-4aaf-98bc-c35371ef9745] received 2024-03-29T01:29:00.712104809Z [2024-03-29 01:29:00,711: INFO/ForkPoolWorker-16] [eacb687a-445d-4948-a359-f807410cdd58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:29:00.738670342Z [2024-03-29 01:29:00,738: INFO/ForkPoolWorker-1] [de342f1d-92ff-4aaf-98bc-c35371ef9745] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:29:01.114886029Z [2024-03-29 01:29:01,110: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:29:01.205574723Z [2024-03-29 01:29:01,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:29:01.217388234Z [2024-03-29 01:29:01,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:29:01.280236041Z [2024-03-29 01:29:01,279: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:29:01.284494476Z [2024-03-29 01:29:01,284: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:29:01.317773352Z [2024-03-29 01:29:01,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:29:01.319272707Z [2024-03-29 01:29:01,318: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:29:01.319371684Z [2024-03-29 01:29:01,319: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:29:01.319473471Z [2024-03-29 01:29:01,319: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:29:01.319806977Z [2024-03-29 01:29:01,319: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:29:01.455787409Z [2024-03-29 01:29:01,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:29:02.363708072Z [2024-03-29 01:29:02,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eacb687a-445d-4948-a359-f807410cdd58] succeeded in 1.6608410809994893s: None 2024-03-29T01:29:02.771380196Z [2024-03-29 01:29:02,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:29:02.775450864Z [2024-03-29 01:29:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:29:02.835663760Z [2024-03-29 01:29:02,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:29:02.839881164Z [2024-03-29 01:29:02,839: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:29:02.840213434Z [2024-03-29 01:29:02,840: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:29:02.840487954Z [2024-03-29 01:29:02,840: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:29:02.840637124Z [2024-03-29 01:29:02,840: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:29:02.840995683Z [2024-03-29 01:29:02,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:29:02.841130133Z [2024-03-29 01:29:02,840: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:29:02.957757267Z [2024-03-29 01:29:02,957: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:29:03.048944405Z [2024-03-29 01:29:03,048: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:29:03.052467611Z [2024-03-29 01:29:03,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:29:03.084968047Z [2024-03-29 01:29:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:29:03.086841526Z [2024-03-29 01:29:03,086: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:29:03.087055537Z [2024-03-29 01:29:03,086: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:29:03.087278931Z [2024-03-29 01:29:03,087: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:29:03.087452353Z [2024-03-29 01:29:03,087: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:29:03.087843228Z [2024-03-29 01:29:03,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:29:03.087971924Z [2024-03-29 01:29:03,087: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:29:03.194543110Z [2024-03-29 01:29:03,194: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:29:04.889164614Z [2024-03-29 01:29:04,888: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe5db056-f857-4d0e-83b7-e7e3a0479f78] succeeded in 4.204454174999228s: None 2024-03-29T01:29:05.530952453Z [2024-03-29 01:29:05,530: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de342f1d-92ff-4aaf-98bc-c35371ef9745] succeeded in 4.8181504920003135s: None 2024-03-29T01:30:01.316110633Z [2024-03-29 01:30:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cb1535f-4f78-48bf-bc4c-2da1e98437d1] received 2024-03-29T01:30:01.318339704Z [2024-03-29 01:30:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86753bac-b2a4-44d7-96a1-2e0a2e034b62] received 2024-03-29T01:30:01.329126246Z [2024-03-29 01:30:01,328: INFO/ForkPoolWorker-16] [86753bac-b2a4-44d7-96a1-2e0a2e034b62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:01.333216892Z [2024-03-29 01:30:01,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3afb3c20-333b-4ef4-a7d8-579555077ff4] received 2024-03-29T01:30:01.333243068Z [2024-03-29 01:30:01,332: INFO/ForkPoolWorker-15] [4cb1535f-4f78-48bf-bc4c-2da1e98437d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:30:01.344904353Z [2024-03-29 01:30:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[384d9006-dd64-4db8-8117-db5633c59a6d] received 2024-03-29T01:30:01.345861263Z [2024-03-29 01:30:01,345: INFO/ForkPoolWorker-1] [3afb3c20-333b-4ef4-a7d8-579555077ff4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:30:01.353567228Z [2024-03-29 01:30:01,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf07588f-acdf-4a72-b22f-22bdd9d69508] received 2024-03-29T01:30:01.371887621Z [2024-03-29 01:30:01,371: INFO/ForkPoolWorker-2] [384d9006-dd64-4db8-8117-db5633c59a6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:30:01.381023388Z [2024-03-29 01:30:01,380: INFO/ForkPoolWorker-3] [bf07588f-acdf-4a72-b22f-22bdd9d69508] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:30:01.963920471Z [2024-03-29 01:30:01,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:30:02.073929845Z [2024-03-29 01:30:02,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:30:02.160548603Z [2024-03-29 01:30:02,147: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:30:02.164191058Z [2024-03-29 01:30:02,155: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:30:02.173285836Z [2024-03-29 01:30:02,168: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:30:02.269469933Z [2024-03-29 01:30:02,268: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:30:02.273862060Z [2024-03-29 01:30:02,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:02.315845586Z [2024-03-29 01:30:02,315: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:30:02.317756429Z [2024-03-29 01:30:02,317: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:30:02.317908354Z [2024-03-29 01:30:02,317: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:30:02.318008012Z [2024-03-29 01:30:02,317: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:30:02.318408916Z [2024-03-29 01:30:02,318: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:30:02.441982099Z [2024-03-29 01:30:02,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:02.646057924Z [2024-03-29 01:30:02,645: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:03.477937687Z [2024-03-29 01:30:03,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cb1535f-4f78-48bf-bc4c-2da1e98437d1] succeeded in 2.157893996999519s: None 2024-03-29T01:30:03.684642978Z [2024-03-29 01:30:03,684: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bf07588f-acdf-4a72-b22f-22bdd9d69508] succeeded in 2.3222398150001027s: None 2024-03-29T01:30:04.300159699Z [2024-03-29 01:30:04,221: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:30:04.300189648Z [2024-03-29 01:30:04,227: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:04.300194045Z [2024-03-29 01:30:04,291: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:30:04.300197821Z [2024-03-29 01:30:04,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:04.342130299Z [2024-03-29 01:30:04,341: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:30:04.345479471Z [2024-03-29 01:30:04,345: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:04.345669397Z [2024-03-29 01:30:04,345: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:04.345979832Z [2024-03-29 01:30:04,345: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:04.346164790Z [2024-03-29 01:30:04,345: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:30:04.346740239Z [2024-03-29 01:30:04,346: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:30:04.346965709Z [2024-03-29 01:30:04,346: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:04.347712066Z [2024-03-29 01:30:04,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:30:04.353954516Z [2024-03-29 01:30:04,353: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:04.360455563Z [2024-03-29 01:30:04,353: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:04.360874214Z [2024-03-29 01:30:04,360: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:04.361076504Z [2024-03-29 01:30:04,360: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:30:04.361668341Z [2024-03-29 01:30:04,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:30:04.361832332Z [2024-03-29 01:30:04,361: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:04.524949869Z [2024-03-29 01:30:04,524: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:04.605771137Z [2024-03-29 01:30:04,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:04.835954312Z [2024-03-29 01:30:04,835: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:30:04.843524273Z [2024-03-29 01:30:04,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:04.895306410Z [2024-03-29 01:30:04,895: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:30:04.899760250Z [2024-03-29 01:30:04,899: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:04.899779923Z [2024-03-29 01:30:04,899: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:04.899974485Z [2024-03-29 01:30:04,899: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:04.900046494Z [2024-03-29 01:30:04,899: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:30:04.900365688Z [2024-03-29 01:30:04,900: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:30:04.900439214Z [2024-03-29 01:30:04,900: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:05.077159727Z [2024-03-29 01:30:05,076: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:05.775408051Z [2024-03-29 01:30:05,770: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86753bac-b2a4-44d7-96a1-2e0a2e034b62] succeeded in 4.4498999209999965s: None 2024-03-29T01:30:06.038542763Z [2024-03-29 01:30:06,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1620e190-3f6d-4693-830b-2817a5769497] received 2024-03-29T01:30:06.046625303Z [2024-03-29 01:30:06,042: INFO/ForkPoolWorker-15] [1620e190-3f6d-4693-830b-2817a5769497] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:06.490527186Z [2024-03-29 01:30:06,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:30:07.006671386Z [2024-03-29 01:30:07,006: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[384d9006-dd64-4db8-8117-db5633c59a6d] succeeded in 5.651846767000279s: None 2024-03-29T01:30:08.458773589Z [2024-03-29 01:30:08,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:30:08.469466007Z [2024-03-29 01:30:08,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:08.547586366Z [2024-03-29 01:30:08,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:30:08.551199958Z [2024-03-29 01:30:08,550: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:08.551274747Z [2024-03-29 01:30:08,551: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:08.551308424Z [2024-03-29 01:30:08,551: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:08.551378468Z [2024-03-29 01:30:08,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:30:08.551591340Z [2024-03-29 01:30:08,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:30:08.551647418Z [2024-03-29 01:30:08,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:08.569783060Z [2024-03-29 01:30:08,569: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3afb3c20-333b-4ef4-a7d8-579555077ff4] succeeded in 7.229656743000305s: None 2024-03-29T01:30:08.646908092Z [2024-03-29 01:30:08,646: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:09.381555240Z [2024-03-29 01:30:09,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1620e190-3f6d-4693-830b-2817a5769497] succeeded in 3.349453159999939s: None 2024-03-29T01:30:09.460395103Z [2024-03-29 01:30:09,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8573525c-0e75-4823-ac40-5bec8a3b8d65] received 2024-03-29T01:30:09.467364098Z [2024-03-29 01:30:09,467: INFO/ForkPoolWorker-15] [8573525c-0e75-4823-ac40-5bec8a3b8d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:30:09.742808696Z [2024-03-29 01:30:09,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:30:10.847361494Z [2024-03-29 01:30:10,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:30:10.850655175Z [2024-03-29 01:30:10,850: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:10.869581833Z [2024-03-29 01:30:10,869: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:30:10.871038450Z [2024-03-29 01:30:10,870: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:10.871079151Z [2024-03-29 01:30:10,870: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:10.871177064Z [2024-03-29 01:30:10,870: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:10.871190132Z [2024-03-29 01:30:10,871: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:30:10.871435247Z [2024-03-29 01:30:10,871: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:30:10.871442768Z [2024-03-29 01:30:10,871: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:10.955542201Z [2024-03-29 01:30:10,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:11.489211837Z [2024-03-29 01:30:11,488: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8573525c-0e75-4823-ac40-5bec8a3b8d65] succeeded in 2.0265344159997767s: None 2024-03-29T01:30:11.826677331Z [2024-03-29 01:30:11,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b8a5458-3b0f-4a6e-84e6-e7c839a7a0a9] received 2024-03-29T01:30:11.836021470Z [2024-03-29 01:30:11,835: INFO/ForkPoolWorker-15] [1b8a5458-3b0f-4a6e-84e6-e7c839a7a0a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:12.116070272Z [2024-03-29 01:30:12,113: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:30:13.242504129Z [2024-03-29 01:30:13,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:30:13.249458435Z [2024-03-29 01:30:13,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:30:13.270594618Z [2024-03-29 01:30:13,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:30:13.272003422Z [2024-03-29 01:30:13,271: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:30:13.272022555Z [2024-03-29 01:30:13,271: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:30:13.272061927Z [2024-03-29 01:30:13,271: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:30:13.272067088Z [2024-03-29 01:30:13,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:30:13.272346149Z [2024-03-29 01:30:13,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:30:13.272351456Z [2024-03-29 01:30:13,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:30:13.366032199Z [2024-03-29 01:30:13,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:30:13.949829446Z [2024-03-29 01:30:13,949: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b8a5458-3b0f-4a6e-84e6-e7c839a7a0a9] succeeded in 2.123493889999736s: None 2024-03-29T01:31:01.173962148Z [2024-03-29 01:31:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54f7b513-193e-4e57-81ef-b73386f14723] received 2024-03-29T01:31:01.176125962Z [2024-03-29 01:31:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c15632f3-0de5-429b-9a53-7955f0c14141] received 2024-03-29T01:31:01.181027259Z [2024-03-29 01:31:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f81efef-e9b5-49e0-928b-8b4512d1ace3] received 2024-03-29T01:31:01.185100537Z [2024-03-29 01:31:01,184: INFO/ForkPoolWorker-16] [c15632f3-0de5-429b-9a53-7955f0c14141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:31:01.189890700Z [2024-03-29 01:31:01,189: INFO/ForkPoolWorker-1] [4f81efef-e9b5-49e0-928b-8b4512d1ace3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:31:01.190528681Z [2024-03-29 01:31:01,190: INFO/ForkPoolWorker-15] [54f7b513-193e-4e57-81ef-b73386f14723] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:31:01.521672346Z [2024-03-29 01:31:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:31:01.522070818Z [2024-03-29 01:31:01,518: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:31:01.522081442Z [2024-03-29 01:31:01,518: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:31:01.720416822Z [2024-03-29 01:31:01,719: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:31:01.724517177Z [2024-03-29 01:31:01,724: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:31:01.752621731Z [2024-03-29 01:31:01,752: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:31:01.754731873Z [2024-03-29 01:31:01,754: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:31:01.754833206Z [2024-03-29 01:31:01,754: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:31:01.754875684Z [2024-03-29 01:31:01,754: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:31:01.755210330Z [2024-03-29 01:31:01,755: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:31:01.864877836Z [2024-03-29 01:31:01,864: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:31:02.671035693Z [2024-03-29 01:31:02,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54f7b513-193e-4e57-81ef-b73386f14723] succeeded in 1.4934200970001257s: None 2024-03-29T01:31:02.894495880Z [2024-03-29 01:31:02,894: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:31:02.898124200Z [2024-03-29 01:31:02,897: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:31:02.921783283Z [2024-03-29 01:31:02,921: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:31:02.923270909Z [2024-03-29 01:31:02,922: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:31:02.923430276Z [2024-03-29 01:31:02,923: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:31:02.923657577Z [2024-03-29 01:31:02,923: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:31:02.923882416Z [2024-03-29 01:31:02,923: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:31:02.924429269Z [2024-03-29 01:31:02,924: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:31:02.924641048Z [2024-03-29 01:31:02,924: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:31:03.074301485Z [2024-03-29 01:31:03,073: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:31:03.134920233Z [2024-03-29 01:31:03,134: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:31:03.138969025Z [2024-03-29 01:31:03,138: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:31:03.164983400Z [2024-03-29 01:31:03,164: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:31:03.166824982Z [2024-03-29 01:31:03,166: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:31:03.166903230Z [2024-03-29 01:31:03,166: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:31:03.167359833Z [2024-03-29 01:31:03,166: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:31:03.167413933Z [2024-03-29 01:31:03,167: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:31:03.167762015Z [2024-03-29 01:31:03,167: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:31:03.167867544Z [2024-03-29 01:31:03,167: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:31:03.279176908Z [2024-03-29 01:31:03,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:31:04.930213047Z [2024-03-29 01:31:04,929: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f81efef-e9b5-49e0-928b-8b4512d1ace3] succeeded in 3.7475048429996605s: None 2024-03-29T01:31:05.534960137Z [2024-03-29 01:31:05,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c15632f3-0de5-429b-9a53-7955f0c14141] succeeded in 4.357565788999636s: None 2024-03-29T01:32:01.068819930Z [2024-03-29 01:32:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67945f2b-4d16-4fb8-b916-be1458ee248c] received 2024-03-29T01:32:01.071694581Z [2024-03-29 01:32:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d1dce4d-9099-45e6-80a5-c19689e88f06] received 2024-03-29T01:32:01.082232661Z [2024-03-29 01:32:01,081: INFO/ForkPoolWorker-16] [7d1dce4d-9099-45e6-80a5-c19689e88f06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:32:01.091159388Z [2024-03-29 01:32:01,090: INFO/ForkPoolWorker-15] [67945f2b-4d16-4fb8-b916-be1458ee248c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:32:01.098718472Z [2024-03-29 01:32:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d52b2e48-5b8c-44ff-b80a-657e7fe7439b] received 2024-03-29T01:32:01.101567380Z [2024-03-29 01:32:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b559dc-677e-44d2-a5f4-6cca41961fe0] received 2024-03-29T01:32:01.114797095Z [2024-03-29 01:32:01,114: INFO/ForkPoolWorker-1] [d52b2e48-5b8c-44ff-b80a-657e7fe7439b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:32:01.116413578Z [2024-03-29 01:32:01,116: INFO/ForkPoolWorker-2] [b0b559dc-677e-44d2-a5f4-6cca41961fe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:32:01.510734672Z [2024-03-29 01:32:01,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:32:01.560639331Z [2024-03-29 01:32:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:32:01.603630814Z [2024-03-29 01:32:01,592: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:32:01.735607716Z [2024-03-29 01:32:01,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:32:01.869393021Z [2024-03-29 01:32:01,868: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:32:01.882122881Z [2024-03-29 01:32:01,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:32:01.882175471Z [2024-03-29 01:32:01,878: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:32:01.932953484Z [2024-03-29 01:32:01,932: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:32:01.939656669Z [2024-03-29 01:32:01,939: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:32:01.939799435Z [2024-03-29 01:32:01,939: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:32:01.939873062Z [2024-03-29 01:32:01,939: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:32:01.940132791Z [2024-03-29 01:32:01,940: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:32:02.073609737Z [2024-03-29 01:32:02,073: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:32:02.736783805Z [2024-03-29 01:32:02,736: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67945f2b-4d16-4fb8-b916-be1458ee248c] succeeded in 1.6612426389992834s: None 2024-03-29T01:32:02.892155269Z [2024-03-29 01:32:02,891: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b0b559dc-677e-44d2-a5f4-6cca41961fe0] succeeded in 1.7874261200004185s: None 2024-03-29T01:32:02.946555761Z [2024-03-29 01:32:02,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:32:02.950440666Z [2024-03-29 01:32:02,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:32:02.968793566Z [2024-03-29 01:32:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:32:02.970104367Z [2024-03-29 01:32:02,969: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:32:02.970162142Z [2024-03-29 01:32:02,970: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:32:02.970362184Z [2024-03-29 01:32:02,970: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:32:02.970433237Z [2024-03-29 01:32:02,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:32:02.970870862Z [2024-03-29 01:32:02,970: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:32:02.970920861Z [2024-03-29 01:32:02,970: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:32:03.064152798Z [2024-03-29 01:32:03,063: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:32:03.231114114Z [2024-03-29 01:32:03,230: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:32:03.234529907Z [2024-03-29 01:32:03,233: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:32:03.263505311Z [2024-03-29 01:32:03,263: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:32:03.265241613Z [2024-03-29 01:32:03,264: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:32:03.265260152Z [2024-03-29 01:32:03,265: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:32:03.265500572Z [2024-03-29 01:32:03,265: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:32:03.265555541Z [2024-03-29 01:32:03,265: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:32:03.265968131Z [2024-03-29 01:32:03,265: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:32:03.266151814Z [2024-03-29 01:32:03,265: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:32:03.381027996Z [2024-03-29 01:32:03,380: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:32:04.749408554Z [2024-03-29 01:32:04,748: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d1dce4d-9099-45e6-80a5-c19689e88f06] succeeded in 3.676446207000481s: None 2024-03-29T01:32:05.171741001Z [2024-03-29 01:32:05,171: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d52b2e48-5b8c-44ff-b80a-657e7fe7439b] succeeded in 4.071061296000153s: None 2024-03-29T01:33:00.730403731Z [2024-03-29 01:33:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[addf268b-7a90-4128-b5ef-177f6f8e698d] received 2024-03-29T01:33:00.733243631Z [2024-03-29 01:33:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1054a898-324e-4ddf-8dbf-b4ae7304bfff] received 2024-03-29T01:33:00.739372864Z [2024-03-29 01:33:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e73a894-5287-4765-b963-864dde68db62] received 2024-03-29T01:33:00.744758276Z [2024-03-29 01:33:00,744: INFO/ForkPoolWorker-15] [addf268b-7a90-4128-b5ef-177f6f8e698d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:33:00.756147080Z [2024-03-29 01:33:00,755: INFO/ForkPoolWorker-16] [1054a898-324e-4ddf-8dbf-b4ae7304bfff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:33:00.756613421Z [2024-03-29 01:33:00,756: INFO/ForkPoolWorker-1] [5e73a894-5287-4765-b963-864dde68db62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:33:01.080491836Z [2024-03-29 01:33:01,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:33:01.081881653Z [2024-03-29 01:33:01,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:33:01.148245419Z [2024-03-29 01:33:01,145: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:33:01.240801721Z [2024-03-29 01:33:01,240: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:33:01.245034836Z [2024-03-29 01:33:01,244: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:33:01.289320049Z [2024-03-29 01:33:01,289: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:33:01.293363687Z [2024-03-29 01:33:01,293: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:33:01.293682682Z [2024-03-29 01:33:01,293: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:33:01.293909081Z [2024-03-29 01:33:01,293: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:33:01.294389377Z [2024-03-29 01:33:01,294: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:33:01.392631735Z [2024-03-29 01:33:01,392: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:33:02.019813472Z [2024-03-29 01:33:02,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1054a898-324e-4ddf-8dbf-b4ae7304bfff] succeeded in 1.2834307940001963s: None 2024-03-29T01:33:02.316816986Z [2024-03-29 01:33:02,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:33:02.320530840Z [2024-03-29 01:33:02,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:33:02.342323595Z [2024-03-29 01:33:02,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:33:02.343970159Z [2024-03-29 01:33:02,343: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:33:02.344048451Z [2024-03-29 01:33:02,343: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:33:02.344105487Z [2024-03-29 01:33:02,343: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:33:02.344110866Z [2024-03-29 01:33:02,344: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:33:02.344333258Z [2024-03-29 01:33:02,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:33:02.344367904Z [2024-03-29 01:33:02,344: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:33:02.371587074Z [2024-03-29 01:33:02,371: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:33:02.374981506Z [2024-03-29 01:33:02,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:33:02.402304938Z [2024-03-29 01:33:02,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:33:02.404165148Z [2024-03-29 01:33:02,403: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:33:02.404246047Z [2024-03-29 01:33:02,404: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:33:02.404284880Z [2024-03-29 01:33:02,404: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:33:02.404363449Z [2024-03-29 01:33:02,404: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:33:02.404789935Z [2024-03-29 01:33:02,404: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:33:02.405044180Z [2024-03-29 01:33:02,404: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:33:02.438260027Z [2024-03-29 01:33:02,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:33:02.523876400Z [2024-03-29 01:33:02,523: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:33:04.443057086Z [2024-03-29 01:33:04,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[addf268b-7a90-4128-b5ef-177f6f8e698d] succeeded in 3.7105034320002233s: None 2024-03-29T01:33:04.453838744Z [2024-03-29 01:33:04,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e73a894-5287-4765-b963-864dde68db62] succeeded in 3.7124945539999317s: None 2024-03-29T01:34:00.477107504Z [2024-03-29 01:34:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3f46ea3-29c6-4d46-b40e-eaf31aeca7cc] received 2024-03-29T01:34:00.479553685Z [2024-03-29 01:34:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6616e2c2-1bb8-4497-a0d1-87b1fe8751a9] received 2024-03-29T01:34:00.485017944Z [2024-03-29 01:34:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e90eb153-2164-49e0-b24a-a084c76e2d94] received 2024-03-29T01:34:00.489224260Z [2024-03-29 01:34:00,488: INFO/ForkPoolWorker-15] [d3f46ea3-29c6-4d46-b40e-eaf31aeca7cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:34:00.491268095Z [2024-03-29 01:34:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c5c352b-7111-4451-a822-3cf0075fe963] received 2024-03-29T01:34:00.493164166Z [2024-03-29 01:34:00,492: INFO/ForkPoolWorker-16] [6616e2c2-1bb8-4497-a0d1-87b1fe8751a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:34:00.498681315Z [2024-03-29 01:34:00,498: INFO/ForkPoolWorker-1] [e90eb153-2164-49e0-b24a-a084c76e2d94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:34:00.503326807Z [2024-03-29 01:34:00,502: INFO/ForkPoolWorker-2] [0c5c352b-7111-4451-a822-3cf0075fe963] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:34:00.798040945Z [2024-03-29 01:34:00,794: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:34:00.842547297Z [2024-03-29 01:34:00,839: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:34:00.865083973Z [2024-03-29 01:34:00,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:34:00.936554024Z [2024-03-29 01:34:00,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:34:00.994721309Z [2024-03-29 01:34:00,994: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:34:00.999669447Z [2024-03-29 01:34:00,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:34:01.030742785Z [2024-03-29 01:34:01,030: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:34:01.032627258Z [2024-03-29 01:34:01,032: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:34:01.033095052Z [2024-03-29 01:34:01,032: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:34:01.033215299Z [2024-03-29 01:34:01,033: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:34:01.034805883Z [2024-03-29 01:34:01,034: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:34:01.148001103Z [2024-03-29 01:34:01,147: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:34:01.423240512Z [2024-03-29 01:34:01,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:34:01.941479361Z [2024-03-29 01:34:01,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6616e2c2-1bb8-4497-a0d1-87b1fe8751a9] succeeded in 1.458617215999766s: None 2024-03-29T01:34:02.009607997Z [2024-03-29 01:34:02,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3f46ea3-29c6-4d46-b40e-eaf31aeca7cc] succeeded in 1.5286583899996913s: None 2024-03-29T01:34:02.454615238Z [2024-03-29 01:34:02,454: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:34:02.458650172Z [2024-03-29 01:34:02,458: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:34:02.482519407Z [2024-03-29 01:34:02,482: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:34:02.485058478Z [2024-03-29 01:34:02,484: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:34:02.485267466Z [2024-03-29 01:34:02,484: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:34:02.485581922Z [2024-03-29 01:34:02,485: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:34:02.485732580Z [2024-03-29 01:34:02,485: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:34:02.486224726Z [2024-03-29 01:34:02,485: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:34:02.486494536Z [2024-03-29 01:34:02,486: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:34:02.549455136Z [2024-03-29 01:34:02,549: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:34:02.553155040Z [2024-03-29 01:34:02,552: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:34:02.577095779Z [2024-03-29 01:34:02,576: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:34:02.578309423Z [2024-03-29 01:34:02,578: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:34:02.578388637Z [2024-03-29 01:34:02,578: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:34:02.578664624Z [2024-03-29 01:34:02,578: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:34:02.578810654Z [2024-03-29 01:34:02,578: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:34:02.579206057Z [2024-03-29 01:34:02,578: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:34:02.579345633Z [2024-03-29 01:34:02,579: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:34:02.613885508Z [2024-03-29 01:34:02,613: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:34:02.682502958Z [2024-03-29 01:34:02,682: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:34:04.296068128Z [2024-03-29 01:34:04,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e90eb153-2164-49e0-b24a-a084c76e2d94] succeeded in 3.8082775730008507s: None 2024-03-29T01:34:04.594918359Z [2024-03-29 01:34:04,594: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c5c352b-7111-4451-a822-3cf0075fe963] succeeded in 4.0968839639999715s: None 2024-03-29T01:35:01.117892452Z [2024-03-29 01:35:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6b01163-ee1b-4510-b40f-1a6e764faa9b] received 2024-03-29T01:35:01.119895135Z [2024-03-29 01:35:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebec9ac9-6f0c-4488-aeb6-83b4481e85b0] received 2024-03-29T01:35:01.124266441Z [2024-03-29 01:35:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3077261a-0df7-4603-96bd-cc4e8c01ec4e] received 2024-03-29T01:35:01.128570470Z [2024-03-29 01:35:01,128: INFO/ForkPoolWorker-15] [e6b01163-ee1b-4510-b40f-1a6e764faa9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:01.132432795Z [2024-03-29 01:35:01,132: INFO/ForkPoolWorker-1] [3077261a-0df7-4603-96bd-cc4e8c01ec4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:35:01.133036885Z [2024-03-29 01:35:01,132: INFO/ForkPoolWorker-16] [ebec9ac9-6f0c-4488-aeb6-83b4481e85b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:35:01.136048646Z [2024-03-29 01:35:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c928bbb-eee7-40d4-a01f-93a2b844a8c7] received 2024-03-29T01:35:01.147314648Z [2024-03-29 01:35:01,146: INFO/ForkPoolWorker-2] [6c928bbb-eee7-40d4-a01f-93a2b844a8c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:35:01.448860100Z [2024-03-29 01:35:01,445: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:35:01.493076529Z [2024-03-29 01:35:01,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:35:01.493237221Z [2024-03-29 01:35:01,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:35:01.607578367Z [2024-03-29 01:35:01,599: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:35:01.661806525Z [2024-03-29 01:35:01,661: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:35:01.666424672Z [2024-03-29 01:35:01,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:01.696681915Z [2024-03-29 01:35:01,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:35:01.699597792Z [2024-03-29 01:35:01,699: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:35:01.699647843Z [2024-03-29 01:35:01,699: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:35:01.699778809Z [2024-03-29 01:35:01,699: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:35:01.700046240Z [2024-03-29 01:35:01,699: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:35:01.832038282Z [2024-03-29 01:35:01,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:02.602048782Z [2024-03-29 01:35:02,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebec9ac9-6f0c-4488-aeb6-83b4481e85b0] succeeded in 1.479069819999495s: None 2024-03-29T01:35:03.152350266Z [2024-03-29 01:35:03,151: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:35:03.159110631Z [2024-03-29 01:35:03,158: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:03.187924182Z [2024-03-29 01:35:03,187: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:35:03.191930940Z [2024-03-29 01:35:03,191: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:03.202512325Z [2024-03-29 01:35:03,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:35:03.204430175Z [2024-03-29 01:35:03,204: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:03.204666457Z [2024-03-29 01:35:03,204: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:03.204953114Z [2024-03-29 01:35:03,204: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:03.205181876Z [2024-03-29 01:35:03,204: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:35:03.205675634Z [2024-03-29 01:35:03,205: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:35:03.205878573Z [2024-03-29 01:35:03,205: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:03.237374804Z [2024-03-29 01:35:03,237: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:35:03.239417569Z [2024-03-29 01:35:03,239: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:03.239695894Z [2024-03-29 01:35:03,239: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:03.240368843Z [2024-03-29 01:35:03,240: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:03.240475385Z [2024-03-29 01:35:03,240: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:35:03.240869194Z [2024-03-29 01:35:03,240: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:35:03.241074253Z [2024-03-29 01:35:03,240: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:03.364918912Z [2024-03-29 01:35:03,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:03.375910266Z [2024-03-29 01:35:03,375: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:03.491447939Z [2024-03-29 01:35:03,490: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:35:03.497678089Z [2024-03-29 01:35:03,497: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:03.529981299Z [2024-03-29 01:35:03,529: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:35:03.532374334Z [2024-03-29 01:35:03,532: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:03.532760620Z [2024-03-29 01:35:03,532: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:03.533161750Z [2024-03-29 01:35:03,532: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:03.533379603Z [2024-03-29 01:35:03,533: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:35:03.533920447Z [2024-03-29 01:35:03,533: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:35:03.540908445Z [2024-03-29 01:35:03,533: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:03.697557292Z [2024-03-29 01:35:03,697: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:04.353419901Z [2024-03-29 01:35:04,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6b01163-ee1b-4510-b40f-1a6e764faa9b] succeeded in 3.2322309680002945s: None 2024-03-29T01:35:05.328216831Z [2024-03-29 01:35:05,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d50d66a-c0aa-46c7-b559-ce77d45d6d44] received 2024-03-29T01:35:05.346826218Z [2024-03-29 01:35:05,346: INFO/ForkPoolWorker-15] [1d50d66a-c0aa-46c7-b559-ce77d45d6d44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:05.700343564Z [2024-03-29 01:35:05,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:35:06.148906185Z [2024-03-29 01:35:06,148: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c928bbb-eee7-40d4-a01f-93a2b844a8c7] succeeded in 5.0111166480000975s: None 2024-03-29T01:35:06.169701918Z [2024-03-29 01:35:06,169: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3077261a-0df7-4603-96bd-cc4e8c01ec4e] succeeded in 5.043823036000504s: None 2024-03-29T01:35:07.339761473Z [2024-03-29 01:35:07,339: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:35:07.343641912Z [2024-03-29 01:35:07,343: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:07.419346256Z [2024-03-29 01:35:07,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:35:07.421801859Z [2024-03-29 01:35:07,421: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:07.422209769Z [2024-03-29 01:35:07,421: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:07.422684930Z [2024-03-29 01:35:07,422: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:07.422960466Z [2024-03-29 01:35:07,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:35:07.423851622Z [2024-03-29 01:35:07,423: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:35:07.424147201Z [2024-03-29 01:35:07,423: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:07.547862263Z [2024-03-29 01:35:07,547: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:08.295517782Z [2024-03-29 01:35:08,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d50d66a-c0aa-46c7-b559-ce77d45d6d44] succeeded in 2.9651978029996826s: None 2024-03-29T01:35:09.319717080Z [2024-03-29 01:35:09,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b678594-f929-4e14-8cf5-05101d09f04d] received 2024-03-29T01:35:09.326992451Z [2024-03-29 01:35:09,326: INFO/ForkPoolWorker-15] [6b678594-f929-4e14-8cf5-05101d09f04d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:35:09.630216590Z [2024-03-29 01:35:09,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:35:10.780251536Z [2024-03-29 01:35:10,779: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:35:10.783726069Z [2024-03-29 01:35:10,783: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:10.801031542Z [2024-03-29 01:35:10,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:35:10.802631664Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:10.802670021Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:10.802792756Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:10.802818553Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:35:10.803058051Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:35:10.803070828Z [2024-03-29 01:35:10,802: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:10.893028888Z [2024-03-29 01:35:10,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:11.414567237Z [2024-03-29 01:35:11,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b678594-f929-4e14-8cf5-05101d09f04d] succeeded in 2.093262930000492s: None 2024-03-29T01:35:11.641338869Z [2024-03-29 01:35:11,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c243aef-e30e-403d-97a1-9f4a952bc9f1] received 2024-03-29T01:35:11.654057488Z [2024-03-29 01:35:11,653: INFO/ForkPoolWorker-15] [8c243aef-e30e-403d-97a1-9f4a952bc9f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:11.976196561Z [2024-03-29 01:35:11,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:35:13.255761989Z [2024-03-29 01:35:13,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:35:13.259101065Z [2024-03-29 01:35:13,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:35:13.295317669Z [2024-03-29 01:35:13,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:35:13.297783224Z [2024-03-29 01:35:13,297: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:35:13.297813458Z [2024-03-29 01:35:13,297: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:35:13.297949237Z [2024-03-29 01:35:13,297: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:35:13.298060095Z [2024-03-29 01:35:13,297: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:35:13.298377124Z [2024-03-29 01:35:13,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:35:13.298541421Z [2024-03-29 01:35:13,298: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:35:13.393993293Z [2024-03-29 01:35:13,393: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:35:13.915072121Z [2024-03-29 01:35:13,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c243aef-e30e-403d-97a1-9f4a952bc9f1] succeeded in 2.271590968000055s: None 2024-03-29T01:36:01.105901730Z [2024-03-29 01:36:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a3014d0-3504-4111-9a7c-586d947a1cea] received 2024-03-29T01:36:01.108164372Z [2024-03-29 01:36:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3ff75dd-8875-4c28-9f46-c6b3392887ae] received 2024-03-29T01:36:01.114545338Z [2024-03-29 01:36:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd4a39fa-7734-4ce0-9e45-2bb33bf39107] received 2024-03-29T01:36:01.123292327Z [2024-03-29 01:36:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16b3c76d-b72d-4297-8f05-b6ba7911a2e2] received 2024-03-29T01:36:01.126925092Z [2024-03-29 01:36:01,126: INFO/ForkPoolWorker-1] [bd4a39fa-7734-4ce0-9e45-2bb33bf39107] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:36:01.129924565Z [2024-03-29 01:36:01,129: INFO/ForkPoolWorker-15] [4a3014d0-3504-4111-9a7c-586d947a1cea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:36:01.131030568Z [2024-03-29 01:36:01,130: INFO/ForkPoolWorker-2] [16b3c76d-b72d-4297-8f05-b6ba7911a2e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:36:01.133419037Z [2024-03-29 01:36:01,133: INFO/ForkPoolWorker-16] [c3ff75dd-8875-4c28-9f46-c6b3392887ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:36:01.577561806Z [2024-03-29 01:36:01,573: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:36:01.583642669Z [2024-03-29 01:36:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:36:01.738133734Z [2024-03-29 01:36:01,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:36:01.787037005Z [2024-03-29 01:36:01,782: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:36:01.981443309Z [2024-03-29 01:36:01,980: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:36:01.984582980Z [2024-03-29 01:36:01,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:36:01.985737443Z [2024-03-29 01:36:01,985: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:36:02.028266177Z [2024-03-29 01:36:02,027: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:36:02.030278814Z [2024-03-29 01:36:02,029: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:36:02.030374009Z [2024-03-29 01:36:02,030: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:36:02.030514180Z [2024-03-29 01:36:02,030: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:36:02.030835956Z [2024-03-29 01:36:02,030: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:36:02.220606211Z [2024-03-29 01:36:02,220: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:36:02.848542606Z [2024-03-29 01:36:02,848: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a3014d0-3504-4111-9a7c-586d947a1cea] succeeded in 1.73907752499872s: None 2024-03-29T01:36:03.102861553Z [2024-03-29 01:36:03,102: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bd4a39fa-7734-4ce0-9e45-2bb33bf39107] succeeded in 1.985756421001497s: None 2024-03-29T01:36:03.478248397Z [2024-03-29 01:36:03,477: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:36:03.481854665Z [2024-03-29 01:36:03,481: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:36:03.482454874Z [2024-03-29 01:36:03,482: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:36:03.486194508Z [2024-03-29 01:36:03,485: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:36:03.516796240Z [2024-03-29 01:36:03,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:36:03.518173462Z [2024-03-29 01:36:03,517: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:36:03.518649800Z [2024-03-29 01:36:03,518: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:36:03.518684334Z [2024-03-29 01:36:03,518: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:36:03.518960311Z [2024-03-29 01:36:03,518: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:36:03.518983257Z [2024-03-29 01:36:03,518: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:36:03.519353670Z [2024-03-29 01:36:03,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:36:03.520462987Z [2024-03-29 01:36:03,520: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:36:03.520607017Z [2024-03-29 01:36:03,520: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:36:03.520757756Z [2024-03-29 01:36:03,520: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:36:03.520917698Z [2024-03-29 01:36:03,520: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:36:03.521011210Z [2024-03-29 01:36:03,520: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:36:03.521318958Z [2024-03-29 01:36:03,521: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:36:03.521385021Z [2024-03-29 01:36:03,521: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:36:03.617772136Z [2024-03-29 01:36:03,617: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:36:03.655057729Z [2024-03-29 01:36:03,654: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:36:05.475214623Z [2024-03-29 01:36:05,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3ff75dd-8875-4c28-9f46-c6b3392887ae] succeeded in 4.361904977999075s: None 2024-03-29T01:36:06.005749977Z [2024-03-29 01:36:06,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[16b3c76d-b72d-4297-8f05-b6ba7911a2e2] succeeded in 4.880390325000917s: None 2024-03-29T01:37:00.940435848Z [2024-03-29 01:37:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6698c6-df4d-40e5-a9b1-7400853aa497] received 2024-03-29T01:37:00.948026740Z [2024-03-29 01:37:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99c94817-d481-4539-90e6-241de1242eca] received 2024-03-29T01:37:00.948237859Z [2024-03-29 01:37:00,948: INFO/ForkPoolWorker-15] [ce6698c6-df4d-40e5-a9b1-7400853aa497] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:37:00.953550331Z [2024-03-29 01:37:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14f87690-88ac-48d9-9c17-34b8452816b8] received 2024-03-29T01:37:00.957379910Z [2024-03-29 01:37:00,957: INFO/ForkPoolWorker-16] [99c94817-d481-4539-90e6-241de1242eca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:37:00.965061054Z [2024-03-29 01:37:00,964: INFO/ForkPoolWorker-1] [14f87690-88ac-48d9-9c17-34b8452816b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:37:01.267216600Z [2024-03-29 01:37:01,263: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:37:01.291847720Z [2024-03-29 01:37:01,288: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:37:01.367774734Z [2024-03-29 01:37:01,364: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:37:01.452824660Z [2024-03-29 01:37:01,452: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:37:01.457600501Z [2024-03-29 01:37:01,457: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:37:01.491399703Z [2024-03-29 01:37:01,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:37:01.492894166Z [2024-03-29 01:37:01,492: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:37:01.492981307Z [2024-03-29 01:37:01,492: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:37:01.493079386Z [2024-03-29 01:37:01,492: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:37:01.493344842Z [2024-03-29 01:37:01,493: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:37:01.584006661Z [2024-03-29 01:37:01,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:37:02.365916597Z [2024-03-29 01:37:02,365: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99c94817-d481-4539-90e6-241de1242eca] succeeded in 1.4159316920013225s: None 2024-03-29T01:37:02.674367086Z [2024-03-29 01:37:02,673: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:37:02.683633317Z [2024-03-29 01:37:02,682: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:37:02.707490943Z [2024-03-29 01:37:02,707: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:37:02.709368117Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:37:02.709386361Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:37:02.709521126Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:37:02.709588917Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:37:02.709826912Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:37:02.709882954Z [2024-03-29 01:37:02,709: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:37:02.797772272Z [2024-03-29 01:37:02,797: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:37:03.043466078Z [2024-03-29 01:37:03,043: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:37:03.047179532Z [2024-03-29 01:37:03,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:37:03.068191456Z [2024-03-29 01:37:03,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:37:03.070761651Z [2024-03-29 01:37:03,070: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:37:03.070869880Z [2024-03-29 01:37:03,070: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:37:03.071043315Z [2024-03-29 01:37:03,070: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:37:03.071119632Z [2024-03-29 01:37:03,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:37:03.071444351Z [2024-03-29 01:37:03,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:37:03.071484269Z [2024-03-29 01:37:03,071: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:37:03.158906362Z [2024-03-29 01:37:03,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:37:04.227723736Z [2024-03-29 01:37:04,227: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[14f87690-88ac-48d9-9c17-34b8452816b8] succeeded in 3.272429167000155s: None 2024-03-29T01:37:04.930813236Z [2024-03-29 01:37:04,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce6698c6-df4d-40e5-a9b1-7400853aa497] succeeded in 3.986987581998619s: None 2024-03-29T01:38:00.722888303Z [2024-03-29 01:38:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c1f48c4-f9a9-492c-8cac-93488e770f09] received 2024-03-29T01:38:00.726362220Z [2024-03-29 01:38:00,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f38557-cff0-417e-8057-466e25c49602] received 2024-03-29T01:38:00.729299103Z [2024-03-29 01:38:00,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ae69a2b-3d01-4a87-a85f-68f2edef818b] received 2024-03-29T01:38:00.730411768Z [2024-03-29 01:38:00,729: INFO/ForkPoolWorker-15] [0c1f48c4-f9a9-492c-8cac-93488e770f09] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:38:00.738424802Z [2024-03-29 01:38:00,738: INFO/ForkPoolWorker-1] [7ae69a2b-3d01-4a87-a85f-68f2edef818b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:38:00.746046060Z [2024-03-29 01:38:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49ab6fe0-e5f4-4217-bf07-87237bbfd290] received 2024-03-29T01:38:00.748516578Z [2024-03-29 01:38:00,748: INFO/ForkPoolWorker-16] [e0f38557-cff0-417e-8057-466e25c49602] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:38:00.755736820Z [2024-03-29 01:38:00,755: INFO/ForkPoolWorker-2] [49ab6fe0-e5f4-4217-bf07-87237bbfd290] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:38:01.068497061Z [2024-03-29 01:38:01,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:38:01.142137764Z [2024-03-29 01:38:01,138: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:38:01.219662824Z [2024-03-29 01:38:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:38:01.292588995Z [2024-03-29 01:38:01,289: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:38:01.312283541Z [2024-03-29 01:38:01,311: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:38:01.316616445Z [2024-03-29 01:38:01,316: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:38:01.350399404Z [2024-03-29 01:38:01,350: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:38:01.353119695Z [2024-03-29 01:38:01,352: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:38:01.354580469Z [2024-03-29 01:38:01,353: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:38:01.354658934Z [2024-03-29 01:38:01,354: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:38:01.354875702Z [2024-03-29 01:38:01,354: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:38:01.373873988Z [2024-03-29 01:38:01,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:38:01.459028354Z [2024-03-29 01:38:01,458: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:38:02.106857437Z [2024-03-29 01:38:02,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c1f48c4-f9a9-492c-8cac-93488e770f09] succeeded in 1.3820321349994629s: None 2024-03-29T01:38:02.260986711Z [2024-03-29 01:38:02,260: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[49ab6fe0-e5f4-4217-bf07-87237bbfd290] succeeded in 1.5120998569982476s: None 2024-03-29T01:38:02.752645871Z [2024-03-29 01:38:02,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:38:02.756700563Z [2024-03-29 01:38:02,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:38:02.787775832Z [2024-03-29 01:38:02,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:38:02.789884699Z [2024-03-29 01:38:02,789: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:38:02.790154040Z [2024-03-29 01:38:02,789: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:38:02.790479582Z [2024-03-29 01:38:02,790: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:38:02.790655731Z [2024-03-29 01:38:02,790: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:38:02.791203339Z [2024-03-29 01:38:02,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:38:02.791461691Z [2024-03-29 01:38:02,791: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:38:02.814885950Z [2024-03-29 01:38:02,814: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:38:02.818586389Z [2024-03-29 01:38:02,817: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:38:02.843678733Z [2024-03-29 01:38:02,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:38:02.845310755Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:38:02.845335270Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:38:02.845559442Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:38:02.845636153Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:38:02.845978580Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:38:02.846170860Z [2024-03-29 01:38:02,845: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:38:02.921425522Z [2024-03-29 01:38:02,917: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:38:02.953970062Z [2024-03-29 01:38:02,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:38:04.543866194Z [2024-03-29 01:38:04,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0f38557-cff0-417e-8057-466e25c49602] succeeded in 3.8155013870000403s: None 2024-03-29T01:38:04.919992171Z [2024-03-29 01:38:04,919: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ae69a2b-3d01-4a87-a85f-68f2edef818b] succeeded in 4.188470360000792s: None 2024-03-29T01:39:00.508611483Z [2024-03-29 01:39:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b3edf30-0d05-4be4-9345-8f9ac619c64e] received 2024-03-29T01:39:00.515634169Z [2024-03-29 01:39:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfd70df8-dbef-427f-b985-2295294b54cf] received 2024-03-29T01:39:00.518926654Z [2024-03-29 01:39:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89ea8267-73b7-440f-812c-81da7ad33f2a] received 2024-03-29T01:39:00.522512433Z [2024-03-29 01:39:00,522: INFO/ForkPoolWorker-15] [3b3edf30-0d05-4be4-9345-8f9ac619c64e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:39:00.532563004Z [2024-03-29 01:39:00,530: INFO/ForkPoolWorker-16] [bfd70df8-dbef-427f-b985-2295294b54cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:39:00.533325803Z [2024-03-29 01:39:00,533: INFO/ForkPoolWorker-1] [89ea8267-73b7-440f-812c-81da7ad33f2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:39:00.849227548Z [2024-03-29 01:39:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:39:00.874508204Z [2024-03-29 01:39:00,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:39:00.880617506Z [2024-03-29 01:39:00,877: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:39:01.046666898Z [2024-03-29 01:39:01,046: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:39:01.051114225Z [2024-03-29 01:39:01,050: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:39:01.073469243Z [2024-03-29 01:39:01,073: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:39:01.074657703Z [2024-03-29 01:39:01,074: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:39:01.074823583Z [2024-03-29 01:39:01,074: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:39:01.074946048Z [2024-03-29 01:39:01,074: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:39:01.075286416Z [2024-03-29 01:39:01,075: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:39:01.217608826Z [2024-03-29 01:39:01,217: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:39:01.900460320Z [2024-03-29 01:39:01,899: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89ea8267-73b7-440f-812c-81da7ad33f2a] succeeded in 1.3793022650006606s: None 2024-03-29T01:39:02.376094787Z [2024-03-29 01:39:02,375: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:39:02.384411015Z [2024-03-29 01:39:02,383: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:39:02.410275887Z [2024-03-29 01:39:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:39:02.412471962Z [2024-03-29 01:39:02,412: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:39:02.412618812Z [2024-03-29 01:39:02,412: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:39:02.412792827Z [2024-03-29 01:39:02,412: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:39:02.412810775Z [2024-03-29 01:39:02,412: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:39:02.413122274Z [2024-03-29 01:39:02,412: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:39:02.413179373Z [2024-03-29 01:39:02,413: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:39:02.481168402Z [2024-03-29 01:39:02,480: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:39:02.484942364Z [2024-03-29 01:39:02,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:39:02.515854897Z [2024-03-29 01:39:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:39:02.519301514Z [2024-03-29 01:39:02,518: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:39:02.519503914Z [2024-03-29 01:39:02,519: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:39:02.519720580Z [2024-03-29 01:39:02,519: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:39:02.519870327Z [2024-03-29 01:39:02,519: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:39:02.520240480Z [2024-03-29 01:39:02,520: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:39:02.520405199Z [2024-03-29 01:39:02,520: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:39:02.523413545Z [2024-03-29 01:39:02,523: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:39:02.629418200Z [2024-03-29 01:39:02,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:39:04.453986569Z [2024-03-29 01:39:04,453: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfd70df8-dbef-427f-b985-2295294b54cf] succeeded in 3.933397867000167s: None 2024-03-29T01:39:04.845132090Z [2024-03-29 01:39:04,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b3edf30-0d05-4be4-9345-8f9ac619c64e] succeeded in 4.334583473000748s: None 2024-03-29T01:40:00.994637258Z [2024-03-29 01:40:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8f4d7fc-dfc4-467d-b2e7-ac2ded4050df] received 2024-03-29T01:40:01.002638172Z [2024-03-29 01:40:01,001: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23eecad8-f16c-4c9f-9611-16f3dc85be0b] received 2024-03-29T01:40:01.014774015Z [2024-03-29 01:40:01,013: INFO/ForkPoolWorker-16] [23eecad8-f16c-4c9f-9611-16f3dc85be0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:40:01.017503617Z [2024-03-29 01:40:01,017: INFO/ForkPoolWorker-15] [d8f4d7fc-dfc4-467d-b2e7-ac2ded4050df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:01.025957824Z [2024-03-29 01:40:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28d4cb0f-448b-4433-9744-d68b9be6da91] received 2024-03-29T01:40:01.031441146Z [2024-03-29 01:40:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf333c9e-19d4-4ba7-8bc3-5d6105098adc] received 2024-03-29T01:40:01.039746043Z [2024-03-29 01:40:01,039: INFO/ForkPoolWorker-1] [28d4cb0f-448b-4433-9744-d68b9be6da91] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:40:01.041058347Z [2024-03-29 01:40:01,040: INFO/ForkPoolWorker-2] [bf333c9e-19d4-4ba7-8bc3-5d6105098adc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:40:01.053246433Z [2024-03-29 01:40:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18fac6fc-b492-40e1-923f-f8e81fe40ace] received 2024-03-29T01:40:01.065951141Z [2024-03-29 01:40:01,065: INFO/ForkPoolWorker-3] [18fac6fc-b492-40e1-923f-f8e81fe40ace] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:40:01.415659020Z [2024-03-29 01:40:01,411: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:40:01.471506025Z [2024-03-29 01:40:01,467: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:40:01.755377624Z [2024-03-29 01:40:01,747: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:40:01.798130000Z [2024-03-29 01:40:01,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:40:01.815355781Z [2024-03-29 01:40:01,807: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:40:02.085322850Z [2024-03-29 01:40:02,084: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T01:40:02.092877385Z [2024-03-29 01:40:02,092: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:02.146183246Z [2024-03-29 01:40:02,145: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:40:02.151999330Z [2024-03-29 01:40:02,151: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:40:02.152091092Z [2024-03-29 01:40:02,151: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:40:02.152102386Z [2024-03-29 01:40:02,151: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T01:40:02.152225008Z [2024-03-29 01:40:02,152: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:40:02.316348725Z [2024-03-29 01:40:02,316: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:02.353309510Z [2024-03-29 01:40:02,352: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:03.085320843Z [2024-03-29 01:40:03,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28d4cb0f-448b-4433-9744-d68b9be6da91] succeeded in 2.057269365001048s: None 2024-03-29T01:40:03.149503626Z [2024-03-29 01:40:03,149: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[18fac6fc-b492-40e1-923f-f8e81fe40ace] succeeded in 2.0934575259998383s: None 2024-03-29T01:40:03.436270181Z [2024-03-29 01:40:03,435: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:40:03.439902342Z [2024-03-29 01:40:03,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:03.452971579Z [2024-03-29 01:40:03,452: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:40:03.460801711Z [2024-03-29 01:40:03,456: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:03.473482487Z [2024-03-29 01:40:03,473: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:40:03.474984331Z [2024-03-29 01:40:03,474: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:03.475166878Z [2024-03-29 01:40:03,474: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:03.475901599Z [2024-03-29 01:40:03,475: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:03.475967075Z [2024-03-29 01:40:03,475: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:40:03.476250590Z [2024-03-29 01:40:03,476: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:40:03.476262172Z [2024-03-29 01:40:03,476: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:03.491250198Z [2024-03-29 01:40:03,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:40:03.493697198Z [2024-03-29 01:40:03,492: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:03.493713408Z [2024-03-29 01:40:03,493: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:03.493756104Z [2024-03-29 01:40:03,493: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:03.493771633Z [2024-03-29 01:40:03,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:40:03.494138525Z [2024-03-29 01:40:03,493: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:40:03.494826235Z [2024-03-29 01:40:03,494: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:03.577087687Z [2024-03-29 01:40:03,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:03.590540930Z [2024-03-29 01:40:03,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:03.608788294Z [2024-03-29 01:40:03,608: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:40:03.613066611Z [2024-03-29 01:40:03,612: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:03.668991173Z [2024-03-29 01:40:03,667: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:40:03.670559528Z [2024-03-29 01:40:03,670: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:03.670578474Z [2024-03-29 01:40:03,670: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:03.670684307Z [2024-03-29 01:40:03,670: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:03.670870243Z [2024-03-29 01:40:03,670: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:40:03.671255590Z [2024-03-29 01:40:03,671: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:40:03.671274985Z [2024-03-29 01:40:03,671: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:03.779685015Z [2024-03-29 01:40:03,779: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:04.378954716Z [2024-03-29 01:40:04,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8f4d7fc-dfc4-467d-b2e7-ac2ded4050df] succeeded in 3.3767015960002027s: None 2024-03-29T01:40:05.383530953Z [2024-03-29 01:40:05,383: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bf333c9e-19d4-4ba7-8bc3-5d6105098adc] succeeded in 4.3493543960012175s: None 2024-03-29T01:40:05.437308762Z [2024-03-29 01:40:05,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4f2d396-181c-417e-84a4-e9876ada769f] received 2024-03-29T01:40:05.450934085Z [2024-03-29 01:40:05,450: INFO/ForkPoolWorker-15] [b4f2d396-181c-417e-84a4-e9876ada769f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:05.754500645Z [2024-03-29 01:40:05,749: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23eecad8-f16c-4c9f-9611-16f3dc85be0b] succeeded in 4.746611716000189s: None 2024-03-29T01:40:06.121974412Z [2024-03-29 01:40:06,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:40:07.634890795Z [2024-03-29 01:40:07,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:40:07.638822648Z [2024-03-29 01:40:07,638: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:07.661283786Z [2024-03-29 01:40:07,661: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:40:07.662671465Z [2024-03-29 01:40:07,662: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:07.662702767Z [2024-03-29 01:40:07,662: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:07.663128178Z [2024-03-29 01:40:07,662: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:07.663182100Z [2024-03-29 01:40:07,663: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:40:07.663528468Z [2024-03-29 01:40:07,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:40:07.663541921Z [2024-03-29 01:40:07,663: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:07.746500601Z [2024-03-29 01:40:07,746: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:08.356380324Z [2024-03-29 01:40:08,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4f2d396-181c-417e-84a4-e9876ada769f] succeeded in 2.9140113909998036s: None 2024-03-29T01:40:08.642320632Z [2024-03-29 01:40:08,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[592bdf9b-e8d6-4445-9e6d-f3b83c85a966] received 2024-03-29T01:40:08.649369260Z [2024-03-29 01:40:08,649: INFO/ForkPoolWorker-15] [592bdf9b-e8d6-4445-9e6d-f3b83c85a966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:40:08.933978189Z [2024-03-29 01:40:08,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:40:10.123946456Z [2024-03-29 01:40:10,123: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:40:10.127426090Z [2024-03-29 01:40:10,126: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:10.145319714Z [2024-03-29 01:40:10,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:40:10.146926716Z [2024-03-29 01:40:10,146: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:10.147147274Z [2024-03-29 01:40:10,146: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:10.147412332Z [2024-03-29 01:40:10,147: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:10.147587623Z [2024-03-29 01:40:10,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:40:10.147948527Z [2024-03-29 01:40:10,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:40:10.148458142Z [2024-03-29 01:40:10,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:10.225984136Z [2024-03-29 01:40:10,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:10.711156082Z [2024-03-29 01:40:10,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[592bdf9b-e8d6-4445-9e6d-f3b83c85a966] succeeded in 2.0667687419991125s: None 2024-03-29T01:40:10.903613128Z [2024-03-29 01:40:10,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e231e16-cf8d-441c-b679-e5d2823e170d] received 2024-03-29T01:40:10.909375154Z [2024-03-29 01:40:10,909: INFO/ForkPoolWorker-15] [1e231e16-cf8d-441c-b679-e5d2823e170d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:11.229351386Z [2024-03-29 01:40:11,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:40:12.364010569Z [2024-03-29 01:40:12,363: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:40:12.367565300Z [2024-03-29 01:40:12,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:40:12.402334829Z [2024-03-29 01:40:12,401: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:40:12.405651291Z [2024-03-29 01:40:12,405: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:40:12.407463250Z [2024-03-29 01:40:12,407: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:40:12.407822881Z [2024-03-29 01:40:12,407: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:40:12.408054610Z [2024-03-29 01:40:12,407: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:40:12.408617960Z [2024-03-29 01:40:12,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:40:12.409013904Z [2024-03-29 01:40:12,408: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:40:12.517511512Z [2024-03-29 01:40:12,517: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:40:13.186538023Z [2024-03-29 01:40:13,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e231e16-cf8d-441c-b679-e5d2823e170d] succeeded in 2.2812560410002334s: None 2024-03-29T01:41:00.982039060Z [2024-03-29 01:41:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a084809-4fdc-47e7-a2c5-25a72cbaef50] received 2024-03-29T01:41:00.987619755Z [2024-03-29 01:41:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d20b805-1e62-4301-85f4-ba82b314d5ab] received 2024-03-29T01:41:00.991307720Z [2024-03-29 01:41:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15497523-0d6b-4708-8467-2bf6c307d29f] received 2024-03-29T01:41:00.999824999Z [2024-03-29 01:41:00,999: INFO/ForkPoolWorker-15] [3a084809-4fdc-47e7-a2c5-25a72cbaef50] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:41:01.005099052Z [2024-03-29 01:41:01,004: INFO/ForkPoolWorker-16] [9d20b805-1e62-4301-85f4-ba82b314d5ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:41:01.008066688Z [2024-03-29 01:41:01,007: INFO/ForkPoolWorker-1] [15497523-0d6b-4708-8467-2bf6c307d29f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:41:01.356915059Z [2024-03-29 01:41:01,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:41:01.359734916Z [2024-03-29 01:41:01,354: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:41:01.416279869Z [2024-03-29 01:41:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:41:01.523171812Z [2024-03-29 01:41:01,522: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:41:01.527583072Z [2024-03-29 01:41:01,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:41:01.570029861Z [2024-03-29 01:41:01,569: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:41:01.572233707Z [2024-03-29 01:41:01,571: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:41:01.572581007Z [2024-03-29 01:41:01,572: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:41:01.572836480Z [2024-03-29 01:41:01,572: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:41:01.573508506Z [2024-03-29 01:41:01,573: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:41:01.759500425Z [2024-03-29 01:41:01,758: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:41:02.503082840Z [2024-03-29 01:41:02,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a084809-4fdc-47e7-a2c5-25a72cbaef50] succeeded in 1.517696488999718s: None 2024-03-29T01:41:02.832707242Z [2024-03-29 01:41:02,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:41:02.836874792Z [2024-03-29 01:41:02,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:41:02.863966492Z [2024-03-29 01:41:02,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:41:02.865920251Z [2024-03-29 01:41:02,865: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:41:02.866019453Z [2024-03-29 01:41:02,865: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:41:02.866388643Z [2024-03-29 01:41:02,866: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:41:02.866603714Z [2024-03-29 01:41:02,866: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:41:02.867591890Z [2024-03-29 01:41:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:41:02.867636812Z [2024-03-29 01:41:02,867: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:41:02.875075219Z [2024-03-29 01:41:02,874: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:41:02.878801449Z [2024-03-29 01:41:02,878: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:41:02.903523204Z [2024-03-29 01:41:02,903: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:41:02.905203600Z [2024-03-29 01:41:02,904: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:41:02.905362351Z [2024-03-29 01:41:02,905: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:41:02.905687783Z [2024-03-29 01:41:02,905: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:41:02.905804755Z [2024-03-29 01:41:02,905: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:41:02.906215505Z [2024-03-29 01:41:02,906: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:41:02.906396027Z [2024-03-29 01:41:02,906: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:41:02.964802469Z [2024-03-29 01:41:02,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:41:03.001731827Z [2024-03-29 01:41:03,001: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:41:05.161954398Z [2024-03-29 01:41:05,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d20b805-1e62-4301-85f4-ba82b314d5ab] succeeded in 4.164663706000283s: None 2024-03-29T01:41:05.516926050Z [2024-03-29 01:41:05,516: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15497523-0d6b-4708-8467-2bf6c307d29f] succeeded in 4.523335984998994s: None 2024-03-29T01:42:00.612926373Z [2024-03-29 01:42:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b482213-7b0f-4def-a229-58b695a7bf80] received 2024-03-29T01:42:00.614601008Z [2024-03-29 01:42:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af6a5f05-a40c-4796-b42d-35f950d1b1e9] received 2024-03-29T01:42:00.621045763Z [2024-03-29 01:42:00,620: INFO/ForkPoolWorker-15] [8b482213-7b0f-4def-a229-58b695a7bf80] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:42:00.623288467Z [2024-03-29 01:42:00,622: INFO/ForkPoolWorker-16] [af6a5f05-a40c-4796-b42d-35f950d1b1e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:42:00.634633296Z [2024-03-29 01:42:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ffa0c15-083b-46d7-aa5e-fc04da525b9c] received 2024-03-29T01:42:00.636864303Z [2024-03-29 01:42:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2908a15-7692-474d-8c64-c84d70f7071e] received 2024-03-29T01:42:00.644829680Z [2024-03-29 01:42:00,644: INFO/ForkPoolWorker-2] [f2908a15-7692-474d-8c64-c84d70f7071e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:42:00.647175058Z [2024-03-29 01:42:00,646: INFO/ForkPoolWorker-1] [0ffa0c15-083b-46d7-aa5e-fc04da525b9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:42:01.052291950Z [2024-03-29 01:42:01,047: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:42:01.148013042Z [2024-03-29 01:42:01,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:42:01.245582606Z [2024-03-29 01:42:01,241: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:42:01.343839779Z [2024-03-29 01:42:01,338: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:42:01.516562127Z [2024-03-29 01:42:01,516: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:42:01.521107059Z [2024-03-29 01:42:01,520: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:42:01.548869284Z [2024-03-29 01:42:01,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:42:01.550089912Z [2024-03-29 01:42:01,549: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:42:01.550167636Z [2024-03-29 01:42:01,550: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:42:01.550529202Z [2024-03-29 01:42:01,550: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:42:01.550748003Z [2024-03-29 01:42:01,550: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:42:01.631787118Z [2024-03-29 01:42:01,631: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:42:01.668726480Z [2024-03-29 01:42:01,668: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:42:02.300853674Z [2024-03-29 01:42:02,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b482213-7b0f-4def-a229-58b695a7bf80] succeeded in 1.6864772310000262s: None 2024-03-29T01:42:02.436257319Z [2024-03-29 01:42:02,435: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af6a5f05-a40c-4796-b42d-35f950d1b1e9] succeeded in 1.8201443689995358s: None 2024-03-29T01:42:02.878524995Z [2024-03-29 01:42:02,877: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:42:02.881882641Z [2024-03-29 01:42:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:42:02.901520611Z [2024-03-29 01:42:02,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:42:02.902876355Z [2024-03-29 01:42:02,902: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:42:02.903237584Z [2024-03-29 01:42:02,903: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:42:02.903339322Z [2024-03-29 01:42:02,903: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:42:02.903378198Z [2024-03-29 01:42:02,903: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:42:02.904082190Z [2024-03-29 01:42:02,903: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:42:02.904105357Z [2024-03-29 01:42:02,904: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:42:02.993109018Z [2024-03-29 01:42:02,992: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:42:03.050227327Z [2024-03-29 01:42:03,049: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:42:03.053913181Z [2024-03-29 01:42:03,053: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:42:03.078751825Z [2024-03-29 01:42:03,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:42:03.080303665Z [2024-03-29 01:42:03,080: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:42:03.080535701Z [2024-03-29 01:42:03,080: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:42:03.080770384Z [2024-03-29 01:42:03,080: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:42:03.080969506Z [2024-03-29 01:42:03,080: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:42:03.081301456Z [2024-03-29 01:42:03,081: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:42:03.081983455Z [2024-03-29 01:42:03,081: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:42:03.178927582Z [2024-03-29 01:42:03,178: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:42:04.829456338Z [2024-03-29 01:42:04,829: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ffa0c15-083b-46d7-aa5e-fc04da525b9c] succeeded in 4.191200462999404s: None 2024-03-29T01:42:05.535024889Z [2024-03-29 01:42:05,534: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2908a15-7692-474d-8c64-c84d70f7071e] succeeded in 4.896707689000323s: None 2024-03-29T01:43:00.472988437Z [2024-03-29 01:43:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9bd80bf-cf95-4652-a7b4-2d3d98307f63] received 2024-03-29T01:43:00.474887249Z [2024-03-29 01:43:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b36275-b2f9-4a00-8633-e775496ed666] received 2024-03-29T01:43:00.480148960Z [2024-03-29 01:43:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[746382a3-d333-4572-a58a-0ee865f46aac] received 2024-03-29T01:43:00.481555750Z [2024-03-29 01:43:00,481: INFO/ForkPoolWorker-15] [f9bd80bf-cf95-4652-a7b4-2d3d98307f63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:43:00.485922236Z [2024-03-29 01:43:00,485: INFO/ForkPoolWorker-16] [e2b36275-b2f9-4a00-8633-e775496ed666] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:43:00.487304296Z [2024-03-29 01:43:00,487: INFO/ForkPoolWorker-1] [746382a3-d333-4572-a58a-0ee865f46aac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:43:00.797739809Z [2024-03-29 01:43:00,794: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:43:00.824101466Z [2024-03-29 01:43:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:43:00.845123553Z [2024-03-29 01:43:00,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:43:00.996943931Z [2024-03-29 01:43:00,996: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:43:01.001123603Z [2024-03-29 01:43:01,000: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:43:01.032059372Z [2024-03-29 01:43:01,031: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:43:01.033596989Z [2024-03-29 01:43:01,033: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:43:01.033851553Z [2024-03-29 01:43:01,033: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:43:01.034074754Z [2024-03-29 01:43:01,033: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:43:01.034464007Z [2024-03-29 01:43:01,034: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:43:01.175047767Z [2024-03-29 01:43:01,174: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:43:02.012218092Z [2024-03-29 01:43:02,011: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[746382a3-d333-4572-a58a-0ee865f46aac] succeeded in 1.5304393970000092s: None 2024-03-29T01:43:02.539223617Z [2024-03-29 01:43:02,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:43:02.546066348Z [2024-03-29 01:43:02,545: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:43:02.570088983Z [2024-03-29 01:43:02,569: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:43:02.574806764Z [2024-03-29 01:43:02,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:43:02.587497977Z [2024-03-29 01:43:02,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:43:02.592364142Z [2024-03-29 01:43:02,591: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:43:02.593044482Z [2024-03-29 01:43:02,592: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:43:02.593459614Z [2024-03-29 01:43:02,593: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:43:02.593676842Z [2024-03-29 01:43:02,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:43:02.594126621Z [2024-03-29 01:43:02,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:43:02.594470277Z [2024-03-29 01:43:02,594: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:43:02.604158459Z [2024-03-29 01:43:02,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:43:02.605797154Z [2024-03-29 01:43:02,605: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:43:02.605942534Z [2024-03-29 01:43:02,605: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:43:02.606119922Z [2024-03-29 01:43:02,605: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:43:02.606198963Z [2024-03-29 01:43:02,606: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:43:02.606670940Z [2024-03-29 01:43:02,606: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:43:02.606809949Z [2024-03-29 01:43:02,606: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:43:02.696194656Z [2024-03-29 01:43:02,695: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:43:02.715887642Z [2024-03-29 01:43:02,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:43:04.251615011Z [2024-03-29 01:43:04,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9bd80bf-cf95-4652-a7b4-2d3d98307f63] succeeded in 3.7764592690000427s: None 2024-03-29T01:43:04.791190661Z [2024-03-29 01:43:04,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2b36275-b2f9-4a00-8633-e775496ed666] succeeded in 4.313777740999285s: None 2024-03-29T01:44:00.411391072Z [2024-03-29 01:44:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33349935-9720-47f8-92bd-bc21c16c88b4] received 2024-03-29T01:44:00.413134488Z [2024-03-29 01:44:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f6152cb-f279-48f3-9e90-b16fc0b04866] received 2024-03-29T01:44:00.421012725Z [2024-03-29 01:44:00,420: INFO/ForkPoolWorker-16] [9f6152cb-f279-48f3-9e90-b16fc0b04866] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:44:00.424057712Z [2024-03-29 01:44:00,423: INFO/ForkPoolWorker-15] [33349935-9720-47f8-92bd-bc21c16c88b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:44:00.430315376Z [2024-03-29 01:44:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19b7624a-0258-4e1e-ac6a-8015e1302096] received 2024-03-29T01:44:00.434308053Z [2024-03-29 01:44:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[603d11e7-d780-4194-be4d-604eb47e6531] received 2024-03-29T01:44:00.439181364Z [2024-03-29 01:44:00,438: INFO/ForkPoolWorker-1] [19b7624a-0258-4e1e-ac6a-8015e1302096] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:44:00.444000769Z [2024-03-29 01:44:00,443: INFO/ForkPoolWorker-2] [603d11e7-d780-4194-be4d-604eb47e6531] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:44:00.838812205Z [2024-03-29 01:44:00,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:44:00.908363607Z [2024-03-29 01:44:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:44:00.957189997Z [2024-03-29 01:44:00,944: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:44:01.011838192Z [2024-03-29 01:44:01,007: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:44:01.268143834Z [2024-03-29 01:44:01,267: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:44:01.371858205Z [2024-03-29 01:44:01,371: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:44:01.375847654Z [2024-03-29 01:44:01,375: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:44:01.405099168Z [2024-03-29 01:44:01,404: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:44:01.406229352Z [2024-03-29 01:44:01,406: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:44:01.406427431Z [2024-03-29 01:44:01,406: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:44:01.406653692Z [2024-03-29 01:44:01,406: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:44:01.407065137Z [2024-03-29 01:44:01,406: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:44:01.562485611Z [2024-03-29 01:44:01,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:44:01.935535677Z [2024-03-29 01:44:01,934: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[19b7624a-0258-4e1e-ac6a-8015e1302096] succeeded in 1.5004667290013458s: None 2024-03-29T01:44:02.297944841Z [2024-03-29 01:44:02,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f6152cb-f279-48f3-9e90-b16fc0b04866] succeeded in 1.8821815609990153s: None 2024-03-29T01:44:02.308283655Z [2024-03-29 01:44:02,307: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:44:02.312281690Z [2024-03-29 01:44:02,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:44:02.343846143Z [2024-03-29 01:44:02,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:44:02.345739614Z [2024-03-29 01:44:02,345: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:44:02.346376306Z [2024-03-29 01:44:02,345: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:44:02.346668196Z [2024-03-29 01:44:02,346: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:44:02.346758307Z [2024-03-29 01:44:02,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:44:02.347251712Z [2024-03-29 01:44:02,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:44:02.347771602Z [2024-03-29 01:44:02,347: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:44:02.454301285Z [2024-03-29 01:44:02,453: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:44:02.546303153Z [2024-03-29 01:44:02,545: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:44:02.549965198Z [2024-03-29 01:44:02,549: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:44:02.580769845Z [2024-03-29 01:44:02,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:44:02.582506989Z [2024-03-29 01:44:02,582: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:44:02.582761507Z [2024-03-29 01:44:02,582: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:44:02.583319187Z [2024-03-29 01:44:02,583: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:44:02.583535332Z [2024-03-29 01:44:02,583: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:44:02.584004522Z [2024-03-29 01:44:02,583: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:44:02.584313680Z [2024-03-29 01:44:02,584: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:44:02.672605628Z [2024-03-29 01:44:02,672: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:44:04.611125864Z [2024-03-29 01:44:04,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33349935-9720-47f8-92bd-bc21c16c88b4] succeeded in 4.195540643000641s: None 2024-03-29T01:44:04.617145429Z [2024-03-29 01:44:04,616: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[603d11e7-d780-4194-be4d-604eb47e6531] succeeded in 4.1812635290007165s: None 2024-03-29T01:45:00.466331839Z [2024-03-29 01:45:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa455820-2cf6-474a-b70c-68f5a18060f2] received 2024-03-29T01:45:00.471658919Z [2024-03-29 01:45:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d440332-4a0d-4f68-a47f-61ccd5f4c60d] received 2024-03-29T01:45:00.484971732Z [2024-03-29 01:45:00,484: INFO/ForkPoolWorker-15] [aa455820-2cf6-474a-b70c-68f5a18060f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:00.491231486Z [2024-03-29 01:45:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a03f1c7-0cac-48fc-adec-4c279591e368] received 2024-03-29T01:45:00.492077608Z [2024-03-29 01:45:00,491: INFO/ForkPoolWorker-16] [6d440332-4a0d-4f68-a47f-61ccd5f4c60d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:45:00.496940305Z [2024-03-29 01:45:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38eba609-6501-43b4-b9c1-8e49b704fa52] received 2024-03-29T01:45:00.505879222Z [2024-03-29 01:45:00,505: INFO/ForkPoolWorker-1] [8a03f1c7-0cac-48fc-adec-4c279591e368] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:45:00.506544099Z [2024-03-29 01:45:00,506: INFO/ForkPoolWorker-2] [38eba609-6501-43b4-b9c1-8e49b704fa52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:45:00.951491901Z [2024-03-29 01:45:00,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:45:01.029419185Z [2024-03-29 01:45:01,026: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:45:01.032646536Z [2024-03-29 01:45:01,028: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:45:01.047346139Z [2024-03-29 01:45:01,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:45:01.284678618Z [2024-03-29 01:45:01,284: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:45:01.288677763Z [2024-03-29 01:45:01,288: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:01.320928024Z [2024-03-29 01:45:01,320: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:45:01.323048083Z [2024-03-29 01:45:01,322: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:45:01.323361215Z [2024-03-29 01:45:01,322: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:45:01.323578907Z [2024-03-29 01:45:01,323: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:45:01.324441845Z [2024-03-29 01:45:01,324: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:45:01.456768308Z [2024-03-29 01:45:01,456: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:02.137027311Z [2024-03-29 01:45:02,136: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[38eba609-6501-43b4-b9c1-8e49b704fa52] succeeded in 1.6364643630004139s: None 2024-03-29T01:45:02.504472813Z [2024-03-29 01:45:02,504: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:45:02.517535230Z [2024-03-29 01:45:02,516: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:02.557764829Z [2024-03-29 01:45:02,557: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:45:02.560048476Z [2024-03-29 01:45:02,559: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:02.560105479Z [2024-03-29 01:45:02,559: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:45:02.560364749Z [2024-03-29 01:45:02,559: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:02.560794758Z [2024-03-29 01:45:02,560: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:02.561044342Z [2024-03-29 01:45:02,560: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:45:02.562092913Z [2024-03-29 01:45:02,561: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:45:02.562285400Z [2024-03-29 01:45:02,562: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:02.564183380Z [2024-03-29 01:45:02,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:02.596430737Z [2024-03-29 01:45:02,596: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:45:02.597822637Z [2024-03-29 01:45:02,597: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:02.597985392Z [2024-03-29 01:45:02,597: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:02.598226202Z [2024-03-29 01:45:02,597: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:02.598272583Z [2024-03-29 01:45:02,598: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:45:02.598685241Z [2024-03-29 01:45:02,598: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:45:02.598731180Z [2024-03-29 01:45:02,598: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:02.640186473Z [2024-03-29 01:45:02,639: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:45:02.645178747Z [2024-03-29 01:45:02,644: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:02.681757715Z [2024-03-29 01:45:02,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:45:02.684435209Z [2024-03-29 01:45:02,684: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:02.684719553Z [2024-03-29 01:45:02,684: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:02.684972797Z [2024-03-29 01:45:02,684: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:02.685170398Z [2024-03-29 01:45:02,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:45:02.685578428Z [2024-03-29 01:45:02,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:45:02.685789473Z [2024-03-29 01:45:02,685: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:02.687096118Z [2024-03-29 01:45:02,686: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:02.713095185Z [2024-03-29 01:45:02,712: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:02.808179308Z [2024-03-29 01:45:02,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:03.584275182Z [2024-03-29 01:45:03,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa455820-2cf6-474a-b70c-68f5a18060f2] succeeded in 3.1103367949999665s: None 2024-03-29T01:45:04.476866161Z [2024-03-29 01:45:04,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73e248b3-a9b8-4375-8bc7-c2fb9f82486d] received 2024-03-29T01:45:04.487216659Z [2024-03-29 01:45:04,486: INFO/ForkPoolWorker-15] [73e248b3-a9b8-4375-8bc7-c2fb9f82486d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:04.656896136Z [2024-03-29 01:45:04,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d440332-4a0d-4f68-a47f-61ccd5f4c60d] succeeded in 4.1754352300013124s: None 2024-03-29T01:45:04.839648896Z [2024-03-29 01:45:04,836: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:45:05.261320112Z [2024-03-29 01:45:05,260: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a03f1c7-0cac-48fc-adec-4c279591e368] succeeded in 4.766947996000454s: None 2024-03-29T01:45:06.332198028Z [2024-03-29 01:45:06,331: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:45:06.337262071Z [2024-03-29 01:45:06,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:06.366681714Z [2024-03-29 01:45:06,365: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:45:06.368336691Z [2024-03-29 01:45:06,368: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:06.368827154Z [2024-03-29 01:45:06,368: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:06.369576322Z [2024-03-29 01:45:06,369: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:06.369764048Z [2024-03-29 01:45:06,369: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:45:06.370108242Z [2024-03-29 01:45:06,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:45:06.370297007Z [2024-03-29 01:45:06,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:06.583279072Z [2024-03-29 01:45:06,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:07.692106297Z [2024-03-29 01:45:07,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73e248b3-a9b8-4375-8bc7-c2fb9f82486d] succeeded in 3.2125111049990664s: None 2024-03-29T01:45:08.228809760Z [2024-03-29 01:45:08,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[534ef00f-ca51-4fbc-a686-4d060fb9c4b4] received 2024-03-29T01:45:08.240491604Z [2024-03-29 01:45:08,240: INFO/ForkPoolWorker-15] [534ef00f-ca51-4fbc-a686-4d060fb9c4b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:45:08.703104798Z [2024-03-29 01:45:08,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:45:10.023140107Z [2024-03-29 01:45:10,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:45:10.026391839Z [2024-03-29 01:45:10,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:10.043662645Z [2024-03-29 01:45:10,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:45:10.044829789Z [2024-03-29 01:45:10,044: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:10.044854640Z [2024-03-29 01:45:10,044: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:10.044960094Z [2024-03-29 01:45:10,044: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:10.044980117Z [2024-03-29 01:45:10,044: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:45:10.045313144Z [2024-03-29 01:45:10,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:45:10.045331891Z [2024-03-29 01:45:10,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:10.126781371Z [2024-03-29 01:45:10,126: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:10.663608268Z [2024-03-29 01:45:10,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[534ef00f-ca51-4fbc-a686-4d060fb9c4b4] succeeded in 2.433091519998925s: None 2024-03-29T01:45:11.244202111Z [2024-03-29 01:45:11,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28d18536-d5c7-4eb0-af61-451b26bb68ed] received 2024-03-29T01:45:11.265384601Z [2024-03-29 01:45:11,262: INFO/ForkPoolWorker-15] [28d18536-d5c7-4eb0-af61-451b26bb68ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:11.556007333Z [2024-03-29 01:45:11,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:45:12.677296867Z [2024-03-29 01:45:12,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:45:12.680883375Z [2024-03-29 01:45:12,680: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:45:12.702715221Z [2024-03-29 01:45:12,702: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:45:12.704657092Z [2024-03-29 01:45:12,704: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:45:12.704776454Z [2024-03-29 01:45:12,704: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:45:12.704943711Z [2024-03-29 01:45:12,704: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:45:12.705035012Z [2024-03-29 01:45:12,704: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:45:12.705345546Z [2024-03-29 01:45:12,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:45:12.705504500Z [2024-03-29 01:45:12,705: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:45:12.791402954Z [2024-03-29 01:45:12,791: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:45:13.374762258Z [2024-03-29 01:45:13,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28d18536-d5c7-4eb0-af61-451b26bb68ed] succeeded in 2.123465123000642s: None 2024-03-29T01:46:01.144691978Z [2024-03-29 01:46:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ced733a-4f8b-46e8-b2de-756b7f11fd07] received 2024-03-29T01:46:01.156291357Z [2024-03-29 01:46:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea5a900-80ae-435e-b6ab-7a97521207c3] received 2024-03-29T01:46:01.170067485Z [2024-03-29 01:46:01,169: INFO/ForkPoolWorker-15] [1ced733a-4f8b-46e8-b2de-756b7f11fd07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:46:01.175063000Z [2024-03-29 01:46:01,174: INFO/ForkPoolWorker-16] [6ea5a900-80ae-435e-b6ab-7a97521207c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:46:01.179285907Z [2024-03-29 01:46:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[873ca023-dd50-42f6-9c26-f99284692241] received 2024-03-29T01:46:01.183552710Z [2024-03-29 01:46:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e00c4cc8-6f76-408d-baba-e9e9fe08c01f] received 2024-03-29T01:46:01.228916620Z [2024-03-29 01:46:01,228: INFO/ForkPoolWorker-2] [e00c4cc8-6f76-408d-baba-e9e9fe08c01f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:46:01.230864092Z [2024-03-29 01:46:01,230: INFO/ForkPoolWorker-1] [873ca023-dd50-42f6-9c26-f99284692241] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:46:01.842852105Z [2024-03-29 01:46:01,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:46:01.884458533Z [2024-03-29 01:46:01,880: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:46:01.991723129Z [2024-03-29 01:46:01,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:46:02.018635016Z [2024-03-29 01:46:02,018: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T01:46:02.023089939Z [2024-03-29 01:46:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:46:02.048610748Z [2024-03-29 01:46:02,048: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:46:02.050334742Z [2024-03-29 01:46:02,050: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:46:02.050514764Z [2024-03-29 01:46:02,050: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:46:02.050596379Z [2024-03-29 01:46:02,050: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T01:46:02.050929478Z [2024-03-29 01:46:02,050: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:46:02.098491779Z [2024-03-29 01:46:02,095: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:46:02.162516581Z [2024-03-29 01:46:02,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:46:02.288200073Z [2024-03-29 01:46:02,287: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:46:02.923741608Z [2024-03-29 01:46:02,923: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ea5a900-80ae-435e-b6ab-7a97521207c3] succeeded in 1.7638325549996807s: None 2024-03-29T01:46:03.082261843Z [2024-03-29 01:46:03,081: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[873ca023-dd50-42f6-9c26-f99284692241] succeeded in 1.9006799409999076s: None 2024-03-29T01:46:03.530305186Z [2024-03-29 01:46:03,529: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:46:03.540465595Z [2024-03-29 01:46:03,539: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:46:03.561515984Z [2024-03-29 01:46:03,561: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:46:03.563118426Z [2024-03-29 01:46:03,562: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:46:03.563232089Z [2024-03-29 01:46:03,563: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:46:03.563464987Z [2024-03-29 01:46:03,563: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:46:03.563526518Z [2024-03-29 01:46:03,563: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:46:03.563802855Z [2024-03-29 01:46:03,563: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:46:03.563904666Z [2024-03-29 01:46:03,563: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:46:03.662068708Z [2024-03-29 01:46:03,661: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:46:03.715767038Z [2024-03-29 01:46:03,715: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:46:03.719414554Z [2024-03-29 01:46:03,718: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:46:03.741086902Z [2024-03-29 01:46:03,740: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:46:03.742988815Z [2024-03-29 01:46:03,742: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:46:03.743256607Z [2024-03-29 01:46:03,742: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:46:03.743482891Z [2024-03-29 01:46:03,743: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:46:03.743737969Z [2024-03-29 01:46:03,743: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:46:03.744150040Z [2024-03-29 01:46:03,743: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:46:03.744377093Z [2024-03-29 01:46:03,744: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:46:03.837676588Z [2024-03-29 01:46:03,837: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:46:05.470751749Z [2024-03-29 01:46:05,470: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ced733a-4f8b-46e8-b2de-756b7f11fd07] succeeded in 4.319852258000537s: None 2024-03-29T01:46:05.479863930Z [2024-03-29 01:46:05,479: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e00c4cc8-6f76-408d-baba-e9e9fe08c01f] succeeded in 4.29193253899939s: None 2024-03-29T01:47:00.298634423Z [2024-03-29 01:47:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cddc87e1-15e4-4ea3-a7ac-47367a4e74bc] received 2024-03-29T01:47:00.307807667Z [2024-03-29 01:47:00,307: INFO/ForkPoolWorker-15] [cddc87e1-15e4-4ea3-a7ac-47367a4e74bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:47:00.323589944Z [2024-03-29 01:47:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[400abe3d-9bb4-498f-a4cc-b9821cf9bb76] received 2024-03-29T01:47:00.330289690Z [2024-03-29 01:47:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd5c0511-ab96-48e5-bd4f-be9e1ef4ff15] received 2024-03-29T01:47:00.336797561Z [2024-03-29 01:47:00,336: INFO/ForkPoolWorker-16] [400abe3d-9bb4-498f-a4cc-b9821cf9bb76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:47:00.343836980Z [2024-03-29 01:47:00,343: INFO/ForkPoolWorker-1] [bd5c0511-ab96-48e5-bd4f-be9e1ef4ff15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:47:00.821256545Z [2024-03-29 01:47:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:47:00.871112683Z [2024-03-29 01:47:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:47:00.981878603Z [2024-03-29 01:47:00,978: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:47:01.262782428Z [2024-03-29 01:47:01,262: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:47:01.269288657Z [2024-03-29 01:47:01,268: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:47:01.299134137Z [2024-03-29 01:47:01,298: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:47:01.301549032Z [2024-03-29 01:47:01,301: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:47:01.302047677Z [2024-03-29 01:47:01,301: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:47:01.302221802Z [2024-03-29 01:47:01,301: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:47:01.302578238Z [2024-03-29 01:47:01,302: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:47:01.438530735Z [2024-03-29 01:47:01,438: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:47:02.314815184Z [2024-03-29 01:47:02,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:47:02.319278984Z [2024-03-29 01:47:02,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:47:02.350747722Z [2024-03-29 01:47:02,350: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:47:02.352612993Z [2024-03-29 01:47:02,352: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:47:02.352693280Z [2024-03-29 01:47:02,352: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:47:02.352894296Z [2024-03-29 01:47:02,352: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:47:02.353013783Z [2024-03-29 01:47:02,352: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:47:02.353394370Z [2024-03-29 01:47:02,353: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:47:02.353619511Z [2024-03-29 01:47:02,353: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:47:02.370042368Z [2024-03-29 01:47:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bd5c0511-ab96-48e5-bd4f-be9e1ef4ff15] succeeded in 2.0370280879997154s: None 2024-03-29T01:47:02.471203017Z [2024-03-29 01:47:02,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:47:02.687760685Z [2024-03-29 01:47:02,687: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:47:02.691718048Z [2024-03-29 01:47:02,691: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:47:02.722962919Z [2024-03-29 01:47:02,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:47:02.726219818Z [2024-03-29 01:47:02,725: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:47:02.726606287Z [2024-03-29 01:47:02,726: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:47:02.727165625Z [2024-03-29 01:47:02,726: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:47:02.727403727Z [2024-03-29 01:47:02,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:47:02.727989537Z [2024-03-29 01:47:02,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:47:02.728222813Z [2024-03-29 01:47:02,728: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:47:02.850964335Z [2024-03-29 01:47:02,850: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:47:04.045835103Z [2024-03-29 01:47:04,045: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[400abe3d-9bb4-498f-a4cc-b9821cf9bb76] succeeded in 3.7199238699995476s: None 2024-03-29T01:47:05.188774586Z [2024-03-29 01:47:05,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cddc87e1-15e4-4ea3-a7ac-47367a4e74bc] succeeded in 4.885302867000064s: None 2024-03-29T01:48:00.985411007Z [2024-03-29 01:48:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17943697-8f99-40e6-b807-bc06cc3b491b] received 2024-03-29T01:48:00.990314141Z [2024-03-29 01:48:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe8f666c-9953-4a6e-b02b-53527a3b00cd] received 2024-03-29T01:48:00.995107346Z [2024-03-29 01:48:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56cfa074-d7d7-464e-8ac1-f9de2de00655] received 2024-03-29T01:48:00.997462625Z [2024-03-29 01:48:00,997: INFO/ForkPoolWorker-16] [fe8f666c-9953-4a6e-b02b-53527a3b00cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:48:00.997861586Z [2024-03-29 01:48:00,997: INFO/ForkPoolWorker-15] [17943697-8f99-40e6-b807-bc06cc3b491b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:48:01.008778429Z [2024-03-29 01:48:01,008: INFO/ForkPoolWorker-1] [56cfa074-d7d7-464e-8ac1-f9de2de00655] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:48:01.015282350Z [2024-03-29 01:48:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6450fec-928d-4776-af34-2fd77c1a194c] received 2024-03-29T01:48:01.024527701Z [2024-03-29 01:48:01,024: INFO/ForkPoolWorker-2] [d6450fec-928d-4776-af34-2fd77c1a194c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:48:01.426126285Z [2024-03-29 01:48:01,422: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:48:01.500390708Z [2024-03-29 01:48:01,497: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:48:01.512468309Z [2024-03-29 01:48:01,505: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:48:01.573357022Z [2024-03-29 01:48:01,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:48:01.701790025Z [2024-03-29 01:48:01,701: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:48:01.706555116Z [2024-03-29 01:48:01,706: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:48:01.751687354Z [2024-03-29 01:48:01,751: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:48:01.755539090Z [2024-03-29 01:48:01,755: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:48:01.755580665Z [2024-03-29 01:48:01,755: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:48:01.755660870Z [2024-03-29 01:48:01,755: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:48:01.755916684Z [2024-03-29 01:48:01,755: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:48:01.940246968Z [2024-03-29 01:48:01,939: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:48:01.941404596Z [2024-03-29 01:48:01,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:48:03.048238953Z [2024-03-29 01:48:03,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17943697-8f99-40e6-b807-bc06cc3b491b] succeeded in 2.0565163100000063s: None 2024-03-29T01:48:03.073598922Z [2024-03-29 01:48:03,072: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6450fec-928d-4776-af34-2fd77c1a194c] succeeded in 2.055017376998876s: None 2024-03-29T01:48:03.381209506Z [2024-03-29 01:48:03,380: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:48:03.385433003Z [2024-03-29 01:48:03,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:48:03.404216709Z [2024-03-29 01:48:03,403: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:48:03.405672444Z [2024-03-29 01:48:03,405: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:48:03.405774508Z [2024-03-29 01:48:03,405: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:48:03.406063945Z [2024-03-29 01:48:03,405: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:48:03.406164013Z [2024-03-29 01:48:03,406: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:48:03.406797921Z [2024-03-29 01:48:03,406: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:48:03.406857860Z [2024-03-29 01:48:03,406: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:48:03.490033876Z [2024-03-29 01:48:03,489: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:48:03.497888576Z [2024-03-29 01:48:03,497: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:48:03.501558938Z [2024-03-29 01:48:03,501: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:48:03.521256400Z [2024-03-29 01:48:03,521: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:48:03.522747198Z [2024-03-29 01:48:03,522: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:48:03.522864803Z [2024-03-29 01:48:03,522: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:48:03.523037407Z [2024-03-29 01:48:03,522: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:48:03.523144418Z [2024-03-29 01:48:03,523: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:48:03.523422605Z [2024-03-29 01:48:03,523: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:48:03.523523627Z [2024-03-29 01:48:03,523: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:48:03.647134582Z [2024-03-29 01:48:03,645: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:48:05.186029397Z [2024-03-29 01:48:05,185: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe8f666c-9953-4a6e-b02b-53527a3b00cd] succeeded in 4.193401354999878s: None 2024-03-29T01:48:05.470262190Z [2024-03-29 01:48:05,469: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56cfa074-d7d7-464e-8ac1-f9de2de00655] succeeded in 4.472463260999575s: None 2024-03-29T01:49:00.749863326Z [2024-03-29 01:49:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fef0207-0d52-423f-9263-573104129b70] received 2024-03-29T01:49:00.763529636Z [2024-03-29 01:49:00,763: INFO/ForkPoolWorker-15] [3fef0207-0d52-423f-9263-573104129b70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:49:00.771839453Z [2024-03-29 01:49:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00b4757-3647-4f7b-802e-a37dcd653835] received 2024-03-29T01:49:00.777024918Z [2024-03-29 01:49:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3daf1126-4a58-4f3c-8b51-a84a876f921a] received 2024-03-29T01:49:00.792109344Z [2024-03-29 01:49:00,791: INFO/ForkPoolWorker-16] [b00b4757-3647-4f7b-802e-a37dcd653835] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:49:00.814536718Z [2024-03-29 01:49:00,814: INFO/ForkPoolWorker-1] [3daf1126-4a58-4f3c-8b51-a84a876f921a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:49:01.194812778Z [2024-03-29 01:49:01,191: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:49:01.231676373Z [2024-03-29 01:49:01,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:49:01.293945966Z [2024-03-29 01:49:01,290: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:49:01.528235338Z [2024-03-29 01:49:01,527: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:49:01.532537891Z [2024-03-29 01:49:01,532: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:49:01.567692845Z [2024-03-29 01:49:01,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:49:01.569103180Z [2024-03-29 01:49:01,568: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:49:01.569304390Z [2024-03-29 01:49:01,569: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:49:01.569403595Z [2024-03-29 01:49:01,569: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:49:01.569746605Z [2024-03-29 01:49:01,569: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:49:01.695384832Z [2024-03-29 01:49:01,695: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:49:02.543840828Z [2024-03-29 01:49:02,543: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3daf1126-4a58-4f3c-8b51-a84a876f921a] succeeded in 1.7637084130001313s: None 2024-03-29T01:49:02.646837703Z [2024-03-29 01:49:02,646: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:49:02.650682111Z [2024-03-29 01:49:02,650: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:49:02.670047098Z [2024-03-29 01:49:02,669: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:49:02.671646047Z [2024-03-29 01:49:02,671: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:49:02.671688549Z [2024-03-29 01:49:02,671: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:49:02.671796062Z [2024-03-29 01:49:02,671: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:49:02.671854465Z [2024-03-29 01:49:02,671: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:49:02.672135967Z [2024-03-29 01:49:02,671: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:49:02.672161765Z [2024-03-29 01:49:02,672: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:49:02.764166059Z [2024-03-29 01:49:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:49:02.917532467Z [2024-03-29 01:49:02,917: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:49:02.921715682Z [2024-03-29 01:49:02,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:49:02.944273233Z [2024-03-29 01:49:02,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:49:02.945895258Z [2024-03-29 01:49:02,945: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:49:02.946034444Z [2024-03-29 01:49:02,945: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:49:02.946216407Z [2024-03-29 01:49:02,945: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:49:02.946327993Z [2024-03-29 01:49:02,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:49:02.946829424Z [2024-03-29 01:49:02,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:49:02.946963515Z [2024-03-29 01:49:02,946: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:49:03.061876670Z [2024-03-29 01:49:03,061: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:49:04.313943483Z [2024-03-29 01:49:04,313: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b00b4757-3647-4f7b-802e-a37dcd653835] succeeded in 3.5390911909998977s: None 2024-03-29T01:49:05.300224092Z [2024-03-29 01:49:05,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3fef0207-0d52-423f-9263-573104129b70] succeeded in 4.546560965000026s: None 2024-03-29T01:50:00.263859429Z [2024-03-29 01:50:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44d69613-bbf8-452c-909a-52e7c0371a3e] received 2024-03-29T01:50:00.266025315Z [2024-03-29 01:50:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6146827c-6d72-46a5-a488-a4a09936b963] received 2024-03-29T01:50:00.277007800Z [2024-03-29 01:50:00,275: INFO/ForkPoolWorker-15] [44d69613-bbf8-452c-909a-52e7c0371a3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:50:00.281038969Z [2024-03-29 01:50:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[639ac02d-0064-49ea-a90a-2b8622420573] received 2024-03-29T01:50:00.286376588Z [2024-03-29 01:50:00,285: INFO/ForkPoolWorker-16] [6146827c-6d72-46a5-a488-a4a09936b963] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:00.293655237Z [2024-03-29 01:50:00,293: INFO/ForkPoolWorker-1] [639ac02d-0064-49ea-a90a-2b8622420573] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:50:00.306650778Z [2024-03-29 01:50:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa29d045-85d5-4b0e-8c11-deb78cec7846] received 2024-03-29T01:50:00.314657320Z [2024-03-29 01:50:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[244019a2-61ca-43ea-98a7-b8eabd2812b1] received 2024-03-29T01:50:00.340221325Z [2024-03-29 01:50:00,322: INFO/ForkPoolWorker-2] [fa29d045-85d5-4b0e-8c11-deb78cec7846] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:50:00.360244186Z [2024-03-29 01:50:00,359: INFO/ForkPoolWorker-3] [244019a2-61ca-43ea-98a7-b8eabd2812b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:50:00.659021498Z [2024-03-29 01:50:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:50:00.706348850Z [2024-03-29 01:50:00,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:50:00.801016671Z [2024-03-29 01:50:00,797: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:50:00.914372086Z [2024-03-29 01:50:00,907: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:50:00.959288903Z [2024-03-29 01:50:00,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:50:00.965377792Z [2024-03-29 01:50:00,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:01.215923431Z [2024-03-29 01:50:01,215: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T01:50:01.220262076Z [2024-03-29 01:50:01,219: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:01.279798995Z [2024-03-29 01:50:01,279: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:50:01.282572819Z [2024-03-29 01:50:01,282: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:50:01.282896846Z [2024-03-29 01:50:01,282: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:50:01.283062644Z [2024-03-29 01:50:01,282: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T01:50:01.283356212Z [2024-03-29 01:50:01,283: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:50:01.424799623Z [2024-03-29 01:50:01,424: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:01.921648710Z [2024-03-29 01:50:01,915: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[639ac02d-0064-49ea-a90a-2b8622420573] succeeded in 1.6322879149993241s: None 2024-03-29T01:50:02.397033968Z [2024-03-29 01:50:02,396: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T01:50:02.400707756Z [2024-03-29 01:50:02,400: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:02.420710510Z [2024-03-29 01:50:02,420: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:50:02.422108825Z [2024-03-29 01:50:02,421: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:02.422126262Z [2024-03-29 01:50:02,421: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:02.422266198Z [2024-03-29 01:50:02,422: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:02.422283468Z [2024-03-29 01:50:02,422: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T01:50:02.422775782Z [2024-03-29 01:50:02,422: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:50:02.422794510Z [2024-03-29 01:50:02,422: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:02.513240736Z [2024-03-29 01:50:02,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44d69613-bbf8-452c-909a-52e7c0371a3e] succeeded in 2.246891149001385s: None 2024-03-29T01:50:02.523046649Z [2024-03-29 01:50:02,522: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:02.720517162Z [2024-03-29 01:50:02,720: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T01:50:02.724955342Z [2024-03-29 01:50:02,724: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:50:02.726335993Z [2024-03-29 01:50:02,725: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:02.732064715Z [2024-03-29 01:50:02,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:02.754088691Z [2024-03-29 01:50:02,753: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T01:50:02.756754963Z [2024-03-29 01:50:02,756: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:02.756822336Z [2024-03-29 01:50:02,756: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:02.757118432Z [2024-03-29 01:50:02,756: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:02.757133938Z [2024-03-29 01:50:02,757: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T01:50:02.757434954Z [2024-03-29 01:50:02,757: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:50:02.757510348Z [2024-03-29 01:50:02,757: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:02.758260692Z [2024-03-29 01:50:02,758: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:50:02.760841388Z [2024-03-29 01:50:02,760: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:02.761035608Z [2024-03-29 01:50:02,760: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:02.761249053Z [2024-03-29 01:50:02,760: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:02.761400802Z [2024-03-29 01:50:02,761: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:50:02.761741354Z [2024-03-29 01:50:02,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:50:02.761892875Z [2024-03-29 01:50:02,761: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:02.860096933Z [2024-03-29 01:50:02,859: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:02.880328721Z [2024-03-29 01:50:02,879: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:03.567869799Z [2024-03-29 01:50:03,567: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6146827c-6d72-46a5-a488-a4a09936b963] succeeded in 3.298447254999701s: None 2024-03-29T01:50:04.394211063Z [2024-03-29 01:50:04,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f58b6d9-b2d1-4449-b477-b82e6eeba695] received 2024-03-29T01:50:04.404138111Z [2024-03-29 01:50:04,403: INFO/ForkPoolWorker-15] [8f58b6d9-b2d1-4449-b477-b82e6eeba695] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:04.696315965Z [2024-03-29 01:50:04,694: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[244019a2-61ca-43ea-98a7-b8eabd2812b1] succeeded in 4.371746812999845s: None 2024-03-29T01:50:04.783180019Z [2024-03-29 01:50:04,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:50:05.365409306Z [2024-03-29 01:50:05,364: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa29d045-85d5-4b0e-8c11-deb78cec7846] succeeded in 5.049662252999042s: None 2024-03-29T01:50:06.368451973Z [2024-03-29 01:50:06,368: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:50:06.373085160Z [2024-03-29 01:50:06,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:06.435708749Z [2024-03-29 01:50:06,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:50:06.437295270Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:06.437412564Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:06.437614169Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:06.437717437Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:50:06.438055458Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:50:06.438145377Z [2024-03-29 01:50:06,437: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:06.564619064Z [2024-03-29 01:50:06,564: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:07.616191329Z [2024-03-29 01:50:07,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f58b6d9-b2d1-4449-b477-b82e6eeba695] succeeded in 3.2198058880003373s: None 2024-03-29T01:50:08.438491011Z [2024-03-29 01:50:08,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed304bc5-a4e2-4f71-aad6-1f64019cc3e0] received 2024-03-29T01:50:08.447826323Z [2024-03-29 01:50:08,447: INFO/ForkPoolWorker-15] [ed304bc5-a4e2-4f71-aad6-1f64019cc3e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:50:08.902636419Z [2024-03-29 01:50:08,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:50:10.068312569Z [2024-03-29 01:50:10,067: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:50:10.071945134Z [2024-03-29 01:50:10,071: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:10.091958408Z [2024-03-29 01:50:10,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:50:10.095151551Z [2024-03-29 01:50:10,094: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:10.095571766Z [2024-03-29 01:50:10,095: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:10.096128381Z [2024-03-29 01:50:10,095: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:10.096452258Z [2024-03-29 01:50:10,096: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:50:10.097225985Z [2024-03-29 01:50:10,096: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:50:10.097537607Z [2024-03-29 01:50:10,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:10.200573636Z [2024-03-29 01:50:10,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:10.790374536Z [2024-03-29 01:50:10,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed304bc5-a4e2-4f71-aad6-1f64019cc3e0] succeeded in 2.349329538999882s: None 2024-03-29T01:50:11.015757613Z [2024-03-29 01:50:11,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4377de2-71a7-4de8-b6af-c216206e997f] received 2024-03-29T01:50:11.022662647Z [2024-03-29 01:50:11,022: INFO/ForkPoolWorker-15] [e4377de2-71a7-4de8-b6af-c216206e997f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:11.386261598Z [2024-03-29 01:50:11,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:50:12.572261536Z [2024-03-29 01:50:12,571: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:50:12.575692699Z [2024-03-29 01:50:12,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:50:12.597666239Z [2024-03-29 01:50:12,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:50:12.599156958Z [2024-03-29 01:50:12,598: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:50:12.599174100Z [2024-03-29 01:50:12,599: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:50:12.599257296Z [2024-03-29 01:50:12,599: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:50:12.599320785Z [2024-03-29 01:50:12,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:50:12.599659890Z [2024-03-29 01:50:12,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:50:12.599671458Z [2024-03-29 01:50:12,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:50:12.684686218Z [2024-03-29 01:50:12,684: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:50:13.219836096Z [2024-03-29 01:50:13,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4377de2-71a7-4de8-b6af-c216206e997f] succeeded in 2.201336287000231s: None 2024-03-29T01:51:00.315481844Z [2024-03-29 01:51:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48a7ea0d-9ce0-4d38-bfdb-ac7a37a4cd68] received 2024-03-29T01:51:00.326957684Z [2024-03-29 01:51:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18f98b32-1ac8-492b-a457-f681cc5f3c1c] received 2024-03-29T01:51:00.331151415Z [2024-03-29 01:51:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8681469e-f230-4d0b-a436-fb50a540e3e9] received 2024-03-29T01:51:00.331501212Z [2024-03-29 01:51:00,331: INFO/ForkPoolWorker-15] [48a7ea0d-9ce0-4d38-bfdb-ac7a37a4cd68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:51:00.333767955Z [2024-03-29 01:51:00,333: INFO/ForkPoolWorker-16] [18f98b32-1ac8-492b-a457-f681cc5f3c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:51:00.342821783Z [2024-03-29 01:51:00,342: INFO/ForkPoolWorker-1] [8681469e-f230-4d0b-a436-fb50a540e3e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:51:00.646652918Z [2024-03-29 01:51:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:51:00.695574710Z [2024-03-29 01:51:00,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:51:00.699536045Z [2024-03-29 01:51:00,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:51:00.871793780Z [2024-03-29 01:51:00,871: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:51:00.875986631Z [2024-03-29 01:51:00,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:51:00.900395394Z [2024-03-29 01:51:00,900: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:51:00.901452586Z [2024-03-29 01:51:00,901: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:51:00.901572553Z [2024-03-29 01:51:00,901: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:51:00.901666523Z [2024-03-29 01:51:00,901: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:51:00.901920336Z [2024-03-29 01:51:00,901: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:51:00.986266041Z [2024-03-29 01:51:00,986: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:51:01.666618835Z [2024-03-29 01:51:01,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8681469e-f230-4d0b-a436-fb50a540e3e9] succeeded in 1.3327325160007604s: None 2024-03-29T01:51:01.889630522Z [2024-03-29 01:51:01,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:51:01.894540554Z [2024-03-29 01:51:01,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:51:01.918078928Z [2024-03-29 01:51:01,917: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:51:01.920258658Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:51:01.920382356Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:51:01.920573338Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:51:01.920631222Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:51:01.920989156Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:51:01.921055420Z [2024-03-29 01:51:01,920: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:51:01.953457901Z [2024-03-29 01:51:01,953: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:51:01.957475266Z [2024-03-29 01:51:01,956: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:51:01.975095418Z [2024-03-29 01:51:01,974: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:51:01.976690170Z [2024-03-29 01:51:01,976: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:51:01.976709640Z [2024-03-29 01:51:01,976: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:51:01.976878359Z [2024-03-29 01:51:01,976: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:51:01.976886110Z [2024-03-29 01:51:01,976: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:51:01.977201834Z [2024-03-29 01:51:01,977: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:51:01.977221754Z [2024-03-29 01:51:01,977: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:51:02.020727707Z [2024-03-29 01:51:02,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:51:02.056762590Z [2024-03-29 01:51:02,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:51:03.720210300Z [2024-03-29 01:51:03,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18f98b32-1ac8-492b-a457-f681cc5f3c1c] succeeded in 3.391092539000965s: None 2024-03-29T01:51:04.784757494Z [2024-03-29 01:51:04,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48a7ea0d-9ce0-4d38-bfdb-ac7a37a4cd68] succeeded in 4.465188586000295s: None 2024-03-29T01:52:01.019468024Z [2024-03-29 01:52:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d2180ff-a827-46c9-845d-7fa52c808a89] received 2024-03-29T01:52:01.022352985Z [2024-03-29 01:52:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[101c8dd9-1bd9-484c-a14c-f877e6f56715] received 2024-03-29T01:52:01.026488682Z [2024-03-29 01:52:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d42ef9df-1f7d-4104-aebf-396e3a9fcb3c] received 2024-03-29T01:52:01.026789684Z [2024-03-29 01:52:01,026: INFO/ForkPoolWorker-15] [1d2180ff-a827-46c9-845d-7fa52c808a89] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:52:01.029363953Z [2024-03-29 01:52:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9026b838-e2ee-4d35-91c2-3bed59986469] received 2024-03-29T01:52:01.036693395Z [2024-03-29 01:52:01,036: INFO/ForkPoolWorker-16] [101c8dd9-1bd9-484c-a14c-f877e6f56715] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:52:01.039216954Z [2024-03-29 01:52:01,038: INFO/ForkPoolWorker-1] [d42ef9df-1f7d-4104-aebf-396e3a9fcb3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:52:01.041121693Z [2024-03-29 01:52:01,040: INFO/ForkPoolWorker-2] [9026b838-e2ee-4d35-91c2-3bed59986469] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:52:01.372707723Z [2024-03-29 01:52:01,366: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:52:01.435717657Z [2024-03-29 01:52:01,432: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:52:01.495781448Z [2024-03-29 01:52:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:52:01.692693995Z [2024-03-29 01:52:01,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:52:02.171127488Z [2024-03-29 01:52:02,170: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:52:02.184271305Z [2024-03-29 01:52:02,175: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:52:02.207959795Z [2024-03-29 01:52:02,207: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:52:02.220985782Z [2024-03-29 01:52:02,220: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:52:02.225193538Z [2024-03-29 01:52:02,224: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:52:02.225337023Z [2024-03-29 01:52:02,225: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:52:02.225474655Z [2024-03-29 01:52:02,225: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:52:02.225751391Z [2024-03-29 01:52:02,225: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:52:02.341718210Z [2024-03-29 01:52:02,338: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:52:03.276128746Z [2024-03-29 01:52:03,275: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9026b838-e2ee-4d35-91c2-3bed59986469] succeeded in 2.2442425930003083s: None 2024-03-29T01:52:03.308851477Z [2024-03-29 01:52:03,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d2180ff-a827-46c9-845d-7fa52c808a89] succeeded in 2.287015457999587s: None 2024-03-29T01:52:03.322858772Z [2024-03-29 01:52:03,322: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:52:03.326593640Z [2024-03-29 01:52:03,326: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:52:03.347130020Z [2024-03-29 01:52:03,346: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:52:03.348646584Z [2024-03-29 01:52:03,348: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:52:03.348702657Z [2024-03-29 01:52:03,348: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:52:03.348906991Z [2024-03-29 01:52:03,348: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:52:03.349022202Z [2024-03-29 01:52:03,348: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:52:03.349321370Z [2024-03-29 01:52:03,349: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:52:03.349806282Z [2024-03-29 01:52:03,349: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:52:03.441093944Z [2024-03-29 01:52:03,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:52:03.492999553Z [2024-03-29 01:52:03,492: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:52:03.496789885Z [2024-03-29 01:52:03,496: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:52:03.514959765Z [2024-03-29 01:52:03,514: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:52:03.517542876Z [2024-03-29 01:52:03,517: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:52:03.517787809Z [2024-03-29 01:52:03,517: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:52:03.518031929Z [2024-03-29 01:52:03,517: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:52:03.518343642Z [2024-03-29 01:52:03,517: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:52:03.519076319Z [2024-03-29 01:52:03,518: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:52:03.519207175Z [2024-03-29 01:52:03,518: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:52:03.679431131Z [2024-03-29 01:52:03,679: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:52:05.134779238Z [2024-03-29 01:52:05,134: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d42ef9df-1f7d-4104-aebf-396e3a9fcb3c] succeeded in 4.106137217999276s: None 2024-03-29T01:52:05.615792269Z [2024-03-29 01:52:05,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[101c8dd9-1bd9-484c-a14c-f877e6f56715] succeeded in 4.591132016999836s: None 2024-03-29T01:53:00.732100053Z [2024-03-29 01:53:00,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b9d18eb-0ed9-4d27-9240-0afcb3622af5] received 2024-03-29T01:53:00.734021171Z [2024-03-29 01:53:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3769d62d-21cb-426f-bcaf-1b1972ea3161] received 2024-03-29T01:53:00.740130556Z [2024-03-29 01:53:00,739: INFO/ForkPoolWorker-15] [3b9d18eb-0ed9-4d27-9240-0afcb3622af5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:53:00.744409775Z [2024-03-29 01:53:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[252ae2ce-adb6-49cf-b8ae-99dd66dd2e82] received 2024-03-29T01:53:00.745356477Z [2024-03-29 01:53:00,745: INFO/ForkPoolWorker-16] [3769d62d-21cb-426f-bcaf-1b1972ea3161] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:53:00.760447667Z [2024-03-29 01:53:00,759: INFO/ForkPoolWorker-1] [252ae2ce-adb6-49cf-b8ae-99dd66dd2e82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:53:01.079481041Z [2024-03-29 01:53:01,075: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:53:01.175991268Z [2024-03-29 01:53:01,172: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:53:01.209104903Z [2024-03-29 01:53:01,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:53:01.378332014Z [2024-03-29 01:53:01,377: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:53:01.382422515Z [2024-03-29 01:53:01,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:53:01.409058756Z [2024-03-29 01:53:01,408: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:53:01.410721150Z [2024-03-29 01:53:01,410: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:53:01.410859530Z [2024-03-29 01:53:01,410: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:53:01.410931216Z [2024-03-29 01:53:01,410: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:53:01.411247705Z [2024-03-29 01:53:01,411: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:53:01.537078312Z [2024-03-29 01:53:01,536: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:53:02.202601275Z [2024-03-29 01:53:02,202: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[252ae2ce-adb6-49cf-b8ae-99dd66dd2e82] succeeded in 1.4522609600007854s: None 2024-03-29T01:53:02.533350196Z [2024-03-29 01:53:02,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:53:02.537056373Z [2024-03-29 01:53:02,536: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:53:02.560147446Z [2024-03-29 01:53:02,559: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:53:02.561545384Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:53:02.561642200Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:53:02.561741564Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:53:02.561787431Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:53:02.562112365Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:53:02.562118829Z [2024-03-29 01:53:02,561: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:53:02.658973493Z [2024-03-29 01:53:02,658: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:53:02.692363643Z [2024-03-29 01:53:02,691: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:53:02.696071190Z [2024-03-29 01:53:02,695: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:53:02.716310551Z [2024-03-29 01:53:02,716: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:53:02.717674350Z [2024-03-29 01:53:02,717: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:53:02.717804667Z [2024-03-29 01:53:02,717: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:53:02.718003117Z [2024-03-29 01:53:02,717: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:53:02.718119639Z [2024-03-29 01:53:02,717: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:53:02.718617294Z [2024-03-29 01:53:02,718: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:53:02.718804363Z [2024-03-29 01:53:02,718: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:53:02.802904462Z [2024-03-29 01:53:02,802: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:53:04.268679719Z [2024-03-29 01:53:04,268: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3769d62d-21cb-426f-bcaf-1b1972ea3161] succeeded in 3.52909580099913s: None 2024-03-29T01:53:04.785510273Z [2024-03-29 01:53:04,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b9d18eb-0ed9-4d27-9240-0afcb3622af5] succeeded in 4.050161384999228s: None 2024-03-29T01:54:00.352027277Z [2024-03-29 01:54:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e58541f1-8342-4a0b-96a7-f264d9f1bcd4] received 2024-03-29T01:54:00.354337391Z [2024-03-29 01:54:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[644a9b21-0102-4d8f-9c9e-818285fc5a13] received 2024-03-29T01:54:00.363258049Z [2024-03-29 01:54:00,362: INFO/ForkPoolWorker-15] [e58541f1-8342-4a0b-96a7-f264d9f1bcd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:54:00.364818695Z [2024-03-29 01:54:00,364: INFO/ForkPoolWorker-16] [644a9b21-0102-4d8f-9c9e-818285fc5a13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:54:00.369026422Z [2024-03-29 01:54:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5b9a00-2f17-4354-af22-413b9f5c4978] received 2024-03-29T01:54:00.376620744Z [2024-03-29 01:54:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca4cdfcb-48b7-4f10-808d-754aa2b79d5f] received 2024-03-29T01:54:00.381264797Z [2024-03-29 01:54:00,380: INFO/ForkPoolWorker-1] [4c5b9a00-2f17-4354-af22-413b9f5c4978] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:54:00.384175145Z [2024-03-29 01:54:00,383: INFO/ForkPoolWorker-2] [ca4cdfcb-48b7-4f10-808d-754aa2b79d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:54:00.661201528Z [2024-03-29 01:54:00,657: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:54:00.670201502Z [2024-03-29 01:54:00,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:54:00.811060358Z [2024-03-29 01:54:00,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:54:00.856739806Z [2024-03-29 01:54:00,850: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:54:00.975713616Z [2024-03-29 01:54:00,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:54:00.982242043Z [2024-03-29 01:54:00,981: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:54:00.989473787Z [2024-03-29 01:54:00,988: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:54:01.027957759Z [2024-03-29 01:54:01,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:54:01.035811870Z [2024-03-29 01:54:01,035: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:54:01.036076695Z [2024-03-29 01:54:01,035: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:54:01.036212732Z [2024-03-29 01:54:01,036: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:54:01.036606131Z [2024-03-29 01:54:01,036: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:54:01.218915083Z [2024-03-29 01:54:01,218: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:54:01.637897316Z [2024-03-29 01:54:01,637: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e58541f1-8342-4a0b-96a7-f264d9f1bcd4] succeeded in 1.281777570999111s: None 2024-03-29T01:54:01.934866676Z [2024-03-29 01:54:01,934: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca4cdfcb-48b7-4f10-808d-754aa2b79d5f] succeeded in 1.5552325530006783s: None 2024-03-29T01:54:02.131871668Z [2024-03-29 01:54:02,131: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:54:02.143629659Z [2024-03-29 01:54:02,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:54:02.163010302Z [2024-03-29 01:54:02,162: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:54:02.164659662Z [2024-03-29 01:54:02,164: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:54:02.164677252Z [2024-03-29 01:54:02,164: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:54:02.164874615Z [2024-03-29 01:54:02,164: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:54:02.164885941Z [2024-03-29 01:54:02,164: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:54:02.165528185Z [2024-03-29 01:54:02,165: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:54:02.165544303Z [2024-03-29 01:54:02,165: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:54:02.278994422Z [2024-03-29 01:54:02,278: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:54:02.334192464Z [2024-03-29 01:54:02,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:54:02.337988213Z [2024-03-29 01:54:02,337: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:54:02.358963696Z [2024-03-29 01:54:02,358: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:54:02.361506165Z [2024-03-29 01:54:02,360: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:54:02.361529277Z [2024-03-29 01:54:02,360: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:54:02.361554339Z [2024-03-29 01:54:02,360: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:54:02.361560970Z [2024-03-29 01:54:02,360: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:54:02.372378353Z [2024-03-29 01:54:02,371: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:54:02.372409639Z [2024-03-29 01:54:02,371: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:54:02.464536819Z [2024-03-29 01:54:02,464: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:54:03.733566013Z [2024-03-29 01:54:03,732: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c5b9a00-2f17-4354-af22-413b9f5c4978] succeeded in 3.3574391229994944s: None 2024-03-29T01:54:04.439080998Z [2024-03-29 01:54:04,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[644a9b21-0102-4d8f-9c9e-818285fc5a13] succeeded in 4.080064931000379s: None 2024-03-29T01:55:00.752654333Z [2024-03-29 01:55:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2e736b1-b0d3-4b39-b6c9-62b90ea8d4f4] received 2024-03-29T01:55:00.758974799Z [2024-03-29 01:55:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81b3f9be-283d-41e3-a456-aaa5818d87d4] received 2024-03-29T01:55:00.760149024Z [2024-03-29 01:55:00,759: INFO/ForkPoolWorker-15] [f2e736b1-b0d3-4b39-b6c9-62b90ea8d4f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:00.766066038Z [2024-03-29 01:55:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4f0b71f-8d50-42c8-a408-25eb8fe382ca] received 2024-03-29T01:55:00.766883418Z [2024-03-29 01:55:00,766: INFO/ForkPoolWorker-16] [81b3f9be-283d-41e3-a456-aaa5818d87d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:55:00.770428414Z [2024-03-29 01:55:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02547b5a-dc25-4795-95d0-47ddb973fbaa] received 2024-03-29T01:55:00.781397455Z [2024-03-29 01:55:00,781: INFO/ForkPoolWorker-1] [a4f0b71f-8d50-42c8-a408-25eb8fe382ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:55:00.784290245Z [2024-03-29 01:55:00,783: INFO/ForkPoolWorker-2] [02547b5a-dc25-4795-95d0-47ddb973fbaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:55:01.098722349Z [2024-03-29 01:55:01,094: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:55:01.174721817Z [2024-03-29 01:55:01,171: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:55:01.266363300Z [2024-03-29 01:55:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:55:01.269807945Z [2024-03-29 01:55:01,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:55:01.340791483Z [2024-03-29 01:55:01,340: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:55:01.346060122Z [2024-03-29 01:55:01,345: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:01.422198883Z [2024-03-29 01:55:01,421: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:55:01.434153975Z [2024-03-29 01:55:01,433: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:55:01.436100686Z [2024-03-29 01:55:01,434: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:55:01.437281765Z [2024-03-29 01:55:01,436: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:55:01.438403672Z [2024-03-29 01:55:01,438: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:55:01.608871008Z [2024-03-29 01:55:01,608: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:02.405808403Z [2024-03-29 01:55:02,405: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02547b5a-dc25-4795-95d0-47ddb973fbaa] succeeded in 1.6299933419995796s: None 2024-03-29T01:55:02.434966129Z [2024-03-29 01:55:02,434: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:55:02.439134990Z [2024-03-29 01:55:02,438: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:02.464092217Z [2024-03-29 01:55:02,463: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:55:02.466209759Z [2024-03-29 01:55:02,465: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:02.466603174Z [2024-03-29 01:55:02,466: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:02.466900358Z [2024-03-29 01:55:02,466: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:02.467115226Z [2024-03-29 01:55:02,466: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:55:02.467590240Z [2024-03-29 01:55:02,467: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:55:02.467775154Z [2024-03-29 01:55:02,467: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:02.578556434Z [2024-03-29 01:55:02,578: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:02.632720224Z [2024-03-29 01:55:02,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:55:02.636516330Z [2024-03-29 01:55:02,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:02.657144102Z [2024-03-29 01:55:02,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:55:02.658404417Z [2024-03-29 01:55:02,658: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:02.658636533Z [2024-03-29 01:55:02,658: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:02.658833780Z [2024-03-29 01:55:02,658: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:02.658982959Z [2024-03-29 01:55:02,658: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:55:02.659628079Z [2024-03-29 01:55:02,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:55:02.659849584Z [2024-03-29 01:55:02,659: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:02.698346570Z [2024-03-29 01:55:02,697: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:55:02.704361556Z [2024-03-29 01:55:02,703: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:02.745779489Z [2024-03-29 01:55:02,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:55:02.751991392Z [2024-03-29 01:55:02,751: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:02.752252756Z [2024-03-29 01:55:02,751: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:02.752542543Z [2024-03-29 01:55:02,752: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:02.752832039Z [2024-03-29 01:55:02,752: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:55:02.753286663Z [2024-03-29 01:55:02,753: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:55:02.753610284Z [2024-03-29 01:55:02,753: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:02.764692917Z [2024-03-29 01:55:02,764: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:02.852080836Z [2024-03-29 01:55:02,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:03.370265384Z [2024-03-29 01:55:03,369: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2e736b1-b0d3-4b39-b6c9-62b90ea8d4f4] succeeded in 2.616222544998891s: None 2024-03-29T01:55:04.366800958Z [2024-03-29 01:55:04,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12560c5f-c19f-44a6-97fe-fecc869dff49] received 2024-03-29T01:55:04.376247927Z [2024-03-29 01:55:04,375: INFO/ForkPoolWorker-15] [12560c5f-c19f-44a6-97fe-fecc869dff49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:04.415571565Z [2024-03-29 01:55:04,415: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4f0b71f-8d50-42c8-a408-25eb8fe382ca] succeeded in 3.640911274998871s: None 2024-03-29T01:55:04.487768807Z [2024-03-29 01:55:04,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81b3f9be-283d-41e3-a456-aaa5818d87d4] succeeded in 3.7264613890001783s: None 2024-03-29T01:55:04.714658396Z [2024-03-29 01:55:04,710: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:55:05.942589429Z [2024-03-29 01:55:05,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:55:05.946575083Z [2024-03-29 01:55:05,945: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:05.982065056Z [2024-03-29 01:55:05,970: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:55:05.982105730Z [2024-03-29 01:55:05,971: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:05.982134296Z [2024-03-29 01:55:05,971: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:05.982142304Z [2024-03-29 01:55:05,971: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:05.982149171Z [2024-03-29 01:55:05,971: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:55:05.982154168Z [2024-03-29 01:55:05,972: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:55:05.982159314Z [2024-03-29 01:55:05,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:06.107248138Z [2024-03-29 01:55:06,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:06.798556340Z [2024-03-29 01:55:06,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b595326-a5b2-47d5-8e1d-c72a95e4e121] received 2024-03-29T01:55:06.807676552Z [2024-03-29 01:55:06,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12560c5f-c19f-44a6-97fe-fecc869dff49] succeeded in 2.4393743990003713s: None 2024-03-29T01:55:06.809449843Z [2024-03-29 01:55:06,809: INFO/ForkPoolWorker-16] [4b595326-a5b2-47d5-8e1d-c72a95e4e121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:55:07.109620132Z [2024-03-29 01:55:07,106: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:55:08.403554413Z [2024-03-29 01:55:08,403: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:55:08.407324733Z [2024-03-29 01:55:08,406: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:08.450371839Z [2024-03-29 01:55:08,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:55:08.451800569Z [2024-03-29 01:55:08,451: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:08.451816395Z [2024-03-29 01:55:08,451: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:08.451923818Z [2024-03-29 01:55:08,451: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:08.451956007Z [2024-03-29 01:55:08,451: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:55:08.454017176Z [2024-03-29 01:55:08,452: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:55:08.454029563Z [2024-03-29 01:55:08,452: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:08.540759944Z [2024-03-29 01:55:08,540: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:09.067510914Z [2024-03-29 01:55:09,067: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b595326-a5b2-47d5-8e1d-c72a95e4e121] succeeded in 2.266459931999634s: None 2024-03-29T01:55:09.122276167Z [2024-03-29 01:55:09,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c05c623-ff6e-4920-ae91-bacb795705d7] received 2024-03-29T01:55:09.129791798Z [2024-03-29 01:55:09,129: INFO/ForkPoolWorker-15] [6c05c623-ff6e-4920-ae91-bacb795705d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:09.443166252Z [2024-03-29 01:55:09,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T01:55:10.585083577Z [2024-03-29 01:55:10,584: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:55:10.588889446Z [2024-03-29 01:55:10,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:55:10.608826452Z [2024-03-29 01:55:10,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:55:10.610157905Z [2024-03-29 01:55:10,609: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:55:10.610174789Z [2024-03-29 01:55:10,610: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:55:10.610328471Z [2024-03-29 01:55:10,610: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:55:10.610339023Z [2024-03-29 01:55:10,610: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:55:10.610714120Z [2024-03-29 01:55:10,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T01:55:10.610729958Z [2024-03-29 01:55:10,610: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:55:10.691438880Z [2024-03-29 01:55:10,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:55:11.242559960Z [2024-03-29 01:55:11,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c05c623-ff6e-4920-ae91-bacb795705d7] succeeded in 2.1181211969997094s: None 2024-03-29T01:56:00.872069686Z [2024-03-29 01:56:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28152513-7014-4131-940f-da88f8a8f17e] received 2024-03-29T01:56:00.874695097Z [2024-03-29 01:56:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12cbd1d4-8186-4f97-82a8-5dad107cb990] received 2024-03-29T01:56:00.882590216Z [2024-03-29 01:56:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac9384c-ed34-4c0f-9bfa-86ec3ce86ae9] received 2024-03-29T01:56:00.883671547Z [2024-03-29 01:56:00,883: INFO/ForkPoolWorker-15] [28152513-7014-4131-940f-da88f8a8f17e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:56:00.883916359Z [2024-03-29 01:56:00,883: INFO/ForkPoolWorker-16] [12cbd1d4-8186-4f97-82a8-5dad107cb990] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:56:00.888156592Z [2024-03-29 01:56:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dee643b6-4c35-4869-bf43-dec64df997cf] received 2024-03-29T01:56:00.893911262Z [2024-03-29 01:56:00,893: INFO/ForkPoolWorker-2] [dee643b6-4c35-4869-bf43-dec64df997cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:56:00.895919388Z [2024-03-29 01:56:00,895: INFO/ForkPoolWorker-1] [6ac9384c-ed34-4c0f-9bfa-86ec3ce86ae9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:56:01.308788616Z [2024-03-29 01:56:01,305: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:56:01.356239396Z [2024-03-29 01:56:01,352: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:56:01.446176825Z [2024-03-29 01:56:01,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:56:01.447771504Z [2024-03-29 01:56:01,443: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:56:01.633710062Z [2024-03-29 01:56:01,633: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:56:01.637978387Z [2024-03-29 01:56:01,637: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:56:01.674156879Z [2024-03-29 01:56:01,673: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:56:01.676535808Z [2024-03-29 01:56:01,676: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:56:01.676884491Z [2024-03-29 01:56:01,676: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:56:01.677142374Z [2024-03-29 01:56:01,676: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:56:01.678435259Z [2024-03-29 01:56:01,678: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:56:01.813921512Z [2024-03-29 01:56:01,813: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:56:01.863746529Z [2024-03-29 01:56:01,863: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:56:02.621918555Z [2024-03-29 01:56:02,621: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dee643b6-4c35-4869-bf43-dec64df997cf] succeeded in 1.7323905969988118s: None 2024-03-29T01:56:02.733388591Z [2024-03-29 01:56:02,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28152513-7014-4131-940f-da88f8a8f17e] succeeded in 1.8569857769998634s: None 2024-03-29T01:56:02.860520871Z [2024-03-29 01:56:02,860: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:56:02.864402523Z [2024-03-29 01:56:02,863: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:56:02.886411756Z [2024-03-29 01:56:02,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:56:02.887982377Z [2024-03-29 01:56:02,887: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:56:02.888027449Z [2024-03-29 01:56:02,887: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:56:02.888171140Z [2024-03-29 01:56:02,887: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:56:02.888194831Z [2024-03-29 01:56:02,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:56:02.888483964Z [2024-03-29 01:56:02,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:56:02.888967060Z [2024-03-29 01:56:02,888: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:56:03.006432887Z [2024-03-29 01:56:03,006: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:56:03.404295126Z [2024-03-29 01:56:03,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:56:03.407987988Z [2024-03-29 01:56:03,407: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:56:03.432454470Z [2024-03-29 01:56:03,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:56:03.434096522Z [2024-03-29 01:56:03,433: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:56:03.434317524Z [2024-03-29 01:56:03,434: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:56:03.434573808Z [2024-03-29 01:56:03,434: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:56:03.434719208Z [2024-03-29 01:56:03,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:56:03.435583854Z [2024-03-29 01:56:03,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:56:03.435802756Z [2024-03-29 01:56:03,435: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:56:03.589775950Z [2024-03-29 01:56:03,589: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:56:05.438998923Z [2024-03-29 01:56:05,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ac9384c-ed34-4c0f-9bfa-86ec3ce86ae9] succeeded in 4.5496361229998s: None 2024-03-29T01:56:05.501476986Z [2024-03-29 01:56:05,501: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12cbd1d4-8186-4f97-82a8-5dad107cb990] succeeded in 4.62496025299879s: None 2024-03-29T01:57:00.612127920Z [2024-03-29 01:57:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56597767-ef5e-4887-93cd-e925cbe4ce07] received 2024-03-29T01:57:00.615720391Z [2024-03-29 01:57:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[217f5ae1-5144-4e5a-abb7-679d4136b831] received 2024-03-29T01:57:00.623243084Z [2024-03-29 01:57:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cae7e8a-29cb-4b80-825b-5cf574b1faf7] received 2024-03-29T01:57:00.624715082Z [2024-03-29 01:57:00,624: INFO/ForkPoolWorker-15] [56597767-ef5e-4887-93cd-e925cbe4ce07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:57:00.633700740Z [2024-03-29 01:57:00,633: INFO/ForkPoolWorker-1] [8cae7e8a-29cb-4b80-825b-5cf574b1faf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:57:00.638415416Z [2024-03-29 01:57:00,638: INFO/ForkPoolWorker-16] [217f5ae1-5144-4e5a-abb7-679d4136b831] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:57:01.007328931Z [2024-03-29 01:57:01,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:57:01.025295105Z [2024-03-29 01:57:01,021: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:57:01.123434823Z [2024-03-29 01:57:01,119: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:57:01.358311638Z [2024-03-29 01:57:01,357: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:57:01.362787140Z [2024-03-29 01:57:01,362: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:57:01.383493670Z [2024-03-29 01:57:01,383: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:57:01.385735382Z [2024-03-29 01:57:01,385: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:57:01.385905307Z [2024-03-29 01:57:01,385: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:57:01.386045571Z [2024-03-29 01:57:01,385: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:57:01.386649863Z [2024-03-29 01:57:01,386: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:57:01.484059540Z [2024-03-29 01:57:01,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:57:02.268269433Z [2024-03-29 01:57:02,267: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cae7e8a-29cb-4b80-825b-5cf574b1faf7] succeeded in 1.6434589109994704s: None 2024-03-29T01:57:02.398762999Z [2024-03-29 01:57:02,398: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:57:02.403473769Z [2024-03-29 01:57:02,402: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:57:02.425140173Z [2024-03-29 01:57:02,424: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:57:02.426850110Z [2024-03-29 01:57:02,426: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:57:02.427018578Z [2024-03-29 01:57:02,426: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:57:02.427341166Z [2024-03-29 01:57:02,426: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:57:02.427558080Z [2024-03-29 01:57:02,427: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:57:02.427968114Z [2024-03-29 01:57:02,427: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:57:02.428205677Z [2024-03-29 01:57:02,428: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:57:02.517684187Z [2024-03-29 01:57:02,517: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:57:02.607435341Z [2024-03-29 01:57:02,606: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:57:02.613068381Z [2024-03-29 01:57:02,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:57:02.643685725Z [2024-03-29 01:57:02,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:57:02.645256603Z [2024-03-29 01:57:02,644: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:57:02.645434549Z [2024-03-29 01:57:02,645: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:57:02.645596238Z [2024-03-29 01:57:02,645: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:57:02.645670139Z [2024-03-29 01:57:02,645: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:57:02.645952766Z [2024-03-29 01:57:02,645: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:57:02.646035193Z [2024-03-29 01:57:02,645: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:57:02.751993023Z [2024-03-29 01:57:02,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:57:04.582353898Z [2024-03-29 01:57:04,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56597767-ef5e-4887-93cd-e925cbe4ce07] succeeded in 3.9686445629995433s: None 2024-03-29T01:57:04.887529831Z [2024-03-29 01:57:04,886: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[217f5ae1-5144-4e5a-abb7-679d4136b831] succeeded in 4.2667735670002s: None 2024-03-29T01:58:00.471647274Z [2024-03-29 01:58:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f50bf23e-1e3a-400d-bc9c-3dff7a0089ae] received 2024-03-29T01:58:00.480507172Z [2024-03-29 01:58:00,480: INFO/ForkPoolWorker-15] [f50bf23e-1e3a-400d-bc9c-3dff7a0089ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:58:00.492952545Z [2024-03-29 01:58:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[171f9b64-a13f-493d-8715-32c614c9c761] received 2024-03-29T01:58:00.498500893Z [2024-03-29 01:58:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92f4b843-99e7-48b9-b197-ca5e1e37f159] received 2024-03-29T01:58:00.507388213Z [2024-03-29 01:58:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2acf8599-1b8c-4ed1-afde-56f28c9a47e0] received 2024-03-29T01:58:00.510843721Z [2024-03-29 01:58:00,510: INFO/ForkPoolWorker-16] [171f9b64-a13f-493d-8715-32c614c9c761] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:58:00.514175073Z [2024-03-29 01:58:00,513: INFO/ForkPoolWorker-1] [92f4b843-99e7-48b9-b197-ca5e1e37f159] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:58:00.515697450Z [2024-03-29 01:58:00,515: INFO/ForkPoolWorker-2] [2acf8599-1b8c-4ed1-afde-56f28c9a47e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:58:00.845706677Z [2024-03-29 01:58:00,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:58:00.854312661Z [2024-03-29 01:58:00,851: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:58:00.855652693Z [2024-03-29 01:58:00,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:58:00.949749458Z [2024-03-29 01:58:00,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T01:58:01.041866059Z [2024-03-29 01:58:01,041: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T01:58:01.045990028Z [2024-03-29 01:58:01,045: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:58:01.077323287Z [2024-03-29 01:58:01,077: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T01:58:01.082541127Z [2024-03-29 01:58:01,082: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:58:01.082786225Z [2024-03-29 01:58:01,082: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:58:01.082861545Z [2024-03-29 01:58:01,082: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T01:58:01.083918317Z [2024-03-29 01:58:01,083: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:58:01.215007952Z [2024-03-29 01:58:01,214: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:58:01.285502877Z [2024-03-29 01:58:01,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:58:01.957554962Z [2024-03-29 01:58:01,957: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2acf8599-1b8c-4ed1-afde-56f28c9a47e0] succeeded in 1.4482548830001178s: None 2024-03-29T01:58:01.960692711Z [2024-03-29 01:58:01,960: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f50bf23e-1e3a-400d-bc9c-3dff7a0089ae] succeeded in 1.4873632280014135s: None 2024-03-29T01:58:02.179784277Z [2024-03-29 01:58:02,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T01:58:02.183309837Z [2024-03-29 01:58:02,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:58:02.203839283Z [2024-03-29 01:58:02,203: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:58:02.206374548Z [2024-03-29 01:58:02,206: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:58:02.206541291Z [2024-03-29 01:58:02,206: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:58:02.206866459Z [2024-03-29 01:58:02,206: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:58:02.207155544Z [2024-03-29 01:58:02,206: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T01:58:02.207822399Z [2024-03-29 01:58:02,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:58:02.208088457Z [2024-03-29 01:58:02,207: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:58:02.269844688Z [2024-03-29 01:58:02,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:58:02.278841805Z [2024-03-29 01:58:02,278: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:58:02.312885123Z [2024-03-29 01:58:02,312: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:58:02.353712285Z [2024-03-29 01:58:02,353: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:58:02.360020862Z [2024-03-29 01:58:02,359: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:58:02.360178735Z [2024-03-29 01:58:02,359: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:58:02.363600503Z [2024-03-29 01:58:02,363: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:58:02.366972141Z [2024-03-29 01:58:02,363: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:58:02.368025553Z [2024-03-29 01:58:02,367: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:58:02.368332696Z [2024-03-29 01:58:02,368: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:58:02.481367121Z [2024-03-29 01:58:02,481: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:58:03.896424787Z [2024-03-29 01:58:03,895: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[92f4b843-99e7-48b9-b197-ca5e1e37f159] succeeded in 3.388878580999517s: None 2024-03-29T01:58:04.427509757Z [2024-03-29 01:58:04,426: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[171f9b64-a13f-493d-8715-32c614c9c761] succeeded in 3.9271536439991905s: None 2024-03-29T01:59:00.334889914Z [2024-03-29 01:59:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bde732c-4aa5-4695-9b3b-d45c54288144] received 2024-03-29T01:59:00.336950914Z [2024-03-29 01:59:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c0e22fe-7d0c-4921-a4c0-d6aaccb15d4a] received 2024-03-29T01:59:00.344265141Z [2024-03-29 01:59:00,343: INFO/ForkPoolWorker-15] [9bde732c-4aa5-4695-9b3b-d45c54288144] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:59:00.348765397Z [2024-03-29 01:59:00,348: INFO/ForkPoolWorker-16] [8c0e22fe-7d0c-4921-a4c0-d6aaccb15d4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:59:00.355361408Z [2024-03-29 01:59:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51eeea45-4930-440d-bb06-6b02c7a0df2e] received 2024-03-29T01:59:00.368521620Z [2024-03-29 01:59:00,366: INFO/ForkPoolWorker-1] [51eeea45-4930-440d-bb06-6b02c7a0df2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:59:00.660108206Z [2024-03-29 01:59:00,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T01:59:00.705324278Z [2024-03-29 01:59:00,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T01:59:00.725183593Z [2024-03-29 01:59:00,722: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T01:59:00.871859514Z [2024-03-29 01:59:00,871: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T01:59:00.876236528Z [2024-03-29 01:59:00,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:59:00.926245480Z [2024-03-29 01:59:00,925: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T01:59:00.931640066Z [2024-03-29 01:59:00,931: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T01:59:00.931672392Z [2024-03-29 01:59:00,931: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T01:59:00.931737673Z [2024-03-29 01:59:00,931: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T01:59:00.931930713Z [2024-03-29 01:59:00,931: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T01:59:01.060264553Z [2024-03-29 01:59:01,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:59:01.666531947Z [2024-03-29 01:59:01,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51eeea45-4930-440d-bb06-6b02c7a0df2e] succeeded in 1.309045939000498s: None 2024-03-29T01:59:02.069539588Z [2024-03-29 01:59:02,069: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T01:59:02.073887606Z [2024-03-29 01:59:02,073: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:59:02.089517037Z [2024-03-29 01:59:02,089: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T01:59:02.091028912Z [2024-03-29 01:59:02,090: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:59:02.091105030Z [2024-03-29 01:59:02,090: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:59:02.091293627Z [2024-03-29 01:59:02,091: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:59:02.091350433Z [2024-03-29 01:59:02,091: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T01:59:02.091681976Z [2024-03-29 01:59:02,091: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T01:59:02.091746777Z [2024-03-29 01:59:02,091: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:59:02.200587134Z [2024-03-29 01:59:02,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:59:02.235119707Z [2024-03-29 01:59:02,234: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T01:59:02.239039368Z [2024-03-29 01:59:02,238: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T01:59:02.265105700Z [2024-03-29 01:59:02,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T01:59:02.266960274Z [2024-03-29 01:59:02,266: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T01:59:02.267200493Z [2024-03-29 01:59:02,266: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T01:59:02.267525161Z [2024-03-29 01:59:02,267: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T01:59:02.267638612Z [2024-03-29 01:59:02,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T01:59:02.268050790Z [2024-03-29 01:59:02,267: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T01:59:02.268352296Z [2024-03-29 01:59:02,267: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T01:59:02.372150365Z [2024-03-29 01:59:02,371: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T01:59:03.686769604Z [2024-03-29 01:59:03,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bde732c-4aa5-4695-9b3b-d45c54288144] succeeded in 3.348679948001518s: None 2024-03-29T01:59:04.287403160Z [2024-03-29 01:59:04,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c0e22fe-7d0c-4921-a4c0-d6aaccb15d4a] succeeded in 3.9472092790001625s: None 2024-03-29T02:00:00.875808313Z [2024-03-29 02:00:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1e000fd-b0bf-46f1-aceb-2c60a884cb86] received 2024-03-29T02:00:00.880513038Z [2024-03-29 02:00:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eadd428-8f30-4f58-83d4-53807801c72d] received 2024-03-29T02:00:00.885729478Z [2024-03-29 02:00:00,885: INFO/ForkPoolWorker-15] [f1e000fd-b0bf-46f1-aceb-2c60a884cb86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:00:00.891783736Z [2024-03-29 02:00:00,891: INFO/ForkPoolWorker-16] [0eadd428-8f30-4f58-83d4-53807801c72d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:00:00.903795953Z [2024-03-29 02:00:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc627ca9-7606-45c4-b8fd-bb73d65b1413] received 2024-03-29T02:00:00.912636381Z [2024-03-29 02:00:00,912: INFO/ForkPoolWorker-1] [cc627ca9-7606-45c4-b8fd-bb73d65b1413] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:00.913135375Z [2024-03-29 02:00:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c433da24-18b8-4cc8-bef4-23c7e0ed15ea] received 2024-03-29T02:00:00.926671543Z [2024-03-29 02:00:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a04ffe4-5dd8-4ba1-8948-6609d59a9d03] received 2024-03-29T02:00:00.930282612Z [2024-03-29 02:00:00,930: INFO/ForkPoolWorker-2] [c433da24-18b8-4cc8-bef4-23c7e0ed15ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:00:00.943661112Z [2024-03-29 02:00:00,943: INFO/ForkPoolWorker-3] [0a04ffe4-5dd8-4ba1-8948-6609d59a9d03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:00:01.331485761Z [2024-03-29 02:00:01,328: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:00:01.352922680Z [2024-03-29 02:00:01,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:00:01.383128850Z [2024-03-29 02:00:01,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:00:01.407034280Z [2024-03-29 02:00:01,403: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:00:01.421211388Z [2024-03-29 02:00:01,416: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:00:01.633870088Z [2024-03-29 02:00:01,633: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T02:00:01.649045377Z [2024-03-29 02:00:01,648: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:01.709322499Z [2024-03-29 02:00:01,709: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:00:01.712252019Z [2024-03-29 02:00:01,711: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:00:01.713142602Z [2024-03-29 02:00:01,712: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:00:01.713768256Z [2024-03-29 02:00:01,713: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T02:00:01.714233042Z [2024-03-29 02:00:01,713: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:00:01.958677559Z [2024-03-29 02:00:01,958: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:01.971795064Z [2024-03-29 02:00:01,971: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:02.897706417Z [2024-03-29 02:00:02,897: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0a04ffe4-5dd8-4ba1-8948-6609d59a9d03] succeeded in 1.968036337999365s: None 2024-03-29T02:00:03.084397309Z [2024-03-29 02:00:03,083: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c433da24-18b8-4cc8-bef4-23c7e0ed15ea] succeeded in 2.168346357999326s: None 2024-03-29T02:00:03.582136209Z [2024-03-29 02:00:03,581: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:00:03.586017223Z [2024-03-29 02:00:03,585: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:03.611348817Z [2024-03-29 02:00:03,611: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:00:03.613282945Z [2024-03-29 02:00:03,612: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:03.613477301Z [2024-03-29 02:00:03,613: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:03.613714002Z [2024-03-29 02:00:03,613: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:03.613871537Z [2024-03-29 02:00:03,613: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:00:03.614482124Z [2024-03-29 02:00:03,614: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:00:03.614688151Z [2024-03-29 02:00:03,614: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:03.644133610Z [2024-03-29 02:00:03,643: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:00:03.657111048Z [2024-03-29 02:00:03,656: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:03.705791396Z [2024-03-29 02:00:03,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:03.708213361Z [2024-03-29 02:00:03,707: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:00:03.710697189Z [2024-03-29 02:00:03,710: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:03.710915000Z [2024-03-29 02:00:03,710: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:03.711440313Z [2024-03-29 02:00:03,710: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:03.711803974Z [2024-03-29 02:00:03,711: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:00:03.714568234Z [2024-03-29 02:00:03,714: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:00:03.714657235Z [2024-03-29 02:00:03,714: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:03.856296211Z [2024-03-29 02:00:03,855: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:03.872852540Z [2024-03-29 02:00:03,872: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:00:03.877311207Z [2024-03-29 02:00:03,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:03.905095068Z [2024-03-29 02:00:03,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:00:03.907741289Z [2024-03-29 02:00:03,907: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:03.907813086Z [2024-03-29 02:00:03,907: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:03.908039946Z [2024-03-29 02:00:03,907: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:03.908151663Z [2024-03-29 02:00:03,908: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:00:03.908604104Z [2024-03-29 02:00:03,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:00:03.909188424Z [2024-03-29 02:00:03,908: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:04.000209563Z [2024-03-29 02:00:03,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:04.647148516Z [2024-03-29 02:00:04,646: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc627ca9-7606-45c4-b8fd-bb73d65b1413] succeeded in 3.7407421640000393s: None 2024-03-29T02:00:05.390243349Z [2024-03-29 02:00:05,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab41fd80-1f8e-4cad-8b45-20829e17d8ac] received 2024-03-29T02:00:05.399088864Z [2024-03-29 02:00:05,398: INFO/ForkPoolWorker-1] [ab41fd80-1f8e-4cad-8b45-20829e17d8ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:05.544345822Z [2024-03-29 02:00:05,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0eadd428-8f30-4f58-83d4-53807801c72d] succeeded in 4.660964386999694s: None 2024-03-29T02:00:05.908792290Z [2024-03-29 02:00:05,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:00:06.432416199Z [2024-03-29 02:00:06,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1e000fd-b0bf-46f1-aceb-2c60a884cb86] succeeded in 5.550891726999907s: None 2024-03-29T02:00:07.509997515Z [2024-03-29 02:00:07,509: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:00:07.514195058Z [2024-03-29 02:00:07,513: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:07.540250610Z [2024-03-29 02:00:07,540: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:00:07.542574986Z [2024-03-29 02:00:07,542: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:07.542769199Z [2024-03-29 02:00:07,542: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:07.542924904Z [2024-03-29 02:00:07,542: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:07.543028029Z [2024-03-29 02:00:07,542: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:00:07.543390507Z [2024-03-29 02:00:07,543: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:00:07.543841266Z [2024-03-29 02:00:07,543: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:07.638762689Z [2024-03-29 02:00:07,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:08.366726630Z [2024-03-29 02:00:08,365: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab41fd80-1f8e-4cad-8b45-20829e17d8ac] succeeded in 2.973286366999673s: None 2024-03-29T02:00:09.190364172Z [2024-03-29 02:00:09,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fd7fab7-7597-436b-9fd3-e8ff04dbff0d] received 2024-03-29T02:00:09.198513892Z [2024-03-29 02:00:09,198: INFO/ForkPoolWorker-15] [9fd7fab7-7597-436b-9fd3-e8ff04dbff0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:00:09.481328479Z [2024-03-29 02:00:09,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:00:10.654616657Z [2024-03-29 02:00:10,654: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:00:10.657991555Z [2024-03-29 02:00:10,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:10.675461969Z [2024-03-29 02:00:10,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:00:10.676610911Z [2024-03-29 02:00:10,676: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:10.676720761Z [2024-03-29 02:00:10,676: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:10.676894859Z [2024-03-29 02:00:10,676: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:10.677002518Z [2024-03-29 02:00:10,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:00:10.677324344Z [2024-03-29 02:00:10,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:00:10.677371299Z [2024-03-29 02:00:10,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:10.759528679Z [2024-03-29 02:00:10,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:11.271156532Z [2024-03-29 02:00:11,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fd7fab7-7597-436b-9fd3-e8ff04dbff0d] succeeded in 2.0785969049993582s: None 2024-03-29T02:00:11.501475539Z [2024-03-29 02:00:11,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[956776e1-898b-4bfa-9bc3-4b90def3782b] received 2024-03-29T02:00:11.511477636Z [2024-03-29 02:00:11,511: INFO/ForkPoolWorker-15] [956776e1-898b-4bfa-9bc3-4b90def3782b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:11.787889328Z [2024-03-29 02:00:11,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:00:12.981798859Z [2024-03-29 02:00:12,981: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:00:12.985468789Z [2024-03-29 02:00:12,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:00:13.001658936Z [2024-03-29 02:00:13,001: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:00:13.002980682Z [2024-03-29 02:00:13,002: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:00:13.002997697Z [2024-03-29 02:00:13,002: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:00:13.003111458Z [2024-03-29 02:00:13,002: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:00:13.003120737Z [2024-03-29 02:00:13,003: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:00:13.003392870Z [2024-03-29 02:00:13,003: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:00:13.003403186Z [2024-03-29 02:00:13,003: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:00:13.083316690Z [2024-03-29 02:00:13,083: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:00:13.627888356Z [2024-03-29 02:00:13,627: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[956776e1-898b-4bfa-9bc3-4b90def3782b] succeeded in 2.1243200129993056s: None 2024-03-29T02:01:01.072142304Z [2024-03-29 02:01:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1faab38a-f600-4ec9-8b1f-4a0420d0d1ba] received 2024-03-29T02:01:01.076675381Z [2024-03-29 02:01:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fb68b50-9881-4246-b819-d6c9d46f11bf] received 2024-03-29T02:01:01.080653734Z [2024-03-29 02:01:01,080: INFO/ForkPoolWorker-15] [1faab38a-f600-4ec9-8b1f-4a0420d0d1ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:01:01.081069449Z [2024-03-29 02:01:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[290791f0-2b8f-4494-bf4d-54156d0820b8] received 2024-03-29T02:01:01.089144457Z [2024-03-29 02:01:01,088: INFO/ForkPoolWorker-1] [290791f0-2b8f-4494-bf4d-54156d0820b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:01:01.091469468Z [2024-03-29 02:01:01,091: INFO/ForkPoolWorker-16] [8fb68b50-9881-4246-b819-d6c9d46f11bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:01:01.414267395Z [2024-03-29 02:01:01,410: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:01:01.466720249Z [2024-03-29 02:01:01,463: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:01:01.534356148Z [2024-03-29 02:01:01,529: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:01:01.634896379Z [2024-03-29 02:01:01,634: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:01:01.638947072Z [2024-03-29 02:01:01,638: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:01:01.697891768Z [2024-03-29 02:01:01,697: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:01:01.699331083Z [2024-03-29 02:01:01,699: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:01:01.699486960Z [2024-03-29 02:01:01,699: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:01:01.699613248Z [2024-03-29 02:01:01,699: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:01:01.699883092Z [2024-03-29 02:01:01,699: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:01:01.805205217Z [2024-03-29 02:01:01,804: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:01:02.546715059Z [2024-03-29 02:01:02,545: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fb68b50-9881-4246-b819-d6c9d46f11bf] succeeded in 1.4668907130017033s: None 2024-03-29T02:01:02.848001781Z [2024-03-29 02:01:02,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:01:02.851746046Z [2024-03-29 02:01:02,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:01:02.876764953Z [2024-03-29 02:01:02,876: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:01:02.878410644Z [2024-03-29 02:01:02,878: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:01:02.878468897Z [2024-03-29 02:01:02,878: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:01:02.878741709Z [2024-03-29 02:01:02,878: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:01:02.878784208Z [2024-03-29 02:01:02,878: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:01:02.879224378Z [2024-03-29 02:01:02,879: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:01:02.879389936Z [2024-03-29 02:01:02,879: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:01:02.976628307Z [2024-03-29 02:01:02,976: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:01:03.001763322Z [2024-03-29 02:01:03,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:01:03.005643333Z [2024-03-29 02:01:03,004: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:01:03.068166436Z [2024-03-29 02:01:03,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:01:03.074378437Z [2024-03-29 02:01:03,073: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:01:03.074736620Z [2024-03-29 02:01:03,074: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:01:03.075115482Z [2024-03-29 02:01:03,074: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:01:03.075441732Z [2024-03-29 02:01:03,075: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:01:03.075953015Z [2024-03-29 02:01:03,075: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:01:03.076210209Z [2024-03-29 02:01:03,075: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:01:03.220268865Z [2024-03-29 02:01:03,219: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:01:04.561802883Z [2024-03-29 02:01:04,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[290791f0-2b8f-4494-bf4d-54156d0820b8] succeeded in 3.478916844998821s: None 2024-03-29T02:01:05.908324775Z [2024-03-29 02:01:05,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1faab38a-f600-4ec9-8b1f-4a0420d0d1ba] succeeded in 4.833591656999488s: None 2024-03-29T02:02:00.645054062Z [2024-03-29 02:02:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05c82169-4008-4811-9354-72185419f23d] received 2024-03-29T02:02:00.649369073Z [2024-03-29 02:02:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[434cba05-666f-4e20-95f9-e71720e4826b] received 2024-03-29T02:02:00.654490908Z [2024-03-29 02:02:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ed25603-9780-4e9e-bee2-85a8ca0ed3e8] received 2024-03-29T02:02:00.656542647Z [2024-03-29 02:02:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6615bdf-9b2c-4320-a1d0-2f73ea4b7431] received 2024-03-29T02:02:00.660161363Z [2024-03-29 02:02:00,659: INFO/ForkPoolWorker-15] [05c82169-4008-4811-9354-72185419f23d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:02:00.666396799Z [2024-03-29 02:02:00,666: INFO/ForkPoolWorker-1] [3ed25603-9780-4e9e-bee2-85a8ca0ed3e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:02:00.667835944Z [2024-03-29 02:02:00,667: INFO/ForkPoolWorker-16] [434cba05-666f-4e20-95f9-e71720e4826b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:02:00.670256519Z [2024-03-29 02:02:00,669: INFO/ForkPoolWorker-2] [d6615bdf-9b2c-4320-a1d0-2f73ea4b7431] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:02:01.042115576Z [2024-03-29 02:02:01,037: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:02:01.075120254Z [2024-03-29 02:02:01,072: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:02:01.234168467Z [2024-03-29 02:02:01,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:02:01.241236617Z [2024-03-29 02:02:01,237: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:02:01.420649700Z [2024-03-29 02:02:01,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:02:01.451928367Z [2024-03-29 02:02:01,451: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:02:01.459280084Z [2024-03-29 02:02:01,458: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:02:01.492412832Z [2024-03-29 02:02:01,492: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:02:01.499919968Z [2024-03-29 02:02:01,499: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:02:01.500125275Z [2024-03-29 02:02:01,499: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:02:01.500242580Z [2024-03-29 02:02:01,500: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:02:01.500502651Z [2024-03-29 02:02:01,500: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:02:01.746575970Z [2024-03-29 02:02:01,743: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:02:02.474002219Z [2024-03-29 02:02:02,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05c82169-4008-4811-9354-72185419f23d] succeeded in 1.8264025580010639s: None 2024-03-29T02:02:02.578279692Z [2024-03-29 02:02:02,577: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6615bdf-9b2c-4320-a1d0-2f73ea4b7431] succeeded in 1.918185735001316s: None 2024-03-29T02:02:03.028408455Z [2024-03-29 02:02:03,028: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:02:03.032185219Z [2024-03-29 02:02:03,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:02:03.068707969Z [2024-03-29 02:02:03,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:02:03.070629743Z [2024-03-29 02:02:03,070: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:02:03.070651811Z [2024-03-29 02:02:03,070: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:02:03.070900741Z [2024-03-29 02:02:03,070: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:02:03.071045071Z [2024-03-29 02:02:03,070: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:02:03.071452579Z [2024-03-29 02:02:03,071: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:02:03.071545240Z [2024-03-29 02:02:03,071: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:02:03.093524842Z [2024-03-29 02:02:03,093: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:02:03.097179871Z [2024-03-29 02:02:03,096: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:02:03.117833858Z [2024-03-29 02:02:03,117: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:02:03.119345145Z [2024-03-29 02:02:03,119: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:02:03.119461981Z [2024-03-29 02:02:03,119: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:02:03.119657109Z [2024-03-29 02:02:03,119: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:02:03.119783780Z [2024-03-29 02:02:03,119: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:02:03.120152704Z [2024-03-29 02:02:03,119: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:02:03.120183255Z [2024-03-29 02:02:03,120: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:02:03.163584363Z [2024-03-29 02:02:03,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:02:03.220337729Z [2024-03-29 02:02:03,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:02:04.762712348Z [2024-03-29 02:02:04,762: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ed25603-9780-4e9e-bee2-85a8ca0ed3e8] succeeded in 4.105489139999918s: None 2024-03-29T02:02:05.097622689Z [2024-03-29 02:02:05,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[434cba05-666f-4e20-95f9-e71720e4826b] succeeded in 4.445801960000608s: None 2024-03-29T02:03:00.404678217Z [2024-03-29 02:03:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e39eb7f1-903e-4e11-8caa-caed078c719b] received 2024-03-29T02:03:00.414371054Z [2024-03-29 02:03:00,414: INFO/ForkPoolWorker-15] [e39eb7f1-903e-4e11-8caa-caed078c719b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:03:00.416028232Z [2024-03-29 02:03:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad739eb5-2cef-4f70-bcb6-b4ba0afdc384] received 2024-03-29T02:03:00.421305890Z [2024-03-29 02:03:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c3bedbf-c598-4388-824e-a1e4b0ded039] received 2024-03-29T02:03:00.427654374Z [2024-03-29 02:03:00,427: INFO/ForkPoolWorker-16] [ad739eb5-2cef-4f70-bcb6-b4ba0afdc384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:03:00.430968040Z [2024-03-29 02:03:00,430: INFO/ForkPoolWorker-1] [4c3bedbf-c598-4388-824e-a1e4b0ded039] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:03:00.728747299Z [2024-03-29 02:03:00,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:03:00.761199904Z [2024-03-29 02:03:00,757: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:03:00.782404666Z [2024-03-29 02:03:00,778: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:03:00.981335377Z [2024-03-29 02:03:00,980: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:03:00.985851512Z [2024-03-29 02:03:00,985: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:03:01.019617259Z [2024-03-29 02:03:01,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:03:01.020970816Z [2024-03-29 02:03:01,020: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:03:01.021141721Z [2024-03-29 02:03:01,020: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:03:01.021380295Z [2024-03-29 02:03:01,021: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:03:01.021642600Z [2024-03-29 02:03:01,021: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:03:01.141462314Z [2024-03-29 02:03:01,141: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:03:01.912732493Z [2024-03-29 02:03:01,912: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c3bedbf-c598-4388-824e-a1e4b0ded039] succeeded in 1.4895024349989399s: None 2024-03-29T02:03:02.062762834Z [2024-03-29 02:03:02,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:03:02.066465013Z [2024-03-29 02:03:02,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:03:02.088109368Z [2024-03-29 02:03:02,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:03:02.089392638Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:03:02.089412609Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:03:02.089537886Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:03:02.089564199Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:03:02.089829038Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:03:02.089876933Z [2024-03-29 02:03:02,089: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:03:02.180196080Z [2024-03-29 02:03:02,179: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:03:02.184194723Z [2024-03-29 02:03:02,183: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:03:02.200834936Z [2024-03-29 02:03:02,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:03:02.220586794Z [2024-03-29 02:03:02,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:03:02.222357794Z [2024-03-29 02:03:02,222: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:03:02.222615413Z [2024-03-29 02:03:02,222: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:03:02.222987350Z [2024-03-29 02:03:02,222: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:03:02.223187976Z [2024-03-29 02:03:02,223: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:03:02.223625492Z [2024-03-29 02:03:02,223: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:03:02.224263140Z [2024-03-29 02:03:02,224: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:03:02.330481577Z [2024-03-29 02:03:02,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:03:03.925907203Z [2024-03-29 02:03:03,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e39eb7f1-903e-4e11-8caa-caed078c719b] succeeded in 3.5194918580000376s: None 2024-03-29T02:03:04.395182517Z [2024-03-29 02:03:04,394: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad739eb5-2cef-4f70-bcb6-b4ba0afdc384] succeeded in 3.976675414998681s: None 2024-03-29T02:04:01.263432148Z [2024-03-29 02:04:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d43d804-a3da-4ded-be31-36d5c5525f17] received 2024-03-29T02:04:01.266711259Z [2024-03-29 02:04:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31fa86ef-7fed-4d57-96c7-480e1f8ecb55] received 2024-03-29T02:04:01.270206359Z [2024-03-29 02:04:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90d1a45f-322c-4e5d-8526-c694a8356323] received 2024-03-29T02:04:01.275166422Z [2024-03-29 02:04:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c155e589-11ac-4b52-9f48-eb9b9bba7b16] received 2024-03-29T02:04:01.279612890Z [2024-03-29 02:04:01,279: INFO/ForkPoolWorker-16] [31fa86ef-7fed-4d57-96c7-480e1f8ecb55] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:04:01.283563959Z [2024-03-29 02:04:01,283: INFO/ForkPoolWorker-1] [90d1a45f-322c-4e5d-8526-c694a8356323] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:04:01.283970808Z [2024-03-29 02:04:01,283: INFO/ForkPoolWorker-2] [c155e589-11ac-4b52-9f48-eb9b9bba7b16] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:04:01.289109608Z [2024-03-29 02:04:01,288: INFO/ForkPoolWorker-15] [3d43d804-a3da-4ded-be31-36d5c5525f17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:04:01.657996371Z [2024-03-29 02:04:01,652: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:04:01.763014032Z [2024-03-29 02:04:01,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:04:01.780910996Z [2024-03-29 02:04:01,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:04:01.876419623Z [2024-03-29 02:04:01,876: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:04:01.881786890Z [2024-03-29 02:04:01,881: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:04:01.907510128Z [2024-03-29 02:04:01,907: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:04:01.908749337Z [2024-03-29 02:04:01,908: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:04:01.908917385Z [2024-03-29 02:04:01,908: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:04:01.909034969Z [2024-03-29 02:04:01,908: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:04:01.909298581Z [2024-03-29 02:04:01,909: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:04:02.006194484Z [2024-03-29 02:04:01,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:04:02.041436804Z [2024-03-29 02:04:02,041: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:04:02.172404717Z [2024-03-29 02:04:02,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:04:02.795769029Z [2024-03-29 02:04:02,795: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c155e589-11ac-4b52-9f48-eb9b9bba7b16] succeeded in 1.518471777000741s: None 2024-03-29T02:04:02.968607803Z [2024-03-29 02:04:02,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31fa86ef-7fed-4d57-96c7-480e1f8ecb55] succeeded in 1.7001219969988597s: None 2024-03-29T02:04:03.542852556Z [2024-03-29 02:04:03,540: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:04:03.544694973Z [2024-03-29 02:04:03,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:04:03.568971920Z [2024-03-29 02:04:03,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:04:03.573047305Z [2024-03-29 02:04:03,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:04:03.578074094Z [2024-03-29 02:04:03,577: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:04:03.583436231Z [2024-03-29 02:04:03,583: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:04:03.583914589Z [2024-03-29 02:04:03,583: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:04:03.584293909Z [2024-03-29 02:04:03,584: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:04:03.584540057Z [2024-03-29 02:04:03,584: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:04:03.585196130Z [2024-03-29 02:04:03,584: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:04:03.585458364Z [2024-03-29 02:04:03,585: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:04:03.597483580Z [2024-03-29 02:04:03,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:04:03.599941117Z [2024-03-29 02:04:03,599: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:04:03.600078495Z [2024-03-29 02:04:03,599: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:04:03.600201759Z [2024-03-29 02:04:03,600: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:04:03.600307469Z [2024-03-29 02:04:03,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:04:03.600583963Z [2024-03-29 02:04:03,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:04:03.600650387Z [2024-03-29 02:04:03,600: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:04:03.692773423Z [2024-03-29 02:04:03,692: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:04:03.724483977Z [2024-03-29 02:04:03,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:04:05.385864364Z [2024-03-29 02:04:05,385: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d43d804-a3da-4ded-be31-36d5c5525f17] succeeded in 4.119048888000179s: None 2024-03-29T02:04:05.984203998Z [2024-03-29 02:04:05,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90d1a45f-322c-4e5d-8526-c694a8356323] succeeded in 4.71134155099935s: None 2024-03-29T02:05:00.916840765Z [2024-03-29 02:05:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6bc84e5-f58c-4f98-9b0b-5aa6bba31fc2] received 2024-03-29T02:05:00.918998411Z [2024-03-29 02:05:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[065e7bfb-ec4a-4077-8f7f-4771c363c63b] received 2024-03-29T02:05:00.925591477Z [2024-03-29 02:05:00,925: INFO/ForkPoolWorker-16] [065e7bfb-ec4a-4077-8f7f-4771c363c63b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:05:00.927907106Z [2024-03-29 02:05:00,927: INFO/ForkPoolWorker-15] [e6bc84e5-f58c-4f98-9b0b-5aa6bba31fc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:05:00.928020480Z [2024-03-29 02:05:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f5e8ce-3da4-4efb-b18b-0bdd99c2f1c9] received 2024-03-29T02:05:00.936960896Z [2024-03-29 02:05:00,936: INFO/ForkPoolWorker-1] [b6f5e8ce-3da4-4efb-b18b-0bdd99c2f1c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:00.937298166Z [2024-03-29 02:05:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a72f22f2-dbb4-4cb3-b1f5-67d8acbde12b] received 2024-03-29T02:05:00.944818396Z [2024-03-29 02:05:00,944: INFO/ForkPoolWorker-2] [a72f22f2-dbb4-4cb3-b1f5-67d8acbde12b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:05:01.324753624Z [2024-03-29 02:05:01,320: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:05:01.375339562Z [2024-03-29 02:05:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:05:01.412362882Z [2024-03-29 02:05:01,408: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:05:01.431900624Z [2024-03-29 02:05:01,428: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:05:01.615756222Z [2024-03-29 02:05:01,615: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:05:01.620353478Z [2024-03-29 02:05:01,619: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:01.654076515Z [2024-03-29 02:05:01,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:05:01.656267867Z [2024-03-29 02:05:01,655: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:05:01.656345255Z [2024-03-29 02:05:01,656: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:05:01.656428653Z [2024-03-29 02:05:01,656: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:05:01.656780410Z [2024-03-29 02:05:01,656: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:05:01.929969124Z [2024-03-29 02:05:01,929: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:02.978843497Z [2024-03-29 02:05:02,978: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[065e7bfb-ec4a-4077-8f7f-4771c363c63b] succeeded in 2.0582464649996837s: None 2024-03-29T02:05:02.989154571Z [2024-03-29 02:05:02,988: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:05:02.993349528Z [2024-03-29 02:05:02,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:03.044391274Z [2024-03-29 02:05:03,043: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:05:03.048214913Z [2024-03-29 02:05:03,047: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:03.048439849Z [2024-03-29 02:05:03,048: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:03.048783781Z [2024-03-29 02:05:03,048: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:03.049056418Z [2024-03-29 02:05:03,048: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:05:03.049606064Z [2024-03-29 02:05:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:05:03.049848189Z [2024-03-29 02:05:03,049: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:03.179489618Z [2024-03-29 02:05:03,179: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:03.214560368Z [2024-03-29 02:05:03,214: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:05:03.218267409Z [2024-03-29 02:05:03,217: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:03.269049802Z [2024-03-29 02:05:03,268: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:05:03.270605808Z [2024-03-29 02:05:03,270: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:03.270618834Z [2024-03-29 02:05:03,270: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:03.270743790Z [2024-03-29 02:05:03,270: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:03.270751147Z [2024-03-29 02:05:03,270: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:05:03.271138463Z [2024-03-29 02:05:03,270: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:05:03.271147066Z [2024-03-29 02:05:03,271: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:03.380500948Z [2024-03-29 02:05:03,380: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:03.529006395Z [2024-03-29 02:05:03,528: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:05:03.534125988Z [2024-03-29 02:05:03,533: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:03.576778886Z [2024-03-29 02:05:03,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:05:03.579284588Z [2024-03-29 02:05:03,578: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:03.579311501Z [2024-03-29 02:05:03,579: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:03.579381413Z [2024-03-29 02:05:03,579: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:03.579404381Z [2024-03-29 02:05:03,579: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:05:03.579724596Z [2024-03-29 02:05:03,579: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:05:03.579737553Z [2024-03-29 02:05:03,579: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:03.753763752Z [2024-03-29 02:05:03,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:03.925399404Z [2024-03-29 02:05:03,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dc0ad3e-7c04-4302-8abd-2fc84b18b28a] received 2024-03-29T02:05:03.935223787Z [2024-03-29 02:05:03,934: INFO/ForkPoolWorker-16] [9dc0ad3e-7c04-4302-8abd-2fc84b18b28a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:03.988112887Z [2024-03-29 02:05:03,987: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b6f5e8ce-3da4-4efb-b18b-0bdd99c2f1c9] succeeded in 3.0579481229997327s: None 2024-03-29T02:05:04.353263155Z [2024-03-29 02:05:04,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:05:05.477708291Z [2024-03-29 02:05:05,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6bc84e5-f58c-4f98-9b0b-5aa6bba31fc2] succeeded in 4.556866332999562s: None 2024-03-29T02:05:05.564518069Z [2024-03-29 02:05:05,564: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a72f22f2-dbb4-4cb3-b1f5-67d8acbde12b] succeeded in 4.6251929009995365s: None 2024-03-29T02:05:05.963928289Z [2024-03-29 02:05:05,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:05:05.968787484Z [2024-03-29 02:05:05,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:06.015703960Z [2024-03-29 02:05:06,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:05:06.019863553Z [2024-03-29 02:05:06,019: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:06.020021032Z [2024-03-29 02:05:06,019: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:06.020254234Z [2024-03-29 02:05:06,020: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:06.022525009Z [2024-03-29 02:05:06,020: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:05:06.022544102Z [2024-03-29 02:05:06,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:05:06.022548854Z [2024-03-29 02:05:06,020: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:06.141513490Z [2024-03-29 02:05:06,141: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:06.863929908Z [2024-03-29 02:05:06,863: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dc0ad3e-7c04-4302-8abd-2fc84b18b28a] succeeded in 2.9355563030003395s: None 2024-03-29T02:05:07.251287737Z [2024-03-29 02:05:07,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8efeb158-331b-4b8e-a881-f9cded2de004] received 2024-03-29T02:05:07.272854919Z [2024-03-29 02:05:07,272: INFO/ForkPoolWorker-15] [8efeb158-331b-4b8e-a881-f9cded2de004] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:05:07.654430749Z [2024-03-29 02:05:07,648: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:05:08.821775576Z [2024-03-29 02:05:08,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:05:08.825466678Z [2024-03-29 02:05:08,824: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:08.845989851Z [2024-03-29 02:05:08,845: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:05:08.847472783Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:08.847491596Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:08.847618686Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:08.847628102Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:05:08.847874828Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:05:08.847928148Z [2024-03-29 02:05:08,847: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:08.937421377Z [2024-03-29 02:05:08,937: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:09.480775284Z [2024-03-29 02:05:09,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8efeb158-331b-4b8e-a881-f9cded2de004] succeeded in 2.2220241759987402s: None 2024-03-29T02:05:09.594575300Z [2024-03-29 02:05:09,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[232ff35b-2576-400b-9002-9f76a995cae2] received 2024-03-29T02:05:09.601306739Z [2024-03-29 02:05:09,600: INFO/ForkPoolWorker-15] [232ff35b-2576-400b-9002-9f76a995cae2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:09.913948172Z [2024-03-29 02:05:09,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:05:11.056279641Z [2024-03-29 02:05:11,055: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:05:11.059609808Z [2024-03-29 02:05:11,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:05:11.079536259Z [2024-03-29 02:05:11,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:05:11.081151694Z [2024-03-29 02:05:11,080: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:05:11.081170777Z [2024-03-29 02:05:11,081: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:05:11.081369358Z [2024-03-29 02:05:11,081: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:05:11.081382241Z [2024-03-29 02:05:11,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:05:11.081692990Z [2024-03-29 02:05:11,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:05:11.081823874Z [2024-03-29 02:05:11,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:05:11.163172926Z [2024-03-29 02:05:11,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:05:11.635113174Z [2024-03-29 02:05:11,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[232ff35b-2576-400b-9002-9f76a995cae2] succeeded in 2.038659085999825s: None 2024-03-29T02:06:01.129271450Z [2024-03-29 02:06:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f2a9904-7888-4fc8-ab32-c47189feca74] received 2024-03-29T02:06:01.130736046Z [2024-03-29 02:06:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28e2c8c3-01a5-4a91-bcdb-39f1159f7b42] received 2024-03-29T02:06:01.134640214Z [2024-03-29 02:06:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42a4dbd1-8179-4066-a5b6-1c35efc675a8] received 2024-03-29T02:06:01.141501955Z [2024-03-29 02:06:01,141: INFO/ForkPoolWorker-16] [28e2c8c3-01a5-4a91-bcdb-39f1159f7b42] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:06:01.144784602Z [2024-03-29 02:06:01,144: INFO/ForkPoolWorker-15] [1f2a9904-7888-4fc8-ab32-c47189feca74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:06:01.155290981Z [2024-03-29 02:06:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1476365-1004-4d06-9114-addb47eab83e] received 2024-03-29T02:06:01.165963315Z [2024-03-29 02:06:01,165: INFO/ForkPoolWorker-2] [b1476365-1004-4d06-9114-addb47eab83e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:06:01.165997181Z [2024-03-29 02:06:01,165: INFO/ForkPoolWorker-1] [42a4dbd1-8179-4066-a5b6-1c35efc675a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:06:01.529245540Z [2024-03-29 02:06:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:06:01.617244909Z [2024-03-29 02:06:01,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:06:01.642813363Z [2024-03-29 02:06:01,633: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:06:01.703036085Z [2024-03-29 02:06:01,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:06:01.835937542Z [2024-03-29 02:06:01,835: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:06:01.840523715Z [2024-03-29 02:06:01,840: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:06:01.874618212Z [2024-03-29 02:06:01,874: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:06:01.895784068Z [2024-03-29 02:06:01,895: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:06:01.899147828Z [2024-03-29 02:06:01,898: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:06:01.899173916Z [2024-03-29 02:06:01,898: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:06:01.899180739Z [2024-03-29 02:06:01,898: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:06:01.901242472Z [2024-03-29 02:06:01,900: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:06:02.004662889Z [2024-03-29 02:06:02,004: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:06:02.831722580Z [2024-03-29 02:06:02,831: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28e2c8c3-01a5-4a91-bcdb-39f1159f7b42] succeeded in 1.6987096129996644s: None 2024-03-29T02:06:02.892166596Z [2024-03-29 02:06:02,891: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b1476365-1004-4d06-9114-addb47eab83e] succeeded in 1.7334914299990487s: None 2024-03-29T02:06:03.469648616Z [2024-03-29 02:06:03,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:06:03.473508574Z [2024-03-29 02:06:03,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:06:03.511656324Z [2024-03-29 02:06:03,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:06:03.515478959Z [2024-03-29 02:06:03,515: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:06:03.515717743Z [2024-03-29 02:06:03,515: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:06:03.516058643Z [2024-03-29 02:06:03,515: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:06:03.516246263Z [2024-03-29 02:06:03,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:06:03.516677184Z [2024-03-29 02:06:03,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:06:03.516894341Z [2024-03-29 02:06:03,516: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:06:03.588081724Z [2024-03-29 02:06:03,587: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:06:03.591742999Z [2024-03-29 02:06:03,591: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:06:03.623658469Z [2024-03-29 02:06:03,623: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:06:03.624818417Z [2024-03-29 02:06:03,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:06:03.630432408Z [2024-03-29 02:06:03,629: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:06:03.630692665Z [2024-03-29 02:06:03,630: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:06:03.630835520Z [2024-03-29 02:06:03,630: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:06:03.630852624Z [2024-03-29 02:06:03,630: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:06:03.631676200Z [2024-03-29 02:06:03,631: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:06:03.631723034Z [2024-03-29 02:06:03,631: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:06:03.718787290Z [2024-03-29 02:06:03,718: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:06:06.081055763Z [2024-03-29 02:06:06,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f2a9904-7888-4fc8-ab32-c47189feca74] succeeded in 4.948525494999558s: None 2024-03-29T02:06:06.863040353Z [2024-03-29 02:06:06,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42a4dbd1-8179-4066-a5b6-1c35efc675a8] succeeded in 5.705954204000591s: None 2024-03-29T02:07:00.235490956Z [2024-03-29 02:07:00,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[200dbe3d-8cb6-48fd-8bb2-93f186178033] received 2024-03-29T02:07:00.239453864Z [2024-03-29 02:07:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbef4e34-0f1e-4ced-abd6-6f680a2248f6] received 2024-03-29T02:07:00.244336342Z [2024-03-29 02:07:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e4d2e29-9499-42ad-b17d-0d6d249f318b] received 2024-03-29T02:07:00.249769055Z [2024-03-29 02:07:00,249: INFO/ForkPoolWorker-15] [200dbe3d-8cb6-48fd-8bb2-93f186178033] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:07:00.251020793Z [2024-03-29 02:07:00,249: INFO/ForkPoolWorker-16] [bbef4e34-0f1e-4ced-abd6-6f680a2248f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:07:00.253948934Z [2024-03-29 02:07:00,253: INFO/ForkPoolWorker-1] [7e4d2e29-9499-42ad-b17d-0d6d249f318b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:07:00.571083434Z [2024-03-29 02:07:00,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:07:00.602921191Z [2024-03-29 02:07:00,598: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:07:00.638546977Z [2024-03-29 02:07:00,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:07:00.732015662Z [2024-03-29 02:07:00,731: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:07:00.736338047Z [2024-03-29 02:07:00,735: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:07:00.759569233Z [2024-03-29 02:07:00,759: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:07:00.760825448Z [2024-03-29 02:07:00,760: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:07:00.760911464Z [2024-03-29 02:07:00,760: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:07:00.760966527Z [2024-03-29 02:07:00,760: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:07:00.761307452Z [2024-03-29 02:07:00,761: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:07:00.866954344Z [2024-03-29 02:07:00,866: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:07:01.481879569Z [2024-03-29 02:07:01,481: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bbef4e34-0f1e-4ced-abd6-6f680a2248f6] succeeded in 1.2405690470004629s: None 2024-03-29T02:07:01.914866411Z [2024-03-29 02:07:01,914: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:07:01.919702163Z [2024-03-29 02:07:01,919: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:07:01.931989397Z [2024-03-29 02:07:01,931: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:07:01.935939393Z [2024-03-29 02:07:01,935: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:07:01.944310808Z [2024-03-29 02:07:01,944: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:07:01.945617018Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:07:01.945637971Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:07:01.945774241Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:07:01.945785866Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:07:01.946003476Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:07:01.946088103Z [2024-03-29 02:07:01,945: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:07:01.967319447Z [2024-03-29 02:07:01,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:07:01.971665379Z [2024-03-29 02:07:01,971: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:07:01.971792983Z [2024-03-29 02:07:01,971: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:07:01.971989419Z [2024-03-29 02:07:01,971: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:07:01.972096841Z [2024-03-29 02:07:01,971: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:07:01.972575196Z [2024-03-29 02:07:01,972: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:07:01.972736735Z [2024-03-29 02:07:01,972: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:07:02.065990775Z [2024-03-29 02:07:02,065: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:07:02.074900450Z [2024-03-29 02:07:02,074: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:07:03.744366088Z [2024-03-29 02:07:03,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e4d2e29-9499-42ad-b17d-0d6d249f318b] succeeded in 3.498078912998608s: None 2024-03-29T02:07:04.023952965Z [2024-03-29 02:07:04,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[200dbe3d-8cb6-48fd-8bb2-93f186178033] succeeded in 3.7847249709993775s: None 2024-03-29T02:08:00.537638682Z [2024-03-29 02:08:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6419996c-d101-41e0-981f-aed5797409b9] received 2024-03-29T02:08:00.540431018Z [2024-03-29 02:08:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[422ca7ad-3b40-41e9-8368-647cc5c1711f] received 2024-03-29T02:08:00.542958973Z [2024-03-29 02:08:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d65ace3f-7fec-4720-8474-4a23362a276a] received 2024-03-29T02:08:00.544664662Z [2024-03-29 02:08:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dab648cc-d359-425b-bc1c-66773dac46a5] received 2024-03-29T02:08:00.549008406Z [2024-03-29 02:08:00,548: INFO/ForkPoolWorker-15] [6419996c-d101-41e0-981f-aed5797409b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:08:00.554093615Z [2024-03-29 02:08:00,553: INFO/ForkPoolWorker-2] [dab648cc-d359-425b-bc1c-66773dac46a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:08:00.558339040Z [2024-03-29 02:08:00,557: INFO/ForkPoolWorker-1] [d65ace3f-7fec-4720-8474-4a23362a276a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:08:00.559158284Z [2024-03-29 02:08:00,558: INFO/ForkPoolWorker-16] [422ca7ad-3b40-41e9-8368-647cc5c1711f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:08:00.992619786Z [2024-03-29 02:08:00,988: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:08:01.137642842Z [2024-03-29 02:08:01,129: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:08:01.163381571Z [2024-03-29 02:08:01,147: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:08:01.362343223Z [2024-03-29 02:08:01,361: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:08:01.371385478Z [2024-03-29 02:08:01,370: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:08:01.441656170Z [2024-03-29 02:08:01,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:08:01.442833378Z [2024-03-29 02:08:01,442: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:08:01.442894710Z [2024-03-29 02:08:01,442: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:08:01.442947309Z [2024-03-29 02:08:01,442: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:08:01.443186671Z [2024-03-29 02:08:01,443: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:08:01.489126722Z [2024-03-29 02:08:01,488: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:08:01.537061907Z [2024-03-29 02:08:01,532: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:08:01.552486639Z [2024-03-29 02:08:01,552: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:08:02.302628062Z [2024-03-29 02:08:02,300: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[422ca7ad-3b40-41e9-8368-647cc5c1711f] succeeded in 1.7550699230014288s: None 2024-03-29T02:08:02.435797473Z [2024-03-29 02:08:02,435: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d65ace3f-7fec-4720-8474-4a23362a276a] succeeded in 1.8866213759993116s: None 2024-03-29T02:08:02.812542799Z [2024-03-29 02:08:02,812: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:08:02.816157739Z [2024-03-29 02:08:02,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:08:02.838609317Z [2024-03-29 02:08:02,838: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:08:02.840476982Z [2024-03-29 02:08:02,840: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:08:02.840488069Z [2024-03-29 02:08:02,840: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:08:02.841069712Z [2024-03-29 02:08:02,840: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:08:02.841080136Z [2024-03-29 02:08:02,840: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:08:02.841501633Z [2024-03-29 02:08:02,841: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:08:02.841761156Z [2024-03-29 02:08:02,841: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:08:02.948623655Z [2024-03-29 02:08:02,948: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:08:03.186144748Z [2024-03-29 02:08:03,185: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:08:03.189871099Z [2024-03-29 02:08:03,189: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:08:03.215307613Z [2024-03-29 02:08:03,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:08:03.216985676Z [2024-03-29 02:08:03,216: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:08:03.217005439Z [2024-03-29 02:08:03,216: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:08:03.217061524Z [2024-03-29 02:08:03,216: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:08:03.217107086Z [2024-03-29 02:08:03,217: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:08:03.217397353Z [2024-03-29 02:08:03,217: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:08:03.217405355Z [2024-03-29 02:08:03,217: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:08:03.319225180Z [2024-03-29 02:08:03,318: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:08:04.857332399Z [2024-03-29 02:08:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6419996c-d101-41e0-981f-aed5797409b9] succeeded in 4.317402534999928s: None 2024-03-29T02:08:04.927995510Z [2024-03-29 02:08:04,927: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dab648cc-d359-425b-bc1c-66773dac46a5] succeeded in 4.381625193998843s: None 2024-03-29T02:09:00.867004319Z [2024-03-29 02:09:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be2b91a-e9ee-48e7-b89d-bc3c212a79d5] received 2024-03-29T02:09:00.868780930Z [2024-03-29 02:09:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a360527-4b60-42bd-afe7-3cff2667e51e] received 2024-03-29T02:09:00.879649574Z [2024-03-29 02:09:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d92387f-75c1-4777-b1ec-a32aa433e3c8] received 2024-03-29T02:09:00.880495208Z [2024-03-29 02:09:00,880: INFO/ForkPoolWorker-16] [6a360527-4b60-42bd-afe7-3cff2667e51e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:09:00.881314639Z [2024-03-29 02:09:00,881: INFO/ForkPoolWorker-15] [7be2b91a-e9ee-48e7-b89d-bc3c212a79d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:09:00.888400215Z [2024-03-29 02:09:00,888: INFO/ForkPoolWorker-1] [5d92387f-75c1-4777-b1ec-a32aa433e3c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:09:01.183458450Z [2024-03-29 02:09:01,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:09:01.204410484Z [2024-03-29 02:09:01,201: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:09:01.336510178Z [2024-03-29 02:09:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:09:01.534389964Z [2024-03-29 02:09:01,533: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:09:01.539054954Z [2024-03-29 02:09:01,538: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:09:01.567962674Z [2024-03-29 02:09:01,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:09:01.569653971Z [2024-03-29 02:09:01,569: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:09:01.569686080Z [2024-03-29 02:09:01,569: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:09:01.569694161Z [2024-03-29 02:09:01,569: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:09:01.570607209Z [2024-03-29 02:09:01,570: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:09:01.723041322Z [2024-03-29 02:09:01,722: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:09:02.503845901Z [2024-03-29 02:09:02,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d92387f-75c1-4777-b1ec-a32aa433e3c8] succeeded in 1.6219747560007818s: None 2024-03-29T02:09:02.679619652Z [2024-03-29 02:09:02,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:09:02.683075738Z [2024-03-29 02:09:02,682: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:09:02.708784005Z [2024-03-29 02:09:02,708: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:09:02.710552120Z [2024-03-29 02:09:02,710: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:09:02.710820765Z [2024-03-29 02:09:02,710: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:09:02.711021946Z [2024-03-29 02:09:02,710: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:09:02.711137734Z [2024-03-29 02:09:02,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:09:02.711505991Z [2024-03-29 02:09:02,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:09:02.711534117Z [2024-03-29 02:09:02,711: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:09:02.778175051Z [2024-03-29 02:09:02,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:09:02.783557884Z [2024-03-29 02:09:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:09:02.796818664Z [2024-03-29 02:09:02,796: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:09:02.805759260Z [2024-03-29 02:09:02,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:09:02.807987348Z [2024-03-29 02:09:02,807: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:09:02.808083801Z [2024-03-29 02:09:02,807: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:09:02.808289380Z [2024-03-29 02:09:02,808: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:09:02.808405579Z [2024-03-29 02:09:02,808: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:09:02.808717562Z [2024-03-29 02:09:02,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:09:02.808895161Z [2024-03-29 02:09:02,808: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:09:02.899953838Z [2024-03-29 02:09:02,899: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:09:04.371694711Z [2024-03-29 02:09:04,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7be2b91a-e9ee-48e7-b89d-bc3c212a79d5] succeeded in 3.5018867510007112s: None 2024-03-29T02:09:04.823858513Z [2024-03-29 02:09:04,823: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a360527-4b60-42bd-afe7-3cff2667e51e] succeeded in 3.9520608100010577s: None 2024-03-29T02:09:38.236898124Z [2024-03-29 02:09:38,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[476c5686-d50b-4d90-a6a6-941b159c81e3] received 2024-03-29T02:09:38.251335796Z [2024-03-29 02:09:38,251: INFO/ForkPoolWorker-15] [476c5686-d50b-4d90-a6a6-941b159c81e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240329020937_015758', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-29T02:09:38.597967544Z [2024-03-29 02:09:38,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-03-29T02:09:38.901160260Z [2024-03-29 02:09:38,900: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:09:39.381427858Z [2024-03-29 02:09:39,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[476c5686-d50b-4d90-a6a6-941b159c81e3] succeeded in 1.1422675180001534s: None 2024-03-29T02:10:00.619056596Z [2024-03-29 02:10:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[081c37fc-d5cc-40c6-b14a-743f83108e9d] received 2024-03-29T02:10:00.621274886Z [2024-03-29 02:10:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36cd5c47-a890-4159-9259-aff693b8a837] received 2024-03-29T02:10:00.627112191Z [2024-03-29 02:10:00,626: INFO/ForkPoolWorker-15] [081c37fc-d5cc-40c6-b14a-743f83108e9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:10:00.629914270Z [2024-03-29 02:10:00,629: INFO/ForkPoolWorker-16] [36cd5c47-a890-4159-9259-aff693b8a837] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:10:00.635209581Z [2024-03-29 02:10:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e26ff8c-f788-45b5-bdda-f870499fff7e] received 2024-03-29T02:10:00.638688388Z [2024-03-29 02:10:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f07296bf-bdc4-4aa7-a14b-2a67f3246809] received 2024-03-29T02:10:00.642273538Z [2024-03-29 02:10:00,642: INFO/ForkPoolWorker-1] [8e26ff8c-f788-45b5-bdda-f870499fff7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:00.643056695Z [2024-03-29 02:10:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa8c2919-38ca-4961-acbd-022c70f19b38] received 2024-03-29T02:10:00.648417161Z [2024-03-29 02:10:00,648: INFO/ForkPoolWorker-2] [f07296bf-bdc4-4aa7-a14b-2a67f3246809] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:10:00.655574635Z [2024-03-29 02:10:00,655: INFO/ForkPoolWorker-3] [aa8c2919-38ca-4961-acbd-022c70f19b38] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:10:01.037047217Z [2024-03-29 02:10:01,033: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:10:01.038915065Z [2024-03-29 02:10:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:10:01.219695091Z [2024-03-29 02:10:01,216: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:10:01.223510680Z [2024-03-29 02:10:01,220: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:10:01.320065470Z [2024-03-29 02:10:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:10:01.642911637Z [2024-03-29 02:10:01,642: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:10:01.647067060Z [2024-03-29 02:10:01,646: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:01.711525125Z [2024-03-29 02:10:01,711: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:10:01.714337263Z [2024-03-29 02:10:01,714: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:10:01.714510199Z [2024-03-29 02:10:01,714: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:10:01.714841741Z [2024-03-29 02:10:01,714: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:10:01.715192327Z [2024-03-29 02:10:01,715: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:10:01.859177599Z [2024-03-29 02:10:01,858: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:01.870582724Z [2024-03-29 02:10:01,870: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:02.847516815Z [2024-03-29 02:10:02,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[081c37fc-d5cc-40c6-b14a-743f83108e9d] succeeded in 2.226279174999945s: None 2024-03-29T02:10:03.171395658Z [2024-03-29 02:10:03,170: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[aa8c2919-38ca-4961-acbd-022c70f19b38] succeeded in 2.5254698040007497s: None 2024-03-29T02:10:03.189133053Z [2024-03-29 02:10:03,188: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:10:03.192729232Z [2024-03-29 02:10:03,192: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:03.223831782Z [2024-03-29 02:10:03,223: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:10:03.226709171Z [2024-03-29 02:10:03,226: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:03.226846701Z [2024-03-29 02:10:03,226: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:03.227124140Z [2024-03-29 02:10:03,226: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:03.228128604Z [2024-03-29 02:10:03,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:10:03.228349435Z [2024-03-29 02:10:03,228: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:10:03.228383793Z [2024-03-29 02:10:03,228: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:03.354210879Z [2024-03-29 02:10:03,353: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:03.392543624Z [2024-03-29 02:10:03,392: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:10:03.396431372Z [2024-03-29 02:10:03,395: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:03.421082405Z [2024-03-29 02:10:03,420: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:10:03.423027356Z [2024-03-29 02:10:03,422: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:03.423373966Z [2024-03-29 02:10:03,423: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:03.423795888Z [2024-03-29 02:10:03,423: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:03.424193065Z [2024-03-29 02:10:03,423: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:10:03.424642610Z [2024-03-29 02:10:03,424: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:10:03.424874662Z [2024-03-29 02:10:03,424: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:03.535817681Z [2024-03-29 02:10:03,535: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:03.607227933Z [2024-03-29 02:10:03,606: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:10:03.613214652Z [2024-03-29 02:10:03,612: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:03.667712080Z [2024-03-29 02:10:03,667: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:10:03.671594441Z [2024-03-29 02:10:03,671: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:03.671869787Z [2024-03-29 02:10:03,671: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:03.672124084Z [2024-03-29 02:10:03,671: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:03.672303865Z [2024-03-29 02:10:03,672: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:10:03.672942743Z [2024-03-29 02:10:03,672: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:10:03.673111347Z [2024-03-29 02:10:03,672: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:03.779708557Z [2024-03-29 02:10:03,779: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:04.225385967Z [2024-03-29 02:10:04,224: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e26ff8c-f788-45b5-bdda-f870499fff7e] succeeded in 3.58849626600022s: None 2024-03-29T02:10:05.075065928Z [2024-03-29 02:10:05,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e0ad549-de22-46e0-8927-c2d75d4664b3] received 2024-03-29T02:10:05.084978930Z [2024-03-29 02:10:05,084: INFO/ForkPoolWorker-15] [3e0ad549-de22-46e0-8927-c2d75d4664b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:05.299269777Z [2024-03-29 02:10:05,298: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f07296bf-bdc4-4aa7-a14b-2a67f3246809] succeeded in 4.657360481000069s: None 2024-03-29T02:10:05.513258003Z [2024-03-29 02:10:05,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:10:05.872926610Z [2024-03-29 02:10:05,872: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36cd5c47-a890-4159-9259-aff693b8a837] succeeded in 5.248338790001071s: None 2024-03-29T02:10:06.863874229Z [2024-03-29 02:10:06,862: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:10:06.867667424Z [2024-03-29 02:10:06,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:06.888405983Z [2024-03-29 02:10:06,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:10:06.890531420Z [2024-03-29 02:10:06,890: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:06.890687223Z [2024-03-29 02:10:06,890: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:06.890892363Z [2024-03-29 02:10:06,890: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:06.890983324Z [2024-03-29 02:10:06,890: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:10:06.891418408Z [2024-03-29 02:10:06,891: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:10:06.891536729Z [2024-03-29 02:10:06,891: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:06.970212103Z [2024-03-29 02:10:06,969: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:07.743571841Z [2024-03-29 02:10:07,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e0ad549-de22-46e0-8927-c2d75d4664b3] succeeded in 2.666440402999797s: None 2024-03-29T02:10:08.619819991Z [2024-03-29 02:10:08,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00432ec6-dd4b-49c5-815c-418b09210aeb] received 2024-03-29T02:10:08.626503603Z [2024-03-29 02:10:08,626: INFO/ForkPoolWorker-15] [00432ec6-dd4b-49c5-815c-418b09210aeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:10:08.968039872Z [2024-03-29 02:10:08,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:10:10.118266917Z [2024-03-29 02:10:10,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:10:10.122032073Z [2024-03-29 02:10:10,121: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:10.138833656Z [2024-03-29 02:10:10,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:10:10.141141662Z [2024-03-29 02:10:10,140: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:10.141223801Z [2024-03-29 02:10:10,141: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:10.142031948Z [2024-03-29 02:10:10,141: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:10.142417084Z [2024-03-29 02:10:10,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:10:10.143303577Z [2024-03-29 02:10:10,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:10:10.143424731Z [2024-03-29 02:10:10,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:10.226009978Z [2024-03-29 02:10:10,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:10.772574269Z [2024-03-29 02:10:10,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00432ec6-dd4b-49c5-815c-418b09210aeb] succeeded in 2.15058637599941s: None 2024-03-29T02:10:11.242269734Z [2024-03-29 02:10:11,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23dabb0d-6989-4eb7-b431-b72b2df64504] received 2024-03-29T02:10:11.260696089Z [2024-03-29 02:10:11,260: INFO/ForkPoolWorker-15] [23dabb0d-6989-4eb7-b431-b72b2df64504] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:11.567397056Z [2024-03-29 02:10:11,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:10:12.667538860Z [2024-03-29 02:10:12,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:10:12.670884475Z [2024-03-29 02:10:12,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:10:12.690959412Z [2024-03-29 02:10:12,690: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:10:12.692472870Z [2024-03-29 02:10:12,692: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:10:12.692483886Z [2024-03-29 02:10:12,692: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:10:12.692689753Z [2024-03-29 02:10:12,692: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:10:12.692838241Z [2024-03-29 02:10:12,692: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:10:12.693201984Z [2024-03-29 02:10:12,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:10:12.693397289Z [2024-03-29 02:10:12,693: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:10:12.787104698Z [2024-03-29 02:10:12,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:10:13.377639338Z [2024-03-29 02:10:13,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23dabb0d-6989-4eb7-b431-b72b2df64504] succeeded in 2.1271508159989025s: None 2024-03-29T02:11:01.216545467Z [2024-03-29 02:11:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad87bc81-057c-4e18-ac8a-3c9045889ebf] received 2024-03-29T02:11:01.224247407Z [2024-03-29 02:11:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78836a41-629d-4b9f-a7ec-8f803f296837] received 2024-03-29T02:11:01.232265048Z [2024-03-29 02:11:01,231: INFO/ForkPoolWorker-15] [ad87bc81-057c-4e18-ac8a-3c9045889ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:11:01.234620872Z [2024-03-29 02:11:01,234: INFO/ForkPoolWorker-16] [78836a41-629d-4b9f-a7ec-8f803f296837] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:11:01.239218791Z [2024-03-29 02:11:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40650b44-3893-40c3-98c4-e0dbbbc1d587] received 2024-03-29T02:11:01.280605165Z [2024-03-29 02:11:01,276: INFO/ForkPoolWorker-1] [40650b44-3893-40c3-98c4-e0dbbbc1d587] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:11:01.836515234Z [2024-03-29 02:11:01,832: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:11:02.142647129Z [2024-03-29 02:11:02,123: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:11:02.209860838Z [2024-03-29 02:11:02,198: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:11:03.746644234Z [2024-03-29 02:11:03,746: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:11:03.765688552Z [2024-03-29 02:11:03,750: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:03.985244953Z [2024-03-29 02:11:03,985: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:11:04.002858872Z [2024-03-29 02:11:04,002: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:11:04.003113234Z [2024-03-29 02:11:04,002: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:11:04.003258889Z [2024-03-29 02:11:04,003: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:11:04.003706984Z [2024-03-29 02:11:04,003: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:11:04.408892940Z [2024-03-29 02:11:04,408: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:04.504730605Z [2024-03-29 02:11:04,504: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:04.509743050Z [2024-03-29 02:11:04,509: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:04.603393664Z [2024-03-29 02:11:04,603: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:04.607382222Z [2024-03-29 02:11:04,607: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:04.607615073Z [2024-03-29 02:11:04,607: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:04.607924479Z [2024-03-29 02:11:04,607: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:04.608243179Z [2024-03-29 02:11:04,607: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:04.608429684Z [2024-03-29 02:11:04,608: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:04.608865324Z [2024-03-29 02:11:04,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:11:04.609430106Z [2024-03-29 02:11:04,609: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:04.621500523Z [2024-03-29 02:11:04,621: INFO/ForkPoolWorker-15] Creating DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:04.720707172Z [2024-03-29 02:11:04,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:05.163025890Z [2024-03-29 02:11:05,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f492943-c76c-468f-a1dd-12081e655a77] received 2024-03-29T02:11:05.181660100Z [2024-03-29 02:11:05,178: INFO/ForkPoolWorker-2] [9f492943-c76c-468f-a1dd-12081e655a77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:11:05.532592457Z [2024-03-29 02:11:05,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:11:05.544287670Z [2024-03-29 02:11:05,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:05.636404460Z [2024-03-29 02:11:05,636: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:11:05.644894448Z [2024-03-29 02:11:05,644: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:05.644916676Z [2024-03-29 02:11:05,644: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:05.644925856Z [2024-03-29 02:11:05,644: INFO/ForkPoolWorker-16] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:05.654752337Z [2024-03-29 02:11:05,644: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:05.654779701Z [2024-03-29 02:11:05,647: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:11:05.654783650Z [2024-03-29 02:11:05,647: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:11:05.654787302Z [2024-03-29 02:11:05,647: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:05.694565853Z [2024-03-29 02:11:05,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:06.293182389Z [2024-03-29 02:11:06,292: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:06.472620141Z [2024-03-29 02:11:06,469: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:11:06.518135612Z [2024-03-29 02:11:06,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[40650b44-3893-40c3-98c4-e0dbbbc1d587] succeeded in 5.272933358000955s: None 2024-03-29T02:11:08.123176333Z [2024-03-29 02:11:08,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad87bc81-057c-4e18-ac8a-3c9045889ebf] succeeded in 6.902237258000241s: None 2024-03-29T02:11:08.589735752Z [2024-03-29 02:11:08,589: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:11:08.592968674Z [2024-03-29 02:11:08,592: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:08.619022294Z [2024-03-29 02:11:08,618: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:11:08.620303171Z [2024-03-29 02:11:08,620: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:08.620378304Z [2024-03-29 02:11:08,620: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:08.620500740Z [2024-03-29 02:11:08,620: INFO/ForkPoolWorker-2] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:08.620689319Z [2024-03-29 02:11:08,620: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:08.620892794Z [2024-03-29 02:11:08,620: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:11:08.621176834Z [2024-03-29 02:11:08,621: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:11:08.621293857Z [2024-03-29 02:11:08,621: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:08.627487629Z [2024-03-29 02:11:08,627: INFO/ForkPoolWorker-2] Creating DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:08.704939192Z [2024-03-29 02:11:08,704: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:09.172959813Z [2024-03-29 02:11:09,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78836a41-629d-4b9f-a7ec-8f803f296837] succeeded in 7.946528033000504s: None 2024-03-29T02:11:09.515604492Z [2024-03-29 02:11:09,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b40ae4e-12f1-4db1-9567-414fa35902a8] received 2024-03-29T02:11:09.534613123Z [2024-03-29 02:11:09,534: INFO/ForkPoolWorker-15] [5b40ae4e-12f1-4db1-9567-414fa35902a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:09.872882443Z [2024-03-29 02:11:09,869: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:11:10.343127822Z [2024-03-29 02:11:10,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f492943-c76c-468f-a1dd-12081e655a77] succeeded in 5.192631874000654s: None 2024-03-29T02:11:10.956793651Z [2024-03-29 02:11:10,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:10.960663929Z [2024-03-29 02:11:10,960: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:10.989031340Z [2024-03-29 02:11:10,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:10.990404333Z [2024-03-29 02:11:10,990: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:10.990563228Z [2024-03-29 02:11:10,990: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:10.990700983Z [2024-03-29 02:11:10,990: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:10.990901776Z [2024-03-29 02:11:10,990: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:10.991024370Z [2024-03-29 02:11:10,990: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:10.991382644Z [2024-03-29 02:11:10,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:11:10.991495752Z [2024-03-29 02:11:10,991: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:10.997435678Z [2024-03-29 02:11:10,997: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:11.089796120Z [2024-03-29 02:11:11,089: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:11.597127077Z [2024-03-29 02:11:11,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b40ae4e-12f1-4db1-9567-414fa35902a8] succeeded in 2.07241828000042s: None 2024-03-29T02:11:11.930949093Z [2024-03-29 02:11:11,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20e8d68c-f135-4b7b-beb0-c0b949206794] received 2024-03-29T02:11:11.937399310Z [2024-03-29 02:11:11,937: INFO/ForkPoolWorker-15] [20e8d68c-f135-4b7b-beb0-c0b949206794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'split_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:12.198454108Z [2024-03-29 02:11:12,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:11:13.258686484Z [2024-03-29 02:11:13,258: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:13.262120105Z [2024-03-29 02:11:13,261: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:13.280465766Z [2024-03-29 02:11:13,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:13.281916628Z [2024-03-29 02:11:13,281: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:13.282005404Z [2024-03-29 02:11:13,281: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:13.282097331Z [2024-03-29 02:11:13,282: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:13.282276612Z [2024-03-29 02:11:13,282: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:13.282358501Z [2024-03-29 02:11:13,282: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:13.282767166Z [2024-03-29 02:11:13,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:11:13.282887592Z [2024-03-29 02:11:13,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:13.288762385Z [2024-03-29 02:11:13,288: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:13.369168064Z [2024-03-29 02:11:13,368: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:13.950034346Z [2024-03-29 02:11:13,949: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20e8d68c-f135-4b7b-beb0-c0b949206794] succeeded in 2.0167471610002394s: None 2024-03-29T02:11:14.871852216Z [2024-03-29 02:11:14,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[565469c1-ddd0-4ce7-ac82-60fa36ed3317] received 2024-03-29T02:11:14.879372257Z [2024-03-29 02:11:14,878: INFO/ForkPoolWorker-15] [565469c1-ddd0-4ce7-ac82-60fa36ed3317] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'collect_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:11:15.192947462Z [2024-03-29 02:11:15,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:11:16.323115144Z [2024-03-29 02:11:16,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:16.326314835Z [2024-03-29 02:11:16,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:16.341894610Z [2024-03-29 02:11:16,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:16.342968165Z [2024-03-29 02:11:16,342: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:16.342981513Z [2024-03-29 02:11:16,342: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:16.343033531Z [2024-03-29 02:11:16,342: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:16.343198755Z [2024-03-29 02:11:16,343: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:16.343209131Z [2024-03-29 02:11:16,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:16.343396902Z [2024-03-29 02:11:16,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:11:16.343447092Z [2024-03-29 02:11:16,343: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:16.348758662Z [2024-03-29 02:11:16,348: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:16.421858352Z [2024-03-29 02:11:16,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:16.917144272Z [2024-03-29 02:11:16,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[565469c1-ddd0-4ce7-ac82-60fa36ed3317] succeeded in 2.043445575000078s: None 2024-03-29T02:11:17.197227095Z [2024-03-29 02:11:17,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad3e9fda-9e8f-4a0d-b9d0-25e2817bf2ed] received 2024-03-29T02:11:17.206740433Z [2024-03-29 02:11:17,206: INFO/ForkPoolWorker-15] [ad3e9fda-9e8f-4a0d-b9d0-25e2817bf2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'send_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:17.569648443Z [2024-03-29 02:11:17,566: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:11:18.735703616Z [2024-03-29 02:11:18,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:18.739535938Z [2024-03-29 02:11:18,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:18.758079976Z [2024-03-29 02:11:18,757: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:18.759568599Z [2024-03-29 02:11:18,759: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:18.759686359Z [2024-03-29 02:11:18,759: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:18.759747470Z [2024-03-29 02:11:18,759: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:18.759938782Z [2024-03-29 02:11:18,759: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:18.760060360Z [2024-03-29 02:11:18,759: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:18.760327207Z [2024-03-29 02:11:18,760: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:11:18.760437715Z [2024-03-29 02:11:18,760: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:18.765908393Z [2024-03-29 02:11:18,765: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:18.848270991Z [2024-03-29 02:11:18,847: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:19.366334248Z [2024-03-29 02:11:19,365: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad3e9fda-9e8f-4a0d-b9d0-25e2817bf2ed] succeeded in 2.1669507499991596s: None 2024-03-29T02:11:25.044514817Z [2024-03-29 02:11:25,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[672cd0a1-e557-4169-a0b2-d2a10e7c471e] received 2024-03-29T02:11:25.051089271Z [2024-03-29 02:11:25,050: INFO/ForkPoolWorker-15] [672cd0a1-e557-4169-a0b2-d2a10e7c471e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:11:25.343994087Z [2024-03-29 02:11:25,340: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:11:26.480468632Z [2024-03-29 02:11:26,480: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:11:26.483876952Z [2024-03-29 02:11:26,483: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:11:26.503744353Z [2024-03-29 02:11:26,503: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:11:26.504886303Z [2024-03-29 02:11:26,504: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:11:26.504897494Z [2024-03-29 02:11:26,504: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:11:26.504988922Z [2024-03-29 02:11:26,504: INFO/ForkPoolWorker-15] Read VIM ea9d251d-feab-4d95-8709-1550a82a0d0e (basic01_010220) 2024-03-29T02:11:26.505101286Z [2024-03-29 02:11:26,504: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ea9d251d-feab-4d95-8709-1550a82a0d0e', 'name': 'basic01_010220', 'vim_type': 'openstack'}] 2024-03-29T02:11:26.505133486Z [2024-03-29 02:11:26,505: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:11:26.505394180Z [2024-03-29 02:11:26,505: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:11:26.505494000Z [2024-03-29 02:11:26,505: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:11:26.510213082Z [2024-03-29 02:11:26,509: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e 2024-03-29T02:11:26.581087158Z [2024-03-29 02:11:26,580: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:28.321964458Z [2024-03-29 02:11:28,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[672cd0a1-e557-4169-a0b2-d2a10e7c471e] succeeded in 3.2752477459998772s: None 2024-03-29T02:11:38.116836993Z [2024-03-29 02:11:38,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b0bc872-72f3-41cd-9e95-7eb66125ad5f] received 2024-03-29T02:11:38.127184256Z [2024-03-29 02:11:38,126: INFO/ForkPoolWorker-15] [9b0bc872-72f3-41cd-9e95-7eb66125ad5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240329021137_806244', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-29T02:11:38.392059726Z [2024-03-29 02:11:38,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-03-29T02:11:38.668660261Z [2024-03-29 02:11:38,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:11:39.289781087Z [2024-03-29 02:11:39,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b0bc872-72f3-41cd-9e95-7eb66125ad5f] succeeded in 1.1677611509985582s: None 2024-03-29T02:12:00.455704813Z [2024-03-29 02:12:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b724ebf0-6f1a-41a2-a726-6a8e68a7ca54] received 2024-03-29T02:12:00.458297941Z [2024-03-29 02:12:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04554997-94fa-4b84-988a-6440fe52694e] received 2024-03-29T02:12:00.466635118Z [2024-03-29 02:12:00,466: INFO/ForkPoolWorker-15] [b724ebf0-6f1a-41a2-a726-6a8e68a7ca54] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:12:00.471924165Z [2024-03-29 02:12:00,468: INFO/ForkPoolWorker-16] [04554997-94fa-4b84-988a-6440fe52694e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:00.472650026Z [2024-03-29 02:12:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[736de4ac-1850-46e5-b71d-efaca0b73ef0] received 2024-03-29T02:12:00.476389524Z [2024-03-29 02:12:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88c849a5-cf6f-425e-9cdd-b232c25b00c9] received 2024-03-29T02:12:00.479199385Z [2024-03-29 02:12:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d5f0818-9276-40e8-96ee-936f60569ad6] received 2024-03-29T02:12:00.499185664Z [2024-03-29 02:12:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7acb44cb-e074-4015-a5f5-7614e1f7a00f] received 2024-03-29T02:12:00.511324933Z [2024-03-29 02:12:00,511: INFO/ForkPoolWorker-2] [88c849a5-cf6f-425e-9cdd-b232c25b00c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:00.519348606Z [2024-03-29 02:12:00,519: INFO/ForkPoolWorker-3] [3d5f0818-9276-40e8-96ee-936f60569ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:00.530083506Z [2024-03-29 02:12:00,529: INFO/ForkPoolWorker-1] [736de4ac-1850-46e5-b71d-efaca0b73ef0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:00.554851484Z [2024-03-29 02:12:00,553: INFO/ForkPoolWorker-4] [7acb44cb-e074-4015-a5f5-7614e1f7a00f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:12:01.076079197Z [2024-03-29 02:12:01,063: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:01.083962647Z [2024-03-29 02:12:01,080: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:12:01.108306041Z [2024-03-29 02:12:01,104: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:12:01.165838844Z [2024-03-29 02:12:01,162: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:01.179964209Z [2024-03-29 02:12:01,176: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:01.408267771Z [2024-03-29 02:12:01,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:12:01.441863457Z [2024-03-29 02:12:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:01.501449984Z [2024-03-29 02:12:01,500: INFO/ForkPoolWorker-4] Getting SDNC list 2024-03-29T02:12:01.515349397Z [2024-03-29 02:12:01,514: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:01.572215421Z [2024-03-29 02:12:01,571: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-29T02:12:01.575495407Z [2024-03-29 02:12:01,575: INFO/ForkPoolWorker-4] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:12:01.575941005Z [2024-03-29 02:12:01,575: INFO/ForkPoolWorker-4] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:12:01.576069587Z [2024-03-29 02:12:01,575: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-03-29T02:12:01.576441617Z [2024-03-29 02:12:01,576: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:12:01.928683109Z [2024-03-29 02:12:01,928: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:12:02.460443625Z [2024-03-29 02:12:02,460: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b724ebf0-6f1a-41a2-a726-6a8e68a7ca54] succeeded in 2.0027952029995504s: None 2024-03-29T02:12:02.873945769Z [2024-03-29 02:12:02,873: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T02:12:02.887774642Z [2024-03-29 02:12:02,883: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:02.959422754Z [2024-03-29 02:12:02,959: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:12:02.963046951Z [2024-03-29 02:12:02,962: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:02.963146908Z [2024-03-29 02:12:02,962: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:02.963368700Z [2024-03-29 02:12:02,962: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:02.963412283Z [2024-03-29 02:12:02,963: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T02:12:02.963862056Z [2024-03-29 02:12:02,963: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:12:02.963886184Z [2024-03-29 02:12:02,963: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:02.967902526Z [2024-03-29 02:12:02,967: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[7acb44cb-e074-4015-a5f5-7614e1f7a00f] succeeded in 2.45811013400089s: None 2024-03-29T02:12:03.139389314Z [2024-03-29 02:12:03,138: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:12:03.311525298Z [2024-03-29 02:12:03,311: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:12:03.316458256Z [2024-03-29 02:12:03,315: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:03.343590045Z [2024-03-29 02:12:03,343: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:12:03.345820941Z [2024-03-29 02:12:03,345: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:03.345909154Z [2024-03-29 02:12:03,345: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:03.346118742Z [2024-03-29 02:12:03,345: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:03.346324808Z [2024-03-29 02:12:03,346: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:12:03.346956064Z [2024-03-29 02:12:03,346: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:12:03.347100735Z [2024-03-29 02:12:03,346: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:03.353982121Z [2024-03-29 02:12:03,353: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:03.355915933Z [2024-03-29 02:12:03,354: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:03.357001633Z [2024-03-29 02:12:03,356: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:12:03.359954521Z [2024-03-29 02:12:03,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:03.385338424Z [2024-03-29 02:12:03,385: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:12:03.393301035Z [2024-03-29 02:12:03,392: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:03.393367558Z [2024-03-29 02:12:03,393: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:03.393687298Z [2024-03-29 02:12:03,393: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:03.393983610Z [2024-03-29 02:12:03,393: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:12:03.394516812Z [2024-03-29 02:12:03,394: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:12:03.396554923Z [2024-03-29 02:12:03,394: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:03.400666350Z [2024-03-29 02:12:03,399: ERROR/ForkPoolWorker-16] [04554997-94fa-4b84-988a-6440fe52694e] Failed to execute task Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:12:03.400744834Z Traceback (most recent call last): 2024-03-29T02:12:03.400752702Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:12:03.400814015Z args.func(args) 2024-03-29T02:12:03.400822369Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:12:03.400828702Z return func(*args, **kwargs) 2024-03-29T02:12:03.400834205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:12:03.400839217Z return f(*args, **kwargs) 2024-03-29T02:12:03.400844748Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:12:03.400851203Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:12:03.400856069Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:12:03.400860816Z raise AirflowException( 2024-03-29T02:12:03.400866564Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:12:03.448423297Z [2024-03-29 02:12:03,447: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04554997-94fa-4b84-988a-6440fe52694e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 04554997-94fa-4b84-988a-6440fe52694e') 2024-03-29T02:12:03.448448732Z Traceback (most recent call last): 2024-03-29T02:12:03.448480728Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:12:03.448486249Z R = retval = fun(*args, **kwargs) 2024-03-29T02:12:03.448491053Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:12:03.448495922Z return self.run(*args, **kwargs) 2024-03-29T02:12:03.448501191Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:12:03.448506522Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:12:03.448511164Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:12:03.448516605Z raise AirflowException(msg) 2024-03-29T02:12:03.448522100Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 04554997-94fa-4b84-988a-6440fe52694e 2024-03-29T02:12:03.749339156Z [2024-03-29 02:12:03,748: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:12:03.753259729Z [2024-03-29 02:12:03,752: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:03.788972456Z [2024-03-29 02:12:03,788: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:12:03.790912544Z [2024-03-29 02:12:03,790: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:03.790944728Z [2024-03-29 02:12:03,790: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:03.791204504Z [2024-03-29 02:12:03,790: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:03.791292916Z [2024-03-29 02:12:03,791: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:12:03.791690820Z [2024-03-29 02:12:03,791: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:12:03.791711557Z [2024-03-29 02:12:03,791: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:03.814120159Z [2024-03-29 02:12:03,813: WARNING/ForkPoolWorker-2] Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:03.815512664Z [2024-03-29 02:12:03,814: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:03.816717883Z [2024-03-29 02:12:03,816: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:12:03.820856855Z [2024-03-29 02:12:03,820: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:03.851511525Z [2024-03-29 02:12:03,851: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:12:03.856461416Z [2024-03-29 02:12:03,856: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:03.856608056Z [2024-03-29 02:12:03,856: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:03.856830269Z [2024-03-29 02:12:03,856: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:03.856999579Z [2024-03-29 02:12:03,856: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:12:03.857372112Z [2024-03-29 02:12:03,857: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:12:03.857631873Z [2024-03-29 02:12:03,857: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:03.862416840Z [2024-03-29 02:12:03,861: ERROR/ForkPoolWorker-2] [88c849a5-cf6f-425e-9cdd-b232c25b00c9] Failed to execute task Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:12:03.862435996Z Traceback (most recent call last): 2024-03-29T02:12:03.862461307Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:12:03.862468463Z args.func(args) 2024-03-29T02:12:03.862474899Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:12:03.862501622Z return func(*args, **kwargs) 2024-03-29T02:12:03.862508379Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:12:03.862513307Z return f(*args, **kwargs) 2024-03-29T02:12:03.862518866Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:12:03.862524154Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:12:03.862529592Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:12:03.862534745Z raise AirflowException( 2024-03-29T02:12:03.862540197Z airflow.exceptions.AirflowException: Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:12:03.901500136Z [2024-03-29 02:12:03,900: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[88c849a5-cf6f-425e-9cdd-b232c25b00c9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 88c849a5-cf6f-425e-9cdd-b232c25b00c9') 2024-03-29T02:12:03.901523564Z Traceback (most recent call last): 2024-03-29T02:12:03.901529783Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:12:03.901535241Z R = retval = fun(*args, **kwargs) 2024-03-29T02:12:03.901540378Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:12:03.901545921Z return self.run(*args, **kwargs) 2024-03-29T02:12:03.901551833Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:12:03.901557840Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:12:03.901563224Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:12:03.901569084Z raise AirflowException(msg) 2024-03-29T02:12:03.901575288Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 88c849a5-cf6f-425e-9cdd-b232c25b00c9 2024-03-29T02:12:03.986513702Z [2024-03-29 02:12:03,986: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:12:03.989709068Z [2024-03-29 02:12:03,989: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:04.010948359Z [2024-03-29 02:12:04,010: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:12:04.013675687Z [2024-03-29 02:12:04,013: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:04.013967547Z [2024-03-29 02:12:04,013: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:04.014273092Z [2024-03-29 02:12:04,013: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:04.014716772Z [2024-03-29 02:12:04,014: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:12:04.015347555Z [2024-03-29 02:12:04,015: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:12:04.015581847Z [2024-03-29 02:12:04,015: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:04.103956056Z [2024-03-29 02:12:04,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:12:05.522387445Z [2024-03-29 02:12:05,521: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3d5f0818-9276-40e8-96ee-936f60569ad6] succeeded in 5.0372366570009035s: None 2024-03-29T02:12:06.555094841Z [2024-03-29 02:12:06,554: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[736de4ac-1850-46e5-b71d-efaca0b73ef0] succeeded in 6.080629071999283s: None 2024-03-29T02:12:13.825136433Z [2024-03-29 02:12:13,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af7ab9c-0a1e-48aa-ae7a-9280e59f4331] received 2024-03-29T02:12:13.833824315Z [2024-03-29 02:12:13,833: INFO/ForkPoolWorker-15] [7af7ab9c-0a1e-48aa-ae7a-9280e59f4331] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:14.110657021Z [2024-03-29 02:12:14,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:15.032999055Z [2024-03-29 02:12:15,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d55b7175-d27a-4cf0-9957-3b4dd39ec70a] received 2024-03-29T02:12:15.071215195Z [2024-03-29 02:12:15,070: INFO/ForkPoolWorker-16] [d55b7175-d27a-4cf0-9957-3b4dd39ec70a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:15.264553270Z [2024-03-29 02:12:15,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:12:15.268515919Z [2024-03-29 02:12:15,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:15.289188217Z [2024-03-29 02:12:15,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:12:15.290810453Z [2024-03-29 02:12:15,290: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:15.290944026Z [2024-03-29 02:12:15,290: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:15.291077131Z [2024-03-29 02:12:15,290: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:15.291093423Z [2024-03-29 02:12:15,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:12:15.291322669Z [2024-03-29 02:12:15,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:12:15.291356791Z [2024-03-29 02:12:15,291: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:15.297590236Z [2024-03-29 02:12:15,297: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:15.299169440Z [2024-03-29 02:12:15,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:12:15.300190439Z [2024-03-29 02:12:15,300: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:12:15.302930431Z [2024-03-29 02:12:15,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:15.314223650Z [2024-03-29 02:12:15,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:12:15.315720391Z [2024-03-29 02:12:15,315: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:15.315843368Z [2024-03-29 02:12:15,315: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:15.316039812Z [2024-03-29 02:12:15,315: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:15.316062621Z [2024-03-29 02:12:15,315: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:12:15.316364691Z [2024-03-29 02:12:15,316: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:12:15.316496170Z [2024-03-29 02:12:15,316: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:15.319777247Z [2024-03-29 02:12:15,319: ERROR/ForkPoolWorker-15] [7af7ab9c-0a1e-48aa-ae7a-9280e59f4331] Failed to execute task Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:12:15.319794046Z Traceback (most recent call last): 2024-03-29T02:12:15.319800554Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:12:15.319806123Z args.func(args) 2024-03-29T02:12:15.319813235Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:12:15.319822304Z return func(*args, **kwargs) 2024-03-29T02:12:15.319827417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:12:15.319832222Z return f(*args, **kwargs) 2024-03-29T02:12:15.319837368Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:12:15.319842175Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:12:15.319846568Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:12:15.319850577Z raise AirflowException( 2024-03-29T02:12:15.319860895Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:12:15.350969020Z [2024-03-29 02:12:15,350: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7af7ab9c-0a1e-48aa-ae7a-9280e59f4331] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7af7ab9c-0a1e-48aa-ae7a-9280e59f4331') 2024-03-29T02:12:15.350990023Z Traceback (most recent call last): 2024-03-29T02:12:15.350994185Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:12:15.350997775Z R = retval = fun(*args, **kwargs) 2024-03-29T02:12:15.351016136Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:12:15.351019294Z return self.run(*args, **kwargs) 2024-03-29T02:12:15.351023020Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:12:15.351026560Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:12:15.351030244Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:12:15.351036572Z raise AirflowException(msg) 2024-03-29T02:12:15.351059175Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7af7ab9c-0a1e-48aa-ae7a-9280e59f4331 2024-03-29T02:12:15.392364211Z [2024-03-29 02:12:15,388: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:16.492619280Z [2024-03-29 02:12:16,492: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:12:16.495742627Z [2024-03-29 02:12:16,495: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:16.518017912Z [2024-03-29 02:12:16,517: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:12:16.520209131Z [2024-03-29 02:12:16,519: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:16.520464663Z [2024-03-29 02:12:16,520: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:16.520664857Z [2024-03-29 02:12:16,520: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:16.520796699Z [2024-03-29 02:12:16,520: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:12:16.521740556Z [2024-03-29 02:12:16,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:12:16.521786523Z [2024-03-29 02:12:16,521: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:16.528431666Z [2024-03-29 02:12:16,528: WARNING/ForkPoolWorker-16] Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:16.529343338Z [2024-03-29 02:12:16,528: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:12:16.530135766Z [2024-03-29 02:12:16,529: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:12:16.533155077Z [2024-03-29 02:12:16,532: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:12:16.548845509Z [2024-03-29 02:12:16,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:12:16.550494280Z [2024-03-29 02:12:16,550: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:12:16.550662196Z [2024-03-29 02:12:16,550: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:12:16.551140001Z [2024-03-29 02:12:16,550: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:12:16.551267528Z [2024-03-29 02:12:16,550: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:12:16.551599368Z [2024-03-29 02:12:16,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:12:16.551862860Z [2024-03-29 02:12:16,551: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:12:16.557614016Z [2024-03-29 02:12:16,556: ERROR/ForkPoolWorker-16] [d55b7175-d27a-4cf0-9957-3b4dd39ec70a] Failed to execute task Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:12:16.557629963Z Traceback (most recent call last): 2024-03-29T02:12:16.557635296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:12:16.557640982Z args.func(args) 2024-03-29T02:12:16.557645878Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:12:16.557651186Z return func(*args, **kwargs) 2024-03-29T02:12:16.557655615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:12:16.557659882Z return f(*args, **kwargs) 2024-03-29T02:12:16.557663972Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:12:16.557668082Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:12:16.557673092Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:12:16.557677163Z raise AirflowException( 2024-03-29T02:12:16.557682062Z airflow.exceptions.AirflowException: Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:12:16.614080066Z [2024-03-29 02:12:16,613: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d55b7175-d27a-4cf0-9957-3b4dd39ec70a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d55b7175-d27a-4cf0-9957-3b4dd39ec70a') 2024-03-29T02:12:16.614115332Z Traceback (most recent call last): 2024-03-29T02:12:16.614123430Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:12:16.614128658Z R = retval = fun(*args, **kwargs) 2024-03-29T02:12:16.614133496Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:12:16.614138440Z return self.run(*args, **kwargs) 2024-03-29T02:12:16.614143826Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:12:16.614149183Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:12:16.614153843Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:12:16.614158627Z raise AirflowException(msg) 2024-03-29T02:12:16.614162730Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d55b7175-d27a-4cf0-9957-3b4dd39ec70a 2024-03-29T02:13:00.593148133Z [2024-03-29 02:13:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed211406-7b54-483d-94d7-bac8634c25ec] received 2024-03-29T02:13:00.595615558Z [2024-03-29 02:13:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c0ecd12-ea73-46c8-ad2f-28c5ed960998] received 2024-03-29T02:13:00.598804928Z [2024-03-29 02:13:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32b58632-ea0d-4cdd-8a9f-ea2ea3dfb06a] received 2024-03-29T02:13:00.601972965Z [2024-03-29 02:13:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bba0c88c-252d-462c-9da8-bd907dbc95bd] received 2024-03-29T02:13:00.604452557Z [2024-03-29 02:13:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3494eb11-3844-4e6b-b1b7-a36d1f963c77] received 2024-03-29T02:13:00.605107184Z [2024-03-29 02:13:00,604: INFO/ForkPoolWorker-15] [ed211406-7b54-483d-94d7-bac8634c25ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:00.610161415Z [2024-03-29 02:13:00,609: INFO/ForkPoolWorker-2] [bba0c88c-252d-462c-9da8-bd907dbc95bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:00.612085768Z [2024-03-29 02:13:00,611: INFO/ForkPoolWorker-1] [32b58632-ea0d-4cdd-8a9f-ea2ea3dfb06a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:13:00.612242167Z [2024-03-29 02:13:00,611: INFO/ForkPoolWorker-16] [4c0ecd12-ea73-46c8-ad2f-28c5ed960998] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:00.616961780Z [2024-03-29 02:13:00,616: INFO/ForkPoolWorker-3] [3494eb11-3844-4e6b-b1b7-a36d1f963c77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:00.986136739Z [2024-03-29 02:13:00,983: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:01.041981748Z [2024-03-29 02:13:01,039: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:13:01.057643828Z [2024-03-29 02:13:01,054: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:01.172817120Z [2024-03-29 02:13:01,167: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:01.206872403Z [2024-03-29 02:13:01,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:01.212567842Z [2024-03-29 02:13:01,212: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:13:01.216616561Z [2024-03-29 02:13:01,216: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:01.255502595Z [2024-03-29 02:13:01,255: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:13:01.258949492Z [2024-03-29 02:13:01,258: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:13:01.259059788Z [2024-03-29 02:13:01,258: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:13:01.259163336Z [2024-03-29 02:13:01,259: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:13:01.259379861Z [2024-03-29 02:13:01,259: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:13:01.378347721Z [2024-03-29 02:13:01,378: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:13:02.299939884Z [2024-03-29 02:13:02,299: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32b58632-ea0d-4cdd-8a9f-ea2ea3dfb06a] succeeded in 1.6986878589996195s: None 2024-03-29T02:13:02.890850608Z [2024-03-29 02:13:02,890: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T02:13:02.894586051Z [2024-03-29 02:13:02,894: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:02.936474136Z [2024-03-29 02:13:02,936: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:13:02.939726602Z [2024-03-29 02:13:02,939: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:02.939958902Z [2024-03-29 02:13:02,939: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:02.940351610Z [2024-03-29 02:13:02,940: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:02.940561274Z [2024-03-29 02:13:02,940: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T02:13:02.940922095Z [2024-03-29 02:13:02,940: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:13:02.941196452Z [2024-03-29 02:13:02,940: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:02.967513565Z [2024-03-29 02:13:02,967: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:13:02.973930846Z [2024-03-29 02:13:02,973: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:03.011233012Z [2024-03-29 02:13:03,010: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:13:03.020079759Z [2024-03-29 02:13:03,019: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:03.020131543Z [2024-03-29 02:13:03,019: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:03.020292945Z [2024-03-29 02:13:03,020: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:03.020320615Z [2024-03-29 02:13:03,020: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:13:03.020659777Z [2024-03-29 02:13:03,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:13:03.020694463Z [2024-03-29 02:13:03,020: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:03.043451760Z [2024-03-29 02:13:03,043: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:13:03.174294707Z [2024-03-29 02:13:03,174: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:13:03.511126186Z [2024-03-29 02:13:03,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:13:03.514494784Z [2024-03-29 02:13:03,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:03.546537380Z [2024-03-29 02:13:03,546: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:13:03.549463699Z [2024-03-29 02:13:03,549: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:03.549590092Z [2024-03-29 02:13:03,549: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:03.549809363Z [2024-03-29 02:13:03,549: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:03.549933530Z [2024-03-29 02:13:03,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:13:03.550318004Z [2024-03-29 02:13:03,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:13:03.550673405Z [2024-03-29 02:13:03,550: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:03.552014108Z [2024-03-29 02:13:03,551: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:13:03.555421656Z [2024-03-29 02:13:03,554: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:03.561943557Z [2024-03-29 02:13:03,561: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:03.563283847Z [2024-03-29 02:13:03,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:03.565302325Z [2024-03-29 02:13:03,564: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:13:03.576555838Z [2024-03-29 02:13:03,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:03.578862862Z [2024-03-29 02:13:03,578: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:13:03.580103242Z [2024-03-29 02:13:03,579: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:03.580230265Z [2024-03-29 02:13:03,580: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:03.580415303Z [2024-03-29 02:13:03,580: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:03.580586229Z [2024-03-29 02:13:03,580: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:13:03.580925934Z [2024-03-29 02:13:03,580: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:13:03.581008098Z [2024-03-29 02:13:03,580: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:03.587293319Z [2024-03-29 02:13:03,587: WARNING/ForkPoolWorker-2] Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:03.588214588Z [2024-03-29 02:13:03,587: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:03.589947883Z [2024-03-29 02:13:03,589: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:13:03.592893080Z [2024-03-29 02:13:03,592: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:03.597894292Z [2024-03-29 02:13:03,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:13:03.599209019Z [2024-03-29 02:13:03,598: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:03.599235212Z [2024-03-29 02:13:03,599: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:03.599410780Z [2024-03-29 02:13:03,599: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:03.599425586Z [2024-03-29 02:13:03,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:13:03.599658230Z [2024-03-29 02:13:03,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:13:03.599704948Z [2024-03-29 02:13:03,599: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:03.602997924Z [2024-03-29 02:13:03,602: ERROR/ForkPoolWorker-15] [ed211406-7b54-483d-94d7-bac8634c25ec] Failed to execute task Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:13:03.603013840Z Traceback (most recent call last): 2024-03-29T02:13:03.603017955Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:13:03.603033125Z args.func(args) 2024-03-29T02:13:03.603037329Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:13:03.603041418Z return func(*args, **kwargs) 2024-03-29T02:13:03.603058288Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:13:03.603061345Z return f(*args, **kwargs) 2024-03-29T02:13:03.603064364Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:13:03.603067628Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:13:03.603070782Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:13:03.603074079Z raise AirflowException( 2024-03-29T02:13:03.603083457Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:13:03.612662522Z [2024-03-29 02:13:03,612: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:13:03.616221894Z [2024-03-29 02:13:03,615: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:03.616339135Z [2024-03-29 02:13:03,616: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:03.616492316Z [2024-03-29 02:13:03,616: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:03.616614255Z [2024-03-29 02:13:03,616: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:13:03.616892810Z [2024-03-29 02:13:03,616: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:13:03.617097633Z [2024-03-29 02:13:03,616: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:03.621423596Z [2024-03-29 02:13:03,620: ERROR/ForkPoolWorker-2] [bba0c88c-252d-462c-9da8-bd907dbc95bd] Failed to execute task Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:13:03.621442607Z Traceback (most recent call last): 2024-03-29T02:13:03.621446460Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:13:03.621467444Z args.func(args) 2024-03-29T02:13:03.621471597Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:13:03.621475278Z return func(*args, **kwargs) 2024-03-29T02:13:03.621478491Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:13:03.621481633Z return f(*args, **kwargs) 2024-03-29T02:13:03.621484853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:13:03.621487817Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:13:03.621490853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:13:03.621493932Z raise AirflowException( 2024-03-29T02:13:03.621502634Z airflow.exceptions.AirflowException: Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:13:03.636852084Z [2024-03-29 02:13:03,635: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed211406-7b54-483d-94d7-bac8634c25ec] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed211406-7b54-483d-94d7-bac8634c25ec') 2024-03-29T02:13:03.636923481Z Traceback (most recent call last): 2024-03-29T02:13:03.636931168Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:13:03.636959021Z R = retval = fun(*args, **kwargs) 2024-03-29T02:13:03.636964509Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:13:03.636989261Z return self.run(*args, **kwargs) 2024-03-29T02:13:03.636998795Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:13:03.637004266Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:13:03.637009211Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:13:03.637014446Z raise AirflowException(msg) 2024-03-29T02:13:03.637019977Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed211406-7b54-483d-94d7-bac8634c25ec 2024-03-29T02:13:03.662238684Z [2024-03-29 02:13:03,661: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bba0c88c-252d-462c-9da8-bd907dbc95bd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bba0c88c-252d-462c-9da8-bd907dbc95bd') 2024-03-29T02:13:03.662260381Z Traceback (most recent call last): 2024-03-29T02:13:03.662264728Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:13:03.662267979Z R = retval = fun(*args, **kwargs) 2024-03-29T02:13:03.662271437Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:13:03.662274762Z return self.run(*args, **kwargs) 2024-03-29T02:13:03.662290184Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:13:03.662294485Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:13:03.662297461Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:13:03.662300889Z raise AirflowException(msg) 2024-03-29T02:13:03.662304673Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bba0c88c-252d-462c-9da8-bd907dbc95bd 2024-03-29T02:13:05.245097496Z [2024-03-29 02:13:05,244: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3494eb11-3844-4e6b-b1b7-a36d1f963c77] succeeded in 4.638689897999939s: None 2024-03-29T02:13:06.830333219Z [2024-03-29 02:13:06,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c0ecd12-ea73-46c8-ad2f-28c5ed960998] succeeded in 6.233321787998648s: None 2024-03-29T02:13:14.433026265Z [2024-03-29 02:13:14,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f502355-f6e7-4ae3-9709-fb8246963f5b] received 2024-03-29T02:13:14.434840506Z [2024-03-29 02:13:14,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5f4fc07-70bb-41cb-9280-44923d8f15e6] received 2024-03-29T02:13:14.443127326Z [2024-03-29 02:13:14,442: INFO/ForkPoolWorker-16] [e5f4fc07-70bb-41cb-9280-44923d8f15e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:14.445050237Z [2024-03-29 02:13:14,444: INFO/ForkPoolWorker-15] [5f502355-f6e7-4ae3-9709-fb8246963f5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:14.735005425Z [2024-03-29 02:13:14,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:14.738158276Z [2024-03-29 02:13:14,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:15.852742183Z [2024-03-29 02:13:15,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:13:15.861308681Z [2024-03-29 02:13:15,860: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:15.903426407Z [2024-03-29 02:13:15,901: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:13:15.903445518Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:15.906598116Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:15.906611993Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:15.906616984Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:13:15.906620425Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:13:15.906623445Z [2024-03-29 02:13:15,903: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:15.920568419Z [2024-03-29 02:13:15,915: WARNING/ForkPoolWorker-16] Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:15.920596745Z [2024-03-29 02:13:15,916: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:13:15.920600980Z [2024-03-29 02:13:15,917: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:13:15.926595493Z [2024-03-29 02:13:15,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:15.975789881Z [2024-03-29 02:13:15,975: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:13:15.978300694Z [2024-03-29 02:13:15,977: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:15.979073339Z [2024-03-29 02:13:15,978: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:15.979995681Z [2024-03-29 02:13:15,979: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:15.980286326Z [2024-03-29 02:13:15,980: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:13:15.980856550Z [2024-03-29 02:13:15,980: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:13:15.981300889Z [2024-03-29 02:13:15,981: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:15.988404070Z [2024-03-29 02:13:15,987: ERROR/ForkPoolWorker-16] [e5f4fc07-70bb-41cb-9280-44923d8f15e6] Failed to execute task Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:13:15.988465620Z Traceback (most recent call last): 2024-03-29T02:13:15.988472684Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:13:15.988479240Z args.func(args) 2024-03-29T02:13:15.988485041Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:13:15.988491761Z return func(*args, **kwargs) 2024-03-29T02:13:15.988496683Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:13:15.988501815Z return f(*args, **kwargs) 2024-03-29T02:13:15.988506897Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:13:15.988512118Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:13:15.988516987Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:13:15.988521841Z raise AirflowException( 2024-03-29T02:13:15.988540451Z airflow.exceptions.AirflowException: Dag 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:13:16.033119290Z [2024-03-29 02:13:16,032: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5f4fc07-70bb-41cb-9280-44923d8f15e6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e5f4fc07-70bb-41cb-9280-44923d8f15e6') 2024-03-29T02:13:16.033148225Z Traceback (most recent call last): 2024-03-29T02:13:16.033153238Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:13:16.033156543Z R = retval = fun(*args, **kwargs) 2024-03-29T02:13:16.033159460Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:13:16.033162956Z return self.run(*args, **kwargs) 2024-03-29T02:13:16.033167542Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:13:16.033171655Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:13:16.033174728Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:13:16.033178744Z raise AirflowException(msg) 2024-03-29T02:13:16.033182754Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e5f4fc07-70bb-41cb-9280-44923d8f15e6 2024-03-29T02:13:16.068374153Z [2024-03-29 02:13:16,067: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:13:16.071522084Z [2024-03-29 02:13:16,071: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:16.095222694Z [2024-03-29 02:13:16,094: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:13:16.096831537Z [2024-03-29 02:13:16,096: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:16.096882206Z [2024-03-29 02:13:16,096: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:16.097088783Z [2024-03-29 02:13:16,096: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:16.097128974Z [2024-03-29 02:13:16,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:13:16.097532916Z [2024-03-29 02:13:16,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:13:16.097563725Z [2024-03-29 02:13:16,097: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:16.105013558Z [2024-03-29 02:13:16,104: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:16.105775513Z [2024-03-29 02:13:16,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:13:16.106766444Z [2024-03-29 02:13:16,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:13:16.110034628Z [2024-03-29 02:13:16,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:13:16.124551582Z [2024-03-29 02:13:16,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:13:16.126180776Z [2024-03-29 02:13:16,126: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:13:16.126358617Z [2024-03-29 02:13:16,126: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:13:16.126565329Z [2024-03-29 02:13:16,126: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:13:16.130623345Z [2024-03-29 02:13:16,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:13:16.130949493Z [2024-03-29 02:13:16,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:13:16.131145114Z [2024-03-29 02:13:16,130: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:13:16.134589675Z [2024-03-29 02:13:16,134: ERROR/ForkPoolWorker-15] [5f502355-f6e7-4ae3-9709-fb8246963f5b] Failed to execute task Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse.. 2024-03-29T02:13:16.134609586Z Traceback (most recent call last): 2024-03-29T02:13:16.134614725Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-29T02:13:16.134619147Z args.func(args) 2024-03-29T02:13:16.134624355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-29T02:13:16.134629463Z return func(*args, **kwargs) 2024-03-29T02:13:16.134633562Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-29T02:13:16.134652182Z return f(*args, **kwargs) 2024-03-29T02:13:16.134656275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-29T02:13:16.134660267Z dag = get_dag(args.subdir, args.dag_id) 2024-03-29T02:13:16.134664238Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-29T02:13:16.134668818Z raise AirflowException( 2024-03-29T02:13:16.134673443Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e' could not be found; either it does not exist or it failed to parse. 2024-03-29T02:13:16.171196854Z [2024-03-29 02:13:16,170: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f502355-f6e7-4ae3-9709-fb8246963f5b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5f502355-f6e7-4ae3-9709-fb8246963f5b') 2024-03-29T02:13:16.171234183Z Traceback (most recent call last): 2024-03-29T02:13:16.171244569Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-29T02:13:16.171252982Z R = retval = fun(*args, **kwargs) 2024-03-29T02:13:16.171261144Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-29T02:13:16.171273379Z return self.run(*args, **kwargs) 2024-03-29T02:13:16.171282893Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-29T02:13:16.171292357Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-29T02:13:16.171300540Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-29T02:13:16.171310123Z raise AirflowException(msg) 2024-03-29T02:13:16.171319131Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5f502355-f6e7-4ae3-9709-fb8246963f5b 2024-03-29T02:14:00.703409456Z [2024-03-29 02:14:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10c015f5-d41f-4820-8859-2d52e3004dba] received 2024-03-29T02:14:00.709077884Z [2024-03-29 02:14:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9408022c-baa2-458a-88a9-a5b8b32fae88] received 2024-03-29T02:14:00.715672389Z [2024-03-29 02:14:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb3baffa-1dbf-421b-be59-cda181e7bd1e] received 2024-03-29T02:14:00.718110403Z [2024-03-29 02:14:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4af43e30-9a0c-4ced-bba4-2e4b82181997] received 2024-03-29T02:14:00.718132115Z [2024-03-29 02:14:00,717: INFO/ForkPoolWorker-15] [10c015f5-d41f-4820-8859-2d52e3004dba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:14:00.718777349Z [2024-03-29 02:14:00,718: INFO/ForkPoolWorker-16] [9408022c-baa2-458a-88a9-a5b8b32fae88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:14:00.731552188Z [2024-03-29 02:14:00,731: INFO/ForkPoolWorker-2] [4af43e30-9a0c-4ced-bba4-2e4b82181997] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:14:00.731775638Z [2024-03-29 02:14:00,731: INFO/ForkPoolWorker-1] [cb3baffa-1dbf-421b-be59-cda181e7bd1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:14:01.110506515Z [2024-03-29 02:14:01,107: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:14:01.128434303Z [2024-03-29 02:14:01,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:14:01.223415228Z [2024-03-29 02:14:01,220: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:14:01.225047299Z [2024-03-29 02:14:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:14:01.439315166Z [2024-03-29 02:14:01,438: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:14:01.450956728Z [2024-03-29 02:14:01,450: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:14:01.529488764Z [2024-03-29 02:14:01,528: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:14:01.534099936Z [2024-03-29 02:14:01,533: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:14:01.534492412Z [2024-03-29 02:14:01,533: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:14:01.535319789Z [2024-03-29 02:14:01,535: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:14:01.535903929Z [2024-03-29 02:14:01,535: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:14:01.550539988Z [2024-03-29 02:14:01,550: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:14:01.758363898Z [2024-03-29 02:14:01,757: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:14:02.444675462Z [2024-03-29 02:14:02,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10c015f5-d41f-4820-8859-2d52e3004dba] succeeded in 1.7367497220002406s: None 2024-03-29T02:14:02.607972981Z [2024-03-29 02:14:02,607: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4af43e30-9a0c-4ced-bba4-2e4b82181997] succeeded in 1.8832189409986313s: None 2024-03-29T02:14:03.147650945Z [2024-03-29 02:14:03,147: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:14:03.151400933Z [2024-03-29 02:14:03,150: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:14:03.170551373Z [2024-03-29 02:14:03,170: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:14:03.172050258Z [2024-03-29 02:14:03,171: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:14:03.172190110Z [2024-03-29 02:14:03,171: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:14:03.172404320Z [2024-03-29 02:14:03,172: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:14:03.172514564Z [2024-03-29 02:14:03,172: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:14:03.172927215Z [2024-03-29 02:14:03,172: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:14:03.173044853Z [2024-03-29 02:14:03,172: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:14:03.290843405Z [2024-03-29 02:14:03,290: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:14:03.430111482Z [2024-03-29 02:14:03,429: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:14:03.433665539Z [2024-03-29 02:14:03,433: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:14:03.477312158Z [2024-03-29 02:14:03,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:14:03.478539504Z [2024-03-29 02:14:03,478: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:14:03.478608607Z [2024-03-29 02:14:03,478: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:14:03.478745372Z [2024-03-29 02:14:03,478: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:14:03.478813736Z [2024-03-29 02:14:03,478: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:14:03.479097182Z [2024-03-29 02:14:03,478: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:14:03.479173586Z [2024-03-29 02:14:03,479: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:14:03.577810330Z [2024-03-29 02:14:03,577: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:14:05.381199679Z [2024-03-29 02:14:05,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb3baffa-1dbf-421b-be59-cda181e7bd1e] succeeded in 4.661325539000245s: None 2024-03-29T02:14:06.531328393Z [2024-03-29 02:14:06,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9408022c-baa2-458a-88a9-a5b8b32fae88] succeeded in 5.820471830000315s: None 2024-03-29T02:15:00.341998540Z [2024-03-29 02:15:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b6d7550-43a3-4626-b079-889a55a499a8] received 2024-03-29T02:15:00.348570924Z [2024-03-29 02:15:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e501e7c5-5179-4069-9d08-8871b12b538b] received 2024-03-29T02:15:00.349957753Z [2024-03-29 02:15:00,349: INFO/ForkPoolWorker-15] [0b6d7550-43a3-4626-b079-889a55a499a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:00.359251469Z [2024-03-29 02:15:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dee9d0a-30f8-4045-8ff0-f287c30a304c] received 2024-03-29T02:15:00.364219225Z [2024-03-29 02:15:00,363: INFO/ForkPoolWorker-16] [e501e7c5-5179-4069-9d08-8871b12b538b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:15:00.371546369Z [2024-03-29 02:15:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aac63661-f4d8-44cd-a8f1-a79d7c4224e6] received 2024-03-29T02:15:00.372229280Z [2024-03-29 02:15:00,371: INFO/ForkPoolWorker-1] [1dee9d0a-30f8-4045-8ff0-f287c30a304c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:15:00.380047108Z [2024-03-29 02:15:00,379: INFO/ForkPoolWorker-2] [aac63661-f4d8-44cd-a8f1-a79d7c4224e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:15:00.677680313Z [2024-03-29 02:15:00,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:15:00.720925636Z [2024-03-29 02:15:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:15:00.969562152Z [2024-03-29 02:15:00,965: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:15:01.006601060Z [2024-03-29 02:15:01,000: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:15:01.203121876Z [2024-03-29 02:15:01,202: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:15:01.207695662Z [2024-03-29 02:15:01,207: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:01.239319600Z [2024-03-29 02:15:01,239: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:15:01.240590886Z [2024-03-29 02:15:01,240: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:15:01.240774561Z [2024-03-29 02:15:01,240: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:15:01.240907773Z [2024-03-29 02:15:01,240: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:15:01.241251911Z [2024-03-29 02:15:01,241: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:15:01.349592962Z [2024-03-29 02:15:01,348: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:02.107321626Z [2024-03-29 02:15:02,106: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aac63661-f4d8-44cd-a8f1-a79d7c4224e6] succeeded in 1.7333750530015095s: None 2024-03-29T02:15:02.403296525Z [2024-03-29 02:15:02,402: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:15:02.404870320Z [2024-03-29 02:15:02,404: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:15:02.407169305Z [2024-03-29 02:15:02,406: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:02.408463576Z [2024-03-29 02:15:02,408: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:02.436431723Z [2024-03-29 02:15:02,436: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:15:02.438033082Z [2024-03-29 02:15:02,437: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:02.438142152Z [2024-03-29 02:15:02,437: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:02.438348160Z [2024-03-29 02:15:02,438: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:02.438561542Z [2024-03-29 02:15:02,438: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:15:02.438786913Z [2024-03-29 02:15:02,438: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:15:02.439195688Z [2024-03-29 02:15:02,438: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:15:02.439454284Z [2024-03-29 02:15:02,439: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:02.440416201Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:02.440431350Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:02.440518497Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:02.440537557Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:15:02.440820175Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:15:02.440898891Z [2024-03-29 02:15:02,440: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:02.533951462Z [2024-03-29 02:15:02,533: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:02.545962539Z [2024-03-29 02:15:02,545: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:02.690977109Z [2024-03-29 02:15:02,690: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:15:02.694349125Z [2024-03-29 02:15:02,693: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:02.722637077Z [2024-03-29 02:15:02,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:15:02.724309239Z [2024-03-29 02:15:02,723: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:02.724331656Z [2024-03-29 02:15:02,724: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:02.724499267Z [2024-03-29 02:15:02,724: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:02.724506404Z [2024-03-29 02:15:02,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:15:02.724759782Z [2024-03-29 02:15:02,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:15:02.724770724Z [2024-03-29 02:15:02,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:02.869463377Z [2024-03-29 02:15:02,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:03.486232372Z [2024-03-29 02:15:03,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45f3eb89-788c-4370-b96a-65d8c8e63ebf] received 2024-03-29T02:15:03.496795081Z [2024-03-29 02:15:03,496: INFO/ForkPoolWorker-2] [45f3eb89-788c-4370-b96a-65d8c8e63ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:03.584459726Z [2024-03-29 02:15:03,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b6d7550-43a3-4626-b079-889a55a499a8] succeeded in 3.2396141270000953s: None 2024-03-29T02:15:03.961436148Z [2024-03-29 02:15:03,958: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:15:04.039870847Z [2024-03-29 02:15:04,039: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1dee9d0a-30f8-4045-8ff0-f287c30a304c] succeeded in 3.674854446999234s: None 2024-03-29T02:15:04.418543811Z [2024-03-29 02:15:04,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e501e7c5-5179-4069-9d08-8871b12b538b] succeeded in 4.062315314000443s: None 2024-03-29T02:15:05.256392611Z [2024-03-29 02:15:05,256: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:15:05.259964266Z [2024-03-29 02:15:05,259: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:05.287441491Z [2024-03-29 02:15:05,287: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:15:05.289224407Z [2024-03-29 02:15:05,288: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:05.289427892Z [2024-03-29 02:15:05,289: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:05.289680740Z [2024-03-29 02:15:05,289: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:05.289876835Z [2024-03-29 02:15:05,289: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:15:05.290538599Z [2024-03-29 02:15:05,290: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:15:05.290692667Z [2024-03-29 02:15:05,290: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:05.390018365Z [2024-03-29 02:15:05,389: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:06.266247510Z [2024-03-29 02:15:06,265: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[45f3eb89-788c-4370-b96a-65d8c8e63ebf] succeeded in 2.7763917919983214s: None 2024-03-29T02:15:07.119824748Z [2024-03-29 02:15:07,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19a37dde-3fa3-4f6d-8a5b-9d5f17aa56ce] received 2024-03-29T02:15:07.144952045Z [2024-03-29 02:15:07,144: INFO/ForkPoolWorker-15] [19a37dde-3fa3-4f6d-8a5b-9d5f17aa56ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:15:07.622006965Z [2024-03-29 02:15:07,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:15:08.843912430Z [2024-03-29 02:15:08,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:15:08.847313901Z [2024-03-29 02:15:08,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:08.868748078Z [2024-03-29 02:15:08,868: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:15:08.870174559Z [2024-03-29 02:15:08,869: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:08.870201230Z [2024-03-29 02:15:08,869: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:08.870223280Z [2024-03-29 02:15:08,870: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:08.871397313Z [2024-03-29 02:15:08,870: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:15:08.871441089Z [2024-03-29 02:15:08,871: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:15:08.871451852Z [2024-03-29 02:15:08,871: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:08.948533331Z [2024-03-29 02:15:08,948: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:09.442866581Z [2024-03-29 02:15:09,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19a37dde-3fa3-4f6d-8a5b-9d5f17aa56ce] succeeded in 2.3071023669999704s: None 2024-03-29T02:15:09.607851029Z [2024-03-29 02:15:09,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4495ee1c-6e96-4e63-bbcb-2a6453280e1e] received 2024-03-29T02:15:09.616905525Z [2024-03-29 02:15:09,616: INFO/ForkPoolWorker-15] [4495ee1c-6e96-4e63-bbcb-2a6453280e1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:09.901585321Z [2024-03-29 02:15:09,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:15:10.990841354Z [2024-03-29 02:15:10,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:15:10.994111560Z [2024-03-29 02:15:10,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:15:11.013065332Z [2024-03-29 02:15:11,012: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:15:11.014773885Z [2024-03-29 02:15:11,014: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:15:11.014792262Z [2024-03-29 02:15:11,014: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:15:11.014953306Z [2024-03-29 02:15:11,014: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:15:11.015132935Z [2024-03-29 02:15:11,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:15:11.015647203Z [2024-03-29 02:15:11,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:15:11.015700850Z [2024-03-29 02:15:11,015: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:15:11.094579121Z [2024-03-29 02:15:11,094: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:15:11.615923685Z [2024-03-29 02:15:11,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4495ee1c-6e96-4e63-bbcb-2a6453280e1e] succeeded in 2.0041232319999835s: None 2024-03-29T02:16:01.279295505Z [2024-03-29 02:16:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9132ff0-27ad-4201-9a36-1291493405be] received 2024-03-29T02:16:01.291985519Z [2024-03-29 02:16:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88cb9c2b-ee2e-4fd0-800c-a2a15f128e7f] received 2024-03-29T02:16:01.292721196Z [2024-03-29 02:16:01,292: INFO/ForkPoolWorker-15] [e9132ff0-27ad-4201-9a36-1291493405be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:16:01.300113426Z [2024-03-29 02:16:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b772c52-9198-4989-885d-d9be693aadc8] received 2024-03-29T02:16:01.302149456Z [2024-03-29 02:16:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed1cbbf-cc56-4022-9649-e65f6e8390d6] received 2024-03-29T02:16:01.313145190Z [2024-03-29 02:16:01,312: INFO/ForkPoolWorker-1] [2b772c52-9198-4989-885d-d9be693aadc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:16:01.315067331Z [2024-03-29 02:16:01,314: INFO/ForkPoolWorker-2] [bed1cbbf-cc56-4022-9649-e65f6e8390d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:16:01.318075745Z [2024-03-29 02:16:01,317: INFO/ForkPoolWorker-16] [88cb9c2b-ee2e-4fd0-800c-a2a15f128e7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:16:01.653582048Z [2024-03-29 02:16:01,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:16:01.661046740Z [2024-03-29 02:16:01,656: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:16:01.695072552Z [2024-03-29 02:16:01,691: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:16:01.923356882Z [2024-03-29 02:16:01,916: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:16:02.037978346Z [2024-03-29 02:16:02,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:16:02.147303915Z [2024-03-29 02:16:02,146: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:16:02.151861524Z [2024-03-29 02:16:02,151: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:16:02.190606731Z [2024-03-29 02:16:02,190: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:16:02.194149659Z [2024-03-29 02:16:02,193: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:16:02.195152128Z [2024-03-29 02:16:02,194: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:16:02.195430388Z [2024-03-29 02:16:02,195: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:16:02.195924499Z [2024-03-29 02:16:02,195: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:16:02.340228062Z [2024-03-29 02:16:02,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:16:02.938619730Z [2024-03-29 02:16:02,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9132ff0-27ad-4201-9a36-1291493405be] succeeded in 1.6547508839994407s: None 2024-03-29T02:16:03.233650265Z [2024-03-29 02:16:03,233: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[88cb9c2b-ee2e-4fd0-800c-a2a15f128e7f] succeeded in 1.933267597001759s: None 2024-03-29T02:16:03.314204638Z [2024-03-29 02:16:03,313: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:16:03.317599938Z [2024-03-29 02:16:03,317: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:16:03.339854358Z [2024-03-29 02:16:03,339: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:16:03.341272253Z [2024-03-29 02:16:03,340: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:16:03.341318538Z [2024-03-29 02:16:03,341: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:16:03.341466803Z [2024-03-29 02:16:03,341: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:16:03.341481214Z [2024-03-29 02:16:03,341: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:16:03.341793203Z [2024-03-29 02:16:03,341: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:16:03.341808285Z [2024-03-29 02:16:03,341: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:16:03.391707227Z [2024-03-29 02:16:03,391: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:16:03.395632316Z [2024-03-29 02:16:03,395: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:16:03.422201467Z [2024-03-29 02:16:03,421: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:16:03.424391747Z [2024-03-29 02:16:03,424: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:16:03.424575730Z [2024-03-29 02:16:03,424: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:16:03.424864021Z [2024-03-29 02:16:03,424: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:16:03.425035471Z [2024-03-29 02:16:03,424: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:16:03.425470619Z [2024-03-29 02:16:03,425: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:16:03.425656436Z [2024-03-29 02:16:03,425: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:16:03.436202954Z [2024-03-29 02:16:03,435: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:16:03.534314352Z [2024-03-29 02:16:03,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:16:05.288791003Z [2024-03-29 02:16:05,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b772c52-9198-4989-885d-d9be693aadc8] succeeded in 3.9853220019995206s: None 2024-03-29T02:16:06.107367532Z [2024-03-29 02:16:06,106: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bed1cbbf-cc56-4022-9649-e65f6e8390d6] succeeded in 4.798485388999325s: None 2024-03-29T02:17:01.146152226Z [2024-03-29 02:17:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cbe4e88-2a8b-465a-9062-7d3b00ba3756] received 2024-03-29T02:17:01.154951260Z [2024-03-29 02:17:01,154: INFO/ForkPoolWorker-15] [1cbe4e88-2a8b-465a-9062-7d3b00ba3756] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:17:01.155181522Z [2024-03-29 02:17:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f168767-dea1-474c-b461-509fb91101dc] received 2024-03-29T02:17:01.161420048Z [2024-03-29 02:17:01,161: INFO/ForkPoolWorker-16] [1f168767-dea1-474c-b461-509fb91101dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:17:01.162350402Z [2024-03-29 02:17:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d599eb85-8bc7-4efc-b6ec-b6a8c89abc9a] received 2024-03-29T02:17:01.174712991Z [2024-03-29 02:17:01,174: INFO/ForkPoolWorker-1] [d599eb85-8bc7-4efc-b6ec-b6a8c89abc9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:17:01.508492219Z [2024-03-29 02:17:01,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:17:01.510758251Z [2024-03-29 02:17:01,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:17:01.600738740Z [2024-03-29 02:17:01,596: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:17:01.719902284Z [2024-03-29 02:17:01,719: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:17:01.726275159Z [2024-03-29 02:17:01,725: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:17:01.764154982Z [2024-03-29 02:17:01,763: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:17:01.767448620Z [2024-03-29 02:17:01,767: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:17:01.767494013Z [2024-03-29 02:17:01,767: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:17:01.767500967Z [2024-03-29 02:17:01,767: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:17:01.767757339Z [2024-03-29 02:17:01,767: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:17:01.876059384Z [2024-03-29 02:17:01,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:17:02.590948714Z [2024-03-29 02:17:02,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f168767-dea1-474c-b461-509fb91101dc] succeeded in 1.4340701519995491s: None 2024-03-29T02:17:02.769251533Z [2024-03-29 02:17:02,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:17:02.773122618Z [2024-03-29 02:17:02,772: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:17:02.804695441Z [2024-03-29 02:17:02,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:17:02.807223694Z [2024-03-29 02:17:02,806: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:17:02.807501820Z [2024-03-29 02:17:02,807: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:17:02.807786737Z [2024-03-29 02:17:02,807: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:17:02.807999011Z [2024-03-29 02:17:02,807: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:17:02.808428234Z [2024-03-29 02:17:02,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:17:02.809266299Z [2024-03-29 02:17:02,809: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:17:02.897247973Z [2024-03-29 02:17:02,896: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:17:02.900744983Z [2024-03-29 02:17:02,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:17:02.915943139Z [2024-03-29 02:17:02,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:17:02.932918583Z [2024-03-29 02:17:02,932: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:17:02.934831882Z [2024-03-29 02:17:02,934: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:17:02.934910121Z [2024-03-29 02:17:02,934: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:17:02.935190883Z [2024-03-29 02:17:02,934: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:17:02.935264736Z [2024-03-29 02:17:02,935: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:17:02.935805969Z [2024-03-29 02:17:02,935: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:17:02.935852704Z [2024-03-29 02:17:02,935: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:17:03.033603072Z [2024-03-29 02:17:03,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:17:04.790947974Z [2024-03-29 02:17:04,788: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d599eb85-8bc7-4efc-b6ec-b6a8c89abc9a] succeeded in 3.624744347998785s: None 2024-03-29T02:17:05.368873561Z [2024-03-29 02:17:05,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cbe4e88-2a8b-465a-9062-7d3b00ba3756] succeeded in 4.22073959699992s: None 2024-03-29T02:18:00.950934655Z [2024-03-29 02:18:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac314a6f-174e-423f-9c9c-662904500cec] received 2024-03-29T02:18:00.954269389Z [2024-03-29 02:18:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acf15f01-4c5a-4f2e-8919-87918b3bf7af] received 2024-03-29T02:18:00.962356803Z [2024-03-29 02:18:00,961: INFO/ForkPoolWorker-15] [ac314a6f-174e-423f-9c9c-662904500cec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:18:00.962756028Z [2024-03-29 02:18:00,962: INFO/ForkPoolWorker-16] [acf15f01-4c5a-4f2e-8919-87918b3bf7af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:18:00.967734919Z [2024-03-29 02:18:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3aaa462-c518-44d5-ab50-95dbfe8d3893] received 2024-03-29T02:18:00.969419414Z [2024-03-29 02:18:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[940ed30f-4191-4a8b-8e22-a3ce606cb3d4] received 2024-03-29T02:18:00.977253567Z [2024-03-29 02:18:00,976: INFO/ForkPoolWorker-1] [b3aaa462-c518-44d5-ab50-95dbfe8d3893] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:18:00.977602888Z [2024-03-29 02:18:00,977: INFO/ForkPoolWorker-2] [940ed30f-4191-4a8b-8e22-a3ce606cb3d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:18:01.406606877Z [2024-03-29 02:18:01,401: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:18:01.723034473Z [2024-03-29 02:18:01,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:18:01.751171487Z [2024-03-29 02:18:01,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:18:01.791721915Z [2024-03-29 02:18:01,787: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:18:01.972444989Z [2024-03-29 02:18:01,971: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:18:01.977011515Z [2024-03-29 02:18:01,976: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:18:02.001993914Z [2024-03-29 02:18:02,001: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:18:02.003313160Z [2024-03-29 02:18:02,003: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:18:02.003470140Z [2024-03-29 02:18:02,003: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:18:02.003548942Z [2024-03-29 02:18:02,003: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:18:02.003708735Z [2024-03-29 02:18:02,003: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:18:02.066491078Z [2024-03-29 02:18:02,066: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:18:02.128559021Z [2024-03-29 02:18:02,128: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:18:02.899750921Z [2024-03-29 02:18:02,899: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[940ed30f-4191-4a8b-8e22-a3ce606cb3d4] succeeded in 1.929180548999284s: None 2024-03-29T02:18:02.900977323Z [2024-03-29 02:18:02,900: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac314a6f-174e-423f-9c9c-662904500cec] succeeded in 1.9482184689986752s: None 2024-03-29T02:18:03.057737319Z [2024-03-29 02:18:03,057: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:18:03.061431966Z [2024-03-29 02:18:03,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:18:03.119391057Z [2024-03-29 02:18:03,119: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:18:03.124568498Z [2024-03-29 02:18:03,124: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:18:03.124591105Z [2024-03-29 02:18:03,124: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:18:03.124762003Z [2024-03-29 02:18:03,124: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:18:03.124889365Z [2024-03-29 02:18:03,124: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:18:03.125276050Z [2024-03-29 02:18:03,125: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:18:03.125460260Z [2024-03-29 02:18:03,125: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:18:03.252596712Z [2024-03-29 02:18:03,252: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:18:03.256314045Z [2024-03-29 02:18:03,255: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:18:03.258019384Z [2024-03-29 02:18:03,257: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:18:03.284422234Z [2024-03-29 02:18:03,284: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:18:03.287789349Z [2024-03-29 02:18:03,287: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:18:03.287806444Z [2024-03-29 02:18:03,287: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:18:03.287986742Z [2024-03-29 02:18:03,287: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:18:03.288107860Z [2024-03-29 02:18:03,287: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:18:03.288715909Z [2024-03-29 02:18:03,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:18:03.288756630Z [2024-03-29 02:18:03,288: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:18:03.387063214Z [2024-03-29 02:18:03,386: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:18:04.977875570Z [2024-03-29 02:18:04,977: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3aaa462-c518-44d5-ab50-95dbfe8d3893] succeeded in 4.005834588999278s: None 2024-03-29T02:18:05.331997078Z [2024-03-29 02:18:05,331: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acf15f01-4c5a-4f2e-8919-87918b3bf7af] succeeded in 4.3755238840003585s: None 2024-03-29T02:19:00.690303661Z [2024-03-29 02:19:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b87596fe-1718-49be-820e-cc9990cbefe0] received 2024-03-29T02:19:00.694370067Z [2024-03-29 02:19:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4e26122-f4f6-4092-b212-35bf0730238e] received 2024-03-29T02:19:00.706291762Z [2024-03-29 02:19:00,705: INFO/ForkPoolWorker-15] [b87596fe-1718-49be-820e-cc9990cbefe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:19:00.710226477Z [2024-03-29 02:19:00,709: INFO/ForkPoolWorker-16] [f4e26122-f4f6-4092-b212-35bf0730238e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:19:00.711161052Z [2024-03-29 02:19:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf1a929a-928e-49fc-8f6d-6c6acf4b3699] received 2024-03-29T02:19:00.727775618Z [2024-03-29 02:19:00,727: INFO/ForkPoolWorker-1] [bf1a929a-928e-49fc-8f6d-6c6acf4b3699] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:19:01.401061035Z [2024-03-29 02:19:01,395: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:19:01.576686678Z [2024-03-29 02:19:01,571: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:19:01.655885755Z [2024-03-29 02:19:01,654: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:19:01.663780509Z [2024-03-29 02:19:01,663: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:19:01.728630555Z [2024-03-29 02:19:01,728: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:19:01.729672214Z [2024-03-29 02:19:01,729: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:19:01.730385143Z [2024-03-29 02:19:01,729: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:19:01.730560696Z [2024-03-29 02:19:01,730: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:19:01.730721615Z [2024-03-29 02:19:01,730: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:19:01.923566801Z [2024-03-29 02:19:01,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:19:01.969110609Z [2024-03-29 02:19:01,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:19:02.938243657Z [2024-03-29 02:19:02,937: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf1a929a-928e-49fc-8f6d-6c6acf4b3699] succeeded in 2.224863274001109s: None 2024-03-29T02:19:03.993334291Z [2024-03-29 02:19:03,992: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:19:03.995672977Z [2024-03-29 02:19:03,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:19:03.998797357Z [2024-03-29 02:19:03,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:19:04.001993508Z [2024-03-29 02:19:03,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:19:04.047298064Z [2024-03-29 02:19:04,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:19:04.049482375Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:19:04.049499402Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:19:04.049583401Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:19:04.049611316Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:19:04.049851371Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:19:04.049864738Z [2024-03-29 02:19:04,049: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:19:04.050962065Z [2024-03-29 02:19:04,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:19:04.056331860Z [2024-03-29 02:19:04,056: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:19:04.056593606Z [2024-03-29 02:19:04,056: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:19:04.056888007Z [2024-03-29 02:19:04,056: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:19:04.057262498Z [2024-03-29 02:19:04,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:19:04.057749508Z [2024-03-29 02:19:04,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:19:04.058019070Z [2024-03-29 02:19:04,057: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:19:04.155142543Z [2024-03-29 02:19:04,154: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:19:04.205330953Z [2024-03-29 02:19:04,205: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:19:07.619231922Z [2024-03-29 02:19:07,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4e26122-f4f6-4092-b212-35bf0730238e] succeeded in 6.921549510001569s: None 2024-03-29T02:19:08.170060337Z [2024-03-29 02:19:08,169: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b87596fe-1718-49be-820e-cc9990cbefe0] succeeded in 7.4757213379998575s: None 2024-03-29T02:20:00.268269899Z [2024-03-29 02:20:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a90eb2b-e4b8-4b50-aca7-e777581940a3] received 2024-03-29T02:20:00.270929508Z [2024-03-29 02:20:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ad6835b-f1f2-4ef3-bd23-a03d5bc22104] received 2024-03-29T02:20:00.280837738Z [2024-03-29 02:20:00,280: INFO/ForkPoolWorker-16] [8ad6835b-f1f2-4ef3-bd23-a03d5bc22104] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:20:00.282522570Z [2024-03-29 02:20:00,282: INFO/ForkPoolWorker-15] [5a90eb2b-e4b8-4b50-aca7-e777581940a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:00.285159084Z [2024-03-29 02:20:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd76c82e-3e1e-49cb-9014-0e82f2225496] received 2024-03-29T02:20:00.290569129Z [2024-03-29 02:20:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93da0688-4831-4b96-9b27-36b2f172aa8a] received 2024-03-29T02:20:00.295093678Z [2024-03-29 02:20:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f537e884-7973-4547-bc91-d582ecd79b7c] received 2024-03-29T02:20:00.296549530Z [2024-03-29 02:20:00,296: INFO/ForkPoolWorker-1] [cd76c82e-3e1e-49cb-9014-0e82f2225496] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:20:00.316809289Z [2024-03-29 02:20:00,316: INFO/ForkPoolWorker-2] [93da0688-4831-4b96-9b27-36b2f172aa8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:20:00.328924725Z [2024-03-29 02:20:00,328: INFO/ForkPoolWorker-3] [f537e884-7973-4547-bc91-d582ecd79b7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:20:00.706675310Z [2024-03-29 02:20:00,702: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:20:00.851885909Z [2024-03-29 02:20:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:20:01.023946029Z [2024-03-29 02:20:01,002: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:20:01.205545093Z [2024-03-29 02:20:01,201: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:20:01.352706571Z [2024-03-29 02:20:01,344: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:20:01.411072248Z [2024-03-29 02:20:01,410: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:20:01.422596469Z [2024-03-29 02:20:01,418: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:01.504180095Z [2024-03-29 02:20:01,503: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:20:01.508560487Z [2024-03-29 02:20:01,508: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:20:01.508621712Z [2024-03-29 02:20:01,508: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:20:01.508715971Z [2024-03-29 02:20:01,508: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:20:01.508968512Z [2024-03-29 02:20:01,508: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:20:01.660920900Z [2024-03-29 02:20:01,660: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:01.693726825Z [2024-03-29 02:20:01,693: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:02.928667817Z [2024-03-29 02:20:02,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ad6835b-f1f2-4ef3-bd23-a03d5bc22104] succeeded in 2.654405149998638s: None 2024-03-29T02:20:03.381725047Z [2024-03-29 02:20:03,371: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93da0688-4831-4b96-9b27-36b2f172aa8a] succeeded in 3.076207592999708s: None 2024-03-29T02:20:03.521046136Z [2024-03-29 02:20:03,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:20:03.524799741Z [2024-03-29 02:20:03,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:03.558127854Z [2024-03-29 02:20:03,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:20:03.559445622Z [2024-03-29 02:20:03,559: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:03.559486654Z [2024-03-29 02:20:03,559: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:03.559699606Z [2024-03-29 02:20:03,559: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:03.560050876Z [2024-03-29 02:20:03,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:20:03.560413385Z [2024-03-29 02:20:03,560: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:20:03.560498464Z [2024-03-29 02:20:03,560: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:03.679137970Z [2024-03-29 02:20:03,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:03.795484747Z [2024-03-29 02:20:03,795: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:20:03.808189567Z [2024-03-29 02:20:03,806: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:03.817432645Z [2024-03-29 02:20:03,816: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T02:20:03.821949039Z [2024-03-29 02:20:03,821: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:03.846659153Z [2024-03-29 02:20:03,846: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:20:03.848860446Z [2024-03-29 02:20:03,848: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:03.848986300Z [2024-03-29 02:20:03,848: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:03.849380675Z [2024-03-29 02:20:03,849: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:03.849599095Z [2024-03-29 02:20:03,849: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T02:20:03.849968082Z [2024-03-29 02:20:03,849: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:20:03.850438085Z [2024-03-29 02:20:03,849: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:03.871163241Z [2024-03-29 02:20:03,870: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:20:03.875748398Z [2024-03-29 02:20:03,875: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:03.875789360Z [2024-03-29 02:20:03,875: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:03.875905875Z [2024-03-29 02:20:03,875: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:03.875942434Z [2024-03-29 02:20:03,875: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:20:03.876236254Z [2024-03-29 02:20:03,876: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:20:03.876253767Z [2024-03-29 02:20:03,876: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:03.981204690Z [2024-03-29 02:20:03,980: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:04.007125742Z [2024-03-29 02:20:04,006: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:04.579510607Z [2024-03-29 02:20:04,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a90eb2b-e4b8-4b50-aca7-e777581940a3] succeeded in 4.307199639000828s: None 2024-03-29T02:20:05.164308338Z [2024-03-29 02:20:05,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c97c63a5-7200-4bcc-9c72-04b5ab3f814f] received 2024-03-29T02:20:05.180634318Z [2024-03-29 02:20:05,173: INFO/ForkPoolWorker-15] [c97c63a5-7200-4bcc-9c72-04b5ab3f814f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:05.568635293Z [2024-03-29 02:20:05,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:20:06.011046081Z [2024-03-29 02:20:06,008: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f537e884-7973-4547-bc91-d582ecd79b7c] succeeded in 5.696426086000429s: None 2024-03-29T02:20:06.358519932Z [2024-03-29 02:20:06,358: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd76c82e-3e1e-49cb-9014-0e82f2225496] succeeded in 6.070487249000507s: None 2024-03-29T02:20:07.097067740Z [2024-03-29 02:20:07,096: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:20:07.100488364Z [2024-03-29 02:20:07,100: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:07.117340242Z [2024-03-29 02:20:07,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:20:07.118591172Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:07.118673572Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:07.118744062Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:07.118786624Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:20:07.118991672Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:20:07.119040048Z [2024-03-29 02:20:07,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:07.234552259Z [2024-03-29 02:20:07,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:07.972476521Z [2024-03-29 02:20:07,972: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c97c63a5-7200-4bcc-9c72-04b5ab3f814f] succeeded in 2.805559013000675s: None 2024-03-29T02:20:08.638132366Z [2024-03-29 02:20:08,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6628f26-eee2-4a8c-8995-a349ed025e50] received 2024-03-29T02:20:08.644629705Z [2024-03-29 02:20:08,644: INFO/ForkPoolWorker-15] [c6628f26-eee2-4a8c-8995-a349ed025e50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:20:08.923745650Z [2024-03-29 02:20:08,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:20:10.173345137Z [2024-03-29 02:20:10,172: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:20:10.179248005Z [2024-03-29 02:20:10,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:10.203753136Z [2024-03-29 02:20:10,203: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:20:10.205405920Z [2024-03-29 02:20:10,205: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:10.205582483Z [2024-03-29 02:20:10,205: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:10.205766711Z [2024-03-29 02:20:10,205: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:10.205833212Z [2024-03-29 02:20:10,205: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:20:10.206251645Z [2024-03-29 02:20:10,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:20:10.206394467Z [2024-03-29 02:20:10,206: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:10.309846713Z [2024-03-29 02:20:10,309: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:10.879763530Z [2024-03-29 02:20:10,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6628f26-eee2-4a8c-8995-a349ed025e50] succeeded in 2.240003523998894s: None 2024-03-29T02:20:10.945266370Z [2024-03-29 02:20:10,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f6d522f-bbd6-4df5-9ff7-80b4be38d562] received 2024-03-29T02:20:10.953099991Z [2024-03-29 02:20:10,952: INFO/ForkPoolWorker-15] [3f6d522f-bbd6-4df5-9ff7-80b4be38d562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:11.349064873Z [2024-03-29 02:20:11,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:20:12.521441547Z [2024-03-29 02:20:12,521: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:20:12.531596235Z [2024-03-29 02:20:12,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:20:12.545009970Z [2024-03-29 02:20:12,544: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:20:12.546532620Z [2024-03-29 02:20:12,546: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:20:12.546555362Z [2024-03-29 02:20:12,546: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:20:12.546738094Z [2024-03-29 02:20:12,546: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:20:12.546808673Z [2024-03-29 02:20:12,546: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:20:12.547231731Z [2024-03-29 02:20:12,546: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:20:12.547248604Z [2024-03-29 02:20:12,547: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:20:12.641631171Z [2024-03-29 02:20:12,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:20:13.309816778Z [2024-03-29 02:20:13,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f6d522f-bbd6-4df5-9ff7-80b4be38d562] succeeded in 2.362282588999733s: None 2024-03-29T02:21:00.477829319Z [2024-03-29 02:21:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6854a291-c81d-4c31-a8fb-43863c3c4827] received 2024-03-29T02:21:00.482168762Z [2024-03-29 02:21:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[925dd00c-2b01-4276-be6a-901fc550a63b] received 2024-03-29T02:21:00.486828227Z [2024-03-29 02:21:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b4cd2fe-3953-4f7e-af85-c9a1a4819f38] received 2024-03-29T02:21:00.495384233Z [2024-03-29 02:21:00,494: INFO/ForkPoolWorker-15] [6854a291-c81d-4c31-a8fb-43863c3c4827] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:21:00.496310819Z [2024-03-29 02:21:00,495: INFO/ForkPoolWorker-1] [4b4cd2fe-3953-4f7e-af85-c9a1a4819f38] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:21:00.502292026Z [2024-03-29 02:21:00,501: INFO/ForkPoolWorker-16] [925dd00c-2b01-4276-be6a-901fc550a63b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:21:00.783102743Z [2024-03-29 02:21:00,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:21:00.835568111Z [2024-03-29 02:21:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:21:01.028093757Z [2024-03-29 02:21:01,027: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:21:01.032415116Z [2024-03-29 02:21:01,031: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:21:01.054485347Z [2024-03-29 02:21:01,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:21:01.055723712Z [2024-03-29 02:21:01,055: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:21:01.055881977Z [2024-03-29 02:21:01,055: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:21:01.056003148Z [2024-03-29 02:21:01,055: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:21:01.056387729Z [2024-03-29 02:21:01,056: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:21:01.070344450Z [2024-03-29 02:21:01,065: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:21:01.159080646Z [2024-03-29 02:21:01,158: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:21:01.727587790Z [2024-03-29 02:21:01,727: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b4cd2fe-3953-4f7e-af85-c9a1a4819f38] succeeded in 1.2388506530005543s: None 2024-03-29T02:21:02.099620535Z [2024-03-29 02:21:02,099: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:21:02.103005760Z [2024-03-29 02:21:02,102: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:21:02.121865183Z [2024-03-29 02:21:02,121: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:21:02.123767529Z [2024-03-29 02:21:02,123: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:21:02.123852641Z [2024-03-29 02:21:02,123: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:21:02.124095463Z [2024-03-29 02:21:02,123: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:21:02.124133672Z [2024-03-29 02:21:02,124: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:21:02.124651406Z [2024-03-29 02:21:02,124: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:21:02.124676410Z [2024-03-29 02:21:02,124: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:21:02.237219324Z [2024-03-29 02:21:02,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:21:02.564066894Z [2024-03-29 02:21:02,563: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:21:02.569486126Z [2024-03-29 02:21:02,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:21:02.631641988Z [2024-03-29 02:21:02,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:21:02.635496623Z [2024-03-29 02:21:02,635: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:21:02.638871486Z [2024-03-29 02:21:02,638: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:21:02.639117131Z [2024-03-29 02:21:02,638: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:21:02.639233685Z [2024-03-29 02:21:02,639: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:21:02.639634436Z [2024-03-29 02:21:02,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:21:02.639811629Z [2024-03-29 02:21:02,639: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:21:02.767952428Z [2024-03-29 02:21:02,767: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:21:03.788803642Z [2024-03-29 02:21:03,788: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[925dd00c-2b01-4276-be6a-901fc550a63b] succeeded in 3.304324552000253s: None 2024-03-29T02:21:04.729889824Z [2024-03-29 02:21:04,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6854a291-c81d-4c31-a8fb-43863c3c4827] succeeded in 4.24299503399925s: None 2024-03-29T02:22:00.356575378Z [2024-03-29 02:22:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0310b6c8-466f-4344-9dfa-a5b5c0d56545] received 2024-03-29T02:22:00.363410309Z [2024-03-29 02:22:00,363: INFO/ForkPoolWorker-15] [0310b6c8-466f-4344-9dfa-a5b5c0d56545] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:22:00.367336074Z [2024-03-29 02:22:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d51e061f-65d6-49e6-a309-b645873a4754] received 2024-03-29T02:22:00.380733842Z [2024-03-29 02:22:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[818c5cf0-e8dd-40e5-9a58-cbb92e5ea3f2] received 2024-03-29T02:22:00.382035140Z [2024-03-29 02:22:00,381: INFO/ForkPoolWorker-16] [d51e061f-65d6-49e6-a309-b645873a4754] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:22:00.386921065Z [2024-03-29 02:22:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95505b44-7f5e-4079-8950-8f4bc4ed9ef1] received 2024-03-29T02:22:00.391095537Z [2024-03-29 02:22:00,390: INFO/ForkPoolWorker-1] [818c5cf0-e8dd-40e5-9a58-cbb92e5ea3f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:22:00.393468334Z [2024-03-29 02:22:00,393: INFO/ForkPoolWorker-2] [95505b44-7f5e-4079-8950-8f4bc4ed9ef1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:22:00.709663685Z [2024-03-29 02:22:00,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:22:00.713641400Z [2024-03-29 02:22:00,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:22:00.786467261Z [2024-03-29 02:22:00,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:22:00.824131912Z [2024-03-29 02:22:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:22:01.002681869Z [2024-03-29 02:22:01,002: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:22:01.007971707Z [2024-03-29 02:22:01,006: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:22:01.029616493Z [2024-03-29 02:22:01,029: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:22:01.030674270Z [2024-03-29 02:22:01,030: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:22:01.030770972Z [2024-03-29 02:22:01,030: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:22:01.030874232Z [2024-03-29 02:22:01,030: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:22:01.031093562Z [2024-03-29 02:22:01,030: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:22:01.151373946Z [2024-03-29 02:22:01,151: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:22:01.168072254Z [2024-03-29 02:22:01,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:22:01.991140925Z [2024-03-29 02:22:01,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0310b6c8-466f-4344-9dfa-a5b5c0d56545] succeeded in 1.6327975249987503s: None 2024-03-29T02:22:01.995711124Z [2024-03-29 02:22:01,995: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95505b44-7f5e-4079-8950-8f4bc4ed9ef1] succeeded in 1.6070513949998713s: None 2024-03-29T02:22:02.255252739Z [2024-03-29 02:22:02,254: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:22:02.258725642Z [2024-03-29 02:22:02,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:22:02.277270255Z [2024-03-29 02:22:02,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:22:02.278802882Z [2024-03-29 02:22:02,278: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:22:02.279021558Z [2024-03-29 02:22:02,278: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:22:02.279232530Z [2024-03-29 02:22:02,279: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:22:02.279353114Z [2024-03-29 02:22:02,279: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:22:02.279659201Z [2024-03-29 02:22:02,279: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:22:02.279806258Z [2024-03-29 02:22:02,279: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:22:02.387430290Z [2024-03-29 02:22:02,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:22:02.621276401Z [2024-03-29 02:22:02,620: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:22:02.624917113Z [2024-03-29 02:22:02,624: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:22:02.652572875Z [2024-03-29 02:22:02,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:22:02.654379242Z [2024-03-29 02:22:02,654: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:22:02.654636259Z [2024-03-29 02:22:02,654: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:22:02.654954424Z [2024-03-29 02:22:02,654: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:22:02.655130282Z [2024-03-29 02:22:02,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:22:02.655552630Z [2024-03-29 02:22:02,655: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:22:02.655698638Z [2024-03-29 02:22:02,655: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:22:02.753275245Z [2024-03-29 02:22:02,752: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:22:03.921622882Z [2024-03-29 02:22:03,921: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[818c5cf0-e8dd-40e5-9a58-cbb92e5ea3f2] succeeded in 3.5382803060001606s: None 2024-03-29T02:22:05.413055398Z [2024-03-29 02:22:05,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d51e061f-65d6-49e6-a309-b645873a4754] succeeded in 5.037184292999882s: None 2024-03-29T02:23:01.071478848Z [2024-03-29 02:23:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28ea94de-a3b8-45ea-9e59-469a47fdb66d] received 2024-03-29T02:23:01.074552718Z [2024-03-29 02:23:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3560c83a-7a1e-4b35-9ea9-9c682dd03914] received 2024-03-29T02:23:01.077280161Z [2024-03-29 02:23:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90fd2351-254c-4809-a6db-d2230a214f36] received 2024-03-29T02:23:01.079810749Z [2024-03-29 02:23:01,079: INFO/ForkPoolWorker-15] [28ea94de-a3b8-45ea-9e59-469a47fdb66d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:23:01.089237357Z [2024-03-29 02:23:01,088: INFO/ForkPoolWorker-16] [3560c83a-7a1e-4b35-9ea9-9c682dd03914] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:23:01.099135879Z [2024-03-29 02:23:01,098: INFO/ForkPoolWorker-1] [90fd2351-254c-4809-a6db-d2230a214f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:23:01.499128595Z [2024-03-29 02:23:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:23:01.525478030Z [2024-03-29 02:23:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:23:01.571170047Z [2024-03-29 02:23:01,567: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:23:01.734339156Z [2024-03-29 02:23:01,733: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:23:01.738815415Z [2024-03-29 02:23:01,738: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:23:01.762149914Z [2024-03-29 02:23:01,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:23:01.764221489Z [2024-03-29 02:23:01,763: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:23:01.764442770Z [2024-03-29 02:23:01,764: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:23:01.764577315Z [2024-03-29 02:23:01,764: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:23:01.764888283Z [2024-03-29 02:23:01,764: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:23:01.865741569Z [2024-03-29 02:23:01,865: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:23:02.507287185Z [2024-03-29 02:23:02,506: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3560c83a-7a1e-4b35-9ea9-9c682dd03914] succeeded in 1.4299518970001373s: None 2024-03-29T02:23:02.830537059Z [2024-03-29 02:23:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:23:02.834374572Z [2024-03-29 02:23:02,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:23:02.858583128Z [2024-03-29 02:23:02,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:23:02.860594455Z [2024-03-29 02:23:02,860: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:23:02.860800323Z [2024-03-29 02:23:02,860: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:23:02.861264059Z [2024-03-29 02:23:02,860: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:23:02.861393158Z [2024-03-29 02:23:02,861: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:23:02.861742106Z [2024-03-29 02:23:02,861: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:23:02.862207551Z [2024-03-29 02:23:02,862: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:23:02.972322622Z [2024-03-29 02:23:02,971: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:23:03.005678596Z [2024-03-29 02:23:03,005: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:23:03.009465102Z [2024-03-29 02:23:03,008: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:23:03.033193391Z [2024-03-29 02:23:03,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:23:03.034932064Z [2024-03-29 02:23:03,034: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:23:03.034987474Z [2024-03-29 02:23:03,034: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:23:03.035228196Z [2024-03-29 02:23:03,034: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:23:03.035292470Z [2024-03-29 02:23:03,035: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:23:03.035724496Z [2024-03-29 02:23:03,035: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:23:03.035858998Z [2024-03-29 02:23:03,035: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:23:03.126120217Z [2024-03-29 02:23:03,125: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:23:05.331962346Z [2024-03-29 02:23:05,330: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90fd2351-254c-4809-a6db-d2230a214f36] succeeded in 4.249555970000074s: None 2024-03-29T02:23:05.811671593Z [2024-03-29 02:23:05,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28ea94de-a3b8-45ea-9e59-469a47fdb66d] succeeded in 4.736280398999952s: None 2024-03-29T02:24:01.015941924Z [2024-03-29 02:24:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3b5f36b-3c11-41d3-be29-833b4511f841] received 2024-03-29T02:24:01.021670082Z [2024-03-29 02:24:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[316e6c7b-7c32-4273-b37c-4be023bc2cdd] received 2024-03-29T02:24:01.024924052Z [2024-03-29 02:24:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[954078bf-ca79-4bdb-98fd-3f54ee24cae1] received 2024-03-29T02:24:01.029700426Z [2024-03-29 02:24:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c40fcfe-816b-4a74-b12e-bf1a122c785f] received 2024-03-29T02:24:01.036800399Z [2024-03-29 02:24:01,036: INFO/ForkPoolWorker-1] [954078bf-ca79-4bdb-98fd-3f54ee24cae1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:24:01.051492097Z [2024-03-29 02:24:01,051: INFO/ForkPoolWorker-16] [316e6c7b-7c32-4273-b37c-4be023bc2cdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:24:01.059462304Z [2024-03-29 02:24:01,059: INFO/ForkPoolWorker-2] [1c40fcfe-816b-4a74-b12e-bf1a122c785f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:24:01.067480947Z [2024-03-29 02:24:01,067: INFO/ForkPoolWorker-15] [e3b5f36b-3c11-41d3-be29-833b4511f841] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:24:01.694374985Z [2024-03-29 02:24:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:24:01.722108120Z [2024-03-29 02:24:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:24:01.944160308Z [2024-03-29 02:24:01,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:24:01.993428727Z [2024-03-29 02:24:01,977: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:24:02.080177268Z [2024-03-29 02:24:02,079: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:24:02.435977614Z [2024-03-29 02:24:02,435: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:24:02.441441198Z [2024-03-29 02:24:02,440: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:24:02.484051887Z [2024-03-29 02:24:02,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:24:02.487029391Z [2024-03-29 02:24:02,486: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:24:02.487426273Z [2024-03-29 02:24:02,487: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:24:02.487684310Z [2024-03-29 02:24:02,487: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:24:02.488108765Z [2024-03-29 02:24:02,487: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:24:02.639917611Z [2024-03-29 02:24:02,639: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:24:03.162241396Z [2024-03-29 02:24:03,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[316e6c7b-7c32-4273-b37c-4be023bc2cdd] succeeded in 2.133687536999787s: None 2024-03-29T02:24:03.667702788Z [2024-03-29 02:24:03,667: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:24:03.671334912Z [2024-03-29 02:24:03,670: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:24:03.711510076Z [2024-03-29 02:24:03,710: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:24:03.714480564Z [2024-03-29 02:24:03,714: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:24:03.714564333Z [2024-03-29 02:24:03,714: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:24:03.714742466Z [2024-03-29 02:24:03,714: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:24:03.714825454Z [2024-03-29 02:24:03,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:24:03.715208839Z [2024-03-29 02:24:03,714: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:24:03.715291427Z [2024-03-29 02:24:03,715: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:24:03.855630239Z [2024-03-29 02:24:03,855: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c40fcfe-816b-4a74-b12e-bf1a122c785f] succeeded in 2.8143709279993345s: None 2024-03-29T02:24:03.887188165Z [2024-03-29 02:24:03,886: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:24:04.787935639Z [2024-03-29 02:24:04,787: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:24:04.791329583Z [2024-03-29 02:24:04,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:24:04.831058924Z [2024-03-29 02:24:04,830: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:24:04.835654674Z [2024-03-29 02:24:04,835: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:24:04.836004051Z [2024-03-29 02:24:04,835: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:24:04.836300571Z [2024-03-29 02:24:04,836: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:24:04.836551471Z [2024-03-29 02:24:04,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:24:04.837050428Z [2024-03-29 02:24:04,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:24:04.837281085Z [2024-03-29 02:24:04,836: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:24:04.935917090Z [2024-03-29 02:24:04,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:24:07.450506569Z [2024-03-29 02:24:07,450: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[954078bf-ca79-4bdb-98fd-3f54ee24cae1] succeeded in 6.423531263999394s: None 2024-03-29T02:24:08.413353227Z [2024-03-29 02:24:08,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3b5f36b-3c11-41d3-be29-833b4511f841] succeeded in 7.393087542999638s: None 2024-03-29T02:25:00.971113424Z [2024-03-29 02:25:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[877e39a0-4c5a-4978-a7ea-1a747ccfcca4] received 2024-03-29T02:25:00.974013688Z [2024-03-29 02:25:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68a957bb-e5de-4139-aec7-f6591813bcfd] received 2024-03-29T02:25:00.977898303Z [2024-03-29 02:25:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01adfadc-135b-4499-9786-b82ddfda7b09] received 2024-03-29T02:25:00.984101592Z [2024-03-29 02:25:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fad8caf7-721c-46b9-bd7a-9f98323ff0c6] received 2024-03-29T02:25:00.988214791Z [2024-03-29 02:25:00,987: INFO/ForkPoolWorker-16] [68a957bb-e5de-4139-aec7-f6591813bcfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:25:00.989363214Z [2024-03-29 02:25:00,989: INFO/ForkPoolWorker-1] [01adfadc-135b-4499-9786-b82ddfda7b09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:25:00.997153019Z [2024-03-29 02:25:00,996: INFO/ForkPoolWorker-15] [877e39a0-4c5a-4978-a7ea-1a747ccfcca4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:01.006984874Z [2024-03-29 02:25:01,006: INFO/ForkPoolWorker-2] [fad8caf7-721c-46b9-bd7a-9f98323ff0c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:25:01.410382536Z [2024-03-29 02:25:01,407: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:25:01.415985556Z [2024-03-29 02:25:01,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:25:01.666843333Z [2024-03-29 02:25:01,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:25:01.695594134Z [2024-03-29 02:25:01,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:25:02.140634800Z [2024-03-29 02:25:02,140: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:25:02.145093008Z [2024-03-29 02:25:02,144: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:02.186508284Z [2024-03-29 02:25:02,186: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:25:02.189962574Z [2024-03-29 02:25:02,189: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:25:02.190563919Z [2024-03-29 02:25:02,189: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:25:02.190781767Z [2024-03-29 02:25:02,190: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:25:02.191101860Z [2024-03-29 02:25:02,190: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:25:02.303647538Z [2024-03-29 02:25:02,303: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:03.103285536Z [2024-03-29 02:25:03,102: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fad8caf7-721c-46b9-bd7a-9f98323ff0c6] succeeded in 2.1170187300012913s: None 2024-03-29T02:25:03.470238643Z [2024-03-29 02:25:03,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:25:03.474334463Z [2024-03-29 02:25:03,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:03.504887246Z [2024-03-29 02:25:03,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:25:03.508452124Z [2024-03-29 02:25:03,508: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:03.508608575Z [2024-03-29 02:25:03,508: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:03.508872902Z [2024-03-29 02:25:03,508: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:03.508995475Z [2024-03-29 02:25:03,508: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:25:03.509431028Z [2024-03-29 02:25:03,509: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:25:03.509598611Z [2024-03-29 02:25:03,509: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:03.611441135Z [2024-03-29 02:25:03,611: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:25:03.615250047Z [2024-03-29 02:25:03,614: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:03.617093749Z [2024-03-29 02:25:03,616: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:03.636821200Z [2024-03-29 02:25:03,636: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:25:03.641195876Z [2024-03-29 02:25:03,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:03.683711713Z [2024-03-29 02:25:03,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:25:03.687124915Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:03.687143716Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:03.687148512Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:03.687169416Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:25:03.687172904Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:25:03.687176236Z [2024-03-29 02:25:03,684: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:03.738665790Z [2024-03-29 02:25:03,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:25:03.740549066Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:03.740567275Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:03.740688801Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:03.740699586Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:25:03.740967469Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:25:03.741002980Z [2024-03-29 02:25:03,740: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:03.825844290Z [2024-03-29 02:25:03,825: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:03.871995678Z [2024-03-29 02:25:03,871: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:04.308232757Z [2024-03-29 02:25:04,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[877e39a0-4c5a-4978-a7ea-1a747ccfcca4] succeeded in 3.334332843998709s: None 2024-03-29T02:25:05.091822633Z [2024-03-29 02:25:05,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f6ba563-986d-4ff5-b117-fb059089946e] received 2024-03-29T02:25:05.104591017Z [2024-03-29 02:25:05,102: INFO/ForkPoolWorker-15] [7f6ba563-986d-4ff5-b117-fb059089946e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:05.679580820Z [2024-03-29 02:25:05,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:25:06.102733736Z [2024-03-29 02:25:06,102: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01adfadc-135b-4499-9786-b82ddfda7b09] succeeded in 5.1229103860005125s: None 2024-03-29T02:25:06.216388713Z [2024-03-29 02:25:06,215: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68a957bb-e5de-4139-aec7-f6591813bcfd] succeeded in 5.239296014000502s: None 2024-03-29T02:25:07.268366527Z [2024-03-29 02:25:07,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:25:07.272528266Z [2024-03-29 02:25:07,272: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:07.373864486Z [2024-03-29 02:25:07,373: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:25:07.376086151Z [2024-03-29 02:25:07,375: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:07.376111069Z [2024-03-29 02:25:07,376: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:07.376224432Z [2024-03-29 02:25:07,376: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:07.376269499Z [2024-03-29 02:25:07,376: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:25:07.376506003Z [2024-03-29 02:25:07,376: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:25:07.376532570Z [2024-03-29 02:25:07,376: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:07.461247629Z [2024-03-29 02:25:07,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:08.164077725Z [2024-03-29 02:25:08,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f6ba563-986d-4ff5-b117-fb059089946e] succeeded in 3.070455195998875s: None 2024-03-29T02:25:08.754408347Z [2024-03-29 02:25:08,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9db8cc9-9202-44fb-b315-88f13c7c12c6] received 2024-03-29T02:25:08.763329731Z [2024-03-29 02:25:08,763: INFO/ForkPoolWorker-15] [f9db8cc9-9202-44fb-b315-88f13c7c12c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:25:09.073027399Z [2024-03-29 02:25:09,069: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:25:10.277616548Z [2024-03-29 02:25:10,277: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:25:10.280813689Z [2024-03-29 02:25:10,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:10.298753917Z [2024-03-29 02:25:10,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:25:10.299949789Z [2024-03-29 02:25:10,299: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:10.300036978Z [2024-03-29 02:25:10,299: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:10.300261023Z [2024-03-29 02:25:10,300: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:10.300434052Z [2024-03-29 02:25:10,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:25:10.300777266Z [2024-03-29 02:25:10,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:25:10.300908043Z [2024-03-29 02:25:10,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:10.383683505Z [2024-03-29 02:25:10,383: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:10.931645854Z [2024-03-29 02:25:10,931: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9db8cc9-9202-44fb-b315-88f13c7c12c6] succeeded in 2.174712070998794s: None 2024-03-29T02:25:11.098122350Z [2024-03-29 02:25:11,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f417114-ae04-4043-94cf-877826e3e2c5] received 2024-03-29T02:25:11.104238754Z [2024-03-29 02:25:11,103: INFO/ForkPoolWorker-15] [4f417114-ae04-4043-94cf-877826e3e2c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:11.416390889Z [2024-03-29 02:25:11,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:25:12.607533171Z [2024-03-29 02:25:12,607: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:25:12.611192515Z [2024-03-29 02:25:12,610: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:25:12.631813999Z [2024-03-29 02:25:12,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:25:12.633140075Z [2024-03-29 02:25:12,632: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:25:12.633356176Z [2024-03-29 02:25:12,633: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:25:12.633671253Z [2024-03-29 02:25:12,633: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:25:12.633900608Z [2024-03-29 02:25:12,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:25:12.634311031Z [2024-03-29 02:25:12,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:25:12.634587740Z [2024-03-29 02:25:12,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:25:12.725518609Z [2024-03-29 02:25:12,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:25:13.316169768Z [2024-03-29 02:25:13,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f417114-ae04-4043-94cf-877826e3e2c5] succeeded in 2.216367003000414s: None 2024-03-29T02:26:00.710301778Z [2024-03-29 02:26:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d8f6c11-a373-4e89-baee-6c3596da9afb] received 2024-03-29T02:26:00.713468940Z [2024-03-29 02:26:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4bb7259-07bd-40bb-a720-235ee593afeb] received 2024-03-29T02:26:00.727143173Z [2024-03-29 02:26:00,726: INFO/ForkPoolWorker-15] [3d8f6c11-a373-4e89-baee-6c3596da9afb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:26:00.732089421Z [2024-03-29 02:26:00,731: INFO/ForkPoolWorker-16] [f4bb7259-07bd-40bb-a720-235ee593afeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:26:00.743862253Z [2024-03-29 02:26:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37691fc8-7a1a-4696-b6d1-2ccc868be76e] received 2024-03-29T02:26:00.750191935Z [2024-03-29 02:26:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f27b2a8d-712c-4d97-820b-534310211bcd] received 2024-03-29T02:26:00.771281924Z [2024-03-29 02:26:00,770: INFO/ForkPoolWorker-2] [f27b2a8d-712c-4d97-820b-534310211bcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:26:00.799215150Z [2024-03-29 02:26:00,798: INFO/ForkPoolWorker-1] [37691fc8-7a1a-4696-b6d1-2ccc868be76e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:26:01.273637946Z [2024-03-29 02:26:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:26:01.273994708Z [2024-03-29 02:26:01,270: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:26:01.318986567Z [2024-03-29 02:26:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:26:01.339161141Z [2024-03-29 02:26:01,334: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:26:01.729271668Z [2024-03-29 02:26:01,728: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:26:01.735021890Z [2024-03-29 02:26:01,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:26:01.776768621Z [2024-03-29 02:26:01,776: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:26:01.779121626Z [2024-03-29 02:26:01,778: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:26:01.779596104Z [2024-03-29 02:26:01,779: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:26:01.779789431Z [2024-03-29 02:26:01,779: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:26:01.780160299Z [2024-03-29 02:26:01,779: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:26:01.827036752Z [2024-03-29 02:26:01,826: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:26:01.951374198Z [2024-03-29 02:26:01,951: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:26:02.597374708Z [2024-03-29 02:26:02,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d8f6c11-a373-4e89-baee-6c3596da9afb] succeeded in 1.8822414740006934s: None 2024-03-29T02:26:02.716625917Z [2024-03-29 02:26:02,716: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f27b2a8d-712c-4d97-820b-534310211bcd] succeeded in 1.9639727610010596s: None 2024-03-29T02:26:02.909660900Z [2024-03-29 02:26:02,909: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:26:02.913323926Z [2024-03-29 02:26:02,912: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:26:02.933413828Z [2024-03-29 02:26:02,933: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:26:02.935229539Z [2024-03-29 02:26:02,934: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:26:02.935390596Z [2024-03-29 02:26:02,935: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:26:02.935626223Z [2024-03-29 02:26:02,935: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:26:02.935804903Z [2024-03-29 02:26:02,935: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:26:02.936102325Z [2024-03-29 02:26:02,935: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:26:02.936279520Z [2024-03-29 02:26:02,936: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:26:03.038879218Z [2024-03-29 02:26:03,038: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:26:03.167088761Z [2024-03-29 02:26:03,166: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:26:03.170804098Z [2024-03-29 02:26:03,170: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:26:03.196156844Z [2024-03-29 02:26:03,195: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:26:03.197775282Z [2024-03-29 02:26:03,197: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:26:03.197825140Z [2024-03-29 02:26:03,197: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:26:03.197977852Z [2024-03-29 02:26:03,197: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:26:03.198197936Z [2024-03-29 02:26:03,198: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:26:03.199031537Z [2024-03-29 02:26:03,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:26:03.199203476Z [2024-03-29 02:26:03,199: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:26:03.309440545Z [2024-03-29 02:26:03,309: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:26:04.987481837Z [2024-03-29 02:26:04,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37691fc8-7a1a-4696-b6d1-2ccc868be76e] succeeded in 4.23459275300047s: None 2024-03-29T02:26:06.594320472Z [2024-03-29 02:26:06,593: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4bb7259-07bd-40bb-a720-235ee593afeb] succeeded in 5.876374528001179s: None 2024-03-29T02:27:00.593851008Z [2024-03-29 02:27:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fcac370-cbba-4964-9486-6b9ad6d025b9] received 2024-03-29T02:27:00.595833546Z [2024-03-29 02:27:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e0c9aef-2e84-465e-935a-b2898ef0d31c] received 2024-03-29T02:27:00.604398570Z [2024-03-29 02:27:00,604: INFO/ForkPoolWorker-15] [7fcac370-cbba-4964-9486-6b9ad6d025b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:27:00.604874074Z [2024-03-29 02:27:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91a4c5cd-f6b8-42d4-ab89-30ab74c50f1a] received 2024-03-29T02:27:00.609968174Z [2024-03-29 02:27:00,609: INFO/ForkPoolWorker-16] [2e0c9aef-2e84-465e-935a-b2898ef0d31c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:27:00.618259297Z [2024-03-29 02:27:00,617: INFO/ForkPoolWorker-1] [91a4c5cd-f6b8-42d4-ab89-30ab74c50f1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:27:00.966661515Z [2024-03-29 02:27:00,963: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:27:01.017123744Z [2024-03-29 02:27:01,012: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:27:01.146656122Z [2024-03-29 02:27:01,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:27:01.287111829Z [2024-03-29 02:27:01,286: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:27:01.292452934Z [2024-03-29 02:27:01,291: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:27:01.316816030Z [2024-03-29 02:27:01,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:27:01.317884551Z [2024-03-29 02:27:01,317: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:27:01.318144746Z [2024-03-29 02:27:01,317: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:27:01.318182972Z [2024-03-29 02:27:01,318: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:27:01.319021933Z [2024-03-29 02:27:01,318: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:27:01.417180876Z [2024-03-29 02:27:01,416: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:27:02.291399944Z [2024-03-29 02:27:02,290: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91a4c5cd-f6b8-42d4-ab89-30ab74c50f1a] succeeded in 1.6848349100000632s: None 2024-03-29T02:27:02.467548742Z [2024-03-29 02:27:02,467: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:27:02.471118996Z [2024-03-29 02:27:02,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:27:02.497497154Z [2024-03-29 02:27:02,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:27:02.499276853Z [2024-03-29 02:27:02,498: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:27:02.499396198Z [2024-03-29 02:27:02,499: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:27:02.499609100Z [2024-03-29 02:27:02,499: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:27:02.499742408Z [2024-03-29 02:27:02,499: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:27:02.500072262Z [2024-03-29 02:27:02,499: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:27:02.500230168Z [2024-03-29 02:27:02,500: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:27:02.592257854Z [2024-03-29 02:27:02,591: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:27:02.743195453Z [2024-03-29 02:27:02,742: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:27:02.746925100Z [2024-03-29 02:27:02,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:27:02.786142086Z [2024-03-29 02:27:02,785: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:27:02.788850227Z [2024-03-29 02:27:02,788: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:27:02.788895322Z [2024-03-29 02:27:02,788: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:27:02.789084309Z [2024-03-29 02:27:02,788: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:27:02.789202022Z [2024-03-29 02:27:02,789: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:27:02.789579197Z [2024-03-29 02:27:02,789: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:27:02.789600955Z [2024-03-29 02:27:02,789: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:27:02.918046683Z [2024-03-29 02:27:02,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:27:05.376707993Z [2024-03-29 02:27:05,375: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e0c9aef-2e84-465e-935a-b2898ef0d31c] succeeded in 4.777940018999288s: None 2024-03-29T02:27:05.564501166Z [2024-03-29 02:27:05,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fcac370-cbba-4964-9486-6b9ad6d025b9] succeeded in 4.96871656499934s: None 2024-03-29T02:28:00.435488309Z [2024-03-29 02:28:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1edbcde2-9bd9-4601-a844-ec9d1b31a56c] received 2024-03-29T02:28:00.442521134Z [2024-03-29 02:28:00,442: INFO/ForkPoolWorker-15] [1edbcde2-9bd9-4601-a844-ec9d1b31a56c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:28:00.446111203Z [2024-03-29 02:28:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1df7fd1-a954-47c4-9c13-2933d7d68230] received 2024-03-29T02:28:00.451282712Z [2024-03-29 02:28:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffb7e48e-71cd-4a81-8823-5c2104c49924] received 2024-03-29T02:28:00.456490213Z [2024-03-29 02:28:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c54b2a8-6aa1-40bf-a626-ca0cecaca8cd] received 2024-03-29T02:28:00.465149139Z [2024-03-29 02:28:00,464: INFO/ForkPoolWorker-16] [f1df7fd1-a954-47c4-9c13-2933d7d68230] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:28:00.479196651Z [2024-03-29 02:28:00,478: INFO/ForkPoolWorker-2] [6c54b2a8-6aa1-40bf-a626-ca0cecaca8cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:28:00.479659234Z [2024-03-29 02:28:00,479: INFO/ForkPoolWorker-1] [ffb7e48e-71cd-4a81-8823-5c2104c49924] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:28:00.811166039Z [2024-03-29 02:28:00,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:28:00.885141595Z [2024-03-29 02:28:00,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:28:00.993832898Z [2024-03-29 02:28:00,993: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:28:00.997659607Z [2024-03-29 02:28:00,997: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:28:01.069983992Z [2024-03-29 02:28:01,069: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:28:01.078355157Z [2024-03-29 02:28:01,075: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:28:01.078729212Z [2024-03-29 02:28:01,078: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:28:01.078945042Z [2024-03-29 02:28:01,078: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:28:01.079365036Z [2024-03-29 02:28:01,079: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:28:01.180266497Z [2024-03-29 02:28:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:28:01.196247593Z [2024-03-29 02:28:01,179: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:28:01.329241612Z [2024-03-29 02:28:01,328: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:28:01.525850635Z [2024-03-29 02:28:01,525: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:28:02.233857543Z [2024-03-29 02:28:02,233: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c54b2a8-6aa1-40bf-a626-ca0cecaca8cd] succeeded in 1.7735040489988023s: None 2024-03-29T02:28:02.397283794Z [2024-03-29 02:28:02,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1edbcde2-9bd9-4601-a844-ec9d1b31a56c] succeeded in 1.9600244329994894s: None 2024-03-29T02:28:02.668373164Z [2024-03-29 02:28:02,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:28:02.672148520Z [2024-03-29 02:28:02,671: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:28:02.692740244Z [2024-03-29 02:28:02,692: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:28:02.694153414Z [2024-03-29 02:28:02,693: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:28:02.694180408Z [2024-03-29 02:28:02,694: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:28:02.694331574Z [2024-03-29 02:28:02,694: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:28:02.694381017Z [2024-03-29 02:28:02,694: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:28:02.694761350Z [2024-03-29 02:28:02,694: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:28:02.694812768Z [2024-03-29 02:28:02,694: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:28:02.799601660Z [2024-03-29 02:28:02,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:28:02.958530573Z [2024-03-29 02:28:02,955: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:28:02.961795212Z [2024-03-29 02:28:02,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:28:03.020516291Z [2024-03-29 02:28:03,020: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:28:03.022003631Z [2024-03-29 02:28:03,021: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:28:03.022300909Z [2024-03-29 02:28:03,021: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:28:03.022326734Z [2024-03-29 02:28:03,021: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:28:03.022331446Z [2024-03-29 02:28:03,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:28:03.022836118Z [2024-03-29 02:28:03,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:28:03.022898905Z [2024-03-29 02:28:03,022: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:28:03.139650157Z [2024-03-29 02:28:03,139: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:28:04.741215470Z [2024-03-29 02:28:04,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ffb7e48e-71cd-4a81-8823-5c2104c49924] succeeded in 4.286924951000401s: None 2024-03-29T02:28:04.777278307Z [2024-03-29 02:28:04,776: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1df7fd1-a954-47c4-9c13-2933d7d68230] succeeded in 4.3257230119997985s: None 2024-03-29T02:29:01.103555220Z [2024-03-29 02:29:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fb9f2e5-2017-47db-86a9-db705f206f79] received 2024-03-29T02:29:01.105949220Z [2024-03-29 02:29:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97e30402-8f4a-4dfa-bb9d-a5e1b335236a] received 2024-03-29T02:29:01.110113781Z [2024-03-29 02:29:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[056da647-34a9-4db4-b381-aa3d6049e45b] received 2024-03-29T02:29:01.121957841Z [2024-03-29 02:29:01,121: INFO/ForkPoolWorker-1] [056da647-34a9-4db4-b381-aa3d6049e45b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:29:01.129009422Z [2024-03-29 02:29:01,127: INFO/ForkPoolWorker-16] [97e30402-8f4a-4dfa-bb9d-a5e1b335236a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:29:01.129068040Z [2024-03-29 02:29:01,127: INFO/ForkPoolWorker-15] [7fb9f2e5-2017-47db-86a9-db705f206f79] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:29:01.429331725Z [2024-03-29 02:29:01,425: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:29:01.472762948Z [2024-03-29 02:29:01,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:29:01.515772230Z [2024-03-29 02:29:01,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:29:01.636518623Z [2024-03-29 02:29:01,635: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:29:01.640552449Z [2024-03-29 02:29:01,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:29:01.664130736Z [2024-03-29 02:29:01,663: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:29:01.665263526Z [2024-03-29 02:29:01,665: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:29:01.666535150Z [2024-03-29 02:29:01,665: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:29:01.666565768Z [2024-03-29 02:29:01,666: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:29:01.667352813Z [2024-03-29 02:29:01,666: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:29:01.796052893Z [2024-03-29 02:29:01,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:29:02.551255943Z [2024-03-29 02:29:02,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fb9f2e5-2017-47db-86a9-db705f206f79] succeeded in 1.4457693160002236s: None 2024-03-29T02:29:02.681231657Z [2024-03-29 02:29:02,680: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:29:02.685001702Z [2024-03-29 02:29:02,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:29:02.716004560Z [2024-03-29 02:29:02,715: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:29:02.718398007Z [2024-03-29 02:29:02,717: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:29:02.718509918Z [2024-03-29 02:29:02,718: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:29:02.718529188Z [2024-03-29 02:29:02,718: INFO/ForkPoolWorker-16] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:29:02.718774061Z [2024-03-29 02:29:02,718: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:29:02.718836618Z [2024-03-29 02:29:02,718: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:29:02.719282967Z [2024-03-29 02:29:02,719: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:29:02.719353090Z [2024-03-29 02:29:02,719: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:29:02.729260147Z [2024-03-29 02:29:02,728: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:29:02.838856761Z [2024-03-29 02:29:02,838: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:29:03.092261502Z [2024-03-29 02:29:03,091: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:29:03.095932394Z [2024-03-29 02:29:03,095: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:29:03.122647696Z [2024-03-29 02:29:03,122: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:29:03.135581115Z [2024-03-29 02:29:03,135: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:29:03.135601921Z [2024-03-29 02:29:03,135: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:29:03.135641846Z [2024-03-29 02:29:03,135: INFO/ForkPoolWorker-1] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:29:03.135874556Z [2024-03-29 02:29:03,135: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:29:03.135897533Z [2024-03-29 02:29:03,135: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:29:03.136710952Z [2024-03-29 02:29:03,136: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:29:03.136726662Z [2024-03-29 02:29:03,136: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:29:03.142603075Z [2024-03-29 02:29:03,142: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:29:03.290171147Z [2024-03-29 02:29:03,289: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:29:05.059493691Z [2024-03-29 02:29:05,059: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[056da647-34a9-4db4-b381-aa3d6049e45b] succeeded in 3.9467017220013076s: None 2024-03-29T02:29:05.278842251Z [2024-03-29 02:29:05,278: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97e30402-8f4a-4dfa-bb9d-a5e1b335236a] succeeded in 4.170876906000558s: None 2024-03-29T02:30:00.451928055Z [2024-03-29 02:30:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79afda82-e31c-42ec-871f-0ffd7c61f9d7] received 2024-03-29T02:30:00.462291454Z [2024-03-29 02:30:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35c93222-a99c-47e1-8e94-08dad9e13a8a] received 2024-03-29T02:30:00.464421137Z [2024-03-29 02:30:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c60fd31-4863-4541-bc73-af6512c23ab9] received 2024-03-29T02:30:00.467158854Z [2024-03-29 02:30:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6738fc2-70d2-4a3b-813e-b29273b0ead4] received 2024-03-29T02:30:00.474217764Z [2024-03-29 02:30:00,473: INFO/ForkPoolWorker-15] [79afda82-e31c-42ec-871f-0ffd7c61f9d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:30:00.474767033Z [2024-03-29 02:30:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b398094-13ca-47ff-ac37-5fc0595a9be0] received 2024-03-29T02:30:00.475203124Z [2024-03-29 02:30:00,474: INFO/ForkPoolWorker-16] [35c93222-a99c-47e1-8e94-08dad9e13a8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:00.475605164Z [2024-03-29 02:30:00,475: INFO/ForkPoolWorker-2] [d6738fc2-70d2-4a3b-813e-b29273b0ead4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:30:00.480145631Z [2024-03-29 02:30:00,479: INFO/ForkPoolWorker-1] [8c60fd31-4863-4541-bc73-af6512c23ab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:30:00.511331454Z [2024-03-29 02:30:00,510: INFO/ForkPoolWorker-3] [9b398094-13ca-47ff-ac37-5fc0595a9be0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:30:00.953931920Z [2024-03-29 02:30:00,943: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:30:00.961998472Z [2024-03-29 02:30:00,958: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:30:00.982412794Z [2024-03-29 02:30:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:30:01.168812687Z [2024-03-29 02:30:01,168: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:30:01.173330632Z [2024-03-29 02:30:01,172: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:01.199897620Z [2024-03-29 02:30:01,192: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:30:01.200705495Z [2024-03-29 02:30:01,200: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:30:01.201988127Z [2024-03-29 02:30:01,201: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:30:01.202012772Z [2024-03-29 02:30:01,201: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:30:01.202106607Z [2024-03-29 02:30:01,202: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:30:01.202624197Z [2024-03-29 02:30:01,202: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:30:01.203850287Z [2024-03-29 02:30:01,194: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:30:01.364079306Z [2024-03-29 02:30:01,363: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:01.365403936Z [2024-03-29 02:30:01,365: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:02.301979138Z [2024-03-29 02:30:02,300: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9b398094-13ca-47ff-ac37-5fc0595a9be0] succeeded in 1.8081921040011366s: None 2024-03-29T02:30:02.323940951Z [2024-03-29 02:30:02,323: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c60fd31-4863-4541-bc73-af6512c23ab9] succeeded in 1.85550507500011s: None 2024-03-29T02:30:02.973247583Z [2024-03-29 02:30:02,972: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:30:02.977304617Z [2024-03-29 02:30:02,976: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:03.005271869Z [2024-03-29 02:30:03,004: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:30:03.007849059Z [2024-03-29 02:30:03,007: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:03.008023836Z [2024-03-29 02:30:03,007: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:03.008192616Z [2024-03-29 02:30:03,008: INFO/ForkPoolWorker-16] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:03.008490250Z [2024-03-29 02:30:03,008: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:03.008627886Z [2024-03-29 02:30:03,008: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:30:03.009144655Z [2024-03-29 02:30:03,008: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:03.009311980Z [2024-03-29 02:30:03,009: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:03.017640719Z [2024-03-29 02:30:03,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:03.132625606Z [2024-03-29 02:30:03,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:03.279409380Z [2024-03-29 02:30:03,279: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:30:03.283325782Z [2024-03-29 02:30:03,282: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:03.323993356Z [2024-03-29 02:30:03,323: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:30:03.326358593Z [2024-03-29 02:30:03,325: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:03.326696087Z [2024-03-29 02:30:03,326: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:03.326901544Z [2024-03-29 02:30:03,326: INFO/ForkPoolWorker-2] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:03.327206887Z [2024-03-29 02:30:03,326: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:03.327416685Z [2024-03-29 02:30:03,327: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:30:03.327903209Z [2024-03-29 02:30:03,327: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:30:03.328187337Z [2024-03-29 02:30:03,327: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:03.337160234Z [2024-03-29 02:30:03,336: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:30:03.405164542Z [2024-03-29 02:30:03,404: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:30:03.408959505Z [2024-03-29 02:30:03,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:03.431620550Z [2024-03-29 02:30:03,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:30:03.433734079Z [2024-03-29 02:30:03,433: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:03.433798095Z [2024-03-29 02:30:03,433: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:03.433888079Z [2024-03-29 02:30:03,433: INFO/ForkPoolWorker-15] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:03.434126081Z [2024-03-29 02:30:03,433: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:03.434219693Z [2024-03-29 02:30:03,434: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:30:03.438192612Z [2024-03-29 02:30:03,437: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:30:03.438308506Z [2024-03-29 02:30:03,438: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:03.446355644Z [2024-03-29 02:30:03,445: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:30:03.464008222Z [2024-03-29 02:30:03,463: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:03.580398734Z [2024-03-29 02:30:03,580: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:03.979445227Z [2024-03-29 02:30:03,978: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35c93222-a99c-47e1-8e94-08dad9e13a8a] succeeded in 3.5145804850017157s: None 2024-03-29T02:30:04.136356197Z [2024-03-29 02:30:04,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b91cd7df-df83-4cc3-8d83-3ddf3a856157] received 2024-03-29T02:30:04.143827188Z [2024-03-29 02:30:04,143: INFO/ForkPoolWorker-16] [b91cd7df-df83-4cc3-8d83-3ddf3a856157] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:04.498100426Z [2024-03-29 02:30:04,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:30:05.069058607Z [2024-03-29 02:30:05,067: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6738fc2-70d2-4a3b-813e-b29273b0ead4] succeeded in 4.598878073000378s: None 2024-03-29T02:30:05.654821575Z [2024-03-29 02:30:05,645: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79afda82-e31c-42ec-871f-0ffd7c61f9d7] succeeded in 5.190652920999128s: None 2024-03-29T02:30:06.183974328Z [2024-03-29 02:30:06,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:30:06.187809048Z [2024-03-29 02:30:06,187: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:06.215864834Z [2024-03-29 02:30:06,215: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:30:06.218064676Z [2024-03-29 02:30:06,217: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:06.218090782Z [2024-03-29 02:30:06,217: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:06.218210501Z [2024-03-29 02:30:06,218: INFO/ForkPoolWorker-16] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:06.218525596Z [2024-03-29 02:30:06,218: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:06.218607452Z [2024-03-29 02:30:06,218: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:30:06.218919590Z [2024-03-29 02:30:06,218: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:06.218979166Z [2024-03-29 02:30:06,218: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:06.230082811Z [2024-03-29 02:30:06,229: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:06.388523306Z [2024-03-29 02:30:06,388: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:07.181741550Z [2024-03-29 02:30:07,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b91cd7df-df83-4cc3-8d83-3ddf3a856157] succeeded in 3.042742162999275s: None 2024-03-29T02:30:07.952867181Z [2024-03-29 02:30:07,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a5196c6-d89b-40d7-b414-dcaba86d93fc] received 2024-03-29T02:30:07.975382276Z [2024-03-29 02:30:07,975: INFO/ForkPoolWorker-15] [0a5196c6-d89b-40d7-b414-dcaba86d93fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:30:08.322837010Z [2024-03-29 02:30:08,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:30:09.575209233Z [2024-03-29 02:30:09,574: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:30:09.578565183Z [2024-03-29 02:30:09,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:09.598793538Z [2024-03-29 02:30:09,598: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:30:09.599995006Z [2024-03-29 02:30:09,599: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:09.600012952Z [2024-03-29 02:30:09,599: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:09.600085187Z [2024-03-29 02:30:09,599: INFO/ForkPoolWorker-15] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:09.600163588Z [2024-03-29 02:30:09,599: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:09.600177321Z [2024-03-29 02:30:09,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:30:09.600417870Z [2024-03-29 02:30:09,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:09.600456635Z [2024-03-29 02:30:09,600: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:09.607873024Z [2024-03-29 02:30:09,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:09.701419961Z [2024-03-29 02:30:09,701: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:10.197101102Z [2024-03-29 02:30:10,196: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a5196c6-d89b-40d7-b414-dcaba86d93fc] succeeded in 2.2372260879983514s: None 2024-03-29T02:30:10.355350488Z [2024-03-29 02:30:10,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36d48762-6009-499e-ac0b-09edbce67457] received 2024-03-29T02:30:10.362678958Z [2024-03-29 02:30:10,362: INFO/ForkPoolWorker-15] [36d48762-6009-499e-ac0b-09edbce67457] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:10.632581865Z [2024-03-29 02:30:10,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:30:11.811901268Z [2024-03-29 02:30:11,811: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:30:11.816102519Z [2024-03-29 02:30:11,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:30:11.844626292Z [2024-03-29 02:30:11,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:30:11.846060155Z [2024-03-29 02:30:11,845: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:30:11.846267990Z [2024-03-29 02:30:11,846: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:30:11.846372633Z [2024-03-29 02:30:11,846: INFO/ForkPoolWorker-15] Read VIM 0469fa5f-519a-4926-8ec5-0b7423fb0d1a (k8s07_dummy) 2024-03-29T02:30:11.846660567Z [2024-03-29 02:30:11,846: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0469fa5f-519a-4926-8ec5-0b7423fb0d1a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-29T02:30:11.846772758Z [2024-03-29 02:30:11,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:30:11.847129556Z [2024-03-29 02:30:11,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:11.847283675Z [2024-03-29 02:30:11,847: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:30:11.854608548Z [2024-03-29 02:30:11,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:30:11.936228381Z [2024-03-29 02:30:11,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:30:12.507394303Z [2024-03-29 02:30:12,506: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36d48762-6009-499e-ac0b-09edbce67457] succeeded in 2.1504342460011685s: None 2024-03-29T02:31:00.910125400Z [2024-03-29 02:31:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a127f4d-e34d-4718-8e9d-5284a986ea95] received 2024-03-29T02:31:00.913114236Z [2024-03-29 02:31:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bec913b7-d1c9-4598-8cf2-f5624d73cefd] received 2024-03-29T02:31:00.917805400Z [2024-03-29 02:31:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f7a1f6b-eafd-4152-a725-7d6021a2e96a] received 2024-03-29T02:31:00.920883202Z [2024-03-29 02:31:00,920: INFO/ForkPoolWorker-16] [bec913b7-d1c9-4598-8cf2-f5624d73cefd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:31:00.924537867Z [2024-03-29 02:31:00,924: INFO/ForkPoolWorker-15] [1a127f4d-e34d-4718-8e9d-5284a986ea95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:31:00.931917033Z [2024-03-29 02:31:00,931: INFO/ForkPoolWorker-1] [1f7a1f6b-eafd-4152-a725-7d6021a2e96a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:31:01.244567942Z [2024-03-29 02:31:01,240: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:31:01.294991283Z [2024-03-29 02:31:01,291: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:31:01.302802738Z [2024-03-29 02:31:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:31:01.413429170Z [2024-03-29 02:31:01,412: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:31:01.417447652Z [2024-03-29 02:31:01,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:31:01.440454505Z [2024-03-29 02:31:01,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:31:01.442029805Z [2024-03-29 02:31:01,441: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:31:01.442122301Z [2024-03-29 02:31:01,441: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:31:01.442127676Z [2024-03-29 02:31:01,442: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:31:01.442321602Z [2024-03-29 02:31:01,442: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:31:01.579005918Z [2024-03-29 02:31:01,578: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:31:02.395497837Z [2024-03-29 02:31:02,394: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bec913b7-d1c9-4598-8cf2-f5624d73cefd] succeeded in 1.479550341000504s: None 2024-03-29T02:31:02.701580391Z [2024-03-29 02:31:02,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:31:02.705809335Z [2024-03-29 02:31:02,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:31:02.729701192Z [2024-03-29 02:31:02,729: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:31:02.731717042Z [2024-03-29 02:31:02,731: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:31:02.731893992Z [2024-03-29 02:31:02,731: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:31:02.732111417Z [2024-03-29 02:31:02,731: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:31:02.732183098Z [2024-03-29 02:31:02,732: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:31:02.732587298Z [2024-03-29 02:31:02,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:31:02.732675507Z [2024-03-29 02:31:02,732: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:31:02.815967576Z [2024-03-29 02:31:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:31:02.916056213Z [2024-03-29 02:31:02,915: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:31:02.919661610Z [2024-03-29 02:31:02,919: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:31:02.940454819Z [2024-03-29 02:31:02,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:31:02.947342803Z [2024-03-29 02:31:02,947: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:31:02.947517908Z [2024-03-29 02:31:02,947: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:31:02.947746393Z [2024-03-29 02:31:02,947: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:31:02.947832753Z [2024-03-29 02:31:02,947: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:31:02.948224154Z [2024-03-29 02:31:02,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:31:02.948893727Z [2024-03-29 02:31:02,948: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:31:03.071227836Z [2024-03-29 02:31:03,070: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:31:04.339523177Z [2024-03-29 02:31:04,339: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a127f4d-e34d-4718-8e9d-5284a986ea95] succeeded in 3.4250651050006127s: None 2024-03-29T02:31:05.234631731Z [2024-03-29 02:31:05,232: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f7a1f6b-eafd-4152-a725-7d6021a2e96a] succeeded in 4.3132362679989456s: None 2024-03-29T02:32:00.692790903Z [2024-03-29 02:32:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50c08156-15bf-489e-9997-2973419676f8] received 2024-03-29T02:32:00.699004261Z [2024-03-29 02:32:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18ccdc18-19dc-4f42-aef0-33546a00f008] received 2024-03-29T02:32:00.700024866Z [2024-03-29 02:32:00,699: INFO/ForkPoolWorker-15] [50c08156-15bf-489e-9997-2973419676f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:32:00.707841815Z [2024-03-29 02:32:00,707: INFO/ForkPoolWorker-16] [18ccdc18-19dc-4f42-aef0-33546a00f008] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:32:00.714235276Z [2024-03-29 02:32:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a47082d9-ccac-496f-9786-9771f9e1ec61] received 2024-03-29T02:32:00.719465564Z [2024-03-29 02:32:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c321418-bcce-4f0f-8a59-57b00127367f] received 2024-03-29T02:32:00.730018238Z [2024-03-29 02:32:00,729: INFO/ForkPoolWorker-1] [a47082d9-ccac-496f-9786-9771f9e1ec61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:32:00.749404668Z [2024-03-29 02:32:00,742: INFO/ForkPoolWorker-2] [6c321418-bcce-4f0f-8a59-57b00127367f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:32:01.125042583Z [2024-03-29 02:32:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:32:01.158774554Z [2024-03-29 02:32:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:32:01.193103405Z [2024-03-29 02:32:01,189: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:32:01.235483222Z [2024-03-29 02:32:01,227: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:32:01.361632310Z [2024-03-29 02:32:01,361: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:32:01.367714443Z [2024-03-29 02:32:01,367: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:32:01.411758945Z [2024-03-29 02:32:01,411: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:32:01.414430343Z [2024-03-29 02:32:01,413: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:32:01.415297736Z [2024-03-29 02:32:01,415: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:32:01.415471942Z [2024-03-29 02:32:01,415: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:32:01.415861852Z [2024-03-29 02:32:01,415: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:32:01.524344704Z [2024-03-29 02:32:01,524: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:32:01.613516773Z [2024-03-29 02:32:01,613: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:32:02.350200622Z [2024-03-29 02:32:02,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18ccdc18-19dc-4f42-aef0-33546a00f008] succeeded in 1.6492427709999902s: None 2024-03-29T02:32:02.399920178Z [2024-03-29 02:32:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50c08156-15bf-489e-9997-2973419676f8] succeeded in 1.7045187540006737s: None 2024-03-29T02:32:02.696246952Z [2024-03-29 02:32:02,695: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:32:02.699575090Z [2024-03-29 02:32:02,699: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:32:02.722126161Z [2024-03-29 02:32:02,721: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:32:02.724534127Z [2024-03-29 02:32:02,724: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:32:02.724611181Z [2024-03-29 02:32:02,724: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:32:02.724857924Z [2024-03-29 02:32:02,724: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:32:02.725333287Z [2024-03-29 02:32:02,725: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:32:02.726163532Z [2024-03-29 02:32:02,725: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:32:02.726214718Z [2024-03-29 02:32:02,726: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:32:02.809498703Z [2024-03-29 02:32:02,809: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:32:03.130766924Z [2024-03-29 02:32:03,130: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:32:03.137092123Z [2024-03-29 02:32:03,136: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:32:03.166582852Z [2024-03-29 02:32:03,166: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:32:03.172060486Z [2024-03-29 02:32:03,171: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:32:03.172086722Z [2024-03-29 02:32:03,171: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:32:03.172430611Z [2024-03-29 02:32:03,171: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:32:03.172492507Z [2024-03-29 02:32:03,172: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:32:03.172890829Z [2024-03-29 02:32:03,172: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:32:03.172903180Z [2024-03-29 02:32:03,172: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:32:03.279069391Z [2024-03-29 02:32:03,278: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:32:04.746052152Z [2024-03-29 02:32:04,745: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c321418-bcce-4f0f-8a59-57b00127367f] succeeded in 4.0231503959985275s: None 2024-03-29T02:32:04.918973911Z [2024-03-29 02:32:04,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a47082d9-ccac-496f-9786-9771f9e1ec61] succeeded in 4.20281650600009s: None 2024-03-29T02:33:00.312658500Z [2024-03-29 02:33:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[213b6b20-2ac7-49b3-9751-90a4e694c1ad] received 2024-03-29T02:33:00.316126101Z [2024-03-29 02:33:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[286067fe-7877-4b5d-ae40-363016b67bfd] received 2024-03-29T02:33:00.327344957Z [2024-03-29 02:33:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e9e4eb3-5211-4c46-bead-70bb30b609db] received 2024-03-29T02:33:00.327774428Z [2024-03-29 02:33:00,327: INFO/ForkPoolWorker-16] [286067fe-7877-4b5d-ae40-363016b67bfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:33:00.328065267Z [2024-03-29 02:33:00,327: INFO/ForkPoolWorker-15] [213b6b20-2ac7-49b3-9751-90a4e694c1ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:33:00.349213919Z [2024-03-29 02:33:00,348: INFO/ForkPoolWorker-1] [5e9e4eb3-5211-4c46-bead-70bb30b609db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:33:00.651321491Z [2024-03-29 02:33:00,646: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:33:00.674914075Z [2024-03-29 02:33:00,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:33:00.689542870Z [2024-03-29 02:33:00,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:33:00.812313341Z [2024-03-29 02:33:00,811: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:33:00.816354083Z [2024-03-29 02:33:00,815: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:33:00.857667786Z [2024-03-29 02:33:00,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:33:00.867386287Z [2024-03-29 02:33:00,866: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:33:00.867553027Z [2024-03-29 02:33:00,867: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:33:00.867657089Z [2024-03-29 02:33:00,867: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:33:00.867931955Z [2024-03-29 02:33:00,867: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:33:01.009729716Z [2024-03-29 02:33:01,009: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:33:01.670702417Z [2024-03-29 02:33:01,670: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[286067fe-7877-4b5d-ae40-363016b67bfd] succeeded in 1.3505380030001106s: None 2024-03-29T02:33:02.206306573Z [2024-03-29 02:33:02,205: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:33:02.209873479Z [2024-03-29 02:33:02,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:33:02.236570883Z [2024-03-29 02:33:02,236: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:33:02.238377482Z [2024-03-29 02:33:02,238: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:33:02.238734443Z [2024-03-29 02:33:02,238: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:33:02.239089191Z [2024-03-29 02:33:02,238: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:33:02.239305817Z [2024-03-29 02:33:02,239: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:33:02.239698015Z [2024-03-29 02:33:02,239: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:33:02.239728787Z [2024-03-29 02:33:02,239: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:33:02.334596223Z [2024-03-29 02:33:02,334: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:33:02.353525403Z [2024-03-29 02:33:02,353: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:33:02.357042967Z [2024-03-29 02:33:02,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:33:02.391813145Z [2024-03-29 02:33:02,391: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:33:02.393345706Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:33:02.393382803Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:33:02.393570204Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:33:02.393690146Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:33:02.394060183Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:33:02.394076743Z [2024-03-29 02:33:02,393: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:33:02.497176934Z [2024-03-29 02:33:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:33:03.950587822Z [2024-03-29 02:33:03,950: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e9e4eb3-5211-4c46-bead-70bb30b609db] succeeded in 3.6076351149986294s: None 2024-03-29T02:33:04.198806149Z [2024-03-29 02:33:04,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[213b6b20-2ac7-49b3-9751-90a4e694c1ad] succeeded in 3.8807792520001385s: None 2024-03-29T02:34:00.646402345Z [2024-03-29 02:34:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[522a04f3-92ff-4f5b-b6ec-662017b99098] received 2024-03-29T02:34:00.649529900Z [2024-03-29 02:34:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f67ad47c-3e14-4f6d-bbf7-d24e8b516159] received 2024-03-29T02:34:00.652153161Z [2024-03-29 02:34:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab307b34-ff2c-4adc-9782-6a6b12ac9f76] received 2024-03-29T02:34:00.658201412Z [2024-03-29 02:34:00,657: INFO/ForkPoolWorker-16] [f67ad47c-3e14-4f6d-bbf7-d24e8b516159] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:34:00.662380252Z [2024-03-29 02:34:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23652d0e-038b-429c-ba94-11945d4bd1fd] received 2024-03-29T02:34:00.662407621Z [2024-03-29 02:34:00,662: INFO/ForkPoolWorker-1] [ab307b34-ff2c-4adc-9782-6a6b12ac9f76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:34:00.662758810Z [2024-03-29 02:34:00,662: INFO/ForkPoolWorker-15] [522a04f3-92ff-4f5b-b6ec-662017b99098] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:34:00.671395676Z [2024-03-29 02:34:00,671: INFO/ForkPoolWorker-2] [23652d0e-038b-429c-ba94-11945d4bd1fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:34:01.097586561Z [2024-03-29 02:34:01,094: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:34:01.144966540Z [2024-03-29 02:34:01,141: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:34:01.153546357Z [2024-03-29 02:34:01,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:34:01.182153900Z [2024-03-29 02:34:01,177: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:34:01.454422628Z [2024-03-29 02:34:01,454: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:34:01.501823095Z [2024-03-29 02:34:01,501: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:34:01.519099736Z [2024-03-29 02:34:01,518: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:34:01.573368686Z [2024-03-29 02:34:01,573: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:34:01.577019124Z [2024-03-29 02:34:01,576: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:34:01.577190248Z [2024-03-29 02:34:01,576: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:34:01.577294342Z [2024-03-29 02:34:01,577: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:34:01.577674783Z [2024-03-29 02:34:01,577: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:34:01.780234637Z [2024-03-29 02:34:01,779: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:34:02.373857416Z [2024-03-29 02:34:02,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[522a04f3-92ff-4f5b-b6ec-662017b99098] succeeded in 1.7248388749994774s: None 2024-03-29T02:34:02.667147633Z [2024-03-29 02:34:02,666: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23652d0e-038b-429c-ba94-11945d4bd1fd] succeeded in 2.002548589000071s: None 2024-03-29T02:34:02.850105084Z [2024-03-29 02:34:02,849: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:34:02.853793288Z [2024-03-29 02:34:02,853: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:34:02.876449508Z [2024-03-29 02:34:02,876: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:34:02.877851076Z [2024-03-29 02:34:02,877: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:34:02.877955599Z [2024-03-29 02:34:02,877: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:34:02.878134252Z [2024-03-29 02:34:02,877: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:34:02.878252828Z [2024-03-29 02:34:02,878: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:34:02.878647970Z [2024-03-29 02:34:02,878: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:34:02.878762188Z [2024-03-29 02:34:02,878: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:34:02.976705241Z [2024-03-29 02:34:02,976: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:34:03.297212626Z [2024-03-29 02:34:03,296: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:34:03.303105852Z [2024-03-29 02:34:03,302: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:34:03.333826098Z [2024-03-29 02:34:03,333: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:34:03.335566512Z [2024-03-29 02:34:03,335: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:34:03.335694925Z [2024-03-29 02:34:03,335: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:34:03.335906728Z [2024-03-29 02:34:03,335: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:34:03.336070659Z [2024-03-29 02:34:03,335: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:34:03.336383671Z [2024-03-29 02:34:03,336: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:34:03.336556653Z [2024-03-29 02:34:03,336: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:34:03.435089186Z [2024-03-29 02:34:03,434: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:34:05.267885538Z [2024-03-29 02:34:05,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f67ad47c-3e14-4f6d-bbf7-d24e8b516159] succeeded in 4.616232697000669s: None 2024-03-29T02:34:05.299661572Z [2024-03-29 02:34:05,299: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab307b34-ff2c-4adc-9782-6a6b12ac9f76] succeeded in 4.6451794679996965s: None 2024-03-29T02:35:01.093220626Z [2024-03-29 02:35:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1e0f0a2-18eb-4105-b076-143e72f2fe90] received 2024-03-29T02:35:01.099060480Z [2024-03-29 02:35:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d689463b-b87f-4f75-b5b5-cf9035ceb2e3] received 2024-03-29T02:35:01.102510679Z [2024-03-29 02:35:01,102: INFO/ForkPoolWorker-15] [c1e0f0a2-18eb-4105-b076-143e72f2fe90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:35:01.105818831Z [2024-03-29 02:35:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03e46263-7530-4cff-8b49-7f55cfbb3142] received 2024-03-29T02:35:01.109809812Z [2024-03-29 02:35:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5376e2e4-0f1c-488d-b5f3-3a39dab3cccf] received 2024-03-29T02:35:01.114348879Z [2024-03-29 02:35:01,114: INFO/ForkPoolWorker-1] [03e46263-7530-4cff-8b49-7f55cfbb3142] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:01.114583893Z [2024-03-29 02:35:01,114: INFO/ForkPoolWorker-16] [d689463b-b87f-4f75-b5b5-cf9035ceb2e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:35:01.123477644Z [2024-03-29 02:35:01,123: INFO/ForkPoolWorker-2] [5376e2e4-0f1c-488d-b5f3-3a39dab3cccf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:35:01.517383812Z [2024-03-29 02:35:01,513: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:35:01.520385470Z [2024-03-29 02:35:01,516: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:35:01.566622743Z [2024-03-29 02:35:01,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:35:01.569063629Z [2024-03-29 02:35:01,565: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:35:01.805165572Z [2024-03-29 02:35:01,804: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:35:01.811152529Z [2024-03-29 02:35:01,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:01.860832625Z [2024-03-29 02:35:01,860: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:35:01.864188366Z [2024-03-29 02:35:01,863: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:35:01.864248147Z [2024-03-29 02:35:01,863: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:35:01.864614015Z [2024-03-29 02:35:01,863: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:35:01.864991928Z [2024-03-29 02:35:01,864: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:35:02.054306929Z [2024-03-29 02:35:02,053: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:02.728260987Z [2024-03-29 02:35:02,727: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d689463b-b87f-4f75-b5b5-cf9035ceb2e3] succeeded in 1.6275374239994562s: None 2024-03-29T02:35:03.254772996Z [2024-03-29 02:35:03,254: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:35:03.258772787Z [2024-03-29 02:35:03,258: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:03.285495265Z [2024-03-29 02:35:03,285: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:35:03.287429450Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:03.287452301Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:03.287542570Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:03.287602493Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:35:03.287903595Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:35:03.287977327Z [2024-03-29 02:35:03,287: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:03.402238254Z [2024-03-29 02:35:03,401: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:35:03.411200780Z [2024-03-29 02:35:03,410: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:03.420151377Z [2024-03-29 02:35:03,419: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:03.432431760Z [2024-03-29 02:35:03,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:35:03.435423681Z [2024-03-29 02:35:03,435: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:03.435439658Z [2024-03-29 02:35:03,435: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:03.435620209Z [2024-03-29 02:35:03,435: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:03.435730851Z [2024-03-29 02:35:03,435: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:35:03.436128745Z [2024-03-29 02:35:03,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:35:03.436261321Z [2024-03-29 02:35:03,436: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:03.562254486Z [2024-03-29 02:35:03,561: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:03.565820440Z [2024-03-29 02:35:03,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:35:03.569364475Z [2024-03-29 02:35:03,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:03.594154979Z [2024-03-29 02:35:03,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:35:03.598076367Z [2024-03-29 02:35:03,597: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:03.598132574Z [2024-03-29 02:35:03,597: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:03.598224051Z [2024-03-29 02:35:03,598: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:03.598234513Z [2024-03-29 02:35:03,598: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:35:03.598551388Z [2024-03-29 02:35:03,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:35:03.598563307Z [2024-03-29 02:35:03,598: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:03.708470155Z [2024-03-29 02:35:03,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:04.329834569Z [2024-03-29 02:35:04,329: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03e46263-7530-4cff-8b49-7f55cfbb3142] succeeded in 3.2221224200002325s: None 2024-03-29T02:35:04.760649650Z [2024-03-29 02:35:04,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6017129-afb8-4a78-93bf-c9dd5831c43e] received 2024-03-29T02:35:04.769273849Z [2024-03-29 02:35:04,768: INFO/ForkPoolWorker-16] [c6017129-afb8-4a78-93bf-c9dd5831c43e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:05.134551865Z [2024-03-29 02:35:05,125: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:35:05.226489703Z [2024-03-29 02:35:05,226: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1e0f0a2-18eb-4105-b076-143e72f2fe90] succeeded in 4.131176901000799s: None 2024-03-29T02:35:05.423383048Z [2024-03-29 02:35:05,422: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5376e2e4-0f1c-488d-b5f3-3a39dab3cccf] succeeded in 4.3110953209998115s: None 2024-03-29T02:35:06.604816063Z [2024-03-29 02:35:06,591: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:35:06.604853218Z [2024-03-29 02:35:06,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:06.683466127Z [2024-03-29 02:35:06,683: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:35:06.685956709Z [2024-03-29 02:35:06,685: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:06.686292852Z [2024-03-29 02:35:06,685: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:06.686537483Z [2024-03-29 02:35:06,686: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:06.686673591Z [2024-03-29 02:35:06,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:35:06.687144446Z [2024-03-29 02:35:06,686: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:35:06.687694314Z [2024-03-29 02:35:06,687: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:06.826297810Z [2024-03-29 02:35:06,825: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:07.572488673Z [2024-03-29 02:35:07,572: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6017129-afb8-4a78-93bf-c9dd5831c43e] succeeded in 2.8099543699991045s: None 2024-03-29T02:35:08.011609258Z [2024-03-29 02:35:08,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe630280-3657-40ab-87d1-d5a481dc57f3] received 2024-03-29T02:35:08.019820920Z [2024-03-29 02:35:08,019: INFO/ForkPoolWorker-15] [fe630280-3657-40ab-87d1-d5a481dc57f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:35:08.315143487Z [2024-03-29 02:35:08,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:35:09.471759573Z [2024-03-29 02:35:09,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:35:09.475097990Z [2024-03-29 02:35:09,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:09.492355957Z [2024-03-29 02:35:09,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:35:09.493792888Z [2024-03-29 02:35:09,493: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:09.493843511Z [2024-03-29 02:35:09,493: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:09.493974883Z [2024-03-29 02:35:09,493: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:09.494066267Z [2024-03-29 02:35:09,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:35:09.494590485Z [2024-03-29 02:35:09,494: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:35:09.494787988Z [2024-03-29 02:35:09,494: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:09.591178316Z [2024-03-29 02:35:09,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:10.120315014Z [2024-03-29 02:35:10,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe630280-3657-40ab-87d1-d5a481dc57f3] succeeded in 2.1070188089997828s: None 2024-03-29T02:35:10.974587348Z [2024-03-29 02:35:10,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e88968d-662b-4dc7-bcdc-c35b4499845b] received 2024-03-29T02:35:10.981272722Z [2024-03-29 02:35:10,980: INFO/ForkPoolWorker-15] [3e88968d-662b-4dc7-bcdc-c35b4499845b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:11.281022488Z [2024-03-29 02:35:11,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:35:12.412610756Z [2024-03-29 02:35:12,412: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:35:12.416089200Z [2024-03-29 02:35:12,415: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:35:12.437654402Z [2024-03-29 02:35:12,437: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:35:12.439523598Z [2024-03-29 02:35:12,439: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:35:12.439625032Z [2024-03-29 02:35:12,439: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:35:12.439868477Z [2024-03-29 02:35:12,439: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:35:12.439975856Z [2024-03-29 02:35:12,439: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:35:12.440364082Z [2024-03-29 02:35:12,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:35:12.440369481Z [2024-03-29 02:35:12,440: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:35:12.543832967Z [2024-03-29 02:35:12,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:35:13.080116639Z [2024-03-29 02:35:13,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e88968d-662b-4dc7-bcdc-c35b4499845b] succeeded in 2.103604752999672s: None 2024-03-29T02:36:00.351942440Z [2024-03-29 02:36:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94f7ca8e-cfaa-4abc-8e60-dc76dcba9e1a] received 2024-03-29T02:36:00.358437066Z [2024-03-29 02:36:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4df7b844-52d7-40e7-bb2c-2119c17b748c] received 2024-03-29T02:36:00.360324709Z [2024-03-29 02:36:00,360: INFO/ForkPoolWorker-15] [94f7ca8e-cfaa-4abc-8e60-dc76dcba9e1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:36:00.365069534Z [2024-03-29 02:36:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3f12f7f-fafa-4acf-8832-d35063e8eb86] received 2024-03-29T02:36:00.366968297Z [2024-03-29 02:36:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3d696f9-2399-4b0f-8b34-85dbba9038f8] received 2024-03-29T02:36:00.371466463Z [2024-03-29 02:36:00,371: INFO/ForkPoolWorker-16] [4df7b844-52d7-40e7-bb2c-2119c17b748c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:36:00.387227228Z [2024-03-29 02:36:00,386: INFO/ForkPoolWorker-1] [d3f12f7f-fafa-4acf-8832-d35063e8eb86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:36:00.398179655Z [2024-03-29 02:36:00,397: INFO/ForkPoolWorker-2] [c3d696f9-2399-4b0f-8b34-85dbba9038f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:36:00.728232496Z [2024-03-29 02:36:00,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:36:00.761035206Z [2024-03-29 02:36:00,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:36:00.851203749Z [2024-03-29 02:36:00,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:36:01.011673872Z [2024-03-29 02:36:01,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:36:01.028297140Z [2024-03-29 02:36:01,027: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:36:01.032561782Z [2024-03-29 02:36:01,032: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:36:01.062164652Z [2024-03-29 02:36:01,061: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:36:01.063761639Z [2024-03-29 02:36:01,063: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:36:01.063956732Z [2024-03-29 02:36:01,063: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:36:01.064073275Z [2024-03-29 02:36:01,063: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:36:01.064850317Z [2024-03-29 02:36:01,064: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:36:01.083830742Z [2024-03-29 02:36:01,079: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:36:01.179894044Z [2024-03-29 02:36:01,179: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:36:01.672919223Z [2024-03-29 02:36:01,672: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94f7ca8e-cfaa-4abc-8e60-dc76dcba9e1a] succeeded in 1.319331944001533s: None 2024-03-29T02:36:01.924826966Z [2024-03-29 02:36:01,924: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3d696f9-2399-4b0f-8b34-85dbba9038f8] succeeded in 1.548114744000486s: None 2024-03-29T02:36:02.339734014Z [2024-03-29 02:36:02,339: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:36:02.343548799Z [2024-03-29 02:36:02,343: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:36:02.365935996Z [2024-03-29 02:36:02,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:36:02.367543868Z [2024-03-29 02:36:02,367: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:36:02.367761665Z [2024-03-29 02:36:02,367: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:36:02.367971826Z [2024-03-29 02:36:02,367: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:36:02.368099047Z [2024-03-29 02:36:02,367: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:36:02.368471190Z [2024-03-29 02:36:02,368: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:36:02.368923648Z [2024-03-29 02:36:02,368: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:36:02.468583981Z [2024-03-29 02:36:02,468: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:36:02.606026154Z [2024-03-29 02:36:02,605: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:36:02.610631624Z [2024-03-29 02:36:02,610: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:36:02.644267551Z [2024-03-29 02:36:02,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:36:02.646157091Z [2024-03-29 02:36:02,645: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:36:02.646337917Z [2024-03-29 02:36:02,646: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:36:02.646783554Z [2024-03-29 02:36:02,646: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:36:02.646988281Z [2024-03-29 02:36:02,646: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:36:02.647623890Z [2024-03-29 02:36:02,647: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:36:02.647902893Z [2024-03-29 02:36:02,647: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:36:02.780760331Z [2024-03-29 02:36:02,780: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:36:04.513189447Z [2024-03-29 02:36:04,512: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3f12f7f-fafa-4acf-8832-d35063e8eb86] succeeded in 4.1358258400014165s: None 2024-03-29T02:36:04.672589879Z [2024-03-29 02:36:04,671: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4df7b844-52d7-40e7-bb2c-2119c17b748c] succeeded in 4.3112315379985375s: None 2024-03-29T02:37:01.270524043Z [2024-03-29 02:37:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f99acb0d-2e8e-4458-a923-7f8dd06c933f] received 2024-03-29T02:37:01.273692709Z [2024-03-29 02:37:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d742614b-241f-4fff-8fe8-e8999e7bd1ad] received 2024-03-29T02:37:01.275447187Z [2024-03-29 02:37:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc6b0c9a-f651-44d9-8c5f-21244f61e2d4] received 2024-03-29T02:37:01.287948757Z [2024-03-29 02:37:01,287: INFO/ForkPoolWorker-15] [f99acb0d-2e8e-4458-a923-7f8dd06c933f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:37:01.288772945Z [2024-03-29 02:37:01,288: INFO/ForkPoolWorker-16] [d742614b-241f-4fff-8fe8-e8999e7bd1ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:37:01.289064395Z [2024-03-29 02:37:01,288: INFO/ForkPoolWorker-1] [dc6b0c9a-f651-44d9-8c5f-21244f61e2d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:37:01.669949959Z [2024-03-29 02:37:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:37:01.716039925Z [2024-03-29 02:37:01,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:37:01.729991007Z [2024-03-29 02:37:01,725: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:37:01.939162933Z [2024-03-29 02:37:01,938: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:37:01.944033507Z [2024-03-29 02:37:01,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:37:01.966277002Z [2024-03-29 02:37:01,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:37:01.968018697Z [2024-03-29 02:37:01,967: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:37:01.968340089Z [2024-03-29 02:37:01,968: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:37:01.968549807Z [2024-03-29 02:37:01,968: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:37:01.968886674Z [2024-03-29 02:37:01,968: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:37:02.105545506Z [2024-03-29 02:37:02,105: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:37:02.843617960Z [2024-03-29 02:37:02,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f99acb0d-2e8e-4458-a923-7f8dd06c933f] succeeded in 1.5691803280005843s: None 2024-03-29T02:37:03.009567685Z [2024-03-29 02:37:03,009: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:37:03.013299706Z [2024-03-29 02:37:03,012: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:37:03.052962723Z [2024-03-29 02:37:03,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:37:03.054921950Z [2024-03-29 02:37:03,054: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:37:03.054989057Z [2024-03-29 02:37:03,054: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:37:03.055249195Z [2024-03-29 02:37:03,054: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:37:03.055292194Z [2024-03-29 02:37:03,055: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:37:03.055680745Z [2024-03-29 02:37:03,055: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:37:03.055730069Z [2024-03-29 02:37:03,055: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:37:03.133126528Z [2024-03-29 02:37:03,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:37:03.182013638Z [2024-03-29 02:37:03,181: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:37:03.185278609Z [2024-03-29 02:37:03,184: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:37:03.203634461Z [2024-03-29 02:37:03,203: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:37:03.204862226Z [2024-03-29 02:37:03,204: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:37:03.204875540Z [2024-03-29 02:37:03,204: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:37:03.205054107Z [2024-03-29 02:37:03,204: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:37:03.205091753Z [2024-03-29 02:37:03,205: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:37:03.205434183Z [2024-03-29 02:37:03,205: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:37:03.205439809Z [2024-03-29 02:37:03,205: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:37:03.287109100Z [2024-03-29 02:37:03,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:37:04.899608377Z [2024-03-29 02:37:04,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d742614b-241f-4fff-8fe8-e8999e7bd1ad] succeeded in 3.6195363019996876s: None 2024-03-29T02:37:05.257912298Z [2024-03-29 02:37:05,257: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc6b0c9a-f651-44d9-8c5f-21244f61e2d4] succeeded in 3.980719142999078s: None 2024-03-29T02:38:00.920797911Z [2024-03-29 02:38:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cba6b188-b287-4599-9c9d-b4648917ad63] received 2024-03-29T02:38:00.925525025Z [2024-03-29 02:38:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[979b1b6d-b150-4b7c-b67c-4d8e74e07944] received 2024-03-29T02:38:00.929036631Z [2024-03-29 02:38:00,928: INFO/ForkPoolWorker-15] [cba6b188-b287-4599-9c9d-b4648917ad63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:38:00.936110898Z [2024-03-29 02:38:00,935: INFO/ForkPoolWorker-16] [979b1b6d-b150-4b7c-b67c-4d8e74e07944] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:38:00.943427108Z [2024-03-29 02:38:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aeed2bc-055b-4ea7-98fd-100d576c98d8] received 2024-03-29T02:38:00.945418871Z [2024-03-29 02:38:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee177404-31d9-4440-942c-ce5e831ab966] received 2024-03-29T02:38:00.956789639Z [2024-03-29 02:38:00,956: INFO/ForkPoolWorker-2] [ee177404-31d9-4440-942c-ce5e831ab966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:38:00.957365613Z [2024-03-29 02:38:00,957: INFO/ForkPoolWorker-1] [2aeed2bc-055b-4ea7-98fd-100d576c98d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:38:01.328984018Z [2024-03-29 02:38:01,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:38:01.353502605Z [2024-03-29 02:38:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:38:01.486844525Z [2024-03-29 02:38:01,483: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:38:01.554948711Z [2024-03-29 02:38:01,549: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:38:01.695629453Z [2024-03-29 02:38:01,695: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:38:01.700195902Z [2024-03-29 02:38:01,699: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:38:01.735271617Z [2024-03-29 02:38:01,734: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:38:01.737812972Z [2024-03-29 02:38:01,737: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:38:01.738293903Z [2024-03-29 02:38:01,737: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:38:01.738618766Z [2024-03-29 02:38:01,738: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:38:01.739465637Z [2024-03-29 02:38:01,739: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:38:01.932435184Z [2024-03-29 02:38:01,931: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:38:02.087801070Z [2024-03-29 02:38:02,087: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:38:02.748849884Z [2024-03-29 02:38:02,748: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[979b1b6d-b150-4b7c-b67c-4d8e74e07944] succeeded in 1.8211667940013285s: None 2024-03-29T02:38:02.902133288Z [2024-03-29 02:38:02,901: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2aeed2bc-055b-4ea7-98fd-100d576c98d8] succeeded in 1.956817266998769s: None 2024-03-29T02:38:03.008626033Z [2024-03-29 02:38:03,008: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:38:03.012416540Z [2024-03-29 02:38:03,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:38:03.033270590Z [2024-03-29 02:38:03,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:38:03.034698860Z [2024-03-29 02:38:03,034: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:38:03.034714277Z [2024-03-29 02:38:03,034: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:38:03.034844928Z [2024-03-29 02:38:03,034: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:38:03.034898480Z [2024-03-29 02:38:03,034: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:38:03.035191518Z [2024-03-29 02:38:03,035: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:38:03.035207323Z [2024-03-29 02:38:03,035: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:38:03.060363411Z [2024-03-29 02:38:03,059: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:38:03.063978973Z [2024-03-29 02:38:03,063: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:38:03.084028833Z [2024-03-29 02:38:03,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:38:03.085351703Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:38:03.085367714Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:38:03.085591061Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:38:03.085603325Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:38:03.085933198Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:38:03.085966196Z [2024-03-29 02:38:03,085: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:38:03.131779028Z [2024-03-29 02:38:03,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:38:03.204770409Z [2024-03-29 02:38:03,204: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:38:06.102069873Z [2024-03-29 02:38:06,101: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ee177404-31d9-4440-942c-ce5e831ab966] succeeded in 5.1531799730000785s: None 2024-03-29T02:38:06.727292276Z [2024-03-29 02:38:06,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cba6b188-b287-4599-9c9d-b4648917ad63] succeeded in 5.80385434299933s: None 2024-03-29T02:39:00.705793358Z [2024-03-29 02:39:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b51782a1-6c20-46a1-b365-23e3c618449b] received 2024-03-29T02:39:00.707463784Z [2024-03-29 02:39:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86f30cca-ee88-4adf-9dbd-2da728ab0b6e] received 2024-03-29T02:39:00.715161683Z [2024-03-29 02:39:00,714: INFO/ForkPoolWorker-15] [b51782a1-6c20-46a1-b365-23e3c618449b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:39:00.715366906Z [2024-03-29 02:39:00,715: INFO/ForkPoolWorker-16] [86f30cca-ee88-4adf-9dbd-2da728ab0b6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:39:00.719970488Z [2024-03-29 02:39:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c132e175-7663-4d37-aaeb-cc77c4a21a10] received 2024-03-29T02:39:00.727418914Z [2024-03-29 02:39:00,727: INFO/ForkPoolWorker-1] [c132e175-7663-4d37-aaeb-cc77c4a21a10] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:39:01.061568988Z [2024-03-29 02:39:01,058: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:39:01.121985196Z [2024-03-29 02:39:01,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:39:01.219811693Z [2024-03-29 02:39:01,216: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:39:01.242816105Z [2024-03-29 02:39:01,242: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:39:01.249626499Z [2024-03-29 02:39:01,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:39:01.301965984Z [2024-03-29 02:39:01,301: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:39:01.303957767Z [2024-03-29 02:39:01,303: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:39:01.304047577Z [2024-03-29 02:39:01,303: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:39:01.304121253Z [2024-03-29 02:39:01,304: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:39:01.304360267Z [2024-03-29 02:39:01,304: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:39:01.477631022Z [2024-03-29 02:39:01,477: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:39:02.329910681Z [2024-03-29 02:39:02,329: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c132e175-7663-4d37-aaeb-cc77c4a21a10] succeeded in 1.608113266998771s: None 2024-03-29T02:39:02.710090865Z [2024-03-29 02:39:02,709: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:39:02.716964398Z [2024-03-29 02:39:02,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:39:02.751470047Z [2024-03-29 02:39:02,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:39:02.753818222Z [2024-03-29 02:39:02,753: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:39:02.754354951Z [2024-03-29 02:39:02,754: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:39:02.754917417Z [2024-03-29 02:39:02,754: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:39:02.755285727Z [2024-03-29 02:39:02,755: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:39:02.757764770Z [2024-03-29 02:39:02,757: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:39:02.758133879Z [2024-03-29 02:39:02,757: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:39:02.806071072Z [2024-03-29 02:39:02,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:39:02.809601255Z [2024-03-29 02:39:02,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:39:02.831765101Z [2024-03-29 02:39:02,831: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:39:02.833113020Z [2024-03-29 02:39:02,832: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:39:02.833131402Z [2024-03-29 02:39:02,832: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:39:02.833250028Z [2024-03-29 02:39:02,833: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:39:02.833259262Z [2024-03-29 02:39:02,833: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:39:02.833555918Z [2024-03-29 02:39:02,833: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:39:02.833593545Z [2024-03-29 02:39:02,833: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:39:02.881149714Z [2024-03-29 02:39:02,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:39:02.920861009Z [2024-03-29 02:39:02,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:39:04.710615483Z [2024-03-29 02:39:04,710: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86f30cca-ee88-4adf-9dbd-2da728ab0b6e] succeeded in 4.000697057001162s: None 2024-03-29T02:39:05.166600085Z [2024-03-29 02:39:05,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b51782a1-6c20-46a1-b365-23e3c618449b] succeeded in 4.457521173000714s: None 2024-03-29T02:40:00.326158162Z [2024-03-29 02:40:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7adcbc6e-3a62-48a8-969d-d1f97194fcfa] received 2024-03-29T02:40:00.331118903Z [2024-03-29 02:40:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567324d0-90ff-4642-9a65-0ae2b6dc5cc8] received 2024-03-29T02:40:00.334001981Z [2024-03-29 02:40:00,333: INFO/ForkPoolWorker-15] [7adcbc6e-3a62-48a8-969d-d1f97194fcfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:00.341373899Z [2024-03-29 02:40:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[659e92c6-e945-4972-bdb5-b8307d72d4d3] received 2024-03-29T02:40:00.342372643Z [2024-03-29 02:40:00,342: INFO/ForkPoolWorker-16] [567324d0-90ff-4642-9a65-0ae2b6dc5cc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:40:00.351884110Z [2024-03-29 02:40:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da5da357-252e-49db-9d1d-a3dfb513632e] received 2024-03-29T02:40:00.354297539Z [2024-03-29 02:40:00,353: INFO/ForkPoolWorker-1] [659e92c6-e945-4972-bdb5-b8307d72d4d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:40:00.357250061Z [2024-03-29 02:40:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a7c55f5-5fac-4aa4-a571-7fa8631842c9] received 2024-03-29T02:40:00.390592429Z [2024-03-29 02:40:00,388: INFO/ForkPoolWorker-3] [7a7c55f5-5fac-4aa4-a571-7fa8631842c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:40:00.399257667Z [2024-03-29 02:40:00,398: INFO/ForkPoolWorker-2] [da5da357-252e-49db-9d1d-a3dfb513632e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:40:00.773661031Z [2024-03-29 02:40:00,770: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:40:00.784517696Z [2024-03-29 02:40:00,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:40:00.980354974Z [2024-03-29 02:40:00,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:40:01.087399838Z [2024-03-29 02:40:01,083: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:40:01.286331233Z [2024-03-29 02:40:01,285: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T02:40:01.291155503Z [2024-03-29 02:40:01,290: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:01.300694299Z [2024-03-29 02:40:01,291: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:40:01.340413395Z [2024-03-29 02:40:01,340: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:40:01.343312276Z [2024-03-29 02:40:01,343: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:40:01.343516416Z [2024-03-29 02:40:01,343: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:40:01.343661891Z [2024-03-29 02:40:01,343: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T02:40:01.343958576Z [2024-03-29 02:40:01,343: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:40:01.460930843Z [2024-03-29 02:40:01,460: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:01.777218839Z [2024-03-29 02:40:01,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:03.242086459Z [2024-03-29 02:40:03,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[567324d0-90ff-4642-9a65-0ae2b6dc5cc8] succeeded in 2.9093447219984228s: None 2024-03-29T02:40:03.399914138Z [2024-03-29 02:40:03,399: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7a7c55f5-5fac-4aa4-a571-7fa8631842c9] succeeded in 3.0348862539995025s: None 2024-03-29T02:40:03.443789901Z [2024-03-29 02:40:03,443: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:40:03.448579966Z [2024-03-29 02:40:03,448: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:03.490816972Z [2024-03-29 02:40:03,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:40:03.498829040Z [2024-03-29 02:40:03,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:03.527066843Z [2024-03-29 02:40:03,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:40:03.538922329Z [2024-03-29 02:40:03,538: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:03.539779810Z [2024-03-29 02:40:03,539: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:40:03.543518997Z [2024-03-29 02:40:03,542: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:03.549558584Z [2024-03-29 02:40:03,549: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:03.549993479Z [2024-03-29 02:40:03,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:40:03.550659913Z [2024-03-29 02:40:03,549: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:03.552586653Z [2024-03-29 02:40:03,552: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:40:03.552850838Z [2024-03-29 02:40:03,552: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:40:03.552863615Z [2024-03-29 02:40:03,552: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:03.553200704Z [2024-03-29 02:40:03,552: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:03.553213953Z [2024-03-29 02:40:03,553: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:03.553390978Z [2024-03-29 02:40:03,553: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:03.553403319Z [2024-03-29 02:40:03,553: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:40:03.553730011Z [2024-03-29 02:40:03,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:40:03.553755471Z [2024-03-29 02:40:03,553: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:03.607319915Z [2024-03-29 02:40:03,607: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:40:03.608631915Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:03.608646732Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:03.608754960Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:03.608765088Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:40:03.609088340Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:40:03.609114213Z [2024-03-29 02:40:03,608: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:03.730851169Z [2024-03-29 02:40:03,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:03.772997312Z [2024-03-29 02:40:03,772: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:03.799804970Z [2024-03-29 02:40:03,799: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:04.689001560Z [2024-03-29 02:40:04,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7adcbc6e-3a62-48a8-969d-d1f97194fcfa] succeeded in 4.357475613000133s: None 2024-03-29T02:40:05.578737839Z [2024-03-29 02:40:05,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00970c1-02a2-413c-9cf0-36aa6cdc69ec] received 2024-03-29T02:40:05.597600119Z [2024-03-29 02:40:05,597: INFO/ForkPoolWorker-15] [b00970c1-02a2-413c-9cf0-36aa6cdc69ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:05.755674877Z [2024-03-29 02:40:05,755: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da5da357-252e-49db-9d1d-a3dfb513632e] succeeded in 5.400158286000078s: None 2024-03-29T02:40:06.289340393Z [2024-03-29 02:40:06,284: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:40:06.356689891Z [2024-03-29 02:40:06,356: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[659e92c6-e945-4972-bdb5-b8307d72d4d3] succeeded in 6.00871184800053s: None 2024-03-29T02:40:07.861552677Z [2024-03-29 02:40:07,861: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:40:07.869652193Z [2024-03-29 02:40:07,868: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:07.920241549Z [2024-03-29 02:40:07,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:40:07.923327109Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:07.923365573Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:07.923418996Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:07.923451566Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:40:07.923772530Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:40:07.923786176Z [2024-03-29 02:40:07,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:08.063185476Z [2024-03-29 02:40:08,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:08.921234841Z [2024-03-29 02:40:08,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b00970c1-02a2-413c-9cf0-36aa6cdc69ec] succeeded in 3.3407378859992605s: None 2024-03-29T02:40:09.215907015Z [2024-03-29 02:40:09,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0310f1ec-d48c-477e-96ac-bf58cde1d593] received 2024-03-29T02:40:09.226089476Z [2024-03-29 02:40:09,225: INFO/ForkPoolWorker-15] [0310f1ec-d48c-477e-96ac-bf58cde1d593] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:40:09.547748316Z [2024-03-29 02:40:09,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:40:10.864468483Z [2024-03-29 02:40:10,864: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:40:10.868002706Z [2024-03-29 02:40:10,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:10.907633182Z [2024-03-29 02:40:10,907: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:40:10.910371848Z [2024-03-29 02:40:10,910: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:10.910635635Z [2024-03-29 02:40:10,910: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:10.911028994Z [2024-03-29 02:40:10,910: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:10.911205823Z [2024-03-29 02:40:10,910: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:40:10.911583729Z [2024-03-29 02:40:10,911: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:40:10.911761143Z [2024-03-29 02:40:10,911: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:11.018365882Z [2024-03-29 02:40:11,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:11.623142508Z [2024-03-29 02:40:11,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a6e4202-05f3-45f9-998d-a9719b3b7a4c] received 2024-03-29T02:40:11.640614747Z [2024-03-29 02:40:11,640: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0310f1ec-d48c-477e-96ac-bf58cde1d593] succeeded in 2.4223814439992566s: None 2024-03-29T02:40:11.645919475Z [2024-03-29 02:40:11,645: INFO/ForkPoolWorker-16] [5a6e4202-05f3-45f9-998d-a9719b3b7a4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:12.037686112Z [2024-03-29 02:40:12,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:40:13.307537991Z [2024-03-29 02:40:13,307: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:40:13.310993328Z [2024-03-29 02:40:13,310: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:40:13.330050060Z [2024-03-29 02:40:13,329: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:40:13.331279679Z [2024-03-29 02:40:13,331: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:40:13.331414902Z [2024-03-29 02:40:13,331: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:40:13.331602697Z [2024-03-29 02:40:13,331: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:40:13.331716482Z [2024-03-29 02:40:13,331: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:40:13.332184811Z [2024-03-29 02:40:13,331: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:40:13.332330707Z [2024-03-29 02:40:13,332: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:40:13.414429414Z [2024-03-29 02:40:13,414: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:40:13.952592792Z [2024-03-29 02:40:13,951: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a6e4202-05f3-45f9-998d-a9719b3b7a4c] succeeded in 2.319403888999659s: None 2024-03-29T02:41:00.548498245Z [2024-03-29 02:41:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dce7b53-1c7b-4fee-b80d-03f7e81433f4] received 2024-03-29T02:41:00.551371134Z [2024-03-29 02:41:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf08b670-9818-4fb9-bf9c-e8c48a377d1b] received 2024-03-29T02:41:00.556167368Z [2024-03-29 02:41:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abc59439-399b-4dd8-80eb-88abc76157f2] received 2024-03-29T02:41:00.560338138Z [2024-03-29 02:41:00,560: INFO/ForkPoolWorker-16] [cf08b670-9818-4fb9-bf9c-e8c48a377d1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:41:00.568570656Z [2024-03-29 02:41:00,568: INFO/ForkPoolWorker-1] [abc59439-399b-4dd8-80eb-88abc76157f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:41:00.569647979Z [2024-03-29 02:41:00,569: INFO/ForkPoolWorker-15] [6dce7b53-1c7b-4fee-b80d-03f7e81433f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:41:00.892648627Z [2024-03-29 02:41:00,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:41:00.925754525Z [2024-03-29 02:41:00,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:41:00.966928440Z [2024-03-29 02:41:00,962: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:41:01.144343043Z [2024-03-29 02:41:01,143: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:41:01.148721574Z [2024-03-29 02:41:01,148: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:41:01.177130600Z [2024-03-29 02:41:01,176: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:41:01.178055108Z [2024-03-29 02:41:01,177: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:41:01.178173668Z [2024-03-29 02:41:01,177: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:41:01.178216442Z [2024-03-29 02:41:01,178: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:41:01.178478999Z [2024-03-29 02:41:01,178: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:41:01.297911608Z [2024-03-29 02:41:01,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:41:02.103849289Z [2024-03-29 02:41:02,103: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abc59439-399b-4dd8-80eb-88abc76157f2] succeeded in 1.5447488160007197s: None 2024-03-29T02:41:02.165473780Z [2024-03-29 02:41:02,165: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:41:02.169612559Z [2024-03-29 02:41:02,168: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:41:02.196948749Z [2024-03-29 02:41:02,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:41:02.199050566Z [2024-03-29 02:41:02,198: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:41:02.199447697Z [2024-03-29 02:41:02,199: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:41:02.199838795Z [2024-03-29 02:41:02,199: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:41:02.200105959Z [2024-03-29 02:41:02,199: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:41:02.200564382Z [2024-03-29 02:41:02,200: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:41:02.200768188Z [2024-03-29 02:41:02,200: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:41:02.298769120Z [2024-03-29 02:41:02,298: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:41:02.311336573Z [2024-03-29 02:41:02,310: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:41:02.315521784Z [2024-03-29 02:41:02,314: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:41:02.342755130Z [2024-03-29 02:41:02,342: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:41:02.344819421Z [2024-03-29 02:41:02,344: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:41:02.344901707Z [2024-03-29 02:41:02,344: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:41:02.345176389Z [2024-03-29 02:41:02,344: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:41:02.345292045Z [2024-03-29 02:41:02,345: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:41:02.345894260Z [2024-03-29 02:41:02,345: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:41:02.346023398Z [2024-03-29 02:41:02,345: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:41:02.441565267Z [2024-03-29 02:41:02,441: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:41:03.946579821Z [2024-03-29 02:41:03,946: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf08b670-9818-4fb9-bf9c-e8c48a377d1b] succeeded in 3.3925598229998286s: None 2024-03-29T02:41:04.956697687Z [2024-03-29 02:41:04,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6dce7b53-1c7b-4fee-b80d-03f7e81433f4] succeeded in 4.404022544000327s: None 2024-03-29T02:42:01.256080506Z [2024-03-29 02:42:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4daedf13-6704-4bba-9eba-1a1fba11a3f5] received 2024-03-29T02:42:01.260744283Z [2024-03-29 02:42:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff74cc8a-ea54-4581-98a6-9fc9b54f3c31] received 2024-03-29T02:42:01.264881187Z [2024-03-29 02:42:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06df1fdd-9c64-46f0-b385-b3f9bba923be] received 2024-03-29T02:42:01.265479391Z [2024-03-29 02:42:01,265: INFO/ForkPoolWorker-15] [4daedf13-6704-4bba-9eba-1a1fba11a3f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:42:01.268784239Z [2024-03-29 02:42:01,268: INFO/ForkPoolWorker-16] [ff74cc8a-ea54-4581-98a6-9fc9b54f3c31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:42:01.271328043Z [2024-03-29 02:42:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13ad1b5c-4268-4cb9-ac9d-ceaded08e2ff] received 2024-03-29T02:42:01.283243983Z [2024-03-29 02:42:01,282: INFO/ForkPoolWorker-1] [06df1fdd-9c64-46f0-b385-b3f9bba923be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:42:01.292514520Z [2024-03-29 02:42:01,291: INFO/ForkPoolWorker-2] [13ad1b5c-4268-4cb9-ac9d-ceaded08e2ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:42:01.584895185Z [2024-03-29 02:42:01,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:42:01.599986152Z [2024-03-29 02:42:01,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:42:01.619372794Z [2024-03-29 02:42:01,615: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:42:01.660916500Z [2024-03-29 02:42:01,657: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:42:01.834466274Z [2024-03-29 02:42:01,834: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:42:01.856038855Z [2024-03-29 02:42:01,855: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:42:01.893518502Z [2024-03-29 02:42:01,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:42:01.912655268Z [2024-03-29 02:42:01,912: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:42:01.917797278Z [2024-03-29 02:42:01,917: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:42:01.918040934Z [2024-03-29 02:42:01,917: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:42:01.918244216Z [2024-03-29 02:42:01,918: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:42:01.918955829Z [2024-03-29 02:42:01,918: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:42:02.054308648Z [2024-03-29 02:42:02,053: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:42:02.465071738Z [2024-03-29 02:42:02,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4daedf13-6704-4bba-9eba-1a1fba11a3f5] succeeded in 1.2064758310007164s: None 2024-03-29T02:42:02.754119596Z [2024-03-29 02:42:02,753: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[13ad1b5c-4268-4cb9-ac9d-ceaded08e2ff] succeeded in 1.475842765001289s: None 2024-03-29T02:42:03.031182260Z [2024-03-29 02:42:03,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:42:03.034661434Z [2024-03-29 02:42:03,034: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:42:03.058890362Z [2024-03-29 02:42:03,058: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:42:03.060310099Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:42:03.060326436Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:42:03.060411229Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:42:03.060467475Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:42:03.060723931Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:42:03.060733887Z [2024-03-29 02:42:03,060: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:42:03.131266819Z [2024-03-29 02:42:03,130: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:42:03.134961776Z [2024-03-29 02:42:03,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:42:03.156928237Z [2024-03-29 02:42:03,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:42:03.175396703Z [2024-03-29 02:42:03,175: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:42:03.179780849Z [2024-03-29 02:42:03,179: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:42:03.182972627Z [2024-03-29 02:42:03,182: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:42:03.183281462Z [2024-03-29 02:42:03,182: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:42:03.183319872Z [2024-03-29 02:42:03,183: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:42:03.183739080Z [2024-03-29 02:42:03,183: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:42:03.185030478Z [2024-03-29 02:42:03,184: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:42:03.301335798Z [2024-03-29 02:42:03,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:42:05.213396604Z [2024-03-29 02:42:05,212: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06df1fdd-9c64-46f0-b385-b3f9bba923be] succeeded in 3.9441077659994335s: None 2024-03-29T02:42:05.578572216Z [2024-03-29 02:42:05,578: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff74cc8a-ea54-4581-98a6-9fc9b54f3c31] succeeded in 4.315317102000336s: None 2024-03-29T02:43:00.956158599Z [2024-03-29 02:43:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20630ff1-0379-4f2e-8a25-f01bfab6726e] received 2024-03-29T02:43:00.960349843Z [2024-03-29 02:43:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6db992a7-978a-43ba-8dce-5bd06b8c28c4] received 2024-03-29T02:43:00.972509631Z [2024-03-29 02:43:00,972: INFO/ForkPoolWorker-15] [20630ff1-0379-4f2e-8a25-f01bfab6726e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:43:00.973189810Z [2024-03-29 02:43:00,972: INFO/ForkPoolWorker-16] [6db992a7-978a-43ba-8dce-5bd06b8c28c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:43:00.984298539Z [2024-03-29 02:43:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab9b4f2-b45e-4178-a6be-109b5f5cbd95] received 2024-03-29T02:43:00.992202430Z [2024-03-29 02:43:00,991: INFO/ForkPoolWorker-1] [4ab9b4f2-b45e-4178-a6be-109b5f5cbd95] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:43:01.307947831Z [2024-03-29 02:43:01,304: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:43:01.331075686Z [2024-03-29 02:43:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:43:01.356281424Z [2024-03-29 02:43:01,352: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:43:01.546936694Z [2024-03-29 02:43:01,546: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:43:01.551657805Z [2024-03-29 02:43:01,551: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:43:01.583747122Z [2024-03-29 02:43:01,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:43:01.585029228Z [2024-03-29 02:43:01,584: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:43:01.585086868Z [2024-03-29 02:43:01,584: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:43:01.585145756Z [2024-03-29 02:43:01,585: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:43:01.585433680Z [2024-03-29 02:43:01,585: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:43:01.714354759Z [2024-03-29 02:43:01,714: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:43:02.410283643Z [2024-03-29 02:43:02,409: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ab9b4f2-b45e-4178-a6be-109b5f5cbd95] succeeded in 1.4241838979996828s: None 2024-03-29T02:43:02.564411589Z [2024-03-29 02:43:02,563: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:43:02.568083596Z [2024-03-29 02:43:02,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:43:02.591616372Z [2024-03-29 02:43:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:43:02.593257874Z [2024-03-29 02:43:02,592: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:43:02.593493305Z [2024-03-29 02:43:02,593: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:43:02.593835326Z [2024-03-29 02:43:02,593: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:43:02.594079579Z [2024-03-29 02:43:02,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:43:02.594619084Z [2024-03-29 02:43:02,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:43:02.594813886Z [2024-03-29 02:43:02,594: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:43:02.651724240Z [2024-03-29 02:43:02,651: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:43:02.655772195Z [2024-03-29 02:43:02,655: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:43:02.681738024Z [2024-03-29 02:43:02,681: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:43:02.683596117Z [2024-03-29 02:43:02,683: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:43:02.683727915Z [2024-03-29 02:43:02,683: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:43:02.683975815Z [2024-03-29 02:43:02,683: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:43:02.684227535Z [2024-03-29 02:43:02,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:43:02.685045646Z [2024-03-29 02:43:02,684: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:43:02.685534018Z [2024-03-29 02:43:02,685: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:43:02.690868792Z [2024-03-29 02:43:02,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:43:02.784243464Z [2024-03-29 02:43:02,783: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:43:04.581472531Z [2024-03-29 02:43:04,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6db992a7-978a-43ba-8dce-5bd06b8c28c4] succeeded in 3.6162457749996975s: None 2024-03-29T02:43:05.277895190Z [2024-03-29 02:43:05,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20630ff1-0379-4f2e-8a25-f01bfab6726e] succeeded in 4.315121409999847s: None 2024-03-29T02:44:00.746152182Z [2024-03-29 02:44:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a91977f1-b13b-4edf-8ee6-3339905e234f] received 2024-03-29T02:44:00.749165336Z [2024-03-29 02:44:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9934487a-537a-4624-a8be-ba5bbbdc9303] received 2024-03-29T02:44:00.757773104Z [2024-03-29 02:44:00,757: INFO/ForkPoolWorker-16] [9934487a-537a-4624-a8be-ba5bbbdc9303] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:44:00.763172824Z [2024-03-29 02:44:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed140e58-9743-478d-a102-59c35cee9350] received 2024-03-29T02:44:00.765305493Z [2024-03-29 02:44:00,764: INFO/ForkPoolWorker-15] [a91977f1-b13b-4edf-8ee6-3339905e234f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:44:00.775170357Z [2024-03-29 02:44:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8aae89f-fc09-477c-9b86-18a58dfdfbb5] received 2024-03-29T02:44:00.777823345Z [2024-03-29 02:44:00,777: INFO/ForkPoolWorker-1] [ed140e58-9743-478d-a102-59c35cee9350] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:44:00.805063076Z [2024-03-29 02:44:00,804: INFO/ForkPoolWorker-2] [f8aae89f-fc09-477c-9b86-18a58dfdfbb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:44:01.133375420Z [2024-03-29 02:44:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:44:01.184493410Z [2024-03-29 02:44:01,181: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:44:01.195232253Z [2024-03-29 02:44:01,191: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:44:01.358341519Z [2024-03-29 02:44:01,353: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:44:01.610765338Z [2024-03-29 02:44:01,609: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:44:01.624449393Z [2024-03-29 02:44:01,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:44:01.736122888Z [2024-03-29 02:44:01,730: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:44:01.756187289Z [2024-03-29 02:44:01,755: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:44:01.759696117Z [2024-03-29 02:44:01,756: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:44:01.763140077Z [2024-03-29 02:44:01,759: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:44:01.769720931Z [2024-03-29 02:44:01,764: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:44:01.887250890Z [2024-03-29 02:44:01,886: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:44:01.981746102Z [2024-03-29 02:44:01,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:44:02.637119330Z [2024-03-29 02:44:02,636: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:44:02.642714022Z [2024-03-29 02:44:02,641: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:44:02.685218903Z [2024-03-29 02:44:02,684: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:44:02.687317810Z [2024-03-29 02:44:02,686: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:44:02.687580980Z [2024-03-29 02:44:02,687: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:44:02.687874582Z [2024-03-29 02:44:02,687: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:44:02.688068298Z [2024-03-29 02:44:02,687: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:44:02.688532456Z [2024-03-29 02:44:02,688: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:44:02.689176254Z [2024-03-29 02:44:02,688: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:44:02.861329920Z [2024-03-29 02:44:02,860: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:44:02.877577913Z [2024-03-29 02:44:02,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed140e58-9743-478d-a102-59c35cee9350] succeeded in 2.111845072999131s: None 2024-03-29T02:44:02.892825582Z [2024-03-29 02:44:02,891: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9934487a-537a-4624-a8be-ba5bbbdc9303] succeeded in 2.140510811999775s: None 2024-03-29T02:44:02.975035860Z [2024-03-29 02:44:02,974: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:44:02.978786833Z [2024-03-29 02:44:02,978: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:44:03.009528046Z [2024-03-29 02:44:03,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:44:03.012016137Z [2024-03-29 02:44:03,011: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:44:03.012290983Z [2024-03-29 02:44:03,011: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:44:03.012681615Z [2024-03-29 02:44:03,012: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:44:03.012945629Z [2024-03-29 02:44:03,012: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:44:03.013704196Z [2024-03-29 02:44:03,013: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:44:03.013972670Z [2024-03-29 02:44:03,013: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:44:03.140588598Z [2024-03-29 02:44:03,140: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:44:04.780970163Z [2024-03-29 02:44:04,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a91977f1-b13b-4edf-8ee6-3339905e234f] succeeded in 4.030098804001682s: None 2024-03-29T02:44:05.543155076Z [2024-03-29 02:44:05,542: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f8aae89f-fc09-477c-9b86-18a58dfdfbb5] succeeded in 4.755460857999424s: None 2024-03-29T02:45:00.363257720Z [2024-03-29 02:45:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5a8aabc-dfdc-4627-b39c-ecec2009ac6c] received 2024-03-29T02:45:00.373763729Z [2024-03-29 02:45:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5504566-2e1b-4aa7-91b8-914de21dfbaa] received 2024-03-29T02:45:00.378414428Z [2024-03-29 02:45:00,377: INFO/ForkPoolWorker-15] [e5a8aabc-dfdc-4627-b39c-ecec2009ac6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:45:00.378591663Z [2024-03-29 02:45:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59a559c3-874d-4fac-b34e-48bdf7fd169f] received 2024-03-29T02:45:00.387781506Z [2024-03-29 02:45:00,387: INFO/ForkPoolWorker-1] [59a559c3-874d-4fac-b34e-48bdf7fd169f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:00.388995544Z [2024-03-29 02:45:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5b520c0-d17b-456d-b218-3fa842346589] received 2024-03-29T02:45:00.398302791Z [2024-03-29 02:45:00,397: INFO/ForkPoolWorker-16] [b5504566-2e1b-4aa7-91b8-914de21dfbaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:45:00.408180793Z [2024-03-29 02:45:00,407: INFO/ForkPoolWorker-2] [d5b520c0-d17b-456d-b218-3fa842346589] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:45:00.796848583Z [2024-03-29 02:45:00,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:45:00.856221654Z [2024-03-29 02:45:00,853: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:45:01.065091416Z [2024-03-29 02:45:01,064: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:45:01.072572115Z [2024-03-29 02:45:01,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:01.103204047Z [2024-03-29 02:45:01,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:45:01.104671914Z [2024-03-29 02:45:01,104: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:45:01.104958887Z [2024-03-29 02:45:01,104: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:45:01.105133323Z [2024-03-29 02:45:01,104: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:45:01.105412193Z [2024-03-29 02:45:01,105: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:45:01.113541921Z [2024-03-29 02:45:01,107: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:45:01.122192404Z [2024-03-29 02:45:01,115: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:45:01.280406924Z [2024-03-29 02:45:01,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:02.563806650Z [2024-03-29 02:45:02,563: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5504566-2e1b-4aa7-91b8-914de21dfbaa] succeeded in 2.187928446999649s: None 2024-03-29T02:45:03.164021780Z [2024-03-29 02:45:03,163: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:45:03.170158534Z [2024-03-29 02:45:03,169: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:03.233414451Z [2024-03-29 02:45:03,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:45:03.236386730Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:03.236409103Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:03.236490353Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:03.236528074Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:45:03.238960961Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:45:03.238980842Z [2024-03-29 02:45:03,236: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:03.437639742Z [2024-03-29 02:45:03,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:03.495249582Z [2024-03-29 02:45:03,494: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:45:03.499882162Z [2024-03-29 02:45:03,499: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:03.554641373Z [2024-03-29 02:45:03,554: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:45:03.558615015Z [2024-03-29 02:45:03,558: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:03.558811124Z [2024-03-29 02:45:03,558: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:03.559142690Z [2024-03-29 02:45:03,558: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:03.559330061Z [2024-03-29 02:45:03,559: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:45:03.559745681Z [2024-03-29 02:45:03,559: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:45:03.559995357Z [2024-03-29 02:45:03,559: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:03.624361691Z [2024-03-29 02:45:03,623: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:45:03.629491012Z [2024-03-29 02:45:03,628: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:03.673579825Z [2024-03-29 02:45:03,673: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:45:03.678698073Z [2024-03-29 02:45:03,676: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:03.681689765Z [2024-03-29 02:45:03,679: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:03.681704462Z [2024-03-29 02:45:03,679: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:03.681709573Z [2024-03-29 02:45:03,679: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:03.681714083Z [2024-03-29 02:45:03,679: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:45:03.681717492Z [2024-03-29 02:45:03,679: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:45:03.681721914Z [2024-03-29 02:45:03,680: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:03.844208319Z [2024-03-29 02:45:03,843: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:04.883485663Z [2024-03-29 02:45:04,883: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59a559c3-874d-4fac-b34e-48bdf7fd169f] succeeded in 4.503280019998783s: None 2024-03-29T02:45:05.316003298Z [2024-03-29 02:45:05,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2410c9d-0896-4604-a748-d2e5140cb4af] received 2024-03-29T02:45:05.369866252Z [2024-03-29 02:45:05,366: INFO/ForkPoolWorker-16] [f2410c9d-0896-4604-a748-d2e5140cb4af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:05.586852491Z [2024-03-29 02:45:05,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5a8aabc-dfdc-4627-b39c-ecec2009ac6c] succeeded in 5.221922976001224s: None 2024-03-29T02:45:06.125337885Z [2024-03-29 02:45:06,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:45:06.903742983Z [2024-03-29 02:45:06,903: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5b520c0-d17b-456d-b218-3fa842346589] succeeded in 6.505743415000325s: None 2024-03-29T02:45:08.373545452Z [2024-03-29 02:45:08,373: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:45:08.376859393Z [2024-03-29 02:45:08,376: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:08.400095102Z [2024-03-29 02:45:08,399: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:45:08.401577956Z [2024-03-29 02:45:08,401: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:08.401749209Z [2024-03-29 02:45:08,401: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:08.401961056Z [2024-03-29 02:45:08,401: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:08.401991943Z [2024-03-29 02:45:08,401: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:45:08.402329243Z [2024-03-29 02:45:08,402: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:45:08.402530169Z [2024-03-29 02:45:08,402: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:08.552505241Z [2024-03-29 02:45:08,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:09.664043635Z [2024-03-29 02:45:09,663: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2410c9d-0896-4604-a748-d2e5140cb4af] succeeded in 4.344612712000526s: None 2024-03-29T02:45:09.866522886Z [2024-03-29 02:45:09,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78059489-eeed-4060-8f8c-0310aca0b1cb] received 2024-03-29T02:45:09.878300175Z [2024-03-29 02:45:09,877: INFO/ForkPoolWorker-15] [78059489-eeed-4060-8f8c-0310aca0b1cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:45:10.172424163Z [2024-03-29 02:45:10,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:45:11.372599554Z [2024-03-29 02:45:11,372: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:45:11.375936623Z [2024-03-29 02:45:11,375: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:11.395121112Z [2024-03-29 02:45:11,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:45:11.396514580Z [2024-03-29 02:45:11,396: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:11.396625645Z [2024-03-29 02:45:11,396: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:11.396768004Z [2024-03-29 02:45:11,396: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:11.396822805Z [2024-03-29 02:45:11,396: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:45:11.397081409Z [2024-03-29 02:45:11,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:45:11.397308808Z [2024-03-29 02:45:11,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:11.476170273Z [2024-03-29 02:45:11,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:12.050677205Z [2024-03-29 02:45:12,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78059489-eeed-4060-8f8c-0310aca0b1cb] succeeded in 2.1822678679982346s: None 2024-03-29T02:45:12.658852844Z [2024-03-29 02:45:12,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf964754-1e2e-4ed5-adcb-1464e3178d7f] received 2024-03-29T02:45:12.669644603Z [2024-03-29 02:45:12,669: INFO/ForkPoolWorker-15] [bf964754-1e2e-4ed5-adcb-1464e3178d7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:13.022539219Z [2024-03-29 02:45:13,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:45:14.304111729Z [2024-03-29 02:45:14,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:45:14.308360918Z [2024-03-29 02:45:14,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:45:14.328643856Z [2024-03-29 02:45:14,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:45:14.329984488Z [2024-03-29 02:45:14,329: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:45:14.329997068Z [2024-03-29 02:45:14,329: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:45:14.330137278Z [2024-03-29 02:45:14,329: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:45:14.330166244Z [2024-03-29 02:45:14,330: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:45:14.330511171Z [2024-03-29 02:45:14,330: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:45:14.330521579Z [2024-03-29 02:45:14,330: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:45:14.437285002Z [2024-03-29 02:45:14,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:45:15.108792472Z [2024-03-29 02:45:15,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf964754-1e2e-4ed5-adcb-1464e3178d7f] succeeded in 2.4464484469990566s: None 2024-03-29T02:46:00.599960447Z [2024-03-29 02:46:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5056f114-0e72-433a-80f3-e99f37d466ea] received 2024-03-29T02:46:00.602997961Z [2024-03-29 02:46:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a66c32b-5772-4010-a6d6-c09a3641c421] received 2024-03-29T02:46:00.605144388Z [2024-03-29 02:46:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51e7aefb-55ee-4b40-ad4a-b177fa8a8d71] received 2024-03-29T02:46:00.608000308Z [2024-03-29 02:46:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b3450e-c18f-4e0b-a251-f2d195abf756] received 2024-03-29T02:46:00.614581327Z [2024-03-29 02:46:00,614: INFO/ForkPoolWorker-15] [5056f114-0e72-433a-80f3-e99f37d466ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:46:00.618591312Z [2024-03-29 02:46:00,618: INFO/ForkPoolWorker-1] [51e7aefb-55ee-4b40-ad4a-b177fa8a8d71] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:46:00.619033736Z [2024-03-29 02:46:00,618: INFO/ForkPoolWorker-2] [78b3450e-c18f-4e0b-a251-f2d195abf756] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:46:00.619580069Z [2024-03-29 02:46:00,619: INFO/ForkPoolWorker-16] [9a66c32b-5772-4010-a6d6-c09a3641c421] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:46:01.008264826Z [2024-03-29 02:46:01,004: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:46:01.322550088Z [2024-03-29 02:46:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:46:01.346039480Z [2024-03-29 02:46:01,345: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:46:01.462478972Z [2024-03-29 02:46:01,453: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:46:01.517315137Z [2024-03-29 02:46:01,513: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:46:01.995492662Z [2024-03-29 02:46:01,994: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:46:02.015184629Z [2024-03-29 02:46:02,014: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:46:02.087664442Z [2024-03-29 02:46:02,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:46:02.092248428Z [2024-03-29 02:46:02,091: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:46:02.092446350Z [2024-03-29 02:46:02,092: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:46:02.092623861Z [2024-03-29 02:46:02,092: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:46:02.092964519Z [2024-03-29 02:46:02,092: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:46:02.217919421Z [2024-03-29 02:46:02,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51e7aefb-55ee-4b40-ad4a-b177fa8a8d71] succeeded in 1.609876141001223s: None 2024-03-29T02:46:02.296446403Z [2024-03-29 02:46:02,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:46:03.172181067Z [2024-03-29 02:46:03,171: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a66c32b-5772-4010-a6d6-c09a3641c421] succeeded in 2.565679789000569s: None 2024-03-29T02:46:03.367656860Z [2024-03-29 02:46:03,367: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:46:03.371276162Z [2024-03-29 02:46:03,370: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:46:03.390759884Z [2024-03-29 02:46:03,390: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:46:03.392273412Z [2024-03-29 02:46:03,392: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:46:03.392300363Z [2024-03-29 02:46:03,392: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:46:03.392521505Z [2024-03-29 02:46:03,392: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:46:03.392645246Z [2024-03-29 02:46:03,392: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:46:03.393680130Z [2024-03-29 02:46:03,393: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:46:03.393739924Z [2024-03-29 02:46:03,393: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:46:03.491576607Z [2024-03-29 02:46:03,491: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:46:03.523794147Z [2024-03-29 02:46:03,523: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:46:03.527312892Z [2024-03-29 02:46:03,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:46:03.578585399Z [2024-03-29 02:46:03,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:46:03.579650624Z [2024-03-29 02:46:03,579: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:46:03.579690960Z [2024-03-29 02:46:03,579: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:46:03.579704922Z [2024-03-29 02:46:03,579: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:46:03.581881485Z [2024-03-29 02:46:03,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:46:03.583031046Z [2024-03-29 02:46:03,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:46:03.583164429Z [2024-03-29 02:46:03,583: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:46:03.724872626Z [2024-03-29 02:46:03,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:46:05.613003742Z [2024-03-29 02:46:05,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5056f114-0e72-433a-80f3-e99f37d466ea] succeeded in 5.009531412999422s: None 2024-03-29T02:46:05.946597530Z [2024-03-29 02:46:05,944: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[78b3450e-c18f-4e0b-a251-f2d195abf756] succeeded in 5.335134185999777s: None 2024-03-29T02:47:00.378800904Z [2024-03-29 02:47:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b7e4345-eec5-4c11-af7c-973152df0223] received 2024-03-29T02:47:00.380967272Z [2024-03-29 02:47:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d83518a-b1ed-4552-807b-d40816962ba0] received 2024-03-29T02:47:00.395438433Z [2024-03-29 02:47:00,394: INFO/ForkPoolWorker-16] [7d83518a-b1ed-4552-807b-d40816962ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:47:00.399058232Z [2024-03-29 02:47:00,398: INFO/ForkPoolWorker-15] [1b7e4345-eec5-4c11-af7c-973152df0223] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:47:00.408560170Z [2024-03-29 02:47:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc81024c-9c46-4b5a-9e22-d07197077599] received 2024-03-29T02:47:00.427266889Z [2024-03-29 02:47:00,426: INFO/ForkPoolWorker-1] [cc81024c-9c46-4b5a-9e22-d07197077599] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:47:00.703902492Z [2024-03-29 02:47:00,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:47:00.814921380Z [2024-03-29 02:47:00,809: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:47:00.839200054Z [2024-03-29 02:47:00,834: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:47:01.025914017Z [2024-03-29 02:47:01,025: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:47:01.030793136Z [2024-03-29 02:47:01,030: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:47:01.054261431Z [2024-03-29 02:47:01,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:47:01.056008019Z [2024-03-29 02:47:01,055: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:47:01.056241496Z [2024-03-29 02:47:01,055: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:47:01.056389009Z [2024-03-29 02:47:01,056: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:47:01.056880580Z [2024-03-29 02:47:01,056: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:47:01.192314040Z [2024-03-29 02:47:01,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:47:01.831796189Z [2024-03-29 02:47:01,831: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc81024c-9c46-4b5a-9e22-d07197077599] succeeded in 1.4210691359985503s: None 2024-03-29T02:47:02.080998636Z [2024-03-29 02:47:02,080: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:47:02.084614398Z [2024-03-29 02:47:02,084: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:47:02.110092576Z [2024-03-29 02:47:02,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:47:02.111759858Z [2024-03-29 02:47:02,111: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:47:02.111813962Z [2024-03-29 02:47:02,111: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:47:02.111876438Z [2024-03-29 02:47:02,111: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:47:02.111949357Z [2024-03-29 02:47:02,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:47:02.112205392Z [2024-03-29 02:47:02,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:47:02.112226120Z [2024-03-29 02:47:02,112: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:47:02.169215835Z [2024-03-29 02:47:02,168: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:47:02.172796199Z [2024-03-29 02:47:02,172: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:47:02.196435789Z [2024-03-29 02:47:02,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:47:02.197789222Z [2024-03-29 02:47:02,197: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:47:02.197822893Z [2024-03-29 02:47:02,197: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:47:02.198041098Z [2024-03-29 02:47:02,197: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:47:02.198125725Z [2024-03-29 02:47:02,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:47:02.198318054Z [2024-03-29 02:47:02,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:47:02.198339252Z [2024-03-29 02:47:02,198: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:47:02.208815289Z [2024-03-29 02:47:02,207: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:47:02.320596894Z [2024-03-29 02:47:02,320: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:47:04.908132206Z [2024-03-29 02:47:04,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b7e4345-eec5-4c11-af7c-973152df0223] succeeded in 4.524430860999928s: None 2024-03-29T02:47:04.942136264Z [2024-03-29 02:47:04,941: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d83518a-b1ed-4552-807b-d40816962ba0] succeeded in 4.55957355999999s: None 2024-03-29T02:48:01.187409340Z [2024-03-29 02:48:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[682845ba-e048-4340-a8dd-a24a0de464e6] received 2024-03-29T02:48:01.190012558Z [2024-03-29 02:48:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6114b33e-8b3e-4728-833e-71a885c01bfb] received 2024-03-29T02:48:01.192383807Z [2024-03-29 02:48:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63089134-1cd5-4dd4-86d3-3650305aa626] received 2024-03-29T02:48:01.194059354Z [2024-03-29 02:48:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5998ffaa-ad96-4abc-ba5e-caf6a5b5fcb3] received 2024-03-29T02:48:01.206818590Z [2024-03-29 02:48:01,206: INFO/ForkPoolWorker-1] [63089134-1cd5-4dd4-86d3-3650305aa626] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:48:01.216975414Z [2024-03-29 02:48:01,216: INFO/ForkPoolWorker-16] [6114b33e-8b3e-4728-833e-71a885c01bfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:48:01.220616535Z [2024-03-29 02:48:01,220: INFO/ForkPoolWorker-15] [682845ba-e048-4340-a8dd-a24a0de464e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:48:01.222027778Z [2024-03-29 02:48:01,221: INFO/ForkPoolWorker-2] [5998ffaa-ad96-4abc-ba5e-caf6a5b5fcb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:48:01.758590923Z [2024-03-29 02:48:01,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:48:01.883476642Z [2024-03-29 02:48:01,866: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:48:02.068968758Z [2024-03-29 02:48:02,053: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:48:02.197062820Z [2024-03-29 02:48:02,190: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:48:02.521689712Z [2024-03-29 02:48:02,520: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:48:02.526278169Z [2024-03-29 02:48:02,525: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:48:02.578040124Z [2024-03-29 02:48:02,577: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:48:02.580840161Z [2024-03-29 02:48:02,580: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:48:02.581312040Z [2024-03-29 02:48:02,581: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:48:02.581534745Z [2024-03-29 02:48:02,581: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:48:02.581917345Z [2024-03-29 02:48:02,581: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:48:02.695489550Z [2024-03-29 02:48:02,694: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:48:02.815956673Z [2024-03-29 02:48:02,815: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:48:03.583912807Z [2024-03-29 02:48:03,583: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5998ffaa-ad96-4abc-ba5e-caf6a5b5fcb3] succeeded in 2.3836770510006318s: None 2024-03-29T02:48:03.600189357Z [2024-03-29 02:48:03,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[682845ba-e048-4340-a8dd-a24a0de464e6] succeeded in 2.4102324129999033s: None 2024-03-29T02:48:03.907970043Z [2024-03-29 02:48:03,907: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:48:03.929870732Z [2024-03-29 02:48:03,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:48:03.955190923Z [2024-03-29 02:48:03,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:48:03.969304939Z [2024-03-29 02:48:03,966: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:48:03.969586761Z [2024-03-29 02:48:03,969: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:48:03.970199473Z [2024-03-29 02:48:03,969: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:48:03.970836853Z [2024-03-29 02:48:03,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:48:03.971321527Z [2024-03-29 02:48:03,971: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:48:03.971471255Z [2024-03-29 02:48:03,971: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:48:04.142728888Z [2024-03-29 02:48:04,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:48:04.293310438Z [2024-03-29 02:48:04,292: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:48:04.297438394Z [2024-03-29 02:48:04,296: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:48:04.364492628Z [2024-03-29 02:48:04,364: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:48:04.370594522Z [2024-03-29 02:48:04,369: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:48:04.370658848Z [2024-03-29 02:48:04,370: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:48:04.370664462Z [2024-03-29 02:48:04,370: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:48:04.370675548Z [2024-03-29 02:48:04,370: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:48:04.371286092Z [2024-03-29 02:48:04,370: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:48:04.374134090Z [2024-03-29 02:48:04,373: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:48:04.532081429Z [2024-03-29 02:48:04,531: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:48:06.835095744Z [2024-03-29 02:48:06,833: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6114b33e-8b3e-4728-833e-71a885c01bfb] succeeded in 5.631124625999291s: None 2024-03-29T02:48:07.472526663Z [2024-03-29 02:48:07,472: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63089134-1cd5-4dd4-86d3-3650305aa626] succeeded in 6.278102686999773s: None 2024-03-29T02:49:00.213088146Z [2024-03-29 02:49:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[255ea335-14c1-4f13-8d18-63e130480104] received 2024-03-29T02:49:00.228222105Z [2024-03-29 02:49:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5465cb81-4bb5-4689-9820-587b17b41456] received 2024-03-29T02:49:00.233720970Z [2024-03-29 02:49:00,233: INFO/ForkPoolWorker-15] [255ea335-14c1-4f13-8d18-63e130480104] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:49:00.234928596Z [2024-03-29 02:49:00,234: INFO/ForkPoolWorker-16] [5465cb81-4bb5-4689-9820-587b17b41456] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:49:00.239377003Z [2024-03-29 02:49:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[407ffb2e-5e77-4e33-a8ee-62a42bc33f64] received 2024-03-29T02:49:00.252777727Z [2024-03-29 02:49:00,252: INFO/ForkPoolWorker-1] [407ffb2e-5e77-4e33-a8ee-62a42bc33f64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:49:00.514076524Z [2024-03-29 02:49:00,510: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:49:00.552313866Z [2024-03-29 02:49:00,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:49:00.574985022Z [2024-03-29 02:49:00,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:49:00.739979252Z [2024-03-29 02:49:00,739: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:49:00.744269883Z [2024-03-29 02:49:00,743: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:49:00.764259691Z [2024-03-29 02:49:00,764: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:49:00.765813591Z [2024-03-29 02:49:00,765: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:49:00.765984186Z [2024-03-29 02:49:00,765: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:49:00.766104976Z [2024-03-29 02:49:00,765: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:49:00.766521963Z [2024-03-29 02:49:00,766: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:49:00.882145011Z [2024-03-29 02:49:00,881: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:49:01.461341991Z [2024-03-29 02:49:01,460: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[407ffb2e-5e77-4e33-a8ee-62a42bc33f64] succeeded in 1.2205333929996414s: None 2024-03-29T02:49:01.835919171Z [2024-03-29 02:49:01,835: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:49:01.839838505Z [2024-03-29 02:49:01,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:49:01.883858649Z [2024-03-29 02:49:01,883: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:49:01.887749832Z [2024-03-29 02:49:01,887: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:49:01.887776223Z [2024-03-29 02:49:01,887: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:49:01.887963796Z [2024-03-29 02:49:01,887: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:49:01.888037611Z [2024-03-29 02:49:01,887: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:49:01.888457305Z [2024-03-29 02:49:01,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:49:01.888477767Z [2024-03-29 02:49:01,888: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:49:02.013694115Z [2024-03-29 02:49:02,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:49:02.019626282Z [2024-03-29 02:49:02,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:49:02.027971121Z [2024-03-29 02:49:02,027: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:49:02.059018744Z [2024-03-29 02:49:02,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:49:02.063601448Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:49:02.063623491Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:49:02.063702349Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:49:02.063733234Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:49:02.064080578Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:49:02.064091962Z [2024-03-29 02:49:02,063: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:49:02.198592338Z [2024-03-29 02:49:02,198: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:49:04.014764458Z [2024-03-29 02:49:04,014: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5465cb81-4bb5-4689-9820-587b17b41456] succeeded in 3.784470599000997s: None 2024-03-29T02:49:04.578027617Z [2024-03-29 02:49:04,577: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[255ea335-14c1-4f13-8d18-63e130480104] succeeded in 4.3497068810011115s: None 2024-03-29T02:50:00.624974769Z [2024-03-29 02:50:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94161869-6f7a-4388-ba43-1704bd67932f] received 2024-03-29T02:50:00.627596984Z [2024-03-29 02:50:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[877d98d3-f094-45ed-9cee-f3a09e224317] received 2024-03-29T02:50:00.629991244Z [2024-03-29 02:50:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b36c4349-e593-4917-b151-c09b3d5e248f] received 2024-03-29T02:50:00.635654197Z [2024-03-29 02:50:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8caa7396-37ea-4f9a-b7cb-44966482bab4] received 2024-03-29T02:50:00.635686545Z [2024-03-29 02:50:00,635: INFO/ForkPoolWorker-16] [877d98d3-f094-45ed-9cee-f3a09e224317] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:50:00.641062993Z [2024-03-29 02:50:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5b197a8-a7b8-4293-91d4-b755bdf6f4a5] received 2024-03-29T02:50:00.642796173Z [2024-03-29 02:50:00,642: INFO/ForkPoolWorker-15] [94161869-6f7a-4388-ba43-1704bd67932f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:00.643252929Z [2024-03-29 02:50:00,643: INFO/ForkPoolWorker-1] [b36c4349-e593-4917-b151-c09b3d5e248f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:50:00.644491316Z [2024-03-29 02:50:00,644: INFO/ForkPoolWorker-2] [8caa7396-37ea-4f9a-b7cb-44966482bab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:50:00.654220836Z [2024-03-29 02:50:00,653: INFO/ForkPoolWorker-3] [c5b197a8-a7b8-4293-91d4-b755bdf6f4a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:50:01.034018799Z [2024-03-29 02:50:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:50:01.088112982Z [2024-03-29 02:50:01,084: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:50:01.217008563Z [2024-03-29 02:50:01,216: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:50:01.221185029Z [2024-03-29 02:50:01,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:01.256444157Z [2024-03-29 02:50:01,256: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:50:01.257785707Z [2024-03-29 02:50:01,257: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:50:01.258032376Z [2024-03-29 02:50:01,257: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:50:01.258159399Z [2024-03-29 02:50:01,257: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:50:01.258512749Z [2024-03-29 02:50:01,258: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:50:01.326095533Z [2024-03-29 02:50:01,318: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:50:01.353030029Z [2024-03-29 02:50:01,352: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:01.375671150Z [2024-03-29 02:50:01,353: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:50:01.390087090Z [2024-03-29 02:50:01,375: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:50:01.759436687Z [2024-03-29 02:50:01,759: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:02.380795463Z [2024-03-29 02:50:02,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[877d98d3-f094-45ed-9cee-f3a09e224317] succeeded in 1.751504861000285s: None 2024-03-29T02:50:02.562116475Z [2024-03-29 02:50:02,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b36c4349-e593-4917-b151-c09b3d5e248f] succeeded in 1.929724895999243s: None 2024-03-29T02:50:03.084891065Z [2024-03-29 02:50:03,084: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:50:03.088762253Z [2024-03-29 02:50:03,088: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:03.097503789Z [2024-03-29 02:50:03,097: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:50:03.101016190Z [2024-03-29 02:50:03,100: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T02:50:03.101660297Z [2024-03-29 02:50:03,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:03.105109133Z [2024-03-29 02:50:03,104: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:03.118985699Z [2024-03-29 02:50:03,118: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:50:03.121187548Z [2024-03-29 02:50:03,120: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:03.121422470Z [2024-03-29 02:50:03,121: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:03.121735200Z [2024-03-29 02:50:03,121: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:03.122051473Z [2024-03-29 02:50:03,121: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:50:03.122396482Z [2024-03-29 02:50:03,122: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:50:03.123664065Z [2024-03-29 02:50:03,122: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:03.130923071Z [2024-03-29 02:50:03,130: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T02:50:03.133110963Z [2024-03-29 02:50:03,132: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:03.133144182Z [2024-03-29 02:50:03,132: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:03.133306367Z [2024-03-29 02:50:03,133: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:03.133360201Z [2024-03-29 02:50:03,133: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T02:50:03.133684691Z [2024-03-29 02:50:03,133: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:50:03.133805999Z [2024-03-29 02:50:03,133: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:03.146385604Z [2024-03-29 02:50:03,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:50:03.149238803Z [2024-03-29 02:50:03,148: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:03.149259416Z [2024-03-29 02:50:03,149: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:03.149378058Z [2024-03-29 02:50:03,149: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:03.149397681Z [2024-03-29 02:50:03,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:50:03.151203638Z [2024-03-29 02:50:03,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:50:03.151237953Z [2024-03-29 02:50:03,151: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:03.241321864Z [2024-03-29 02:50:03,240: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:03.257848724Z [2024-03-29 02:50:03,257: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:03.271893532Z [2024-03-29 02:50:03,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:04.372398876Z [2024-03-29 02:50:04,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94161869-6f7a-4388-ba43-1704bd67932f] succeeded in 3.741315235998627s: None 2024-03-29T02:50:04.493333398Z [2024-03-29 02:50:04,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46c2a3af-a2fb-44af-a2f8-7ec652c9ac2d] received 2024-03-29T02:50:04.500095704Z [2024-03-29 02:50:04,499: INFO/ForkPoolWorker-15] [46c2a3af-a2fb-44af-a2f8-7ec652c9ac2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:04.815564161Z [2024-03-29 02:50:04,811: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:50:05.466735961Z [2024-03-29 02:50:05,466: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8caa7396-37ea-4f9a-b7cb-44966482bab4] succeeded in 4.828424687999359s: None 2024-03-29T02:50:05.974168733Z [2024-03-29 02:50:05,973: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c5b197a8-a7b8-4293-91d4-b755bdf6f4a5] succeeded in 5.329680503000418s: None 2024-03-29T02:50:06.384411564Z [2024-03-29 02:50:06,383: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:50:06.388820030Z [2024-03-29 02:50:06,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:06.420012100Z [2024-03-29 02:50:06,419: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:50:06.421719588Z [2024-03-29 02:50:06,421: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:06.421762985Z [2024-03-29 02:50:06,421: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:06.421850279Z [2024-03-29 02:50:06,421: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:06.421883288Z [2024-03-29 02:50:06,421: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:50:06.428216521Z [2024-03-29 02:50:06,427: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:50:06.428344249Z [2024-03-29 02:50:06,428: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:06.539138871Z [2024-03-29 02:50:06,538: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:07.363605502Z [2024-03-29 02:50:07,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07283d4b-2b43-472b-a011-134bb6045198] received 2024-03-29T02:50:07.403297103Z [2024-03-29 02:50:07,402: INFO/ForkPoolWorker-16] [07283d4b-2b43-472b-a011-134bb6045198] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:50:07.576513562Z [2024-03-29 02:50:07,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46c2a3af-a2fb-44af-a2f8-7ec652c9ac2d] succeeded in 3.081446213000163s: None 2024-03-29T02:50:07.861311887Z [2024-03-29 02:50:07,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:50:09.082655289Z [2024-03-29 02:50:09,082: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:50:09.086355698Z [2024-03-29 02:50:09,085: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:09.105976044Z [2024-03-29 02:50:09,105: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:50:09.107520799Z [2024-03-29 02:50:09,107: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:09.107656425Z [2024-03-29 02:50:09,107: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:09.107837801Z [2024-03-29 02:50:09,107: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:09.107953274Z [2024-03-29 02:50:09,107: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:50:09.108242394Z [2024-03-29 02:50:09,108: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:50:09.108353390Z [2024-03-29 02:50:09,108: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:09.258980558Z [2024-03-29 02:50:09,258: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:10.963704970Z [2024-03-29 02:50:10,963: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[07283d4b-2b43-472b-a011-134bb6045198] succeeded in 3.5886655619997327s: None 2024-03-29T02:50:11.587776272Z [2024-03-29 02:50:11,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d16e936-6d45-4219-972b-2bd7fe25e440] received 2024-03-29T02:50:11.594408655Z [2024-03-29 02:50:11,594: INFO/ForkPoolWorker-15] [7d16e936-6d45-4219-972b-2bd7fe25e440] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:11.903530654Z [2024-03-29 02:50:11,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:50:13.099534234Z [2024-03-29 02:50:13,099: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:50:13.102906574Z [2024-03-29 02:50:13,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:50:13.120458876Z [2024-03-29 02:50:13,120: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:50:13.122235296Z [2024-03-29 02:50:13,121: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:50:13.122315409Z [2024-03-29 02:50:13,122: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:50:13.122654894Z [2024-03-29 02:50:13,122: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:50:13.122766874Z [2024-03-29 02:50:13,122: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:50:13.123118777Z [2024-03-29 02:50:13,122: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:50:13.123190097Z [2024-03-29 02:50:13,123: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:50:13.212843682Z [2024-03-29 02:50:13,212: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:50:13.743512726Z [2024-03-29 02:50:13,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d16e936-6d45-4219-972b-2bd7fe25e440] succeeded in 2.1542032060006022s: None 2024-03-29T02:51:00.534621787Z [2024-03-29 02:51:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ccee44-3e03-4356-b6f5-effed9e6b69d] received 2024-03-29T02:51:00.537967370Z [2024-03-29 02:51:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22b3b179-9c96-4811-bcb2-97994832512f] received 2024-03-29T02:51:00.541911992Z [2024-03-29 02:51:00,541: INFO/ForkPoolWorker-15] [23ccee44-3e03-4356-b6f5-effed9e6b69d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:51:00.545595173Z [2024-03-29 02:51:00,545: INFO/ForkPoolWorker-16] [22b3b179-9c96-4811-bcb2-97994832512f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:51:00.545962964Z [2024-03-29 02:51:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb2f4485-8106-41c4-bb28-4a6b922a845e] received 2024-03-29T02:51:00.552979234Z [2024-03-29 02:51:00,552: INFO/ForkPoolWorker-1] [eb2f4485-8106-41c4-bb28-4a6b922a845e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:51:00.965733813Z [2024-03-29 02:51:00,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:51:00.975421881Z [2024-03-29 02:51:00,972: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:51:00.985131038Z [2024-03-29 02:51:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:51:01.185391390Z [2024-03-29 02:51:01,184: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:51:01.192150361Z [2024-03-29 02:51:01,191: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:51:01.224354289Z [2024-03-29 02:51:01,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:51:01.225925263Z [2024-03-29 02:51:01,225: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:51:01.226289259Z [2024-03-29 02:51:01,225: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:51:01.226581007Z [2024-03-29 02:51:01,226: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:51:01.227332436Z [2024-03-29 02:51:01,227: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:51:01.337600028Z [2024-03-29 02:51:01,337: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:51:02.202104859Z [2024-03-29 02:51:02,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23ccee44-3e03-4356-b6f5-effed9e6b69d] succeeded in 1.6655915539995476s: None 2024-03-29T02:51:02.353764039Z [2024-03-29 02:51:02,353: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:51:02.359758157Z [2024-03-29 02:51:02,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:51:02.385111269Z [2024-03-29 02:51:02,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:51:02.386841319Z [2024-03-29 02:51:02,386: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:51:02.386874522Z [2024-03-29 02:51:02,386: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:51:02.387004337Z [2024-03-29 02:51:02,386: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:51:02.387019156Z [2024-03-29 02:51:02,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:51:02.387377935Z [2024-03-29 02:51:02,387: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:51:02.387413587Z [2024-03-29 02:51:02,387: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:51:02.394531489Z [2024-03-29 02:51:02,394: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:51:02.397977477Z [2024-03-29 02:51:02,397: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:51:02.424905907Z [2024-03-29 02:51:02,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:51:02.426493226Z [2024-03-29 02:51:02,426: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:51:02.426620748Z [2024-03-29 02:51:02,426: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:51:02.426771143Z [2024-03-29 02:51:02,426: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:51:02.426839750Z [2024-03-29 02:51:02,426: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:51:02.427217010Z [2024-03-29 02:51:02,427: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:51:02.427781278Z [2024-03-29 02:51:02,427: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:51:02.480079330Z [2024-03-29 02:51:02,479: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:51:02.553693087Z [2024-03-29 02:51:02,553: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:51:04.143790063Z [2024-03-29 02:51:04,143: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22b3b179-9c96-4811-bcb2-97994832512f] succeeded in 3.604140538000138s: None 2024-03-29T02:51:04.511681627Z [2024-03-29 02:51:04,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb2f4485-8106-41c4-bb28-4a6b922a845e] succeeded in 3.964195213000494s: None 2024-03-29T02:52:00.259499211Z [2024-03-29 02:52:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e048a884-87fd-4d10-b4d6-f6988822a014] received 2024-03-29T02:52:00.261904626Z [2024-03-29 02:52:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25a2c88e-fc6b-47ca-86b6-4edbcc59f7b3] received 2024-03-29T02:52:00.267251630Z [2024-03-29 02:52:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae0c6241-39d4-415f-ba78-beb6c5d51949] received 2024-03-29T02:52:00.268284084Z [2024-03-29 02:52:00,268: INFO/ForkPoolWorker-15] [e048a884-87fd-4d10-b4d6-f6988822a014] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:52:00.270150971Z [2024-03-29 02:52:00,269: INFO/ForkPoolWorker-16] [25a2c88e-fc6b-47ca-86b6-4edbcc59f7b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:52:00.274292863Z [2024-03-29 02:52:00,274: INFO/ForkPoolWorker-1] [ae0c6241-39d4-415f-ba78-beb6c5d51949] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:52:00.278853373Z [2024-03-29 02:52:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98951f43-9b01-4554-afb1-bc3b4fcdca0b] received 2024-03-29T02:52:00.287000943Z [2024-03-29 02:52:00,286: INFO/ForkPoolWorker-2] [98951f43-9b01-4554-afb1-bc3b4fcdca0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:52:00.617970764Z [2024-03-29 02:52:00,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:52:00.662990933Z [2024-03-29 02:52:00,658: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:52:00.666532368Z [2024-03-29 02:52:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:52:00.691871705Z [2024-03-29 02:52:00,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:52:00.808813707Z [2024-03-29 02:52:00,808: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:52:00.814381099Z [2024-03-29 02:52:00,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:52:00.879769327Z [2024-03-29 02:52:00,879: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:52:00.883497928Z [2024-03-29 02:52:00,883: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:52:00.883565485Z [2024-03-29 02:52:00,883: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:52:00.883570972Z [2024-03-29 02:52:00,883: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:52:00.883853213Z [2024-03-29 02:52:00,883: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:52:01.028145568Z [2024-03-29 02:52:01,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:52:01.037008068Z [2024-03-29 02:52:01,036: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:52:01.761505638Z [2024-03-29 02:52:01,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae0c6241-39d4-415f-ba78-beb6c5d51949] succeeded in 1.4920633860001544s: None 2024-03-29T02:52:01.893600285Z [2024-03-29 02:52:01,892: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e048a884-87fd-4d10-b4d6-f6988822a014] succeeded in 1.6300120779997087s: None 2024-03-29T02:52:02.235927471Z [2024-03-29 02:52:02,235: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:52:02.239818582Z [2024-03-29 02:52:02,238: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:52:02.264871306Z [2024-03-29 02:52:02,264: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:52:02.267492699Z [2024-03-29 02:52:02,267: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:52:02.267884151Z [2024-03-29 02:52:02,267: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:52:02.268171202Z [2024-03-29 02:52:02,267: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:52:02.268224349Z [2024-03-29 02:52:02,268: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:52:02.269937243Z [2024-03-29 02:52:02,268: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:52:02.270194403Z [2024-03-29 02:52:02,269: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:52:02.395315838Z [2024-03-29 02:52:02,394: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:52:02.430961756Z [2024-03-29 02:52:02,430: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:52:02.435476459Z [2024-03-29 02:52:02,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:52:02.462212473Z [2024-03-29 02:52:02,461: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:52:02.464095960Z [2024-03-29 02:52:02,463: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:52:02.464130222Z [2024-03-29 02:52:02,463: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:52:02.464512774Z [2024-03-29 02:52:02,464: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:52:02.464579242Z [2024-03-29 02:52:02,464: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:52:02.464923956Z [2024-03-29 02:52:02,464: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:52:02.465092224Z [2024-03-29 02:52:02,464: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:52:02.564747504Z [2024-03-29 02:52:02,564: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:52:04.094999198Z [2024-03-29 02:52:04,094: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25a2c88e-fc6b-47ca-86b6-4edbcc59f7b3] succeeded in 3.8314964230012265s: None 2024-03-29T02:52:04.530620257Z [2024-03-29 02:52:04,530: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[98951f43-9b01-4554-afb1-bc3b4fcdca0b] succeeded in 4.2497508650012605s: None 2024-03-29T02:53:01.102786531Z [2024-03-29 02:53:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b8a6f38-486a-4540-8487-eed78cec4cf6] received 2024-03-29T02:53:01.111685580Z [2024-03-29 02:53:01,111: INFO/ForkPoolWorker-15] [1b8a6f38-486a-4540-8487-eed78cec4cf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:53:01.114990937Z [2024-03-29 02:53:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33268b27-986a-41d2-b935-828e9755271d] received 2024-03-29T02:53:01.117034374Z [2024-03-29 02:53:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa37f8ae-e184-42f1-acf5-2fb4ee5e54be] received 2024-03-29T02:53:01.125468700Z [2024-03-29 02:53:01,125: INFO/ForkPoolWorker-1] [aa37f8ae-e184-42f1-acf5-2fb4ee5e54be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:53:01.132457548Z [2024-03-29 02:53:01,131: INFO/ForkPoolWorker-16] [33268b27-986a-41d2-b935-828e9755271d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:53:01.445803857Z [2024-03-29 02:53:01,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:53:01.472252659Z [2024-03-29 02:53:01,468: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:53:01.474823898Z [2024-03-29 02:53:01,470: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:53:01.628810045Z [2024-03-29 02:53:01,628: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:53:01.633307487Z [2024-03-29 02:53:01,632: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:53:01.658929909Z [2024-03-29 02:53:01,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:53:01.660900530Z [2024-03-29 02:53:01,660: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:53:01.661230634Z [2024-03-29 02:53:01,660: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:53:01.661360621Z [2024-03-29 02:53:01,661: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:53:01.661902738Z [2024-03-29 02:53:01,661: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:53:01.806732323Z [2024-03-29 02:53:01,806: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:53:02.633118905Z [2024-03-29 02:53:02,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b8a6f38-486a-4540-8487-eed78cec4cf6] succeeded in 1.5280119250001007s: None 2024-03-29T02:53:02.922175844Z [2024-03-29 02:53:02,921: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:53:02.925926321Z [2024-03-29 02:53:02,925: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:53:02.947581139Z [2024-03-29 02:53:02,947: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:53:02.949149917Z [2024-03-29 02:53:02,948: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:53:02.949331772Z [2024-03-29 02:53:02,949: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:53:02.949574146Z [2024-03-29 02:53:02,949: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:53:02.949670774Z [2024-03-29 02:53:02,949: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:53:02.949946659Z [2024-03-29 02:53:02,949: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:53:02.950782359Z [2024-03-29 02:53:02,949: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:53:02.970983701Z [2024-03-29 02:53:02,970: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:53:02.974600080Z [2024-03-29 02:53:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:53:02.999764156Z [2024-03-29 02:53:02,999: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:53:03.004240375Z [2024-03-29 02:53:03,003: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:53:03.004285935Z [2024-03-29 02:53:03,004: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:53:03.004624583Z [2024-03-29 02:53:03,004: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:53:03.004643613Z [2024-03-29 02:53:03,004: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:53:03.005064667Z [2024-03-29 02:53:03,004: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:53:03.005160537Z [2024-03-29 02:53:03,005: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:53:03.048598583Z [2024-03-29 02:53:03,048: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:53:03.117893016Z [2024-03-29 02:53:03,117: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:53:04.624491838Z [2024-03-29 02:53:04,624: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33268b27-986a-41d2-b935-828e9755271d] succeeded in 3.507570891000796s: None 2024-03-29T02:53:05.793478019Z [2024-03-29 02:53:05,791: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa37f8ae-e184-42f1-acf5-2fb4ee5e54be] succeeded in 4.673559774000751s: None 2024-03-29T02:54:00.852494151Z [2024-03-29 02:54:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b2d1854-b50d-4dca-9a3e-61e66eaded57] received 2024-03-29T02:54:00.867530022Z [2024-03-29 02:54:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[931c6d9c-5666-4985-8858-86225590411e] received 2024-03-29T02:54:00.870540825Z [2024-03-29 02:54:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36e1c4df-c561-45ab-b0f4-48f916015029] received 2024-03-29T02:54:00.873645595Z [2024-03-29 02:54:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab3dec6f-c431-43cb-9cd7-ba7af5610af2] received 2024-03-29T02:54:00.885802605Z [2024-03-29 02:54:00,885: INFO/ForkPoolWorker-15] [0b2d1854-b50d-4dca-9a3e-61e66eaded57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:54:00.887036649Z [2024-03-29 02:54:00,886: INFO/ForkPoolWorker-16] [931c6d9c-5666-4985-8858-86225590411e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:54:00.887170259Z [2024-03-29 02:54:00,886: INFO/ForkPoolWorker-2] [ab3dec6f-c431-43cb-9cd7-ba7af5610af2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:54:00.902840377Z [2024-03-29 02:54:00,902: INFO/ForkPoolWorker-1] [36e1c4df-c561-45ab-b0f4-48f916015029] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:54:01.242703332Z [2024-03-29 02:54:01,238: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:54:01.356239390Z [2024-03-29 02:54:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:54:01.419891631Z [2024-03-29 02:54:01,415: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:54:01.484971440Z [2024-03-29 02:54:01,480: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:54:01.646197632Z [2024-03-29 02:54:01,645: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:54:01.725806839Z [2024-03-29 02:54:01,725: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T02:54:01.730673176Z [2024-03-29 02:54:01,730: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:54:01.762893596Z [2024-03-29 02:54:01,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:54:01.770701024Z [2024-03-29 02:54:01,770: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:54:01.770932994Z [2024-03-29 02:54:01,770: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:54:01.771195172Z [2024-03-29 02:54:01,770: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T02:54:01.771757777Z [2024-03-29 02:54:01,771: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:54:01.929553597Z [2024-03-29 02:54:01,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:54:02.408328028Z [2024-03-29 02:54:02,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b2d1854-b50d-4dca-9a3e-61e66eaded57] succeeded in 1.544301527999778s: None 2024-03-29T02:54:02.741383251Z [2024-03-29 02:54:02,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:54:02.747594744Z [2024-03-29 02:54:02,746: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:54:02.776203022Z [2024-03-29 02:54:02,775: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:54:02.778230722Z [2024-03-29 02:54:02,777: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:54:02.778683169Z [2024-03-29 02:54:02,778: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:54:02.778986448Z [2024-03-29 02:54:02,778: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:54:02.779177497Z [2024-03-29 02:54:02,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:54:02.779692679Z [2024-03-29 02:54:02,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:54:02.779864935Z [2024-03-29 02:54:02,779: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:54:02.783781285Z [2024-03-29 02:54:02,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36e1c4df-c561-45ab-b0f4-48f916015029] succeeded in 1.9116112970004906s: None 2024-03-29T02:54:02.885942899Z [2024-03-29 02:54:02,885: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:54:02.927187400Z [2024-03-29 02:54:02,926: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:54:02.931017521Z [2024-03-29 02:54:02,930: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:54:02.951752098Z [2024-03-29 02:54:02,951: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:54:02.953521141Z [2024-03-29 02:54:02,953: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:54:02.953635491Z [2024-03-29 02:54:02,953: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:54:02.953873780Z [2024-03-29 02:54:02,953: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:54:02.954084640Z [2024-03-29 02:54:02,953: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:54:02.954711382Z [2024-03-29 02:54:02,954: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:54:02.954855963Z [2024-03-29 02:54:02,954: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:54:03.115116124Z [2024-03-29 02:54:03,114: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:54:05.367136149Z [2024-03-29 02:54:05,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[931c6d9c-5666-4985-8858-86225590411e] succeeded in 4.5034671899993555s: None 2024-03-29T02:54:05.376664938Z [2024-03-29 02:54:05,376: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ab3dec6f-c431-43cb-9cd7-ba7af5610af2] succeeded in 4.500739912000427s: None 2024-03-29T02:55:00.468750863Z [2024-03-29 02:55:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb0d73f3-f08b-4ae4-97a5-710e754923de] received 2024-03-29T02:55:00.475043409Z [2024-03-29 02:55:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59631b79-6c9c-4100-9624-713147a4afe1] received 2024-03-29T02:55:00.479360470Z [2024-03-29 02:55:00,478: INFO/ForkPoolWorker-15] [fb0d73f3-f08b-4ae4-97a5-710e754923de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:55:00.484321182Z [2024-03-29 02:55:00,484: INFO/ForkPoolWorker-16] [59631b79-6c9c-4100-9624-713147a4afe1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:55:00.486821958Z [2024-03-29 02:55:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e33303f-feb6-4aa8-a72a-5faeedadfbaa] received 2024-03-29T02:55:00.490410442Z [2024-03-29 02:55:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[524bf807-bb55-49e4-9eeb-42063fbc4bb6] received 2024-03-29T02:55:00.494033924Z [2024-03-29 02:55:00,493: INFO/ForkPoolWorker-1] [7e33303f-feb6-4aa8-a72a-5faeedadfbaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:00.500593459Z [2024-03-29 02:55:00,500: INFO/ForkPoolWorker-2] [524bf807-bb55-49e4-9eeb-42063fbc4bb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:55:00.810270083Z [2024-03-29 02:55:00,806: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:55:00.854972988Z [2024-03-29 02:55:00,851: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:55:00.904498242Z [2024-03-29 02:55:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:55:00.980533882Z [2024-03-29 02:55:00,979: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:55:00.984728061Z [2024-03-29 02:55:00,984: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:01.014976493Z [2024-03-29 02:55:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:55:01.034903737Z [2024-03-29 02:55:01,034: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:55:01.043585485Z [2024-03-29 02:55:01,043: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:55:01.043611741Z [2024-03-29 02:55:01,043: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:55:01.043644094Z [2024-03-29 02:55:01,043: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:55:01.043863519Z [2024-03-29 02:55:01,043: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:55:01.216968622Z [2024-03-29 02:55:01,216: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:02.433843416Z [2024-03-29 02:55:02,433: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[524bf807-bb55-49e4-9eeb-42063fbc4bb6] succeeded in 1.941359991000354s: None 2024-03-29T02:55:02.675535592Z [2024-03-29 02:55:02,675: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:55:02.679382531Z [2024-03-29 02:55:02,678: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:02.721579810Z [2024-03-29 02:55:02,721: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:55:02.725200919Z [2024-03-29 02:55:02,724: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:02.725389658Z [2024-03-29 02:55:02,725: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:02.725719823Z [2024-03-29 02:55:02,725: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:02.725974648Z [2024-03-29 02:55:02,725: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:55:02.726466908Z [2024-03-29 02:55:02,726: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:55:02.727078320Z [2024-03-29 02:55:02,726: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:02.860188914Z [2024-03-29 02:55:02,859: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:55:02.864770795Z [2024-03-29 02:55:02,864: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:02.870454986Z [2024-03-29 02:55:02,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:02.916613366Z [2024-03-29 02:55:02,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:55:02.919552037Z [2024-03-29 02:55:02,919: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:02.919755520Z [2024-03-29 02:55:02,919: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:02.920089874Z [2024-03-29 02:55:02,919: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:02.920286366Z [2024-03-29 02:55:02,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:55:02.920708007Z [2024-03-29 02:55:02,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:55:02.920886168Z [2024-03-29 02:55:02,920: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:03.042146823Z [2024-03-29 02:55:03,041: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:03.307676156Z [2024-03-29 02:55:03,307: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:55:03.311919358Z [2024-03-29 02:55:03,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:03.334510354Z [2024-03-29 02:55:03,334: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:55:03.335982890Z [2024-03-29 02:55:03,335: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:03.336201065Z [2024-03-29 02:55:03,336: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:03.336494978Z [2024-03-29 02:55:03,336: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:03.336662423Z [2024-03-29 02:55:03,336: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:55:03.337044422Z [2024-03-29 02:55:03,336: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:55:03.337181439Z [2024-03-29 02:55:03,337: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:03.423865927Z [2024-03-29 02:55:03,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:03.769098203Z [2024-03-29 02:55:03,768: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e33303f-feb6-4aa8-a72a-5faeedadfbaa] succeeded in 3.280420499999309s: None 2024-03-29T02:55:04.887358800Z [2024-03-29 02:55:04,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b98a826f-56e5-4cf5-832c-bb5064885691] received 2024-03-29T02:55:04.911257220Z [2024-03-29 02:55:04,910: INFO/ForkPoolWorker-1] [b98a826f-56e5-4cf5-832c-bb5064885691] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:04.975589201Z [2024-03-29 02:55:04,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb0d73f3-f08b-4ae4-97a5-710e754923de] succeeded in 4.502828112001225s: None 2024-03-29T02:55:05.125963264Z [2024-03-29 02:55:05,122: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59631b79-6c9c-4100-9624-713147a4afe1] succeeded in 4.644964818000517s: None 2024-03-29T02:55:05.521256898Z [2024-03-29 02:55:05,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:55:06.929034507Z [2024-03-29 02:55:06,928: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:55:06.933100893Z [2024-03-29 02:55:06,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:06.973845815Z [2024-03-29 02:55:06,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:55:06.976310027Z [2024-03-29 02:55:06,975: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:06.976454463Z [2024-03-29 02:55:06,976: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:06.976694832Z [2024-03-29 02:55:06,976: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:06.976862222Z [2024-03-29 02:55:06,976: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:55:06.977295084Z [2024-03-29 02:55:06,977: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:55:06.977405372Z [2024-03-29 02:55:06,977: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:07.084462111Z [2024-03-29 02:55:07,084: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:08.011341682Z [2024-03-29 02:55:08,010: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b98a826f-56e5-4cf5-832c-bb5064885691] succeeded in 3.1197360759997537s: None 2024-03-29T02:55:08.746853460Z [2024-03-29 02:55:08,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8bd1c0d-6ef6-41e9-b71a-63477bfe698e] received 2024-03-29T02:55:08.763316854Z [2024-03-29 02:55:08,762: INFO/ForkPoolWorker-15] [a8bd1c0d-6ef6-41e9-b71a-63477bfe698e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:55:09.075638669Z [2024-03-29 02:55:09,071: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:55:10.256630713Z [2024-03-29 02:55:10,256: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:55:10.259783824Z [2024-03-29 02:55:10,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:10.290724288Z [2024-03-29 02:55:10,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:55:10.293398272Z [2024-03-29 02:55:10,292: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:10.293542526Z [2024-03-29 02:55:10,293: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:10.293889180Z [2024-03-29 02:55:10,293: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:10.294101929Z [2024-03-29 02:55:10,293: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:55:10.295083268Z [2024-03-29 02:55:10,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:55:10.295438936Z [2024-03-29 02:55:10,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:10.397491680Z [2024-03-29 02:55:10,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:11.933511255Z [2024-03-29 02:55:11,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8bd1c0d-6ef6-41e9-b71a-63477bfe698e] succeeded in 3.1842695609993825s: None 2024-03-29T02:55:12.594957450Z [2024-03-29 02:55:12,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd60091c-b1a3-4d54-a301-310e9a78eb26] received 2024-03-29T02:55:12.603103054Z [2024-03-29 02:55:12,602: INFO/ForkPoolWorker-15] [fd60091c-b1a3-4d54-a301-310e9a78eb26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:13.011379969Z [2024-03-29 02:55:13,008: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T02:55:14.145441278Z [2024-03-29 02:55:14,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T02:55:14.148637025Z [2024-03-29 02:55:14,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:55:14.166344256Z [2024-03-29 02:55:14,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:55:14.167779160Z [2024-03-29 02:55:14,167: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:55:14.167837581Z [2024-03-29 02:55:14,167: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:55:14.168022659Z [2024-03-29 02:55:14,167: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:55:14.168094844Z [2024-03-29 02:55:14,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T02:55:14.168531910Z [2024-03-29 02:55:14,168: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T02:55:14.168560463Z [2024-03-29 02:55:14,168: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:55:14.259238934Z [2024-03-29 02:55:14,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:55:14.871431191Z [2024-03-29 02:55:14,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd60091c-b1a3-4d54-a301-310e9a78eb26] succeeded in 2.274479063000399s: None 2024-03-29T02:56:00.957265789Z [2024-03-29 02:56:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90ab219b-dd75-48d5-9107-85171bdd650e] received 2024-03-29T02:56:00.967642446Z [2024-03-29 02:56:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4aeab4f3-e09a-487b-9189-5b4dc0537260] received 2024-03-29T02:56:00.968740719Z [2024-03-29 02:56:00,968: INFO/ForkPoolWorker-15] [90ab219b-dd75-48d5-9107-85171bdd650e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:56:00.975970449Z [2024-03-29 02:56:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db84cea2-1f11-4d79-bcfc-773683b85367] received 2024-03-29T02:56:00.982758944Z [2024-03-29 02:56:00,982: INFO/ForkPoolWorker-1] [db84cea2-1f11-4d79-bcfc-773683b85367] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:56:00.987199601Z [2024-03-29 02:56:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e8e9265-55a0-40b7-b584-e5f162dd831d] received 2024-03-29T02:56:00.988631981Z [2024-03-29 02:56:00,988: INFO/ForkPoolWorker-16] [4aeab4f3-e09a-487b-9189-5b4dc0537260] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:56:01.008216944Z [2024-03-29 02:56:01,007: INFO/ForkPoolWorker-2] [5e8e9265-55a0-40b7-b584-e5f162dd831d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:56:01.356964966Z [2024-03-29 02:56:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:56:01.395725288Z [2024-03-29 02:56:01,391: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:56:01.449166454Z [2024-03-29 02:56:01,444: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:56:01.531837455Z [2024-03-29 02:56:01,528: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:56:01.684049087Z [2024-03-29 02:56:01,683: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T02:56:01.688773278Z [2024-03-29 02:56:01,688: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:56:01.713491806Z [2024-03-29 02:56:01,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:56:01.728321627Z [2024-03-29 02:56:01,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:56:01.731895815Z [2024-03-29 02:56:01,731: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:56:01.732076713Z [2024-03-29 02:56:01,731: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:56:01.732274083Z [2024-03-29 02:56:01,732: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T02:56:01.732593502Z [2024-03-29 02:56:01,732: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:56:01.851219726Z [2024-03-29 02:56:01,850: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:56:02.508040329Z [2024-03-29 02:56:02,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90ab219b-dd75-48d5-9107-85171bdd650e] succeeded in 1.5464008649996686s: None 2024-03-29T02:56:02.730627159Z [2024-03-29 02:56:02,726: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4aeab4f3-e09a-487b-9189-5b4dc0537260] succeeded in 1.7484459379993496s: None 2024-03-29T02:56:03.281057327Z [2024-03-29 02:56:03,280: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:56:03.284797499Z [2024-03-29 02:56:03,284: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:56:03.308445114Z [2024-03-29 02:56:03,308: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:56:03.310602273Z [2024-03-29 02:56:03,310: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:56:03.310625044Z [2024-03-29 02:56:03,310: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:56:03.310766643Z [2024-03-29 02:56:03,310: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:56:03.310809596Z [2024-03-29 02:56:03,310: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:56:03.311347360Z [2024-03-29 02:56:03,311: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:56:03.311362326Z [2024-03-29 02:56:03,311: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:56:03.369834850Z [2024-03-29 02:56:03,369: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T02:56:03.373507021Z [2024-03-29 02:56:03,372: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:56:03.401706006Z [2024-03-29 02:56:03,401: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:56:03.403869193Z [2024-03-29 02:56:03,403: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:56:03.404064029Z [2024-03-29 02:56:03,403: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:56:03.404307667Z [2024-03-29 02:56:03,404: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:56:03.404486035Z [2024-03-29 02:56:03,404: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T02:56:03.404930045Z [2024-03-29 02:56:03,404: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:56:03.405105974Z [2024-03-29 02:56:03,404: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:56:03.415492549Z [2024-03-29 02:56:03,415: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:56:03.551980149Z [2024-03-29 02:56:03,551: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:56:05.514092497Z [2024-03-29 02:56:05,513: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db84cea2-1f11-4d79-bcfc-773683b85367] succeeded in 4.536575693000486s: None 2024-03-29T02:56:06.530945322Z [2024-03-29 02:56:06,527: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e8e9265-55a0-40b7-b584-e5f162dd831d] succeeded in 5.532320174001143s: None 2024-03-29T02:57:01.209665199Z [2024-03-29 02:57:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d703a5cc-cd61-4d71-91ed-b1eb2b4ed3eb] received 2024-03-29T02:57:01.214208251Z [2024-03-29 02:57:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fc989b1-d384-43bf-8a6a-40f9f9b0a0a4] received 2024-03-29T02:57:01.223632359Z [2024-03-29 02:57:01,223: INFO/ForkPoolWorker-15] [d703a5cc-cd61-4d71-91ed-b1eb2b4ed3eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:57:01.228152745Z [2024-03-29 02:57:01,227: INFO/ForkPoolWorker-16] [5fc989b1-d384-43bf-8a6a-40f9f9b0a0a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:57:01.252312046Z [2024-03-29 02:57:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28315036-d7dc-4321-925c-ffe42d6fa8a5] received 2024-03-29T02:57:01.259851541Z [2024-03-29 02:57:01,259: INFO/ForkPoolWorker-1] [28315036-d7dc-4321-925c-ffe42d6fa8a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:57:01.524039019Z [2024-03-29 02:57:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:57:01.698159997Z [2024-03-29 02:57:01,697: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:57:01.702400927Z [2024-03-29 02:57:01,698: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:57:01.702717379Z [2024-03-29 02:57:01,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:57:01.733139057Z [2024-03-29 02:57:01,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:57:01.734930931Z [2024-03-29 02:57:01,734: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:57:01.734955767Z [2024-03-29 02:57:01,734: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:57:01.735089177Z [2024-03-29 02:57:01,734: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:57:01.740364077Z [2024-03-29 02:57:01,740: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:57:01.745960092Z [2024-03-29 02:57:01,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:57:01.846116437Z [2024-03-29 02:57:01,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:57:02.432013922Z [2024-03-29 02:57:02,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d703a5cc-cd61-4d71-91ed-b1eb2b4ed3eb] succeeded in 1.2187227060003352s: None 2024-03-29T02:57:03.060126814Z [2024-03-29 02:57:03,059: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:57:03.064131877Z [2024-03-29 02:57:03,063: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:57:03.095509498Z [2024-03-29 02:57:03,095: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:57:03.097785676Z [2024-03-29 02:57:03,097: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:57:03.098126342Z [2024-03-29 02:57:03,097: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:57:03.098364229Z [2024-03-29 02:57:03,098: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:57:03.098599993Z [2024-03-29 02:57:03,098: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:57:03.099198320Z [2024-03-29 02:57:03,099: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:57:03.099820357Z [2024-03-29 02:57:03,099: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:57:03.163996243Z [2024-03-29 02:57:03,163: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:57:03.167973267Z [2024-03-29 02:57:03,167: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:57:03.194437719Z [2024-03-29 02:57:03,194: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:57:03.196675093Z [2024-03-29 02:57:03,196: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:57:03.196803473Z [2024-03-29 02:57:03,196: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:57:03.197001225Z [2024-03-29 02:57:03,196: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:57:03.197123425Z [2024-03-29 02:57:03,196: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:57:03.197512085Z [2024-03-29 02:57:03,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:57:03.197591017Z [2024-03-29 02:57:03,197: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:57:03.203355721Z [2024-03-29 02:57:03,203: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:57:03.323589151Z [2024-03-29 02:57:03,323: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:57:05.290777111Z [2024-03-29 02:57:05,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5fc989b1-d384-43bf-8a6a-40f9f9b0a0a4] succeeded in 4.074807820999922s: None 2024-03-29T02:57:05.950650351Z [2024-03-29 02:57:05,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28315036-d7dc-4321-925c-ffe42d6fa8a5] succeeded in 4.695715588000894s: None 2024-03-29T02:58:00.416616699Z [2024-03-29 02:58:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cefc41d-d724-4024-bfcc-7104e0bb73d3] received 2024-03-29T02:58:00.419137261Z [2024-03-29 02:58:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d46850c-38e2-44df-924d-cba236f9b211] received 2024-03-29T02:58:00.427250478Z [2024-03-29 02:58:00,426: INFO/ForkPoolWorker-16] [1d46850c-38e2-44df-924d-cba236f9b211] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:58:00.430312052Z [2024-03-29 02:58:00,430: INFO/ForkPoolWorker-15] [4cefc41d-d724-4024-bfcc-7104e0bb73d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:58:00.440747171Z [2024-03-29 02:58:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96dc76e1-b1e8-44d2-8818-ba6d096f5ec0] received 2024-03-29T02:58:00.442876282Z [2024-03-29 02:58:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e87355f-512e-44c4-886b-8c4dd0d12778] received 2024-03-29T02:58:00.452145332Z [2024-03-29 02:58:00,451: INFO/ForkPoolWorker-2] [5e87355f-512e-44c4-886b-8c4dd0d12778] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:58:00.455252609Z [2024-03-29 02:58:00,454: INFO/ForkPoolWorker-1] [96dc76e1-b1e8-44d2-8818-ba6d096f5ec0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:58:00.762065188Z [2024-03-29 02:58:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T02:58:00.778270647Z [2024-03-29 02:58:00,774: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:58:00.779744676Z [2024-03-29 02:58:00,776: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:58:00.791937408Z [2024-03-29 02:58:00,788: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:58:00.960484217Z [2024-03-29 02:58:00,960: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T02:58:00.966769230Z [2024-03-29 02:58:00,966: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:58:01.035269021Z [2024-03-29 02:58:01,035: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T02:58:01.047884903Z [2024-03-29 02:58:01,047: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:58:01.047983717Z [2024-03-29 02:58:01,047: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:58:01.048025107Z [2024-03-29 02:58:01,047: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T02:58:01.048252937Z [2024-03-29 02:58:01,048: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:58:01.161421937Z [2024-03-29 02:58:01,161: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:58:01.235841111Z [2024-03-29 02:58:01,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:58:01.799543309Z [2024-03-29 02:58:01,799: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e87355f-512e-44c4-886b-8c4dd0d12778] succeeded in 1.353027180000936s: None 2024-03-29T02:58:01.852907462Z [2024-03-29 02:58:01,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cefc41d-d724-4024-bfcc-7104e0bb73d3] succeeded in 1.4326095569995232s: None 2024-03-29T02:58:02.235952023Z [2024-03-29 02:58:02,235: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:58:02.239817988Z [2024-03-29 02:58:02,239: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:58:02.270614609Z [2024-03-29 02:58:02,270: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:58:02.272318058Z [2024-03-29 02:58:02,272: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:58:02.272369822Z [2024-03-29 02:58:02,272: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:58:02.272649282Z [2024-03-29 02:58:02,272: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:58:02.272701485Z [2024-03-29 02:58:02,272: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:58:02.273101538Z [2024-03-29 02:58:02,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:58:02.273278690Z [2024-03-29 02:58:02,273: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:58:02.366255565Z [2024-03-29 02:58:02,365: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:58:02.386326693Z [2024-03-29 02:58:02,385: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:58:02.390369728Z [2024-03-29 02:58:02,389: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:58:02.418341646Z [2024-03-29 02:58:02,418: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:58:02.420178172Z [2024-03-29 02:58:02,419: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:58:02.420195896Z [2024-03-29 02:58:02,420: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:58:02.420451591Z [2024-03-29 02:58:02,420: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:58:02.420466026Z [2024-03-29 02:58:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:58:02.420819773Z [2024-03-29 02:58:02,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:58:02.421053764Z [2024-03-29 02:58:02,420: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:58:02.515331704Z [2024-03-29 02:58:02,514: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:58:04.095562956Z [2024-03-29 02:58:04,095: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96dc76e1-b1e8-44d2-8818-ba6d096f5ec0] succeeded in 3.6489109009999083s: None 2024-03-29T02:58:04.200795454Z [2024-03-29 02:58:04,200: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d46850c-38e2-44df-924d-cba236f9b211] succeeded in 3.779877024999223s: None 2024-03-29T02:59:00.929585087Z [2024-03-29 02:59:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7201f75b-5cbc-42d2-943d-e62a790611c7] received 2024-03-29T02:59:00.936364552Z [2024-03-29 02:59:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dcb4948-80b2-4c74-9a63-b071faa6d431] received 2024-03-29T02:59:00.937962304Z [2024-03-29 02:59:00,937: INFO/ForkPoolWorker-15] [7201f75b-5cbc-42d2-943d-e62a790611c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:59:00.943064486Z [2024-03-29 02:59:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ada4b45-7bc1-41f7-bb5c-bf8113c6bf34] received 2024-03-29T02:59:00.957899315Z [2024-03-29 02:59:00,957: INFO/ForkPoolWorker-1] [3ada4b45-7bc1-41f7-bb5c-bf8113c6bf34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:59:00.961884705Z [2024-03-29 02:59:00,961: INFO/ForkPoolWorker-16] [4dcb4948-80b2-4c74-9a63-b071faa6d431] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:59:01.274721789Z [2024-03-29 02:59:01,271: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T02:59:01.285547024Z [2024-03-29 02:59:01,282: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T02:59:01.322392407Z [2024-03-29 02:59:01,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T02:59:01.498565247Z [2024-03-29 02:59:01,498: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T02:59:01.502700281Z [2024-03-29 02:59:01,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:59:01.541255548Z [2024-03-29 02:59:01,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T02:59:01.543617252Z [2024-03-29 02:59:01,543: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T02:59:01.543687264Z [2024-03-29 02:59:01,543: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T02:59:01.543802286Z [2024-03-29 02:59:01,543: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T02:59:01.544082709Z [2024-03-29 02:59:01,543: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T02:59:01.641643493Z [2024-03-29 02:59:01,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:59:02.346862918Z [2024-03-29 02:59:02,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7201f75b-5cbc-42d2-943d-e62a790611c7] succeeded in 1.4146934370000963s: None 2024-03-29T02:59:02.519973281Z [2024-03-29 02:59:02,519: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T02:59:02.523580327Z [2024-03-29 02:59:02,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:59:02.556532398Z [2024-03-29 02:59:02,556: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T02:59:02.560481401Z [2024-03-29 02:59:02,560: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:59:02.560753089Z [2024-03-29 02:59:02,560: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:59:02.561251978Z [2024-03-29 02:59:02,560: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:59:02.561476042Z [2024-03-29 02:59:02,561: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T02:59:02.562047628Z [2024-03-29 02:59:02,561: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T02:59:02.562208324Z [2024-03-29 02:59:02,562: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:59:02.653464876Z [2024-03-29 02:59:02,653: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:59:02.684527388Z [2024-03-29 02:59:02,683: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T02:59:02.688069802Z [2024-03-29 02:59:02,687: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T02:59:02.715018090Z [2024-03-29 02:59:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T02:59:02.717011767Z [2024-03-29 02:59:02,716: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T02:59:02.717223062Z [2024-03-29 02:59:02,716: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T02:59:02.717493604Z [2024-03-29 02:59:02,717: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T02:59:02.717655913Z [2024-03-29 02:59:02,717: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T02:59:02.718012058Z [2024-03-29 02:59:02,717: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T02:59:02.718177461Z [2024-03-29 02:59:02,717: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T02:59:02.810858931Z [2024-03-29 02:59:02,810: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T02:59:04.188496586Z [2024-03-29 02:59:04,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ada4b45-7bc1-41f7-bb5c-bf8113c6bf34] succeeded in 3.242908799998986s: None 2024-03-29T02:59:04.899893254Z [2024-03-29 02:59:04,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4dcb4948-80b2-4c74-9a63-b071faa6d431] succeeded in 3.9598157340005855s: None 2024-03-29T03:00:01.241123928Z [2024-03-29 03:00:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c403ce4a-1e34-4507-a230-ec82546d0805] received 2024-03-29T03:00:01.254023497Z [2024-03-29 03:00:01,253: INFO/ForkPoolWorker-15] [c403ce4a-1e34-4507-a230-ec82546d0805] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:00:01.264474966Z [2024-03-29 03:00:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27413439-45a5-4165-8faa-20a6fd9459c9] received 2024-03-29T03:00:01.267511625Z [2024-03-29 03:00:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a7c9bca-b0c2-4cd6-93db-28da9a6c7f3d] received 2024-03-29T03:00:01.269687606Z [2024-03-29 03:00:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e0b40a0-07ca-4705-a6a9-692d8f3c9728] received 2024-03-29T03:00:01.271770845Z [2024-03-29 03:00:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0823b61-5154-4965-9a88-cd1ce98b3eee] received 2024-03-29T03:00:01.277356128Z [2024-03-29 03:00:01,277: INFO/ForkPoolWorker-1] [5a7c9bca-b0c2-4cd6-93db-28da9a6c7f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:00:01.283193338Z [2024-03-29 03:00:01,282: INFO/ForkPoolWorker-16] [27413439-45a5-4165-8faa-20a6fd9459c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:00:01.287465958Z [2024-03-29 03:00:01,287: INFO/ForkPoolWorker-3] [e0823b61-5154-4965-9a88-cd1ce98b3eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:00:01.288198387Z [2024-03-29 03:00:01,287: INFO/ForkPoolWorker-2] [0e0b40a0-07ca-4705-a6a9-692d8f3c9728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:01.687087863Z [2024-03-29 03:00:01,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:00:01.763954789Z [2024-03-29 03:00:01,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:00:01.894296644Z [2024-03-29 03:00:01,893: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:00:01.913648080Z [2024-03-29 03:00:01,913: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:01.965141946Z [2024-03-29 03:00:01,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:00:01.966541365Z [2024-03-29 03:00:01,966: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:00:01.966685365Z [2024-03-29 03:00:01,966: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:00:01.966790801Z [2024-03-29 03:00:01,966: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:00:01.967038095Z [2024-03-29 03:00:01,966: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:00:01.976100630Z [2024-03-29 03:00:01,972: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:00:02.072208148Z [2024-03-29 03:00:02,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:02.132368993Z [2024-03-29 03:00:02,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:00:02.307594801Z [2024-03-29 03:00:02,296: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:00:02.449495811Z [2024-03-29 03:00:02,449: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:03.019136240Z [2024-03-29 03:00:03,018: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c403ce4a-1e34-4507-a230-ec82546d0805] succeeded in 1.7756352799988235s: None 2024-03-29T03:00:03.265653163Z [2024-03-29 03:00:03,265: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e0823b61-5154-4965-9a88-cd1ce98b3eee] succeeded in 1.9911364689996844s: None 2024-03-29T03:00:03.718505866Z [2024-03-29 03:00:03,718: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:00:03.722853014Z [2024-03-29 03:00:03,721: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:03.747247370Z [2024-03-29 03:00:03,746: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:00:03.749179439Z [2024-03-29 03:00:03,748: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:03.749449082Z [2024-03-29 03:00:03,749: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:03.749760848Z [2024-03-29 03:00:03,749: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:03.749998243Z [2024-03-29 03:00:03,749: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:00:03.750549603Z [2024-03-29 03:00:03,750: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:00:03.750764623Z [2024-03-29 03:00:03,750: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:03.846639955Z [2024-03-29 03:00:03,846: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:03.961518050Z [2024-03-29 03:00:03,961: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:00:03.965187852Z [2024-03-29 03:00:03,964: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:03.987612874Z [2024-03-29 03:00:03,987: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:00:03.989854321Z [2024-03-29 03:00:03,989: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:03.990110973Z [2024-03-29 03:00:03,989: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:03.990493185Z [2024-03-29 03:00:03,990: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:03.990791899Z [2024-03-29 03:00:03,990: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:00:03.991365180Z [2024-03-29 03:00:03,991: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:00:03.992233102Z [2024-03-29 03:00:03,991: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:04.058342224Z [2024-03-29 03:00:04,057: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:00:04.062185924Z [2024-03-29 03:00:04,061: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:04.100452520Z [2024-03-29 03:00:04,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:00:04.104145777Z [2024-03-29 03:00:04,103: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:04.104175755Z [2024-03-29 03:00:04,104: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:04.104439170Z [2024-03-29 03:00:04,104: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:04.104733092Z [2024-03-29 03:00:04,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:00:04.104922611Z [2024-03-29 03:00:04,104: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:04.105403164Z [2024-03-29 03:00:04,105: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:00:04.105684207Z [2024-03-29 03:00:04,105: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:04.209528688Z [2024-03-29 03:00:04,209: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:04.850685433Z [2024-03-29 03:00:04,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e0b40a0-07ca-4705-a6a9-692d8f3c9728] succeeded in 3.576285895000183s: None 2024-03-29T03:00:05.371006696Z [2024-03-29 03:00:05,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d404d6b2-e599-49e3-ae94-f650f632b506] received 2024-03-29T03:00:05.392811297Z [2024-03-29 03:00:05,392: INFO/ForkPoolWorker-15] [d404d6b2-e599-49e3-ae94-f650f632b506] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:05.824169914Z [2024-03-29 03:00:05,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:00:06.376103146Z [2024-03-29 03:00:06,375: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a7c9bca-b0c2-4cd6-93db-28da9a6c7f3d] succeeded in 5.106757991001359s: None 2024-03-29T03:00:06.528054400Z [2024-03-29 03:00:06,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27413439-45a5-4165-8faa-20a6fd9459c9] succeeded in 5.261734589999833s: None 2024-03-29T03:00:07.507092516Z [2024-03-29 03:00:07,506: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:00:07.513838099Z [2024-03-29 03:00:07,513: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:07.549253603Z [2024-03-29 03:00:07,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:00:07.550591548Z [2024-03-29 03:00:07,550: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:07.550725057Z [2024-03-29 03:00:07,550: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:07.550862357Z [2024-03-29 03:00:07,550: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:07.550956877Z [2024-03-29 03:00:07,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:00:07.551383816Z [2024-03-29 03:00:07,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:00:07.551491802Z [2024-03-29 03:00:07,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:07.639898530Z [2024-03-29 03:00:07,639: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:08.403052918Z [2024-03-29 03:00:08,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d404d6b2-e599-49e3-ae94-f650f632b506] succeeded in 3.027379685001506s: None 2024-03-29T03:00:09.085637837Z [2024-03-29 03:00:09,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed2d1fe-b894-403b-877d-38a8e0a32080] received 2024-03-29T03:00:09.093533309Z [2024-03-29 03:00:09,093: INFO/ForkPoolWorker-15] [bed2d1fe-b894-403b-877d-38a8e0a32080] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:00:09.437388601Z [2024-03-29 03:00:09,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:00:10.645038598Z [2024-03-29 03:00:10,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:00:10.651281429Z [2024-03-29 03:00:10,650: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:10.671875847Z [2024-03-29 03:00:10,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:00:10.673260858Z [2024-03-29 03:00:10,672: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:10.673278946Z [2024-03-29 03:00:10,673: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:10.673427446Z [2024-03-29 03:00:10,673: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:10.673453699Z [2024-03-29 03:00:10,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:00:10.673710833Z [2024-03-29 03:00:10,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:00:10.673718997Z [2024-03-29 03:00:10,673: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:10.770918589Z [2024-03-29 03:00:10,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:12.308200975Z [2024-03-29 03:00:12,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bed2d1fe-b894-403b-877d-38a8e0a32080] succeeded in 3.220753962001254s: None 2024-03-29T03:00:13.096967805Z [2024-03-29 03:00:13,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a7dff27-6dc1-4b26-b7c7-534eac541b98] received 2024-03-29T03:00:13.105589203Z [2024-03-29 03:00:13,105: INFO/ForkPoolWorker-15] [3a7dff27-6dc1-4b26-b7c7-534eac541b98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:13.442276854Z [2024-03-29 03:00:13,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:00:14.705139872Z [2024-03-29 03:00:14,704: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:00:14.708473808Z [2024-03-29 03:00:14,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:00:14.726051055Z [2024-03-29 03:00:14,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:00:14.727277312Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:00:14.727309567Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:00:14.727380597Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:00:14.727386112Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:00:14.727628965Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:00:14.727669683Z [2024-03-29 03:00:14,727: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:00:14.831265431Z [2024-03-29 03:00:14,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:00:15.488543423Z [2024-03-29 03:00:15,488: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a7dff27-6dc1-4b26-b7c7-534eac541b98] succeeded in 2.38842620899959s: None 2024-03-29T03:01:00.423052772Z [2024-03-29 03:01:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ed852b1-8b84-4e1f-9054-fac87700187a] received 2024-03-29T03:01:00.425244435Z [2024-03-29 03:01:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ac68235-fa69-4e30-abbb-3e56f4ce7363] received 2024-03-29T03:01:00.432407680Z [2024-03-29 03:01:00,432: INFO/ForkPoolWorker-15] [5ed852b1-8b84-4e1f-9054-fac87700187a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:01:00.434517745Z [2024-03-29 03:01:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96554769-aa03-4c2e-b034-ca8360613ee8] received 2024-03-29T03:01:00.436259872Z [2024-03-29 03:01:00,435: INFO/ForkPoolWorker-16] [2ac68235-fa69-4e30-abbb-3e56f4ce7363] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:01:00.447721125Z [2024-03-29 03:01:00,447: INFO/ForkPoolWorker-1] [96554769-aa03-4c2e-b034-ca8360613ee8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:01:00.764352583Z [2024-03-29 03:01:00,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:01:00.775265612Z [2024-03-29 03:01:00,771: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:01:00.789055114Z [2024-03-29 03:01:00,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:01:00.942680182Z [2024-03-29 03:01:00,942: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:01:00.947122561Z [2024-03-29 03:01:00,946: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:01:00.977678241Z [2024-03-29 03:01:00,977: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:01:00.983550950Z [2024-03-29 03:01:00,983: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:01:00.984393387Z [2024-03-29 03:01:00,983: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:01:00.984523618Z [2024-03-29 03:01:00,984: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:01:00.984847336Z [2024-03-29 03:01:00,984: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:01:01.095321519Z [2024-03-29 03:01:01,094: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:01:01.794031656Z [2024-03-29 03:01:01,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96554769-aa03-4c2e-b034-ca8360613ee8] succeeded in 1.3577608819996385s: None 2024-03-29T03:01:02.087452216Z [2024-03-29 03:01:02,086: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:01:02.094224428Z [2024-03-29 03:01:02,093: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:01:02.110229090Z [2024-03-29 03:01:02,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:01:02.114258215Z [2024-03-29 03:01:02,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:01:02.120164163Z [2024-03-29 03:01:02,119: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:01:02.121901697Z [2024-03-29 03:01:02,121: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:01:02.121918091Z [2024-03-29 03:01:02,121: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:01:02.122063586Z [2024-03-29 03:01:02,121: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:01:02.122164695Z [2024-03-29 03:01:02,122: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:01:02.122558749Z [2024-03-29 03:01:02,122: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:01:02.122637075Z [2024-03-29 03:01:02,122: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:01:02.139510211Z [2024-03-29 03:01:02,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:01:02.141674014Z [2024-03-29 03:01:02,141: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:01:02.141694879Z [2024-03-29 03:01:02,141: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:01:02.141800842Z [2024-03-29 03:01:02,141: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:01:02.141858557Z [2024-03-29 03:01:02,141: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:01:02.142147774Z [2024-03-29 03:01:02,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:01:02.142226606Z [2024-03-29 03:01:02,142: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:01:02.211373265Z [2024-03-29 03:01:02,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:01:02.250764440Z [2024-03-29 03:01:02,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:01:03.930091233Z [2024-03-29 03:01:03,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ed852b1-8b84-4e1f-9054-fac87700187a] succeeded in 3.5047526439993817s: None 2024-03-29T03:01:04.955924466Z [2024-03-29 03:01:04,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ac68235-fa69-4e30-abbb-3e56f4ce7363] succeeded in 4.528608220998649s: None 2024-03-29T03:02:00.710750133Z [2024-03-29 03:02:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7206a414-4366-483b-be81-596bfb61eceb] received 2024-03-29T03:02:00.713425504Z [2024-03-29 03:02:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f92f679-40b6-4153-a12d-03736399fc56] received 2024-03-29T03:02:00.717888123Z [2024-03-29 03:02:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73d69169-8236-4b11-8d04-5e4afda30cec] received 2024-03-29T03:02:00.720697468Z [2024-03-29 03:02:00,720: INFO/ForkPoolWorker-16] [2f92f679-40b6-4153-a12d-03736399fc56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:02:00.721209628Z [2024-03-29 03:02:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de9b3eb1-09af-4b03-8676-974056e2870d] received 2024-03-29T03:02:00.731543656Z [2024-03-29 03:02:00,731: INFO/ForkPoolWorker-15] [7206a414-4366-483b-be81-596bfb61eceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:02:00.732163096Z [2024-03-29 03:02:00,731: INFO/ForkPoolWorker-2] [de9b3eb1-09af-4b03-8676-974056e2870d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:02:00.750907686Z [2024-03-29 03:02:00,750: INFO/ForkPoolWorker-1] [73d69169-8236-4b11-8d04-5e4afda30cec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:02:01.079061816Z [2024-03-29 03:02:01,075: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:02:01.232107504Z [2024-03-29 03:02:01,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:02:01.266589095Z [2024-03-29 03:02:01,262: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:02:01.358092993Z [2024-03-29 03:02:01,354: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:02:01.411611355Z [2024-03-29 03:02:01,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:02:01.495291645Z [2024-03-29 03:02:01,494: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:02:01.499879215Z [2024-03-29 03:02:01,499: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:02:01.552277365Z [2024-03-29 03:02:01,551: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:02:01.554057938Z [2024-03-29 03:02:01,553: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:02:01.554319618Z [2024-03-29 03:02:01,554: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:02:01.554526363Z [2024-03-29 03:02:01,554: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:02:01.554920504Z [2024-03-29 03:02:01,554: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:02:01.747581450Z [2024-03-29 03:02:01,747: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:02:02.195818710Z [2024-03-29 03:02:02,195: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7206a414-4366-483b-be81-596bfb61eceb] succeeded in 1.480956815999889s: None 2024-03-29T03:02:02.589414789Z [2024-03-29 03:02:02,588: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[de9b3eb1-09af-4b03-8676-974056e2870d] succeeded in 1.8658710939998855s: None 2024-03-29T03:02:02.925328844Z [2024-03-29 03:02:02,924: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:02:02.929265265Z [2024-03-29 03:02:02,928: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:02:02.951486596Z [2024-03-29 03:02:02,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:02:02.953128471Z [2024-03-29 03:02:02,952: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:02:02.953382772Z [2024-03-29 03:02:02,953: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:02:02.953693045Z [2024-03-29 03:02:02,953: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:02:02.953844878Z [2024-03-29 03:02:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:02:02.954258391Z [2024-03-29 03:02:02,954: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:02:02.954867555Z [2024-03-29 03:02:02,954: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:02:03.002023778Z [2024-03-29 03:02:03,001: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:02:03.005668731Z [2024-03-29 03:02:03,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:02:03.049135143Z [2024-03-29 03:02:03,048: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:02:03.049181104Z [2024-03-29 03:02:03,048: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:02:03.050716546Z [2024-03-29 03:02:03,050: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:02:03.050769003Z [2024-03-29 03:02:03,050: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:02:03.050880241Z [2024-03-29 03:02:03,050: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:02:03.050894281Z [2024-03-29 03:02:03,050: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:02:03.051178025Z [2024-03-29 03:02:03,051: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:02:03.051184453Z [2024-03-29 03:02:03,051: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:02:03.134724825Z [2024-03-29 03:02:03,134: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:02:04.546040242Z [2024-03-29 03:02:04,545: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73d69169-8236-4b11-8d04-5e4afda30cec] succeeded in 3.823217774999648s: None 2024-03-29T03:02:05.352237189Z [2024-03-29 03:02:05,351: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f92f679-40b6-4153-a12d-03736399fc56] succeeded in 4.637453675999495s: None 2024-03-29T03:03:00.411893484Z [2024-03-29 03:03:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[facc7d53-9283-4564-b301-70c6189e4876] received 2024-03-29T03:03:00.420406595Z [2024-03-29 03:03:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ba86437-2feb-403b-a219-6a30b0c35c5f] received 2024-03-29T03:03:00.421381502Z [2024-03-29 03:03:00,421: INFO/ForkPoolWorker-15] [facc7d53-9283-4564-b301-70c6189e4876] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:03:00.427983981Z [2024-03-29 03:03:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64abf334-9f75-4de1-9cc9-cc6ee724b29b] received 2024-03-29T03:03:00.435532539Z [2024-03-29 03:03:00,435: INFO/ForkPoolWorker-1] [64abf334-9f75-4de1-9cc9-cc6ee724b29b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:03:00.438473853Z [2024-03-29 03:03:00,438: INFO/ForkPoolWorker-16] [3ba86437-2feb-403b-a219-6a30b0c35c5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:03:00.734179235Z [2024-03-29 03:03:00,731: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:03:00.746873843Z [2024-03-29 03:03:00,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:03:00.756346778Z [2024-03-29 03:03:00,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:03:00.962583092Z [2024-03-29 03:03:00,962: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:03:00.966611539Z [2024-03-29 03:03:00,966: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:03:00.987289569Z [2024-03-29 03:03:00,987: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:03:00.988223904Z [2024-03-29 03:03:00,988: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:03:00.988388856Z [2024-03-29 03:03:00,988: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:03:00.988524004Z [2024-03-29 03:03:00,988: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:03:00.988818117Z [2024-03-29 03:03:00,988: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:03:01.087611770Z [2024-03-29 03:03:01,087: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:03:01.668464364Z [2024-03-29 03:03:01,667: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64abf334-9f75-4de1-9cc9-cc6ee724b29b] succeeded in 1.2381657360001554s: None 2024-03-29T03:03:01.872089741Z [2024-03-29 03:03:01,871: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:03:01.875598083Z [2024-03-29 03:03:01,875: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:03:01.905189831Z [2024-03-29 03:03:01,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:03:01.907627513Z [2024-03-29 03:03:01,907: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:03:01.907661790Z [2024-03-29 03:03:01,907: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:03:01.907817073Z [2024-03-29 03:03:01,907: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:03:01.907901932Z [2024-03-29 03:03:01,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:03:01.908831675Z [2024-03-29 03:03:01,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:03:01.909123437Z [2024-03-29 03:03:01,908: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:03:01.999699525Z [2024-03-29 03:03:01,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:03:02.102126172Z [2024-03-29 03:03:02,101: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:03:02.105796866Z [2024-03-29 03:03:02,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:03:02.134124016Z [2024-03-29 03:03:02,133: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:03:02.135846059Z [2024-03-29 03:03:02,135: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:03:02.135861644Z [2024-03-29 03:03:02,135: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:03:02.135994201Z [2024-03-29 03:03:02,135: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:03:02.136062048Z [2024-03-29 03:03:02,135: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:03:02.136326376Z [2024-03-29 03:03:02,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:03:02.136347311Z [2024-03-29 03:03:02,136: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:03:02.269997431Z [2024-03-29 03:03:02,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:03:03.466982995Z [2024-03-29 03:03:03,466: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ba86437-2feb-403b-a219-6a30b0c35c5f] succeeded in 3.0403296399999817s: None 2024-03-29T03:03:04.121511544Z [2024-03-29 03:03:04,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[facc7d53-9283-4564-b301-70c6189e4876] succeeded in 3.706684446999134s: None 2024-03-29T03:04:01.015738430Z [2024-03-29 03:04:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba2de48d-6674-46b8-8c71-cc8c5ef864e9] received 2024-03-29T03:04:01.018206919Z [2024-03-29 03:04:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22af57fb-b777-49f3-877a-83f59d5a8b69] received 2024-03-29T03:04:01.021316327Z [2024-03-29 03:04:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f5471fd-f4f8-4911-944a-a23628579dbc] received 2024-03-29T03:04:01.024918287Z [2024-03-29 03:04:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7f9dc49-a2d1-4cb4-a7fe-6f66bd529732] received 2024-03-29T03:04:01.031241041Z [2024-03-29 03:04:01,030: INFO/ForkPoolWorker-16] [22af57fb-b777-49f3-877a-83f59d5a8b69] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:04:01.033273567Z [2024-03-29 03:04:01,033: INFO/ForkPoolWorker-2] [d7f9dc49-a2d1-4cb4-a7fe-6f66bd529732] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:04:01.036493536Z [2024-03-29 03:04:01,036: INFO/ForkPoolWorker-15] [ba2de48d-6674-46b8-8c71-cc8c5ef864e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:04:01.036739138Z [2024-03-29 03:04:01,036: INFO/ForkPoolWorker-1] [2f5471fd-f4f8-4911-944a-a23628579dbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:04:01.410329277Z [2024-03-29 03:04:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:04:01.428209196Z [2024-03-29 03:04:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:04:01.579376504Z [2024-03-29 03:04:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:04:01.759628973Z [2024-03-29 03:04:01,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:04:01.819227487Z [2024-03-29 03:04:01,818: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:04:02.061057060Z [2024-03-29 03:04:02,060: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:04:02.073627443Z [2024-03-29 03:04:02,071: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:04:02.128104271Z [2024-03-29 03:04:02,127: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:04:02.131749784Z [2024-03-29 03:04:02,131: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:04:02.131849579Z [2024-03-29 03:04:02,131: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:04:02.131899582Z [2024-03-29 03:04:02,131: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:04:02.132201412Z [2024-03-29 03:04:02,132: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:04:02.230719280Z [2024-03-29 03:04:02,230: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:04:02.602085256Z [2024-03-29 03:04:02,601: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f5471fd-f4f8-4911-944a-a23628579dbc] succeeded in 1.5786074420011573s: None 2024-03-29T03:04:02.906058552Z [2024-03-29 03:04:02,905: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:04:02.909945888Z [2024-03-29 03:04:02,909: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:04:02.940862005Z [2024-03-29 03:04:02,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:04:02.942663245Z [2024-03-29 03:04:02,942: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:04:02.942819564Z [2024-03-29 03:04:02,942: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:04:02.943077456Z [2024-03-29 03:04:02,942: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:04:02.943103732Z [2024-03-29 03:04:02,942: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:04:02.943379112Z [2024-03-29 03:04:02,943: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:04:02.943414507Z [2024-03-29 03:04:02,943: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:04:03.039648025Z [2024-03-29 03:04:03,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:04:03.057808426Z [2024-03-29 03:04:03,057: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22af57fb-b777-49f3-877a-83f59d5a8b69] succeeded in 2.03718777100039s: None 2024-03-29T03:04:03.192775992Z [2024-03-29 03:04:03,192: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:04:03.196261708Z [2024-03-29 03:04:03,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:04:03.223337701Z [2024-03-29 03:04:03,223: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:04:03.224996176Z [2024-03-29 03:04:03,224: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:04:03.225061404Z [2024-03-29 03:04:03,224: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:04:03.225216025Z [2024-03-29 03:04:03,225: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:04:03.225294602Z [2024-03-29 03:04:03,225: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:04:03.226596840Z [2024-03-29 03:04:03,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:04:03.227194791Z [2024-03-29 03:04:03,226: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:04:03.380771602Z [2024-03-29 03:04:03,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:04:04.973906164Z [2024-03-29 03:04:04,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba2de48d-6674-46b8-8c71-cc8c5ef864e9] succeeded in 3.9537774360014737s: None 2024-03-29T03:04:05.039118786Z [2024-03-29 03:04:05,038: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d7f9dc49-a2d1-4cb4-a7fe-6f66bd529732] succeeded in 4.012208926000312s: None 2024-03-29T03:05:01.300124610Z [2024-03-29 03:05:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6f660a8-77ad-4ef5-946d-514813dd0375] received 2024-03-29T03:05:01.305365317Z [2024-03-29 03:05:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c65f809b-d9bd-45c1-a5b0-28f3f7bad781] received 2024-03-29T03:05:01.308156161Z [2024-03-29 03:05:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b900041e-36b9-4b10-b2cc-a55aa766576f] received 2024-03-29T03:05:01.310366394Z [2024-03-29 03:05:01,309: INFO/ForkPoolWorker-15] [e6f660a8-77ad-4ef5-946d-514813dd0375] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:01.314383893Z [2024-03-29 03:05:01,314: INFO/ForkPoolWorker-16] [c65f809b-d9bd-45c1-a5b0-28f3f7bad781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:05:01.316369479Z [2024-03-29 03:05:01,316: INFO/ForkPoolWorker-1] [b900041e-36b9-4b10-b2cc-a55aa766576f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:05:01.319856194Z [2024-03-29 03:05:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daec25be-ae8f-4691-aff3-e169f33018be] received 2024-03-29T03:05:01.328710653Z [2024-03-29 03:05:01,328: INFO/ForkPoolWorker-2] [daec25be-ae8f-4691-aff3-e169f33018be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:05:01.768141539Z [2024-03-29 03:05:01,762: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:05:01.787991158Z [2024-03-29 03:05:01,783: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:05:01.803587717Z [2024-03-29 03:05:01,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:05:01.814935523Z [2024-03-29 03:05:01,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:05:02.140770210Z [2024-03-29 03:05:02,140: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:05:02.147940021Z [2024-03-29 03:05:02,147: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:02.180397152Z [2024-03-29 03:05:02,180: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:05:02.181914703Z [2024-03-29 03:05:02,181: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:05:02.182401041Z [2024-03-29 03:05:02,181: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:05:02.182753983Z [2024-03-29 03:05:02,182: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:05:02.183375968Z [2024-03-29 03:05:02,182: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:05:02.330067677Z [2024-03-29 03:05:02,329: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:03.115620956Z [2024-03-29 03:05:03,115: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[daec25be-ae8f-4691-aff3-e169f33018be] succeeded in 1.7938778319985431s: None 2024-03-29T03:05:03.437280638Z [2024-03-29 03:05:03,436: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:05:03.441107493Z [2024-03-29 03:05:03,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:03.476228737Z [2024-03-29 03:05:03,475: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:05:03.479275384Z [2024-03-29 03:05:03,478: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:03.479616963Z [2024-03-29 03:05:03,479: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:03.481133025Z [2024-03-29 03:05:03,479: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:03.481353508Z [2024-03-29 03:05:03,481: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:05:03.481824488Z [2024-03-29 03:05:03,481: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:05:03.482615856Z [2024-03-29 03:05:03,481: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:03.582404489Z [2024-03-29 03:05:03,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:03.589772841Z [2024-03-29 03:05:03,589: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:05:03.593606711Z [2024-03-29 03:05:03,593: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:03.620970060Z [2024-03-29 03:05:03,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:05:03.623737398Z [2024-03-29 03:05:03,623: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:03.623884243Z [2024-03-29 03:05:03,623: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:03.624063856Z [2024-03-29 03:05:03,623: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:03.624086195Z [2024-03-29 03:05:03,624: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:05:03.624430857Z [2024-03-29 03:05:03,624: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:05:03.624445947Z [2024-03-29 03:05:03,624: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:03.755245603Z [2024-03-29 03:05:03,754: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:03.917072559Z [2024-03-29 03:05:03,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:05:03.921063446Z [2024-03-29 03:05:03,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:03.976292677Z [2024-03-29 03:05:03,975: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:05:03.978627472Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:03.978654310Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:03.978676371Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:03.978682781Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:05:03.978953112Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:05:03.978976347Z [2024-03-29 03:05:03,978: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:04.123273930Z [2024-03-29 03:05:04,122: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:04.434749524Z [2024-03-29 03:05:04,434: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6f660a8-77ad-4ef5-946d-514813dd0375] succeeded in 3.130718438000258s: None 2024-03-29T03:05:05.137032813Z [2024-03-29 03:05:05,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a531ab6-975f-4891-b2fd-573a6c5eb287] received 2024-03-29T03:05:05.170648683Z [2024-03-29 03:05:05,166: INFO/ForkPoolWorker-15] [8a531ab6-975f-4891-b2fd-573a6c5eb287] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:05.526566346Z [2024-03-29 03:05:05,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:05:06.105799733Z [2024-03-29 03:05:06,105: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c65f809b-d9bd-45c1-a5b0-28f3f7bad781] succeeded in 4.7984388709992345s: None 2024-03-29T03:05:06.272917660Z [2024-03-29 03:05:06,272: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b900041e-36b9-4b10-b2cc-a55aa766576f] succeeded in 4.962123744000564s: None 2024-03-29T03:05:07.230754426Z [2024-03-29 03:05:07,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:05:07.230803269Z [2024-03-29 03:05:07,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:07.303476454Z [2024-03-29 03:05:07,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:05:07.306738021Z [2024-03-29 03:05:07,306: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:07.308571339Z [2024-03-29 03:05:07,307: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:07.308586132Z [2024-03-29 03:05:07,307: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:07.308590530Z [2024-03-29 03:05:07,307: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:05:07.309481869Z [2024-03-29 03:05:07,308: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:05:07.310353826Z [2024-03-29 03:05:07,309: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:07.543602487Z [2024-03-29 03:05:07,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:08.380440212Z [2024-03-29 03:05:08,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a531ab6-975f-4891-b2fd-573a6c5eb287] succeeded in 3.2361899280003854s: None 2024-03-29T03:05:08.393636551Z [2024-03-29 03:05:08,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1baf5676-c2b2-4ffc-9c2d-cde497f61867] received 2024-03-29T03:05:08.419004780Z [2024-03-29 03:05:08,418: INFO/ForkPoolWorker-15] [1baf5676-c2b2-4ffc-9c2d-cde497f61867] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:05:08.762337413Z [2024-03-29 03:05:08,755: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:05:09.893695196Z [2024-03-29 03:05:09,893: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:05:09.897074896Z [2024-03-29 03:05:09,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:09.918239651Z [2024-03-29 03:05:09,917: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:05:09.920297076Z [2024-03-29 03:05:09,920: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:09.920373927Z [2024-03-29 03:05:09,920: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:09.920605398Z [2024-03-29 03:05:09,920: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:09.920709190Z [2024-03-29 03:05:09,920: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:05:09.921129526Z [2024-03-29 03:05:09,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:05:09.921248703Z [2024-03-29 03:05:09,921: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:10.022801492Z [2024-03-29 03:05:10,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:11.437418575Z [2024-03-29 03:05:11,436: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1baf5676-c2b2-4ffc-9c2d-cde497f61867] succeeded in 3.037946189999275s: None 2024-03-29T03:05:11.879481710Z [2024-03-29 03:05:11,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f6db97f-dafa-44b4-a22c-f5200d8fae20] received 2024-03-29T03:05:11.887841903Z [2024-03-29 03:05:11,887: INFO/ForkPoolWorker-15] [0f6db97f-dafa-44b4-a22c-f5200d8fae20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:12.245234995Z [2024-03-29 03:05:12,241: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:05:13.416362384Z [2024-03-29 03:05:13,415: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:05:13.419716715Z [2024-03-29 03:05:13,419: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:05:13.446030508Z [2024-03-29 03:05:13,445: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:05:13.447245841Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:05:13.447321988Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:05:13.447469865Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:05:13.447535884Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:05:13.447868122Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:05:13.447936933Z [2024-03-29 03:05:13,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:05:13.532424227Z [2024-03-29 03:05:13,532: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:05:14.065520424Z [2024-03-29 03:05:14,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f6db97f-dafa-44b4-a22c-f5200d8fae20] succeeded in 2.1832263080013945s: None 2024-03-29T03:06:00.206891618Z [2024-03-29 03:06:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69308a48-7854-4941-880e-9e9d3893c184] received 2024-03-29T03:06:00.211032490Z [2024-03-29 03:06:00,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[676db413-a898-4b4d-a5d0-514d582ec638] received 2024-03-29T03:06:00.215165495Z [2024-03-29 03:06:00,214: INFO/ForkPoolWorker-15] [69308a48-7854-4941-880e-9e9d3893c184] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:06:00.221004923Z [2024-03-29 03:06:00,220: INFO/ForkPoolWorker-16] [676db413-a898-4b4d-a5d0-514d582ec638] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:06:00.231818718Z [2024-03-29 03:06:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cfe8c91-b193-45cc-b8c0-ea5d0ba2226b] received 2024-03-29T03:06:00.263181263Z [2024-03-29 03:06:00,262: INFO/ForkPoolWorker-1] [7cfe8c91-b193-45cc-b8c0-ea5d0ba2226b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:06:00.636393427Z [2024-03-29 03:06:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64e47150-1d73-4dbd-b95d-0971f1f8dbe8] received 2024-03-29T03:06:00.646599622Z [2024-03-29 03:06:00,646: INFO/ForkPoolWorker-2] [64e47150-1d73-4dbd-b95d-0971f1f8dbe8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:06:00.698528333Z [2024-03-29 03:06:00,695: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:06:00.774619915Z [2024-03-29 03:06:00,771: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:06:00.912227919Z [2024-03-29 03:06:00,906: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:06:00.975545703Z [2024-03-29 03:06:00,975: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:06:00.980905166Z [2024-03-29 03:06:00,980: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:06:01.007615617Z [2024-03-29 03:06:01,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:06:01.011481635Z [2024-03-29 03:06:01,011: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:06:01.011770913Z [2024-03-29 03:06:01,011: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:06:01.011982148Z [2024-03-29 03:06:01,011: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:06:01.012443878Z [2024-03-29 03:06:01,012: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:06:01.085663589Z [2024-03-29 03:06:01,082: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:06:01.091326362Z [2024-03-29 03:06:01,091: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:06:01.136065094Z [2024-03-29 03:06:01,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:06:01.822216503Z [2024-03-29 03:06:01,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[676db413-a898-4b4d-a5d0-514d582ec638] succeeded in 1.609186513000168s: None 2024-03-29T03:06:01.844728555Z [2024-03-29 03:06:01,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69308a48-7854-4941-880e-9e9d3893c184] succeeded in 1.6356540839988156s: None 2024-03-29T03:06:02.365788710Z [2024-03-29 03:06:02,365: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:06:02.369968707Z [2024-03-29 03:06:02,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:06:02.390542042Z [2024-03-29 03:06:02,390: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:06:02.392083559Z [2024-03-29 03:06:02,391: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:06:02.392106254Z [2024-03-29 03:06:02,391: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:06:02.392189782Z [2024-03-29 03:06:02,392: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:06:02.392215263Z [2024-03-29 03:06:02,392: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:06:02.392472162Z [2024-03-29 03:06:02,392: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:06:02.392491665Z [2024-03-29 03:06:02,392: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:06:02.482854026Z [2024-03-29 03:06:02,482: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:06:02.553546719Z [2024-03-29 03:06:02,552: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:06:02.557422668Z [2024-03-29 03:06:02,556: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:06:02.580041966Z [2024-03-29 03:06:02,579: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:06:02.581507976Z [2024-03-29 03:06:02,581: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:06:02.581594582Z [2024-03-29 03:06:02,581: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:06:02.581863179Z [2024-03-29 03:06:02,581: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:06:02.582011640Z [2024-03-29 03:06:02,581: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:06:02.582345160Z [2024-03-29 03:06:02,582: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:06:02.582492594Z [2024-03-29 03:06:02,582: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:06:02.655614613Z [2024-03-29 03:06:02,655: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:06:04.067495289Z [2024-03-29 03:06:04,067: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cfe8c91-b193-45cc-b8c0-ea5d0ba2226b] succeeded in 3.8294857860000775s: None 2024-03-29T03:06:04.884327655Z [2024-03-29 03:06:04,883: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[64e47150-1d73-4dbd-b95d-0971f1f8dbe8] succeeded in 4.244921840998359s: None 2024-03-29T03:07:00.871343525Z [2024-03-29 03:07:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32969edb-4a44-4eeb-aa03-aa075079cf5d] received 2024-03-29T03:07:00.874180386Z [2024-03-29 03:07:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da10cdfb-ba73-40fc-837a-acadbe4cc041] received 2024-03-29T03:07:00.889059124Z [2024-03-29 03:07:00,888: INFO/ForkPoolWorker-16] [da10cdfb-ba73-40fc-837a-acadbe4cc041] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:07:00.890181660Z [2024-03-29 03:07:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[712a68a7-8c0e-4a77-86f7-50773574bc11] received 2024-03-29T03:07:00.903221716Z [2024-03-29 03:07:00,902: INFO/ForkPoolWorker-15] [32969edb-4a44-4eeb-aa03-aa075079cf5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:07:00.908964140Z [2024-03-29 03:07:00,908: INFO/ForkPoolWorker-1] [712a68a7-8c0e-4a77-86f7-50773574bc11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:07:01.287283309Z [2024-03-29 03:07:01,283: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:07:01.369897829Z [2024-03-29 03:07:01,365: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:07:01.392295898Z [2024-03-29 03:07:01,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:07:01.544349228Z [2024-03-29 03:07:01,543: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:07:01.548788306Z [2024-03-29 03:07:01,548: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:07:01.575592876Z [2024-03-29 03:07:01,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:07:01.576773976Z [2024-03-29 03:07:01,576: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:07:01.576911126Z [2024-03-29 03:07:01,576: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:07:01.576966481Z [2024-03-29 03:07:01,576: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:07:01.577121024Z [2024-03-29 03:07:01,576: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:07:01.678985429Z [2024-03-29 03:07:01,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:07:02.865444550Z [2024-03-29 03:07:02,865: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da10cdfb-ba73-40fc-837a-acadbe4cc041] succeeded in 1.9892125229998783s: None 2024-03-29T03:07:02.914768131Z [2024-03-29 03:07:02,914: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:07:02.922885496Z [2024-03-29 03:07:02,922: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:07:02.963313001Z [2024-03-29 03:07:02,963: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:07:02.969786533Z [2024-03-29 03:07:02,969: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:07:02.969979749Z [2024-03-29 03:07:02,969: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:07:02.970303209Z [2024-03-29 03:07:02,969: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:07:02.970662025Z [2024-03-29 03:07:02,970: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:07:02.971244661Z [2024-03-29 03:07:02,971: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:07:02.971514944Z [2024-03-29 03:07:02,971: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:07:03.217315041Z [2024-03-29 03:07:03,216: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:07:03.413446797Z [2024-03-29 03:07:03,412: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:07:03.417365639Z [2024-03-29 03:07:03,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:07:03.444305815Z [2024-03-29 03:07:03,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:07:03.451831896Z [2024-03-29 03:07:03,451: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:07:03.451891021Z [2024-03-29 03:07:03,451: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:07:03.451979828Z [2024-03-29 03:07:03,451: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:07:03.452147479Z [2024-03-29 03:07:03,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:07:03.452534100Z [2024-03-29 03:07:03,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:07:03.452557131Z [2024-03-29 03:07:03,452: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:07:03.534278489Z [2024-03-29 03:07:03,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:07:05.282957599Z [2024-03-29 03:07:05,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32969edb-4a44-4eeb-aa03-aa075079cf5d] succeeded in 4.407526688000871s: None 2024-03-29T03:07:05.368293102Z [2024-03-29 03:07:05,367: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[712a68a7-8c0e-4a77-86f7-50773574bc11] succeeded in 4.474853178000558s: None 2024-03-29T03:08:00.817575809Z [2024-03-29 03:08:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3704562e-7baf-4b5e-bb33-dffe27463f20] received 2024-03-29T03:08:00.825856188Z [2024-03-29 03:08:00,825: INFO/ForkPoolWorker-15] [3704562e-7baf-4b5e-bb33-dffe27463f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:08:00.831073301Z [2024-03-29 03:08:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24d4a07f-6942-4396-8b2d-603dd0482cfa] received 2024-03-29T03:08:00.833887128Z [2024-03-29 03:08:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79821d7b-f1d2-413e-bbe6-4fcc314c6f72] received 2024-03-29T03:08:00.835803149Z [2024-03-29 03:08:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6373e69c-60c1-425b-ac0c-bc62fa097737] received 2024-03-29T03:08:00.841768252Z [2024-03-29 03:08:00,841: INFO/ForkPoolWorker-16] [24d4a07f-6942-4396-8b2d-603dd0482cfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:08:00.850742626Z [2024-03-29 03:08:00,850: INFO/ForkPoolWorker-2] [6373e69c-60c1-425b-ac0c-bc62fa097737] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:08:00.853216148Z [2024-03-29 03:08:00,852: INFO/ForkPoolWorker-1] [79821d7b-f1d2-413e-bbe6-4fcc314c6f72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:08:01.190498259Z [2024-03-29 03:08:01,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:08:01.207674320Z [2024-03-29 03:08:01,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:08:01.270534443Z [2024-03-29 03:08:01,266: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:08:01.310696556Z [2024-03-29 03:08:01,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:08:01.465031302Z [2024-03-29 03:08:01,464: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:08:01.469448855Z [2024-03-29 03:08:01,468: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:08:01.518704819Z [2024-03-29 03:08:01,518: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:08:01.523047950Z [2024-03-29 03:08:01,522: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:08:01.523813736Z [2024-03-29 03:08:01,523: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:08:01.524242137Z [2024-03-29 03:08:01,524: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:08:01.524563693Z [2024-03-29 03:08:01,524: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:08:01.547802143Z [2024-03-29 03:08:01,547: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:08:01.707694875Z [2024-03-29 03:08:01,707: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:08:02.456370366Z [2024-03-29 03:08:02,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3704562e-7baf-4b5e-bb33-dffe27463f20] succeeded in 1.6368635609997s: None 2024-03-29T03:08:02.595967755Z [2024-03-29 03:08:02,595: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6373e69c-60c1-425b-ac0c-bc62fa097737] succeeded in 1.7509178220007016s: None 2024-03-29T03:08:03.013501073Z [2024-03-29 03:08:03,013: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:08:03.017467823Z [2024-03-29 03:08:03,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:08:03.043649712Z [2024-03-29 03:08:03,043: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:08:03.046421266Z [2024-03-29 03:08:03,046: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:08:03.046589707Z [2024-03-29 03:08:03,046: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:08:03.046614287Z [2024-03-29 03:08:03,046: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:08:03.046680210Z [2024-03-29 03:08:03,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:08:03.047154009Z [2024-03-29 03:08:03,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:08:03.047337333Z [2024-03-29 03:08:03,047: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:08:03.142835121Z [2024-03-29 03:08:03,142: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:08:03.148092752Z [2024-03-29 03:08:03,147: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:08:03.151687809Z [2024-03-29 03:08:03,151: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:08:03.180313745Z [2024-03-29 03:08:03,180: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:08:03.181946721Z [2024-03-29 03:08:03,181: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:08:03.181963683Z [2024-03-29 03:08:03,181: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:08:03.182049956Z [2024-03-29 03:08:03,181: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:08:03.182059895Z [2024-03-29 03:08:03,181: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:08:03.182367123Z [2024-03-29 03:08:03,182: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:08:03.182372636Z [2024-03-29 03:08:03,182: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:08:03.302663225Z [2024-03-29 03:08:03,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:08:05.587812896Z [2024-03-29 03:08:05,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79821d7b-f1d2-413e-bbe6-4fcc314c6f72] succeeded in 4.750575430000026s: None 2024-03-29T03:08:05.609650906Z [2024-03-29 03:08:05,609: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24d4a07f-6942-4396-8b2d-603dd0482cfa] succeeded in 4.773809395001081s: None 2024-03-29T03:09:00.560991606Z [2024-03-29 03:09:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06fbe195-c98a-4c30-a19b-c788cc20f79a] received 2024-03-29T03:09:00.566794160Z [2024-03-29 03:09:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddfe7471-ee52-4c48-a67f-6d4ae0c9566f] received 2024-03-29T03:09:00.571115988Z [2024-03-29 03:09:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15365aa2-958a-4a2c-957c-9286d76ac130] received 2024-03-29T03:09:00.573333809Z [2024-03-29 03:09:00,573: INFO/ForkPoolWorker-15] [06fbe195-c98a-4c30-a19b-c788cc20f79a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:09:00.584587807Z [2024-03-29 03:09:00,584: INFO/ForkPoolWorker-16] [ddfe7471-ee52-4c48-a67f-6d4ae0c9566f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:09:00.588809694Z [2024-03-29 03:09:00,587: INFO/ForkPoolWorker-1] [15365aa2-958a-4a2c-957c-9286d76ac130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:09:00.959286353Z [2024-03-29 03:09:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:09:00.972475327Z [2024-03-29 03:09:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:09:00.978578890Z [2024-03-29 03:09:00,970: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:09:01.146829414Z [2024-03-29 03:09:01,146: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:09:01.151270181Z [2024-03-29 03:09:01,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:09:01.221636411Z [2024-03-29 03:09:01,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:09:01.231695249Z [2024-03-29 03:09:01,231: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:09:01.231956740Z [2024-03-29 03:09:01,231: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:09:01.232029629Z [2024-03-29 03:09:01,231: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:09:01.233302016Z [2024-03-29 03:09:01,233: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:09:01.380496127Z [2024-03-29 03:09:01,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:09:02.163393598Z [2024-03-29 03:09:02,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06fbe195-c98a-4c30-a19b-c788cc20f79a] succeeded in 1.5987821800008533s: None 2024-03-29T03:09:02.553685173Z [2024-03-29 03:09:02,553: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:09:02.557156754Z [2024-03-29 03:09:02,556: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:09:02.584332991Z [2024-03-29 03:09:02,583: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:09:02.587022603Z [2024-03-29 03:09:02,586: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:09:02.587041855Z [2024-03-29 03:09:02,586: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:09:02.587250114Z [2024-03-29 03:09:02,586: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:09:02.587368960Z [2024-03-29 03:09:02,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:09:02.587921522Z [2024-03-29 03:09:02,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:09:02.588122740Z [2024-03-29 03:09:02,587: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:09:02.688391451Z [2024-03-29 03:09:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:09:02.704086881Z [2024-03-29 03:09:02,703: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:09:02.707491134Z [2024-03-29 03:09:02,706: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:09:02.749406626Z [2024-03-29 03:09:02,749: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:09:02.751567893Z [2024-03-29 03:09:02,751: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:09:02.751659119Z [2024-03-29 03:09:02,751: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:09:02.751952246Z [2024-03-29 03:09:02,751: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:09:02.752108414Z [2024-03-29 03:09:02,751: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:09:02.752525923Z [2024-03-29 03:09:02,752: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:09:02.752884658Z [2024-03-29 03:09:02,752: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:09:02.880206230Z [2024-03-29 03:09:02,879: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:09:04.538004190Z [2024-03-29 03:09:04,537: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15365aa2-958a-4a2c-957c-9286d76ac130] succeeded in 3.9636962690001383s: None 2024-03-29T03:09:04.774429470Z [2024-03-29 03:09:04,773: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ddfe7471-ee52-4c48-a67f-6d4ae0c9566f] succeeded in 4.202788325999791s: None 2024-03-29T03:10:00.924193726Z [2024-03-29 03:10:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[577dc35a-6b95-410f-98c5-82dc4e2c9ac2] received 2024-03-29T03:10:00.925896744Z [2024-03-29 03:10:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[262859ae-b490-4c50-aaa9-9d4d80215bdb] received 2024-03-29T03:10:00.929797222Z [2024-03-29 03:10:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6843cd1-0e2a-43c1-a98a-398fe92c5f9d] received 2024-03-29T03:10:00.931624910Z [2024-03-29 03:10:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce105f59-6a39-405c-bdc8-51419b7f4fef] received 2024-03-29T03:10:00.932709132Z [2024-03-29 03:10:00,932: INFO/ForkPoolWorker-16] [262859ae-b490-4c50-aaa9-9d4d80215bdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:10:00.935994975Z [2024-03-29 03:10:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efd8dabb-0526-4bb4-aeab-b943f13e24e0] received 2024-03-29T03:10:00.936557395Z [2024-03-29 03:10:00,936: INFO/ForkPoolWorker-1] [f6843cd1-0e2a-43c1-a98a-398fe92c5f9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:10:00.938665582Z [2024-03-29 03:10:00,938: INFO/ForkPoolWorker-15] [577dc35a-6b95-410f-98c5-82dc4e2c9ac2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:00.945764133Z [2024-03-29 03:10:00,945: INFO/ForkPoolWorker-2] [ce105f59-6a39-405c-bdc8-51419b7f4fef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:10:00.951871761Z [2024-03-29 03:10:00,951: INFO/ForkPoolWorker-3] [efd8dabb-0526-4bb4-aeab-b943f13e24e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:10:01.299362689Z [2024-03-29 03:10:01,294: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:10:01.390501038Z [2024-03-29 03:10:01,387: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:10:01.533011347Z [2024-03-29 03:10:01,528: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:10:01.630859442Z [2024-03-29 03:10:01,630: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:10:01.636228994Z [2024-03-29 03:10:01,635: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:01.663213308Z [2024-03-29 03:10:01,662: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:10:01.665343538Z [2024-03-29 03:10:01,665: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:10:01.665734841Z [2024-03-29 03:10:01,665: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:10:01.666004070Z [2024-03-29 03:10:01,665: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:10:01.666606835Z [2024-03-29 03:10:01,666: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:10:01.679344623Z [2024-03-29 03:10:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:10:01.776138026Z [2024-03-29 03:10:01,764: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:10:01.825066940Z [2024-03-29 03:10:01,824: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:02.156712749Z [2024-03-29 03:10:02,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:02.748725400Z [2024-03-29 03:10:02,748: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6843cd1-0e2a-43c1-a98a-398fe92c5f9d] succeeded in 1.8170256880002853s: None 2024-03-29T03:10:02.951001670Z [2024-03-29 03:10:02,950: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[262859ae-b490-4c50-aaa9-9d4d80215bdb] succeeded in 2.0236826929995004s: None 2024-03-29T03:10:03.494130571Z [2024-03-29 03:10:03,493: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:10:03.497522775Z [2024-03-29 03:10:03,496: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:03.524240463Z [2024-03-29 03:10:03,523: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:10:03.526552426Z [2024-03-29 03:10:03,526: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:03.526925511Z [2024-03-29 03:10:03,526: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:03.527094783Z [2024-03-29 03:10:03,526: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:03.527179059Z [2024-03-29 03:10:03,527: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:10:03.527479443Z [2024-03-29 03:10:03,527: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:10:03.527574122Z [2024-03-29 03:10:03,527: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:03.681612601Z [2024-03-29 03:10:03,681: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:03.706106964Z [2024-03-29 03:10:03,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:10:03.712994149Z [2024-03-29 03:10:03,712: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:03.745359816Z [2024-03-29 03:10:03,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:10:03.747651901Z [2024-03-29 03:10:03,747: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:03.747680274Z [2024-03-29 03:10:03,747: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:03.747936881Z [2024-03-29 03:10:03,747: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:03.748049284Z [2024-03-29 03:10:03,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:10:03.748559764Z [2024-03-29 03:10:03,748: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:10:03.748595528Z [2024-03-29 03:10:03,748: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:03.881136998Z [2024-03-29 03:10:03,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:04.062901749Z [2024-03-29 03:10:04,062: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T03:10:04.066394971Z [2024-03-29 03:10:04,065: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:04.095385864Z [2024-03-29 03:10:04,095: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T03:10:04.096709220Z [2024-03-29 03:10:04,096: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:04.096752164Z [2024-03-29 03:10:04,096: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:04.096823816Z [2024-03-29 03:10:04,096: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:04.096888195Z [2024-03-29 03:10:04,096: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T03:10:04.097162277Z [2024-03-29 03:10:04,097: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:10:04.097173990Z [2024-03-29 03:10:04,097: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:04.180468393Z [2024-03-29 03:10:04,180: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:04.557413452Z [2024-03-29 03:10:04,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7a0fb24-701a-44bf-9043-8d99765f9d32] received 2024-03-29T03:10:04.570939741Z [2024-03-29 03:10:04,570: INFO/ForkPoolWorker-16] [f7a0fb24-701a-44bf-9043-8d99765f9d32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:04.625007077Z [2024-03-29 03:10:04,624: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[577dc35a-6b95-410f-98c5-82dc4e2c9ac2] succeeded in 3.6964371350004512s: None 2024-03-29T03:10:04.972200420Z [2024-03-29 03:10:04,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:10:06.188711049Z [2024-03-29 03:10:06,179: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ce105f59-6a39-405c-bdc8-51419b7f4fef] succeeded in 5.246571693998703s: None 2024-03-29T03:10:06.249161245Z [2024-03-29 03:10:06,248: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[efd8dabb-0526-4bb4-aeab-b943f13e24e0] succeeded in 5.309370637000029s: None 2024-03-29T03:10:06.807828219Z [2024-03-29 03:10:06,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:10:06.811668226Z [2024-03-29 03:10:06,811: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:06.841551692Z [2024-03-29 03:10:06,841: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:10:06.843211841Z [2024-03-29 03:10:06,842: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:06.843401420Z [2024-03-29 03:10:06,843: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:06.843657150Z [2024-03-29 03:10:06,843: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:06.843826248Z [2024-03-29 03:10:06,843: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:10:06.844210065Z [2024-03-29 03:10:06,844: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:10:06.844398649Z [2024-03-29 03:10:06,844: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:06.951555340Z [2024-03-29 03:10:06,951: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:07.825913460Z [2024-03-29 03:10:07,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7a0fb24-701a-44bf-9043-8d99765f9d32] succeeded in 3.2654783880007017s: None 2024-03-29T03:10:08.034756361Z [2024-03-29 03:10:08,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea127c3f-b97b-48ee-972b-d72d9cf0a3b3] received 2024-03-29T03:10:08.046500477Z [2024-03-29 03:10:08,046: INFO/ForkPoolWorker-15] [ea127c3f-b97b-48ee-972b-d72d9cf0a3b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:10:08.375495557Z [2024-03-29 03:10:08,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:10:09.680010474Z [2024-03-29 03:10:09,679: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:10:09.683401037Z [2024-03-29 03:10:09,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:09.700330523Z [2024-03-29 03:10:09,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:10:09.701925760Z [2024-03-29 03:10:09,701: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:09.702043334Z [2024-03-29 03:10:09,701: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:09.702269243Z [2024-03-29 03:10:09,702: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:09.702389992Z [2024-03-29 03:10:09,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:10:09.702816770Z [2024-03-29 03:10:09,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:10:09.702962613Z [2024-03-29 03:10:09,702: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:09.790409258Z [2024-03-29 03:10:09,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:11.202420272Z [2024-03-29 03:10:11,202: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea127c3f-b97b-48ee-972b-d72d9cf0a3b3] succeeded in 3.1634974569988117s: None 2024-03-29T03:10:11.398424493Z [2024-03-29 03:10:11,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca2a377e-36c8-4a86-b7af-e3c4412d6073] received 2024-03-29T03:10:11.405836408Z [2024-03-29 03:10:11,405: INFO/ForkPoolWorker-15] [ca2a377e-36c8-4a86-b7af-e3c4412d6073] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:11.668529067Z [2024-03-29 03:10:11,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:10:12.817839033Z [2024-03-29 03:10:12,817: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:10:12.821402202Z [2024-03-29 03:10:12,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:10:12.842327886Z [2024-03-29 03:10:12,842: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:10:12.843776584Z [2024-03-29 03:10:12,843: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:10:12.843796765Z [2024-03-29 03:10:12,843: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:10:12.843913510Z [2024-03-29 03:10:12,843: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:10:12.843934013Z [2024-03-29 03:10:12,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:10:12.844238637Z [2024-03-29 03:10:12,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:10:12.844327859Z [2024-03-29 03:10:12,844: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:10:12.933511129Z [2024-03-29 03:10:12,933: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:10:13.513599248Z [2024-03-29 03:10:13,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca2a377e-36c8-4a86-b7af-e3c4412d6073] succeeded in 2.1137939269992785s: None 2024-03-29T03:11:00.984321548Z [2024-03-29 03:11:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80b145eb-efc6-4d29-9704-3432857f19fc] received 2024-03-29T03:11:00.993973269Z [2024-03-29 03:11:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc95c699-074f-454f-a217-5bbc7d41fa89] received 2024-03-29T03:11:00.995242422Z [2024-03-29 03:11:00,994: INFO/ForkPoolWorker-15] [80b145eb-efc6-4d29-9704-3432857f19fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:11:01.004548014Z [2024-03-29 03:11:01,004: INFO/ForkPoolWorker-16] [bc95c699-074f-454f-a217-5bbc7d41fa89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:11:01.009657048Z [2024-03-29 03:11:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da032306-4774-4493-b875-2d9b41ed417a] received 2024-03-29T03:11:01.023196945Z [2024-03-29 03:11:01,022: INFO/ForkPoolWorker-1] [da032306-4774-4493-b875-2d9b41ed417a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:11:01.320107167Z [2024-03-29 03:11:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:11:01.373543224Z [2024-03-29 03:11:01,369: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:11:01.422914227Z [2024-03-29 03:11:01,419: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:11:01.603065304Z [2024-03-29 03:11:01,602: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:11:01.607584321Z [2024-03-29 03:11:01,606: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:11:01.634725209Z [2024-03-29 03:11:01,634: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:11:01.636326923Z [2024-03-29 03:11:01,636: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:11:01.636564665Z [2024-03-29 03:11:01,636: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:11:01.636625073Z [2024-03-29 03:11:01,636: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:11:01.637096458Z [2024-03-29 03:11:01,636: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:11:01.792212629Z [2024-03-29 03:11:01,791: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:11:02.583012992Z [2024-03-29 03:11:02,582: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da032306-4774-4493-b875-2d9b41ed417a] succeeded in 1.5713785059997463s: None 2024-03-29T03:11:02.680130007Z [2024-03-29 03:11:02,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:11:02.683718075Z [2024-03-29 03:11:02,683: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:11:02.688100787Z [2024-03-29 03:11:02,687: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:11:02.691870180Z [2024-03-29 03:11:02,691: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:11:02.719438740Z [2024-03-29 03:11:02,719: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:11:02.724145937Z [2024-03-29 03:11:02,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:11:02.725672229Z [2024-03-29 03:11:02,725: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:11:02.726324883Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:11:02.726579794Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:11:02.726635672Z [2024-03-29 03:11:02,725: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:11:02.726851210Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:11:02.726857666Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:11:02.726907784Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:11:02.727014807Z [2024-03-29 03:11:02,726: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:11:02.727426213Z [2024-03-29 03:11:02,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:11:02.727509609Z [2024-03-29 03:11:02,727: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:11:02.730916974Z [2024-03-29 03:11:02,730: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:11:02.733161197Z [2024-03-29 03:11:02,730: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:11:02.834928282Z [2024-03-29 03:11:02,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:11:02.838531926Z [2024-03-29 03:11:02,838: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:11:05.365629894Z [2024-03-29 03:11:05,365: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc95c699-074f-454f-a217-5bbc7d41fa89] succeeded in 4.369896091000555s: None 2024-03-29T03:11:05.891347347Z [2024-03-29 03:11:05,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80b145eb-efc6-4d29-9704-3432857f19fc] succeeded in 4.901107592000699s: None 2024-03-29T03:11:54.504607490Z [2024-03-29 03:11:54,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26d18ce6-44c8-4b89-98de-b2a32c8439de] received 2024-03-29T03:11:54.511324169Z [2024-03-29 03:11:54,511: INFO/ForkPoolWorker-15] [26d18ce6-44c8-4b89-98de-b2a32c8439de] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031153_387322', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:11:54.817268962Z [2024-03-29 03:11:54,809: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-29T03:11:55.213610317Z [2024-03-29 03:11:55,213: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:11:55.787384981Z [2024-03-29 03:11:55,786: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26d18ce6-44c8-4b89-98de-b2a32c8439de] succeeded in 1.2806762370000797s: None 2024-03-29T03:12:00.796556764Z [2024-03-29 03:12:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88861309-88d8-418c-aeff-313a8be806c1] received 2024-03-29T03:12:00.799047716Z [2024-03-29 03:12:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b860fd05-6e1b-48e0-b6c6-6982556e8d35] received 2024-03-29T03:12:00.812780859Z [2024-03-29 03:12:00,812: INFO/ForkPoolWorker-16] [b860fd05-6e1b-48e0-b6c6-6982556e8d35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:12:00.814217377Z [2024-03-29 03:12:00,813: INFO/ForkPoolWorker-15] [88861309-88d8-418c-aeff-313a8be806c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:12:00.827240217Z [2024-03-29 03:12:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d697812e-cb5c-4014-9de0-45150c96d097] received 2024-03-29T03:12:00.830778334Z [2024-03-29 03:12:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac764b69-cbb6-424b-b2a6-2ba2ca6ad2cf] received 2024-03-29T03:12:00.849308640Z [2024-03-29 03:12:00,848: INFO/ForkPoolWorker-2] [ac764b69-cbb6-424b-b2a6-2ba2ca6ad2cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:12:00.850028098Z [2024-03-29 03:12:00,849: INFO/ForkPoolWorker-1] [d697812e-cb5c-4014-9de0-45150c96d097] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:12:01.174384562Z [2024-03-29 03:12:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:12:01.196054576Z [2024-03-29 03:12:01,189: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:12:01.230326675Z [2024-03-29 03:12:01,227: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:12:01.288883743Z [2024-03-29 03:12:01,285: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:12:01.476056924Z [2024-03-29 03:12:01,475: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:12:01.484596698Z [2024-03-29 03:12:01,484: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:12:01.532007496Z [2024-03-29 03:12:01,531: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:12:01.539958920Z [2024-03-29 03:12:01,539: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:12:01.540936577Z [2024-03-29 03:12:01,540: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:12:01.541213954Z [2024-03-29 03:12:01,540: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:12:01.541278633Z [2024-03-29 03:12:01,541: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:12:01.541553277Z [2024-03-29 03:12:01,541: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:12:01.734265399Z [2024-03-29 03:12:01,733: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:12:02.577983965Z [2024-03-29 03:12:02,577: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88861309-88d8-418c-aeff-313a8be806c1] succeeded in 1.7708010300011665s: None 2024-03-29T03:12:02.709458974Z [2024-03-29 03:12:02,708: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac764b69-cbb6-424b-b2a6-2ba2ca6ad2cf] succeeded in 1.8736908779992518s: None 2024-03-29T03:12:02.956424679Z [2024-03-29 03:12:02,955: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:12:02.960164894Z [2024-03-29 03:12:02,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:12:02.986087760Z [2024-03-29 03:12:02,983: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:12:02.987949675Z [2024-03-29 03:12:02,987: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:12:02.987969652Z [2024-03-29 03:12:02,987: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:12:02.988156689Z [2024-03-29 03:12:02,987: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:12:02.988284534Z [2024-03-29 03:12:02,988: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:12:02.988960013Z [2024-03-29 03:12:02,988: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:12:02.989212084Z [2024-03-29 03:12:02,988: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:12:03.105523578Z [2024-03-29 03:12:03,105: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:12:03.175839577Z [2024-03-29 03:12:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:12:03.179459466Z [2024-03-29 03:12:03,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:12:03.219237556Z [2024-03-29 03:12:03,218: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:12:03.223373312Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:12:03.223471366Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:12:03.223486103Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:12:03.223490585Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:12:03.223794564Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:12:03.223806000Z [2024-03-29 03:12:03,223: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:12:03.363051829Z [2024-03-29 03:12:03,362: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:12:05.976654054Z [2024-03-29 03:12:05,975: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d697812e-cb5c-4014-9de0-45150c96d097] succeeded in 5.146264303999487s: None 2024-03-29T03:12:06.854844833Z [2024-03-29 03:12:06,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b860fd05-6e1b-48e0-b6c6-6982556e8d35] succeeded in 6.053644493998945s: None 2024-03-29T03:13:00.625867914Z [2024-03-29 03:13:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23dfd90e-3ff3-40ef-b76f-c079a69066dd] received 2024-03-29T03:13:00.628116009Z [2024-03-29 03:13:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9400d0b-c329-45d1-badd-235698cfce1e] received 2024-03-29T03:13:00.629699289Z [2024-03-29 03:13:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90ab472b-0e55-457e-b0a1-7edc2d672e97] received 2024-03-29T03:13:00.638644046Z [2024-03-29 03:13:00,638: INFO/ForkPoolWorker-16] [a9400d0b-c329-45d1-badd-235698cfce1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:13:00.638737071Z [2024-03-29 03:13:00,638: INFO/ForkPoolWorker-1] [90ab472b-0e55-457e-b0a1-7edc2d672e97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:13:00.643475601Z [2024-03-29 03:13:00,643: INFO/ForkPoolWorker-15] [23dfd90e-3ff3-40ef-b76f-c079a69066dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:13:01.030426204Z [2024-03-29 03:13:01,027: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:13:01.042033269Z [2024-03-29 03:13:01,038: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:13:01.077914822Z [2024-03-29 03:13:01,074: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:13:01.221290928Z [2024-03-29 03:13:01,220: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:13:01.225371683Z [2024-03-29 03:13:01,224: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:13:01.260930645Z [2024-03-29 03:13:01,260: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:13:01.262621412Z [2024-03-29 03:13:01,262: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:13:01.262894824Z [2024-03-29 03:13:01,262: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:13:01.263123681Z [2024-03-29 03:13:01,262: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:13:01.263568375Z [2024-03-29 03:13:01,263: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:13:01.360318468Z [2024-03-29 03:13:01,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:13:02.050789364Z [2024-03-29 03:13:02,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23dfd90e-3ff3-40ef-b76f-c079a69066dd] succeeded in 1.4228719460006687s: None 2024-03-29T03:13:02.429728338Z [2024-03-29 03:13:02,429: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:13:02.434257864Z [2024-03-29 03:13:02,433: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:13:02.460046225Z [2024-03-29 03:13:02,459: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:13:02.461746633Z [2024-03-29 03:13:02,461: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:13:02.461803854Z [2024-03-29 03:13:02,461: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:13:02.462093014Z [2024-03-29 03:13:02,461: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:13:02.462157667Z [2024-03-29 03:13:02,462: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:13:02.462565016Z [2024-03-29 03:13:02,462: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:13:02.462656846Z [2024-03-29 03:13:02,462: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:13:02.479938130Z [2024-03-29 03:13:02,479: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:13:02.483718689Z [2024-03-29 03:13:02,483: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:13:02.515891528Z [2024-03-29 03:13:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:13:02.519990834Z [2024-03-29 03:13:02,519: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:13:02.520222127Z [2024-03-29 03:13:02,520: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:13:02.520538400Z [2024-03-29 03:13:02,520: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:13:02.520736792Z [2024-03-29 03:13:02,520: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:13:02.521176975Z [2024-03-29 03:13:02,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:13:02.521414707Z [2024-03-29 03:13:02,521: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:13:02.565823076Z [2024-03-29 03:13:02,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:13:02.632239794Z [2024-03-29 03:13:02,631: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:13:04.545026234Z [2024-03-29 03:13:04,544: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9400d0b-c329-45d1-badd-235698cfce1e] succeeded in 3.913440559999799s: None 2024-03-29T03:13:04.874807703Z [2024-03-29 03:13:04,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90ab472b-0e55-457e-b0a1-7edc2d672e97] succeeded in 4.242785758999162s: None 2024-03-29T03:14:00.502951985Z [2024-03-29 03:14:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4abeb4-ce2d-4077-81fb-7c97a4c45434] received 2024-03-29T03:14:00.510059435Z [2024-03-29 03:14:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8bb8e65-a62f-42d9-b35c-8388940b4b96] received 2024-03-29T03:14:00.515267708Z [2024-03-29 03:14:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[991bbb77-c9bd-425c-b8b7-db7be6bd11cb] received 2024-03-29T03:14:00.515814548Z [2024-03-29 03:14:00,515: INFO/ForkPoolWorker-15] [aa4abeb4-ce2d-4077-81fb-7c97a4c45434] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:14:00.530894052Z [2024-03-29 03:14:00,530: INFO/ForkPoolWorker-16] [f8bb8e65-a62f-42d9-b35c-8388940b4b96] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:14:00.531573115Z [2024-03-29 03:14:00,531: INFO/ForkPoolWorker-1] [991bbb77-c9bd-425c-b8b7-db7be6bd11cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:14:00.533072398Z [2024-03-29 03:14:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d968c1-9906-4feb-88ee-408d6998be09] received 2024-03-29T03:14:00.543570212Z [2024-03-29 03:14:00,543: INFO/ForkPoolWorker-2] [20d968c1-9906-4feb-88ee-408d6998be09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:14:00.828667091Z [2024-03-29 03:14:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:14:00.964741008Z [2024-03-29 03:14:00,958: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:14:00.996033803Z [2024-03-29 03:14:00,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:14:01.092948641Z [2024-03-29 03:14:01,088: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:14:01.153208297Z [2024-03-29 03:14:01,152: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:14:01.296829974Z [2024-03-29 03:14:01,296: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:14:01.301050395Z [2024-03-29 03:14:01,300: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:14:01.333897612Z [2024-03-29 03:14:01,333: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:14:01.335329495Z [2024-03-29 03:14:01,335: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:14:01.335493580Z [2024-03-29 03:14:01,335: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:14:01.335620906Z [2024-03-29 03:14:01,335: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:14:01.335866905Z [2024-03-29 03:14:01,335: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:14:01.464399855Z [2024-03-29 03:14:01,464: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:14:01.892907266Z [2024-03-29 03:14:01,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8bb8e65-a62f-42d9-b35c-8388940b4b96] succeeded in 1.3752597399998194s: None 2024-03-29T03:14:02.290208651Z [2024-03-29 03:14:02,289: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[991bbb77-c9bd-425c-b8b7-db7be6bd11cb] succeeded in 1.7676944820013887s: None 2024-03-29T03:14:02.538869207Z [2024-03-29 03:14:02,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:14:02.542612670Z [2024-03-29 03:14:02,541: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:14:02.561783358Z [2024-03-29 03:14:02,561: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:14:02.563123234Z [2024-03-29 03:14:02,562: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:14:02.563140752Z [2024-03-29 03:14:02,563: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:14:02.563290993Z [2024-03-29 03:14:02,563: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:14:02.563351219Z [2024-03-29 03:14:02,563: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:14:02.563682054Z [2024-03-29 03:14:02,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:14:02.563691315Z [2024-03-29 03:14:02,563: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:14:02.597662904Z [2024-03-29 03:14:02,597: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:14:02.601250686Z [2024-03-29 03:14:02,600: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:14:02.629051106Z [2024-03-29 03:14:02,628: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:14:02.631974533Z [2024-03-29 03:14:02,631: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:14:02.632082394Z [2024-03-29 03:14:02,631: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:14:02.632302720Z [2024-03-29 03:14:02,632: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:14:02.632429403Z [2024-03-29 03:14:02,632: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:14:02.632906062Z [2024-03-29 03:14:02,632: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:14:02.633193250Z [2024-03-29 03:14:02,633: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:14:02.675294841Z [2024-03-29 03:14:02,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:14:02.730433576Z [2024-03-29 03:14:02,730: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:14:04.660460233Z [2024-03-29 03:14:04,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa4abeb4-ce2d-4077-81fb-7c97a4c45434] succeeded in 4.155351878000147s: None 2024-03-29T03:14:05.699087836Z [2024-03-29 03:14:05,698: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20d968c1-9906-4feb-88ee-408d6998be09] succeeded in 5.1607592000000295s: None 2024-03-29T03:15:00.306691660Z [2024-03-29 03:15:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6a451ff-3669-4dc8-b5f9-b571e8743d93] received 2024-03-29T03:15:00.311542014Z [2024-03-29 03:15:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c1cafd0-2c0a-4ca5-8fb3-a4504a444abb] received 2024-03-29T03:15:00.315281736Z [2024-03-29 03:15:00,314: INFO/ForkPoolWorker-15] [f6a451ff-3669-4dc8-b5f9-b571e8743d93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:00.316178375Z [2024-03-29 03:15:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d43432c-9bca-481e-9cd1-c48c990d92f6] received 2024-03-29T03:15:00.319351547Z [2024-03-29 03:15:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f91e2baa-70c7-41ae-a78e-edd6ec1a995a] received 2024-03-29T03:15:00.321698798Z [2024-03-29 03:15:00,321: INFO/ForkPoolWorker-16] [6c1cafd0-2c0a-4ca5-8fb3-a4504a444abb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:15:00.323728633Z [2024-03-29 03:15:00,323: INFO/ForkPoolWorker-1] [3d43432c-9bca-481e-9cd1-c48c990d92f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:15:00.325381182Z [2024-03-29 03:15:00,325: INFO/ForkPoolWorker-2] [f91e2baa-70c7-41ae-a78e-edd6ec1a995a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:15:00.659010735Z [2024-03-29 03:15:00,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:15:00.689523764Z [2024-03-29 03:15:00,686: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:15:00.978329352Z [2024-03-29 03:15:00,967: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:15:01.206244439Z [2024-03-29 03:15:01,201: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:15:01.484997829Z [2024-03-29 03:15:01,484: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:15:01.499755108Z [2024-03-29 03:15:01,498: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:01.552865403Z [2024-03-29 03:15:01,552: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:15:01.557924241Z [2024-03-29 03:15:01,557: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:15:01.558128276Z [2024-03-29 03:15:01,557: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:15:01.558528288Z [2024-03-29 03:15:01,558: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:15:01.558973829Z [2024-03-29 03:15:01,558: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:15:01.780696466Z [2024-03-29 03:15:01,780: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:02.817254531Z [2024-03-29 03:15:02,816: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f91e2baa-70c7-41ae-a78e-edd6ec1a995a] succeeded in 2.4961964340000122s: None 2024-03-29T03:15:02.851297706Z [2024-03-29 03:15:02,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:15:02.855091132Z [2024-03-29 03:15:02,854: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:02.883653963Z [2024-03-29 03:15:02,883: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:15:02.885302640Z [2024-03-29 03:15:02,885: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:02.885547571Z [2024-03-29 03:15:02,885: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:02.885761743Z [2024-03-29 03:15:02,885: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:02.885917856Z [2024-03-29 03:15:02,885: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:15:02.886356386Z [2024-03-29 03:15:02,886: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:15:02.886888392Z [2024-03-29 03:15:02,886: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:03.029548275Z [2024-03-29 03:15:03,029: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:03.245666039Z [2024-03-29 03:15:03,245: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:15:03.251573413Z [2024-03-29 03:15:03,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:03.283183426Z [2024-03-29 03:15:03,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:15:03.286561026Z [2024-03-29 03:15:03,285: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:03.286923382Z [2024-03-29 03:15:03,286: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:03.287267507Z [2024-03-29 03:15:03,286: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:03.287493112Z [2024-03-29 03:15:03,287: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:15:03.288538694Z [2024-03-29 03:15:03,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:15:03.290828040Z [2024-03-29 03:15:03,288: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:03.331105004Z [2024-03-29 03:15:03,330: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:15:03.340211736Z [2024-03-29 03:15:03,334: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:03.392119276Z [2024-03-29 03:15:03,391: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:15:03.394034230Z [2024-03-29 03:15:03,393: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:03.394271863Z [2024-03-29 03:15:03,393: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:03.394667067Z [2024-03-29 03:15:03,394: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:03.394925128Z [2024-03-29 03:15:03,394: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:15:03.395561894Z [2024-03-29 03:15:03,395: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:15:03.395749026Z [2024-03-29 03:15:03,395: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:03.421561125Z [2024-03-29 03:15:03,421: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:03.505520170Z [2024-03-29 03:15:03,505: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:03.740024505Z [2024-03-29 03:15:03,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3adf23a-e269-4870-9170-50dc4f8b665e] received 2024-03-29T03:15:03.751660825Z [2024-03-29 03:15:03,751: INFO/ForkPoolWorker-2] [e3adf23a-e269-4870-9170-50dc4f8b665e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:03.812924244Z [2024-03-29 03:15:03,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6a451ff-3669-4dc8-b5f9-b571e8743d93] succeeded in 3.503933997999411s: None 2024-03-29T03:15:04.211664753Z [2024-03-29 03:15:04,208: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:15:05.438926631Z [2024-03-29 03:15:05,438: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:15:05.442376172Z [2024-03-29 03:15:05,441: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:05.464094422Z [2024-03-29 03:15:05,463: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:15:05.467696667Z [2024-03-29 03:15:05,467: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:05.467962513Z [2024-03-29 03:15:05,467: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:05.468158265Z [2024-03-29 03:15:05,467: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:05.468399397Z [2024-03-29 03:15:05,468: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:15:05.468819703Z [2024-03-29 03:15:05,468: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:15:05.468959508Z [2024-03-29 03:15:05,468: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:05.544152306Z [2024-03-29 03:15:05,543: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:05.887695366Z [2024-03-29 03:15:05,887: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d43432c-9bca-481e-9cd1-c48c990d92f6] succeeded in 5.569462793999264s: None 2024-03-29T03:15:06.436424323Z [2024-03-29 03:15:06,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f823c17d-a06c-480d-a841-e1de9b523177] received 2024-03-29T03:15:06.469059642Z [2024-03-29 03:15:06,468: INFO/ForkPoolWorker-15] [f823c17d-a06c-480d-a841-e1de9b523177] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:15:06.549973875Z [2024-03-29 03:15:06,549: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3adf23a-e269-4870-9170-50dc4f8b665e] succeeded in 2.8079815749988484s: None 2024-03-29T03:15:06.653005218Z [2024-03-29 03:15:06,648: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c1cafd0-2c0a-4ca5-8fb3-a4504a444abb] succeeded in 6.335348009000882s: None 2024-03-29T03:15:06.888363155Z [2024-03-29 03:15:06,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:15:08.329843440Z [2024-03-29 03:15:08,329: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:15:08.333165161Z [2024-03-29 03:15:08,332: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:08.361917565Z [2024-03-29 03:15:08,361: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:15:08.363240403Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:08.363258767Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:08.363379880Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:08.363424734Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:15:08.363750412Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:15:08.363796513Z [2024-03-29 03:15:08,363: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:08.453610312Z [2024-03-29 03:15:08,453: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:09.060049179Z [2024-03-29 03:15:09,059: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f823c17d-a06c-480d-a841-e1de9b523177] succeeded in 2.6213600219998625s: None 2024-03-29T03:15:09.338687969Z [2024-03-29 03:15:09,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c9c72a5-c037-472a-8fcc-46ef51628ab2] received 2024-03-29T03:15:09.347202373Z [2024-03-29 03:15:09,346: INFO/ForkPoolWorker-15] [4c9c72a5-c037-472a-8fcc-46ef51628ab2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:09.633704957Z [2024-03-29 03:15:09,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:15:10.810222113Z [2024-03-29 03:15:10,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:15:10.813698046Z [2024-03-29 03:15:10,813: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:15:10.844100568Z [2024-03-29 03:15:10,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:15:10.854724507Z [2024-03-29 03:15:10,854: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:15:10.854874224Z [2024-03-29 03:15:10,854: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:15:10.855125141Z [2024-03-29 03:15:10,854: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:15:10.855236379Z [2024-03-29 03:15:10,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:15:10.855626951Z [2024-03-29 03:15:10,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:15:10.857188973Z [2024-03-29 03:15:10,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:15:10.943668959Z [2024-03-29 03:15:10,943: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:15:11.511948036Z [2024-03-29 03:15:11,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c9c72a5-c037-472a-8fcc-46ef51628ab2] succeeded in 2.171513542998582s: None 2024-03-29T03:16:00.753568121Z [2024-03-29 03:16:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0759e413-d55c-4074-a362-f926050954d2] received 2024-03-29T03:16:00.755992051Z [2024-03-29 03:16:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a57b70ed-efce-4b92-abf7-53871cf56d1a] received 2024-03-29T03:16:00.760631405Z [2024-03-29 03:16:00,760: INFO/ForkPoolWorker-15] [0759e413-d55c-4074-a362-f926050954d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:16:00.762337210Z [2024-03-29 03:16:00,762: INFO/ForkPoolWorker-16] [a57b70ed-efce-4b92-abf7-53871cf56d1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:16:00.768129179Z [2024-03-29 03:16:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b2344c8-d394-4c8e-b6ff-955d68200eeb] received 2024-03-29T03:16:00.774784424Z [2024-03-29 03:16:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46dda6e4-c7cc-49a0-ac60-73ba64c1fe5f] received 2024-03-29T03:16:00.780234353Z [2024-03-29 03:16:00,779: INFO/ForkPoolWorker-2] [46dda6e4-c7cc-49a0-ac60-73ba64c1fe5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:16:00.780389228Z [2024-03-29 03:16:00,780: INFO/ForkPoolWorker-1] [4b2344c8-d394-4c8e-b6ff-955d68200eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:16:01.202937503Z [2024-03-29 03:16:01,199: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:16:01.272730692Z [2024-03-29 03:16:01,268: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:16:01.325035798Z [2024-03-29 03:16:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:16:01.374384929Z [2024-03-29 03:16:01,371: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:16:01.416757882Z [2024-03-29 03:16:01,416: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:16:01.423399962Z [2024-03-29 03:16:01,422: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:16:01.468256532Z [2024-03-29 03:16:01,467: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:16:01.473495978Z [2024-03-29 03:16:01,472: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:16:01.473523036Z [2024-03-29 03:16:01,473: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:16:01.473527646Z [2024-03-29 03:16:01,473: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:16:01.473743147Z [2024-03-29 03:16:01,473: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:16:01.605876168Z [2024-03-29 03:16:01,605: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:16:01.775047041Z [2024-03-29 03:16:01,774: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:16:02.517278998Z [2024-03-29 03:16:02,516: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[46dda6e4-c7cc-49a0-ac60-73ba64c1fe5f] succeeded in 1.7412977760013746s: None 2024-03-29T03:16:02.631976314Z [2024-03-29 03:16:02,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0759e413-d55c-4074-a362-f926050954d2] succeeded in 1.8761390439995012s: None 2024-03-29T03:16:03.197230894Z [2024-03-29 03:16:03,196: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:16:03.201057539Z [2024-03-29 03:16:03,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:16:03.224174727Z [2024-03-29 03:16:03,223: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:16:03.225810210Z [2024-03-29 03:16:03,225: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:16:03.225865460Z [2024-03-29 03:16:03,225: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:16:03.226024405Z [2024-03-29 03:16:03,225: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:16:03.226096889Z [2024-03-29 03:16:03,226: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:16:03.226433085Z [2024-03-29 03:16:03,226: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:16:03.226944611Z [2024-03-29 03:16:03,226: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:16:03.332405045Z [2024-03-29 03:16:03,332: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:16:03.456052456Z [2024-03-29 03:16:03,455: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:16:03.465036971Z [2024-03-29 03:16:03,464: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:16:03.499120396Z [2024-03-29 03:16:03,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:16:03.500963197Z [2024-03-29 03:16:03,500: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:16:03.501004136Z [2024-03-29 03:16:03,500: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:16:03.501161201Z [2024-03-29 03:16:03,500: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:16:03.501175595Z [2024-03-29 03:16:03,501: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:16:03.501538329Z [2024-03-29 03:16:03,501: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:16:03.501594388Z [2024-03-29 03:16:03,501: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:16:03.622678566Z [2024-03-29 03:16:03,622: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:16:05.428638059Z [2024-03-29 03:16:05,428: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b2344c8-d394-4c8e-b6ff-955d68200eeb] succeeded in 4.658780866999223s: None 2024-03-29T03:16:05.987044675Z [2024-03-29 03:16:05,986: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a57b70ed-efce-4b92-abf7-53871cf56d1a] succeeded in 5.229686472999674s: None 2024-03-29T03:17:01.121038860Z [2024-03-29 03:17:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15ee7986-22a4-45c7-987d-50a952f920ce] received 2024-03-29T03:17:01.126355894Z [2024-03-29 03:17:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b411dff-ebc2-41ff-a830-4fe7eb4235c0] received 2024-03-29T03:17:01.131896259Z [2024-03-29 03:17:01,131: INFO/ForkPoolWorker-15] [15ee7986-22a4-45c7-987d-50a952f920ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:17:01.134597581Z [2024-03-29 03:17:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[639c240a-3849-4c4f-b635-b4abd7edc896] received 2024-03-29T03:17:01.142020321Z [2024-03-29 03:17:01,141: INFO/ForkPoolWorker-16] [5b411dff-ebc2-41ff-a830-4fe7eb4235c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:17:01.158225779Z [2024-03-29 03:17:01,157: INFO/ForkPoolWorker-1] [639c240a-3849-4c4f-b635-b4abd7edc896] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:17:01.482513684Z [2024-03-29 03:17:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:17:01.504044713Z [2024-03-29 03:17:01,497: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:17:01.546679609Z [2024-03-29 03:17:01,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:17:01.708925135Z [2024-03-29 03:17:01,702: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:17:01.708967948Z [2024-03-29 03:17:01,706: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:17:01.753998054Z [2024-03-29 03:17:01,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:17:01.759772389Z [2024-03-29 03:17:01,759: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:17:01.759801913Z [2024-03-29 03:17:01,759: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:17:01.759864892Z [2024-03-29 03:17:01,759: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:17:01.760100416Z [2024-03-29 03:17:01,759: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:17:01.862584366Z [2024-03-29 03:17:01,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:17:02.491750696Z [2024-03-29 03:17:02,491: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b411dff-ebc2-41ff-a830-4fe7eb4235c0] succeeded in 1.3611425119997875s: None 2024-03-29T03:17:02.938262963Z [2024-03-29 03:17:02,937: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:17:02.941651445Z [2024-03-29 03:17:02,941: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:17:02.966641147Z [2024-03-29 03:17:02,966: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:17:02.968191905Z [2024-03-29 03:17:02,967: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:17:02.968206015Z [2024-03-29 03:17:02,968: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:17:02.968374064Z [2024-03-29 03:17:02,968: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:17:02.968409349Z [2024-03-29 03:17:02,968: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:17:02.968732112Z [2024-03-29 03:17:02,968: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:17:02.968759843Z [2024-03-29 03:17:02,968: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:17:03.056654105Z [2024-03-29 03:17:03,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:17:03.060151286Z [2024-03-29 03:17:03,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:17:03.060181528Z [2024-03-29 03:17:03,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:17:03.079750392Z [2024-03-29 03:17:03,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:17:03.083640510Z [2024-03-29 03:17:03,083: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:17:03.083717663Z [2024-03-29 03:17:03,083: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:17:03.083934016Z [2024-03-29 03:17:03,083: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:17:03.084067770Z [2024-03-29 03:17:03,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:17:03.084369612Z [2024-03-29 03:17:03,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:17:03.084504129Z [2024-03-29 03:17:03,084: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:17:03.184087621Z [2024-03-29 03:17:03,183: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:17:04.675286345Z [2024-03-29 03:17:04,674: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[639c240a-3849-4c4f-b635-b4abd7edc896] succeeded in 3.5383500619991537s: None 2024-03-29T03:17:05.047515096Z [2024-03-29 03:17:05,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15ee7986-22a4-45c7-987d-50a952f920ce] succeeded in 3.923485957999219s: None 2024-03-29T03:17:54.120167881Z [2024-03-29 03:17:54,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22322a7c-d5a3-42cf-a927-07bbcf210f4b] received 2024-03-29T03:17:54.131336396Z [2024-03-29 03:17:54,130: INFO/ForkPoolWorker-15] [22322a7c-d5a3-42cf-a927-07bbcf210f4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031753_538328', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:17:54.450237311Z [2024-03-29 03:17:54,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-29T03:17:54.803949026Z [2024-03-29 03:17:54,803: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:17:55.364056330Z [2024-03-29 03:17:55,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22322a7c-d5a3-42cf-a927-07bbcf210f4b] succeeded in 1.241331129000173s: None 2024-03-29T03:18:00.453280461Z [2024-03-29 03:18:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02564f20-3e63-4a13-ab77-0775a68ba0d7] received 2024-03-29T03:18:00.458478427Z [2024-03-29 03:18:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8929f365-7ca3-4260-8a45-5520ce97e874] received 2024-03-29T03:18:00.459190387Z [2024-03-29 03:18:00,458: INFO/ForkPoolWorker-15] [02564f20-3e63-4a13-ab77-0775a68ba0d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:18:00.471624246Z [2024-03-29 03:18:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2eaa726a-7d31-4fe4-9bb4-97f2473d0006] received 2024-03-29T03:18:00.476593942Z [2024-03-29 03:18:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5727469f-54b7-4ebe-8c8f-c633ce6d79f3] received 2024-03-29T03:18:00.486707956Z [2024-03-29 03:18:00,486: INFO/ForkPoolWorker-2] [5727469f-54b7-4ebe-8c8f-c633ce6d79f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:18:00.486858373Z [2024-03-29 03:18:00,486: INFO/ForkPoolWorker-1] [2eaa726a-7d31-4fe4-9bb4-97f2473d0006] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:18:00.490329834Z [2024-03-29 03:18:00,489: INFO/ForkPoolWorker-16] [8929f365-7ca3-4260-8a45-5520ce97e874] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:18:00.795820879Z [2024-03-29 03:18:00,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:18:00.825261470Z [2024-03-29 03:18:00,821: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:18:00.920287480Z [2024-03-29 03:18:00,916: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:18:01.213859809Z [2024-03-29 03:18:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:18:01.277973027Z [2024-03-29 03:18:01,277: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:18:01.538901688Z [2024-03-29 03:18:01,538: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:18:01.547885870Z [2024-03-29 03:18:01,547: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:18:01.587878858Z [2024-03-29 03:18:01,587: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:18:01.591879548Z [2024-03-29 03:18:01,591: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:18:01.592129517Z [2024-03-29 03:18:01,591: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:18:01.592313479Z [2024-03-29 03:18:01,592: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:18:01.593254241Z [2024-03-29 03:18:01,592: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:18:01.780324243Z [2024-03-29 03:18:01,779: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:18:02.124287402Z [2024-03-29 03:18:02,123: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8929f365-7ca3-4260-8a45-5520ce97e874] succeeded in 1.6508926059996156s: None 2024-03-29T03:18:02.478571701Z [2024-03-29 03:18:02,478: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:18:02.483712664Z [2024-03-29 03:18:02,483: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:18:02.513504834Z [2024-03-29 03:18:02,513: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:18:02.515123741Z [2024-03-29 03:18:02,514: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:18:02.515315225Z [2024-03-29 03:18:02,515: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:18:02.515613654Z [2024-03-29 03:18:02,515: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:18:02.515878762Z [2024-03-29 03:18:02,515: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:18:02.516312510Z [2024-03-29 03:18:02,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:18:02.516508571Z [2024-03-29 03:18:02,516: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:18:02.556134113Z [2024-03-29 03:18:02,555: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2eaa726a-7d31-4fe4-9bb4-97f2473d0006] succeeded in 2.0829935499987187s: None 2024-03-29T03:18:02.583991838Z [2024-03-29 03:18:02,583: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:18:02.587480150Z [2024-03-29 03:18:02,586: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:18:02.608919249Z [2024-03-29 03:18:02,608: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:18:02.611698868Z [2024-03-29 03:18:02,611: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:18:02.615952772Z [2024-03-29 03:18:02,615: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:18:02.616002881Z [2024-03-29 03:18:02,615: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:18:02.616213584Z [2024-03-29 03:18:02,615: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:18:02.616390681Z [2024-03-29 03:18:02,616: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:18:02.616784091Z [2024-03-29 03:18:02,616: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:18:02.616895604Z [2024-03-29 03:18:02,616: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:18:02.712273386Z [2024-03-29 03:18:02,712: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:18:04.199070455Z [2024-03-29 03:18:04,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02564f20-3e63-4a13-ab77-0775a68ba0d7] succeeded in 3.7440601419984887s: None 2024-03-29T03:18:04.576138381Z [2024-03-29 03:18:04,575: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5727469f-54b7-4ebe-8c8f-c633ce6d79f3] succeeded in 4.09720724699946s: None 2024-03-29T03:19:01.231457212Z [2024-03-29 03:19:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a40361b3-2b33-418d-9738-381a37af5b72] received 2024-03-29T03:19:01.239526926Z [2024-03-29 03:19:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c2b89f0-241e-4b61-b013-43470e6236c7] received 2024-03-29T03:19:01.240215456Z [2024-03-29 03:19:01,239: INFO/ForkPoolWorker-15] [a40361b3-2b33-418d-9738-381a37af5b72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:19:01.245419739Z [2024-03-29 03:19:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ca23f41-8cb1-4297-b3fa-15b6e1f46eb3] received 2024-03-29T03:19:01.249593733Z [2024-03-29 03:19:01,249: INFO/ForkPoolWorker-16] [6c2b89f0-241e-4b61-b013-43470e6236c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:19:01.255005409Z [2024-03-29 03:19:01,254: INFO/ForkPoolWorker-1] [2ca23f41-8cb1-4297-b3fa-15b6e1f46eb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:19:01.567810800Z [2024-03-29 03:19:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:19:01.611555463Z [2024-03-29 03:19:01,608: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:19:01.725734147Z [2024-03-29 03:19:01,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:19:01.779309645Z [2024-03-29 03:19:01,778: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:19:01.783464911Z [2024-03-29 03:19:01,782: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:19:01.805491047Z [2024-03-29 03:19:01,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:19:01.807774239Z [2024-03-29 03:19:01,807: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:19:01.808639975Z [2024-03-29 03:19:01,808: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:19:01.808802719Z [2024-03-29 03:19:01,808: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:19:01.809727786Z [2024-03-29 03:19:01,809: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:19:01.912808832Z [2024-03-29 03:19:01,912: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:19:02.536447084Z [2024-03-29 03:19:02,536: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c2b89f0-241e-4b61-b013-43470e6236c7] succeeded in 1.2943708069997228s: None 2024-03-29T03:19:02.778493448Z [2024-03-29 03:19:02,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:19:02.781860843Z [2024-03-29 03:19:02,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:19:02.803917260Z [2024-03-29 03:19:02,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:19:02.805138628Z [2024-03-29 03:19:02,804: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:19:02.805177739Z [2024-03-29 03:19:02,805: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:19:02.805303888Z [2024-03-29 03:19:02,805: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:19:02.805316379Z [2024-03-29 03:19:02,805: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:19:02.805550362Z [2024-03-29 03:19:02,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:19:02.805566541Z [2024-03-29 03:19:02,805: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:19:02.897397158Z [2024-03-29 03:19:02,897: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:19:02.938554113Z [2024-03-29 03:19:02,938: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:19:02.942088349Z [2024-03-29 03:19:02,941: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:19:02.965616444Z [2024-03-29 03:19:02,965: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:19:02.967009493Z [2024-03-29 03:19:02,966: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:19:02.967370471Z [2024-03-29 03:19:02,967: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:19:02.967439923Z [2024-03-29 03:19:02,967: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:19:02.967537397Z [2024-03-29 03:19:02,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:19:02.968137867Z [2024-03-29 03:19:02,967: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:19:02.968213864Z [2024-03-29 03:19:02,968: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:19:03.051873122Z [2024-03-29 03:19:03,051: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:19:04.854577149Z [2024-03-29 03:19:04,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ca23f41-8cb1-4297-b3fa-15b6e1f46eb3] succeeded in 3.6076271689998975s: None 2024-03-29T03:19:05.198412438Z [2024-03-29 03:19:05,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a40361b3-2b33-418d-9738-381a37af5b72] succeeded in 3.964493739000318s: None 2024-03-29T03:19:54.920955230Z [2024-03-29 03:19:54,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[664d20b5-a826-424e-bc25-d3d438cccee9] received 2024-03-29T03:19:54.948813562Z [2024-03-29 03:19:54,948: INFO/ForkPoolWorker-15] [664d20b5-a826-424e-bc25-d3d438cccee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031953_407350', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:19:55.329116883Z [2024-03-29 03:19:55,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-29T03:19:55.709675067Z [2024-03-29 03:19:55,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:19:56.355764980Z [2024-03-29 03:19:56,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[664d20b5-a826-424e-bc25-d3d438cccee9] succeeded in 1.4312582940001448s: None 2024-03-29T03:20:01.099584142Z [2024-03-29 03:20:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1ba4816-9b88-470e-81ac-c89560306785] received 2024-03-29T03:20:01.101549236Z [2024-03-29 03:20:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3f818a2-2600-4aea-9a6f-79093cfab011] received 2024-03-29T03:20:01.108666253Z [2024-03-29 03:20:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb91eb3a-cc7d-4e9b-9087-d15a657f7e02] received 2024-03-29T03:20:01.108694518Z [2024-03-29 03:20:01,108: INFO/ForkPoolWorker-15] [e1ba4816-9b88-470e-81ac-c89560306785] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:01.112221867Z [2024-03-29 03:20:01,111: INFO/ForkPoolWorker-16] [f3f818a2-2600-4aea-9a6f-79093cfab011] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:20:01.115805255Z [2024-03-29 03:20:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[228b1905-135f-448d-b319-13e1cf94f121] received 2024-03-29T03:20:01.119568878Z [2024-03-29 03:20:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f568920d-23e0-4f21-bcec-c6803de21c1f] received 2024-03-29T03:20:01.132735346Z [2024-03-29 03:20:01,132: INFO/ForkPoolWorker-1] [cb91eb3a-cc7d-4e9b-9087-d15a657f7e02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:20:01.143915021Z [2024-03-29 03:20:01,143: INFO/ForkPoolWorker-2] [228b1905-135f-448d-b319-13e1cf94f121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:20:01.151571832Z [2024-03-29 03:20:01,151: INFO/ForkPoolWorker-3] [f568920d-23e0-4f21-bcec-c6803de21c1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:20:01.548215351Z [2024-03-29 03:20:01,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:20:01.623253390Z [2024-03-29 03:20:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:20:01.704440379Z [2024-03-29 03:20:01,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:20:01.833955574Z [2024-03-29 03:20:01,829: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:20:01.851604332Z [2024-03-29 03:20:01,846: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:20:02.014272333Z [2024-03-29 03:20:02,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:02.154230747Z [2024-03-29 03:20:02,153: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:20:02.171699017Z [2024-03-29 03:20:02,171: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:02.208600888Z [2024-03-29 03:20:02,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:20:02.211045713Z [2024-03-29 03:20:02,210: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:20:02.211330541Z [2024-03-29 03:20:02,210: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:20:02.219215150Z [2024-03-29 03:20:02,218: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:20:02.220877325Z [2024-03-29 03:20:02,220: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:20:02.353723406Z [2024-03-29 03:20:02,353: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:02.939034668Z [2024-03-29 03:20:02,938: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb91eb3a-cc7d-4e9b-9087-d15a657f7e02] succeeded in 1.8280537230002665s: None 2024-03-29T03:20:03.261668346Z [2024-03-29 03:20:03,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3f818a2-2600-4aea-9a6f-79093cfab011] succeeded in 2.1585417780006537s: None 2024-03-29T03:20:03.416187051Z [2024-03-29 03:20:03,415: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:20:03.420258349Z [2024-03-29 03:20:03,419: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:03.460894540Z [2024-03-29 03:20:03,460: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:20:03.462387348Z [2024-03-29 03:20:03,462: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:03.462473054Z [2024-03-29 03:20:03,462: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:03.462777464Z [2024-03-29 03:20:03,462: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:03.462921090Z [2024-03-29 03:20:03,462: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:20:03.463334691Z [2024-03-29 03:20:03,463: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:20:03.463503072Z [2024-03-29 03:20:03,463: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:03.556220903Z [2024-03-29 03:20:03,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:03.819733257Z [2024-03-29 03:20:03,819: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T03:20:03.823527031Z [2024-03-29 03:20:03,823: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:03.843782823Z [2024-03-29 03:20:03,843: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T03:20:03.845410051Z [2024-03-29 03:20:03,845: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:03.845424877Z [2024-03-29 03:20:03,845: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:03.845675769Z [2024-03-29 03:20:03,845: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:03.845793946Z [2024-03-29 03:20:03,845: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T03:20:03.846114618Z [2024-03-29 03:20:03,845: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:20:03.846233955Z [2024-03-29 03:20:03,846: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:03.866121123Z [2024-03-29 03:20:03,865: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:20:03.869715618Z [2024-03-29 03:20:03,869: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:03.897733220Z [2024-03-29 03:20:03,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:20:03.900169226Z [2024-03-29 03:20:03,899: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:03.900467660Z [2024-03-29 03:20:03,900: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:03.900850098Z [2024-03-29 03:20:03,900: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:03.901026583Z [2024-03-29 03:20:03,900: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:20:03.901559230Z [2024-03-29 03:20:03,901: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:20:03.901781204Z [2024-03-29 03:20:03,901: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:03.943507295Z [2024-03-29 03:20:03,943: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:04.034306554Z [2024-03-29 03:20:04,033: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:04.230285495Z [2024-03-29 03:20:04,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5110de59-c1e3-44be-a661-37aa95004379] received 2024-03-29T03:20:04.245618623Z [2024-03-29 03:20:04,245: INFO/ForkPoolWorker-16] [5110de59-c1e3-44be-a661-37aa95004379] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:04.351239927Z [2024-03-29 03:20:04,350: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1ba4816-9b88-470e-81ac-c89560306785] succeeded in 3.2482888529993943s: None 2024-03-29T03:20:04.626274987Z [2024-03-29 03:20:04,623: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:20:05.998220685Z [2024-03-29 03:20:05,997: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:20:06.005479773Z [2024-03-29 03:20:06,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:06.050598937Z [2024-03-29 03:20:06,049: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:20:06.052632683Z [2024-03-29 03:20:06,052: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:06.052649682Z [2024-03-29 03:20:06,052: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:06.052828269Z [2024-03-29 03:20:06,052: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:06.052912708Z [2024-03-29 03:20:06,052: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:20:06.053355267Z [2024-03-29 03:20:06,053: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:20:06.053405708Z [2024-03-29 03:20:06,053: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:06.108836517Z [2024-03-29 03:20:06,108: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f568920d-23e0-4f21-bcec-c6803de21c1f] succeeded in 4.983074427998872s: None 2024-03-29T03:20:06.147526775Z [2024-03-29 03:20:06,147: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:06.917667560Z [2024-03-29 03:20:06,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d2bec5-0615-4392-8295-f731baf24eeb] received 2024-03-29T03:20:06.937643225Z [2024-03-29 03:20:06,937: INFO/ForkPoolWorker-15] [39d2bec5-0615-4392-8295-f731baf24eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:20:06.979949339Z [2024-03-29 03:20:06,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5110de59-c1e3-44be-a661-37aa95004379] succeeded in 2.7464957810007036s: None 2024-03-29T03:20:07.004967259Z [2024-03-29 03:20:07,004: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[228b1905-135f-448d-b319-13e1cf94f121] succeeded in 5.8773954910011525s: None 2024-03-29T03:20:07.404651053Z [2024-03-29 03:20:07,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:20:08.685861132Z [2024-03-29 03:20:08,685: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:20:08.689208931Z [2024-03-29 03:20:08,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:08.706859607Z [2024-03-29 03:20:08,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:20:08.708293556Z [2024-03-29 03:20:08,708: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:08.708497872Z [2024-03-29 03:20:08,708: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:08.708714052Z [2024-03-29 03:20:08,708: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:08.708828321Z [2024-03-29 03:20:08,708: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:20:08.709138035Z [2024-03-29 03:20:08,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:20:08.709612780Z [2024-03-29 03:20:08,709: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:08.797627817Z [2024-03-29 03:20:08,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:10.053754089Z [2024-03-29 03:20:10,053: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39d2bec5-0615-4392-8295-f731baf24eeb] succeeded in 3.1338628880002943s: None 2024-03-29T03:20:11.018902137Z [2024-03-29 03:20:11,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[208a9ca0-6cc7-4794-a266-58cb6185db79] received 2024-03-29T03:20:11.025892294Z [2024-03-29 03:20:11,025: INFO/ForkPoolWorker-15] [208a9ca0-6cc7-4794-a266-58cb6185db79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:11.326581960Z [2024-03-29 03:20:11,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:20:12.526790136Z [2024-03-29 03:20:12,526: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:20:12.530330673Z [2024-03-29 03:20:12,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:20:12.550153836Z [2024-03-29 03:20:12,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:20:12.551281536Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:20:12.551302703Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:20:12.551384365Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:20:12.551401647Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:20:12.551642696Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:20:12.551653425Z [2024-03-29 03:20:12,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:20:12.654823032Z [2024-03-29 03:20:12,654: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:20:13.192475307Z [2024-03-29 03:20:13,191: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[208a9ca0-6cc7-4794-a266-58cb6185db79] succeeded in 2.171822037998936s: None 2024-03-29T03:21:00.366956903Z [2024-03-29 03:21:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1271e27-8047-4976-b085-bb6658b72e33] received 2024-03-29T03:21:00.374256680Z [2024-03-29 03:21:00,373: INFO/ForkPoolWorker-15] [d1271e27-8047-4976-b085-bb6658b72e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:21:00.375250609Z [2024-03-29 03:21:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b764b6e-8f67-4aac-9003-24d39469bc5a] received 2024-03-29T03:21:00.384728886Z [2024-03-29 03:21:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b54d030e-fc55-4096-ad3a-a31e0f93fa35] received 2024-03-29T03:21:00.387676267Z [2024-03-29 03:21:00,387: INFO/ForkPoolWorker-16] [8b764b6e-8f67-4aac-9003-24d39469bc5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:21:00.395735992Z [2024-03-29 03:21:00,395: INFO/ForkPoolWorker-1] [b54d030e-fc55-4096-ad3a-a31e0f93fa35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:21:00.715781195Z [2024-03-29 03:21:00,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:21:00.758405866Z [2024-03-29 03:21:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:21:00.767968446Z [2024-03-29 03:21:00,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:21:00.956313045Z [2024-03-29 03:21:00,955: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:21:00.960571445Z [2024-03-29 03:21:00,960: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:21:00.987709192Z [2024-03-29 03:21:00,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:21:00.990002957Z [2024-03-29 03:21:00,989: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:21:00.990333397Z [2024-03-29 03:21:00,989: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:21:00.990661200Z [2024-03-29 03:21:00,990: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:21:00.991080353Z [2024-03-29 03:21:00,990: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:21:01.131266275Z [2024-03-29 03:21:01,130: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:21:01.725513474Z [2024-03-29 03:21:01,725: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b764b6e-8f67-4aac-9003-24d39469bc5a] succeeded in 1.3465951170001063s: None 2024-03-29T03:21:02.061970915Z [2024-03-29 03:21:02,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:21:02.065843102Z [2024-03-29 03:21:02,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:21:02.090027351Z [2024-03-29 03:21:02,089: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:21:02.091805044Z [2024-03-29 03:21:02,091: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:21:02.092003239Z [2024-03-29 03:21:02,091: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:21:02.092354719Z [2024-03-29 03:21:02,092: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:21:02.092493409Z [2024-03-29 03:21:02,092: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:21:02.092842152Z [2024-03-29 03:21:02,092: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:21:02.093011427Z [2024-03-29 03:21:02,092: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:21:02.148725407Z [2024-03-29 03:21:02,148: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:21:02.152647199Z [2024-03-29 03:21:02,152: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:21:02.181552170Z [2024-03-29 03:21:02,181: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:21:02.183262597Z [2024-03-29 03:21:02,183: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:21:02.183435241Z [2024-03-29 03:21:02,183: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:21:02.183604461Z [2024-03-29 03:21:02,183: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:21:02.183744183Z [2024-03-29 03:21:02,183: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:21:02.184080964Z [2024-03-29 03:21:02,183: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:21:02.184251239Z [2024-03-29 03:21:02,184: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:21:02.222963279Z [2024-03-29 03:21:02,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:21:02.294733145Z [2024-03-29 03:21:02,294: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:21:03.928551354Z [2024-03-29 03:21:03,927: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b54d030e-fc55-4096-ad3a-a31e0f93fa35] succeeded in 3.5401533669992205s: None 2024-03-29T03:21:05.274641689Z [2024-03-29 03:21:05,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1271e27-8047-4976-b085-bb6658b72e33] succeeded in 4.9058085510005185s: None 2024-03-29T03:22:00.743061949Z [2024-03-29 03:22:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb484b0f-f76e-4535-90eb-fef1269a0694] received 2024-03-29T03:22:00.750665375Z [2024-03-29 03:22:00,750: INFO/ForkPoolWorker-15] [fb484b0f-f76e-4535-90eb-fef1269a0694] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:22:00.753018742Z [2024-03-29 03:22:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72411abf-3efd-42c9-a45e-88c2c2cedffb] received 2024-03-29T03:22:00.757236374Z [2024-03-29 03:22:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[264f497d-136a-44e7-85cf-339d22c3f526] received 2024-03-29T03:22:00.763420510Z [2024-03-29 03:22:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d066621a-9392-4eae-97e7-5a2f6f36286a] received 2024-03-29T03:22:00.775313081Z [2024-03-29 03:22:00,774: INFO/ForkPoolWorker-16] [72411abf-3efd-42c9-a45e-88c2c2cedffb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:22:00.777259130Z [2024-03-29 03:22:00,776: INFO/ForkPoolWorker-2] [d066621a-9392-4eae-97e7-5a2f6f36286a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:22:00.778209358Z [2024-03-29 03:22:00,777: INFO/ForkPoolWorker-1] [264f497d-136a-44e7-85cf-339d22c3f526] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:22:01.174168885Z [2024-03-29 03:22:01,170: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:22:01.264894946Z [2024-03-29 03:22:01,250: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:22:01.391701111Z [2024-03-29 03:22:01,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:22:01.473012404Z [2024-03-29 03:22:01,468: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:22:01.730994856Z [2024-03-29 03:22:01,730: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:22:01.743660330Z [2024-03-29 03:22:01,740: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:22:01.773182026Z [2024-03-29 03:22:01,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:22:01.836466287Z [2024-03-29 03:22:01,836: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:22:01.843745856Z [2024-03-29 03:22:01,843: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:22:01.843792340Z [2024-03-29 03:22:01,843: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:22:01.843857415Z [2024-03-29 03:22:01,843: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:22:01.844177250Z [2024-03-29 03:22:01,844: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:22:01.989420942Z [2024-03-29 03:22:01,989: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:22:02.739484769Z [2024-03-29 03:22:02,738: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb484b0f-f76e-4535-90eb-fef1269a0694] succeeded in 1.9946356670006935s: None 2024-03-29T03:22:02.849987560Z [2024-03-29 03:22:02,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d066621a-9392-4eae-97e7-5a2f6f36286a] succeeded in 2.0832989230002568s: None 2024-03-29T03:22:03.055867058Z [2024-03-29 03:22:03,055: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:22:03.059542752Z [2024-03-29 03:22:03,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:22:03.081588618Z [2024-03-29 03:22:03,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:22:03.083450041Z [2024-03-29 03:22:03,083: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:22:03.083585417Z [2024-03-29 03:22:03,083: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:22:03.083842151Z [2024-03-29 03:22:03,083: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:22:03.084003251Z [2024-03-29 03:22:03,083: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:22:03.084741379Z [2024-03-29 03:22:03,084: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:22:03.084946868Z [2024-03-29 03:22:03,084: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:22:03.179865041Z [2024-03-29 03:22:03,179: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:22:03.371785431Z [2024-03-29 03:22:03,371: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:22:03.375326286Z [2024-03-29 03:22:03,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:22:03.402542717Z [2024-03-29 03:22:03,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:22:03.404308529Z [2024-03-29 03:22:03,403: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:22:03.404349160Z [2024-03-29 03:22:03,404: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:22:03.404582822Z [2024-03-29 03:22:03,404: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:22:03.404635457Z [2024-03-29 03:22:03,404: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:22:03.404958738Z [2024-03-29 03:22:03,404: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:22:03.404966315Z [2024-03-29 03:22:03,404: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:22:03.501087645Z [2024-03-29 03:22:03,500: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:22:05.051528746Z [2024-03-29 03:22:05,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72411abf-3efd-42c9-a45e-88c2c2cedffb] succeeded in 4.2961122739998245s: None 2024-03-29T03:22:05.092555210Z [2024-03-29 03:22:05,092: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[264f497d-136a-44e7-85cf-339d22c3f526] succeeded in 4.328886379000323s: None 2024-03-29T03:23:00.436686774Z [2024-03-29 03:23:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[943a461d-3255-42a1-9fda-83fd610e9b02] received 2024-03-29T03:23:00.439440504Z [2024-03-29 03:23:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02916681-8600-40d6-a094-dba852ed60eb] received 2024-03-29T03:23:00.448599282Z [2024-03-29 03:23:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6681123-a0e9-4bb3-8b79-6c14df55b3fd] received 2024-03-29T03:23:00.449407861Z [2024-03-29 03:23:00,449: INFO/ForkPoolWorker-16] [02916681-8600-40d6-a094-dba852ed60eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:23:00.451569724Z [2024-03-29 03:23:00,451: INFO/ForkPoolWorker-15] [943a461d-3255-42a1-9fda-83fd610e9b02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:23:00.457551584Z [2024-03-29 03:23:00,457: INFO/ForkPoolWorker-1] [d6681123-a0e9-4bb3-8b79-6c14df55b3fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:23:00.739383324Z [2024-03-29 03:23:00,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:23:00.821127303Z [2024-03-29 03:23:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:23:00.859990710Z [2024-03-29 03:23:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:23:01.102772322Z [2024-03-29 03:23:01,102: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:23:01.106872731Z [2024-03-29 03:23:01,106: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:23:01.124652008Z [2024-03-29 03:23:01,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:23:01.125696170Z [2024-03-29 03:23:01,125: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:23:01.125923216Z [2024-03-29 03:23:01,125: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:23:01.126093981Z [2024-03-29 03:23:01,125: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:23:01.126372569Z [2024-03-29 03:23:01,126: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:23:01.218476783Z [2024-03-29 03:23:01,218: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:23:01.892911052Z [2024-03-29 03:23:01,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02916681-8600-40d6-a094-dba852ed60eb] succeeded in 1.4519167710004695s: None 2024-03-29T03:23:01.965475034Z [2024-03-29 03:23:01,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:23:01.969303187Z [2024-03-29 03:23:01,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:23:01.988223389Z [2024-03-29 03:23:01,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:23:01.989884245Z [2024-03-29 03:23:01,989: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:23:01.989966250Z [2024-03-29 03:23:01,989: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:23:01.990169738Z [2024-03-29 03:23:01,989: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:23:01.990217094Z [2024-03-29 03:23:01,990: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:23:01.990543092Z [2024-03-29 03:23:01,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:23:01.990558201Z [2024-03-29 03:23:01,990: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:23:02.082222141Z [2024-03-29 03:23:02,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:23:02.271190621Z [2024-03-29 03:23:02,270: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:23:02.274921994Z [2024-03-29 03:23:02,274: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:23:02.296132642Z [2024-03-29 03:23:02,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:23:02.299758224Z [2024-03-29 03:23:02,299: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:23:02.299790280Z [2024-03-29 03:23:02,299: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:23:02.299807774Z [2024-03-29 03:23:02,299: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:23:02.299869805Z [2024-03-29 03:23:02,299: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:23:02.300243813Z [2024-03-29 03:23:02,300: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:23:02.300348365Z [2024-03-29 03:23:02,300: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:23:02.388886905Z [2024-03-29 03:23:02,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:23:03.955875353Z [2024-03-29 03:23:03,955: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[943a461d-3255-42a1-9fda-83fd610e9b02] succeeded in 3.5147356119996402s: None 2024-03-29T03:23:04.227301630Z [2024-03-29 03:23:04,226: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6681123-a0e9-4bb3-8b79-6c14df55b3fd] succeeded in 3.775813560001552s: None 2024-03-29T03:24:00.250551315Z [2024-03-29 03:24:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46028929-02b4-42ba-bcd3-e97ec40cc4e1] received 2024-03-29T03:24:00.255299721Z [2024-03-29 03:24:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1461d36-5005-4a0f-b99e-2eda096eb8cf] received 2024-03-29T03:24:00.259276298Z [2024-03-29 03:24:00,258: INFO/ForkPoolWorker-15] [46028929-02b4-42ba-bcd3-e97ec40cc4e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:24:00.259989517Z [2024-03-29 03:24:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb37b56-9288-41a3-9d24-c249cfdbc539] received 2024-03-29T03:24:00.263175936Z [2024-03-29 03:24:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11ba1f69-63c7-4c5b-9e5f-9bb5737591a9] received 2024-03-29T03:24:00.263823358Z [2024-03-29 03:24:00,263: INFO/ForkPoolWorker-16] [a1461d36-5005-4a0f-b99e-2eda096eb8cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:24:00.277661732Z [2024-03-29 03:24:00,277: INFO/ForkPoolWorker-1] [ceb37b56-9288-41a3-9d24-c249cfdbc539] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:24:00.278279160Z [2024-03-29 03:24:00,277: INFO/ForkPoolWorker-2] [11ba1f69-63c7-4c5b-9e5f-9bb5737591a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:24:00.605638224Z [2024-03-29 03:24:00,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:24:00.612947555Z [2024-03-29 03:24:00,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:24:00.660270380Z [2024-03-29 03:24:00,655: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:24:00.664382683Z [2024-03-29 03:24:00,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:24:00.829443657Z [2024-03-29 03:24:00,829: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:24:00.836721304Z [2024-03-29 03:24:00,834: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:24:00.885535345Z [2024-03-29 03:24:00,885: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:24:00.886600057Z [2024-03-29 03:24:00,886: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:24:00.886635335Z [2024-03-29 03:24:00,886: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:24:00.886683323Z [2024-03-29 03:24:00,886: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:24:00.886938409Z [2024-03-29 03:24:00,886: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:24:00.923371392Z [2024-03-29 03:24:00,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:24:01.044544757Z [2024-03-29 03:24:01,044: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:24:01.624478518Z [2024-03-29 03:24:01,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46028929-02b4-42ba-bcd3-e97ec40cc4e1] succeeded in 1.3710898789995554s: None 2024-03-29T03:24:01.823923419Z [2024-03-29 03:24:01,823: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11ba1f69-63c7-4c5b-9e5f-9bb5737591a9] succeeded in 1.5540322069991817s: None 2024-03-29T03:24:02.156944313Z [2024-03-29 03:24:02,156: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:24:02.161680092Z [2024-03-29 03:24:02,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:24:02.191800226Z [2024-03-29 03:24:02,191: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:24:02.196615719Z [2024-03-29 03:24:02,196: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:24:02.196818032Z [2024-03-29 03:24:02,196: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:24:02.197162201Z [2024-03-29 03:24:02,196: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:24:02.197916725Z [2024-03-29 03:24:02,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:24:02.198823872Z [2024-03-29 03:24:02,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:24:02.199023746Z [2024-03-29 03:24:02,198: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:24:02.260963469Z [2024-03-29 03:24:02,260: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:24:02.264775478Z [2024-03-29 03:24:02,264: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:24:02.296150713Z [2024-03-29 03:24:02,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:24:02.299868138Z [2024-03-29 03:24:02,299: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:24:02.300289841Z [2024-03-29 03:24:02,300: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:24:02.300675919Z [2024-03-29 03:24:02,300: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:24:02.301002414Z [2024-03-29 03:24:02,300: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:24:02.301698292Z [2024-03-29 03:24:02,301: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:24:02.301952650Z [2024-03-29 03:24:02,301: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:24:02.310436005Z [2024-03-29 03:24:02,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:24:02.425042812Z [2024-03-29 03:24:02,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:24:04.139784370Z [2024-03-29 03:24:04,139: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ceb37b56-9288-41a3-9d24-c249cfdbc539] succeeded in 3.875129875001221s: None 2024-03-29T03:24:04.250391203Z [2024-03-29 03:24:04,249: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1461d36-5005-4a0f-b99e-2eda096eb8cf] succeeded in 3.9926947500007373s: None 2024-03-29T03:25:00.795685584Z [2024-03-29 03:25:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa0513cd-a912-47f9-8de7-fbe1512c2bd7] received 2024-03-29T03:25:00.802204831Z [2024-03-29 03:25:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4bfe99a-1856-4680-b5b4-7c790442ae56] received 2024-03-29T03:25:00.805486610Z [2024-03-29 03:25:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da6a2e3d-95d2-4a13-93a3-7539b4f099c8] received 2024-03-29T03:25:00.808140246Z [2024-03-29 03:25:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29f91376-3d1d-4b29-9f3b-67b962453f71] received 2024-03-29T03:25:00.812880735Z [2024-03-29 03:25:00,812: INFO/ForkPoolWorker-16] [f4bfe99a-1856-4680-b5b4-7c790442ae56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:00.814473922Z [2024-03-29 03:25:00,814: INFO/ForkPoolWorker-2] [29f91376-3d1d-4b29-9f3b-67b962453f71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:25:00.815695061Z [2024-03-29 03:25:00,815: INFO/ForkPoolWorker-1] [da6a2e3d-95d2-4a13-93a3-7539b4f099c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:25:00.831539611Z [2024-03-29 03:25:00,831: INFO/ForkPoolWorker-15] [aa0513cd-a912-47f9-8de7-fbe1512c2bd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:25:01.286505561Z [2024-03-29 03:25:01,282: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:25:01.392612439Z [2024-03-29 03:25:01,388: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:25:01.421034486Z [2024-03-29 03:25:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:25:01.506832812Z [2024-03-29 03:25:01,506: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:25:01.512883014Z [2024-03-29 03:25:01,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:01.567477770Z [2024-03-29 03:25:01,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:25:01.571533776Z [2024-03-29 03:25:01,571: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:25:01.572061570Z [2024-03-29 03:25:01,571: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:25:01.572400047Z [2024-03-29 03:25:01,572: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:25:01.572800330Z [2024-03-29 03:25:01,572: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:25:01.613850711Z [2024-03-29 03:25:01,605: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:25:01.729612137Z [2024-03-29 03:25:01,729: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:02.524905224Z [2024-03-29 03:25:02,524: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da6a2e3d-95d2-4a13-93a3-7539b4f099c8] succeeded in 1.7175801579996914s: None 2024-03-29T03:25:02.998684059Z [2024-03-29 03:25:02,998: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:25:03.007188898Z [2024-03-29 03:25:03,006: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:03.045143149Z [2024-03-29 03:25:03,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:25:03.046716693Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:03.046788300Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:03.046806380Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:03.046813033Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:25:03.047109261Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:25:03.047122759Z [2024-03-29 03:25:03,046: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:03.165816975Z [2024-03-29 03:25:03,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:03.254527513Z [2024-03-29 03:25:03,254: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:25:03.257792034Z [2024-03-29 03:25:03,257: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:03.257810840Z [2024-03-29 03:25:03,257: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:25:03.261386252Z [2024-03-29 03:25:03,260: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:03.280330314Z [2024-03-29 03:25:03,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:25:03.281571592Z [2024-03-29 03:25:03,281: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:03.281631505Z [2024-03-29 03:25:03,281: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:03.281746238Z [2024-03-29 03:25:03,281: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:03.281756789Z [2024-03-29 03:25:03,281: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:25:03.282096507Z [2024-03-29 03:25:03,281: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:25:03.282109557Z [2024-03-29 03:25:03,282: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:03.293880808Z [2024-03-29 03:25:03,293: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:25:03.295548763Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:03.295594973Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:03.295771800Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:03.295788831Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:25:03.296014422Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:25:03.296041922Z [2024-03-29 03:25:03,295: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:03.377749680Z [2024-03-29 03:25:03,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:03.386911398Z [2024-03-29 03:25:03,386: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:04.056314494Z [2024-03-29 03:25:04,055: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4bfe99a-1856-4680-b5b4-7c790442ae56] succeeded in 3.251764227001331s: None 2024-03-29T03:25:04.709627997Z [2024-03-29 03:25:04,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa0513cd-a912-47f9-8de7-fbe1512c2bd7] succeeded in 3.9110538519998954s: None 2024-03-29T03:25:04.800303540Z [2024-03-29 03:25:04,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cdd68e7-60e3-429f-bd3a-4aef5ec790f9] received 2024-03-29T03:25:04.806429912Z [2024-03-29 03:25:04,806: INFO/ForkPoolWorker-15] [1cdd68e7-60e3-429f-bd3a-4aef5ec790f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:05.124502041Z [2024-03-29 03:25:05,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:25:06.122948577Z [2024-03-29 03:25:06,122: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[29f91376-3d1d-4b29-9f3b-67b962453f71] succeeded in 5.313411565999559s: None 2024-03-29T03:25:06.520670747Z [2024-03-29 03:25:06,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:25:06.524217821Z [2024-03-29 03:25:06,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:06.549358646Z [2024-03-29 03:25:06,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:25:06.551056922Z [2024-03-29 03:25:06,550: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:06.551101170Z [2024-03-29 03:25:06,550: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:06.551108799Z [2024-03-29 03:25:06,550: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:06.551113591Z [2024-03-29 03:25:06,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:25:06.553241569Z [2024-03-29 03:25:06,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:25:06.553263872Z [2024-03-29 03:25:06,553: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:06.689236809Z [2024-03-29 03:25:06,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:07.586426799Z [2024-03-29 03:25:07,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cdd68e7-60e3-429f-bd3a-4aef5ec790f9] succeeded in 2.7846771410004294s: None 2024-03-29T03:25:07.931328603Z [2024-03-29 03:25:07,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c70d1b76-74d6-4db1-9f70-3ff8a8a20d35] received 2024-03-29T03:25:07.953351290Z [2024-03-29 03:25:07,953: INFO/ForkPoolWorker-15] [c70d1b76-74d6-4db1-9f70-3ff8a8a20d35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:25:08.377907361Z [2024-03-29 03:25:08,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:25:09.578932475Z [2024-03-29 03:25:09,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:25:09.583258154Z [2024-03-29 03:25:09,582: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:09.603301213Z [2024-03-29 03:25:09,603: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:25:09.605342859Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:09.605383730Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:09.605504150Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:09.605543608Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:25:09.605856078Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:25:09.605988977Z [2024-03-29 03:25:09,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:09.700425383Z [2024-03-29 03:25:09,700: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:11.069144626Z [2024-03-29 03:25:11,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c70d1b76-74d6-4db1-9f70-3ff8a8a20d35] succeeded in 3.1350850660001015s: None 2024-03-29T03:25:11.327546155Z [2024-03-29 03:25:11,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0ed974f-a029-4006-bca0-504f3998dc71] received 2024-03-29T03:25:11.341731305Z [2024-03-29 03:25:11,341: INFO/ForkPoolWorker-15] [e0ed974f-a029-4006-bca0-504f3998dc71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:11.693633797Z [2024-03-29 03:25:11,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:25:12.809001908Z [2024-03-29 03:25:12,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:25:12.812420628Z [2024-03-29 03:25:12,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:25:12.832262104Z [2024-03-29 03:25:12,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:25:12.833776626Z [2024-03-29 03:25:12,833: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:25:12.833887704Z [2024-03-29 03:25:12,833: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:25:12.834125708Z [2024-03-29 03:25:12,833: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:25:12.834280395Z [2024-03-29 03:25:12,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:25:12.834815071Z [2024-03-29 03:25:12,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:25:12.834974648Z [2024-03-29 03:25:12,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:25:12.917864788Z [2024-03-29 03:25:12,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:25:13.514353822Z [2024-03-29 03:25:13,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0ed974f-a029-4006-bca0-504f3998dc71] succeeded in 2.182451005000985s: None 2024-03-29T03:26:00.944209448Z [2024-03-29 03:26:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8b0401-c667-42b2-98b1-6048be356044] received 2024-03-29T03:26:00.944248452Z [2024-03-29 03:26:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35820b1d-4b1c-4dee-8c79-5d6d2d8c6518] received 2024-03-29T03:26:00.944256758Z [2024-03-29 03:26:00,938: INFO/ForkPoolWorker-15] [bd8b0401-c667-42b2-98b1-6048be356044] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:26:00.944261439Z [2024-03-29 03:26:00,938: INFO/ForkPoolWorker-16] [35820b1d-4b1c-4dee-8c79-5d6d2d8c6518] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:26:00.950540452Z [2024-03-29 03:26:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d426c2da-1722-4523-a47e-9c2ffd1b74ba] received 2024-03-29T03:26:00.952314529Z [2024-03-29 03:26:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65936ffc-c96c-44b4-b6b8-e6d29b64cdf8] received 2024-03-29T03:26:00.958413905Z [2024-03-29 03:26:00,958: INFO/ForkPoolWorker-2] [65936ffc-c96c-44b4-b6b8-e6d29b64cdf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:26:00.958678578Z [2024-03-29 03:26:00,958: INFO/ForkPoolWorker-1] [d426c2da-1722-4523-a47e-9c2ffd1b74ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:26:01.410648777Z [2024-03-29 03:26:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:26:01.477269560Z [2024-03-29 03:26:01,474: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:26:01.549644173Z [2024-03-29 03:26:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:26:01.642703534Z [2024-03-29 03:26:01,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:26:01.805637585Z [2024-03-29 03:26:01,805: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:26:01.835417802Z [2024-03-29 03:26:01,834: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:26:01.839568226Z [2024-03-29 03:26:01,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:26:01.872048524Z [2024-03-29 03:26:01,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:26:01.875151058Z [2024-03-29 03:26:01,874: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:26:01.876178622Z [2024-03-29 03:26:01,875: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:26:01.876368461Z [2024-03-29 03:26:01,876: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:26:01.876754602Z [2024-03-29 03:26:01,876: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:26:02.072905301Z [2024-03-29 03:26:02,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:26:02.453579954Z [2024-03-29 03:26:02,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d426c2da-1722-4523-a47e-9c2ffd1b74ba] succeeded in 1.5017450399991503s: None 2024-03-29T03:26:02.864383050Z [2024-03-29 03:26:02,863: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35820b1d-4b1c-4dee-8c79-5d6d2d8c6518] succeeded in 1.9291578449992812s: None 2024-03-29T03:26:02.940883044Z [2024-03-29 03:26:02,940: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:26:02.944528575Z [2024-03-29 03:26:02,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:26:02.967519775Z [2024-03-29 03:26:02,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:26:02.969699970Z [2024-03-29 03:26:02,969: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:26:02.969891273Z [2024-03-29 03:26:02,969: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:26:02.970165027Z [2024-03-29 03:26:02,969: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:26:02.970343528Z [2024-03-29 03:26:02,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:26:02.970897926Z [2024-03-29 03:26:02,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:26:02.971220505Z [2024-03-29 03:26:02,971: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:26:03.015528336Z [2024-03-29 03:26:03,015: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:26:03.019328346Z [2024-03-29 03:26:03,018: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:26:03.040642406Z [2024-03-29 03:26:03,040: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:26:03.042266841Z [2024-03-29 03:26:03,042: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:26:03.042515321Z [2024-03-29 03:26:03,042: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:26:03.042777693Z [2024-03-29 03:26:03,042: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:26:03.042919233Z [2024-03-29 03:26:03,042: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:26:03.043265152Z [2024-03-29 03:26:03,043: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:26:03.043400522Z [2024-03-29 03:26:03,043: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:26:03.076478338Z [2024-03-29 03:26:03,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:26:03.161949769Z [2024-03-29 03:26:03,161: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:26:04.981014355Z [2024-03-29 03:26:04,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd8b0401-c667-42b2-98b1-6048be356044] succeeded in 4.044083086000683s: None 2024-03-29T03:26:05.536919765Z [2024-03-29 03:26:05,536: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65936ffc-c96c-44b4-b6b8-e6d29b64cdf8] succeeded in 4.583298748000743s: None 2024-03-29T03:26:57.616766564Z [2024-03-29 03:26:57,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9009d02-1b17-4aa8-93f7-16f72f2d7a99] received 2024-03-29T03:26:57.626722939Z [2024-03-29 03:26:57,626: INFO/ForkPoolWorker-15] [c9009d02-1b17-4aa8-93f7-16f72f2d7a99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240329032657_255056', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-29T03:26:57.909268790Z [2024-03-29 03:26:57,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-03-29T03:26:58.141874981Z [2024-03-29 03:26:58,141: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:26:58.657746568Z [2024-03-29 03:26:58,657: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9009d02-1b17-4aa8-93f7-16f72f2d7a99] succeeded in 1.038406396000937s: None 2024-03-29T03:27:00.765378009Z [2024-03-29 03:27:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4e7d10f-861e-4a9c-9595-8758cbbbe31d] received 2024-03-29T03:27:00.770701930Z [2024-03-29 03:27:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99be7a8f-5f4e-4f0f-a8b6-51d9973af7c0] received 2024-03-29T03:27:00.772559526Z [2024-03-29 03:27:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bea57e20-0208-4a3d-92d6-5337cbdfb50b] received 2024-03-29T03:27:00.774576504Z [2024-03-29 03:27:00,774: INFO/ForkPoolWorker-15] [c4e7d10f-861e-4a9c-9595-8758cbbbe31d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:27:00.782612330Z [2024-03-29 03:27:00,782: INFO/ForkPoolWorker-16] [99be7a8f-5f4e-4f0f-a8b6-51d9973af7c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:27:00.783171792Z [2024-03-29 03:27:00,782: INFO/ForkPoolWorker-1] [bea57e20-0208-4a3d-92d6-5337cbdfb50b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:27:01.124909590Z [2024-03-29 03:27:01,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:27:01.137819943Z [2024-03-29 03:27:01,134: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:27:01.150225156Z [2024-03-29 03:27:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:27:01.310084824Z [2024-03-29 03:27:01,309: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:27:01.314066547Z [2024-03-29 03:27:01,313: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:27:01.337568479Z [2024-03-29 03:27:01,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:27:01.339406458Z [2024-03-29 03:27:01,339: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:27:01.339653345Z [2024-03-29 03:27:01,339: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:27:01.339817089Z [2024-03-29 03:27:01,339: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:27:01.340126645Z [2024-03-29 03:27:01,339: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:27:01.432786855Z [2024-03-29 03:27:01,432: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:27:02.159080151Z [2024-03-29 03:27:02,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99be7a8f-5f4e-4f0f-a8b6-51d9973af7c0] succeeded in 1.3846892929996102s: None 2024-03-29T03:27:02.347074476Z [2024-03-29 03:27:02,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:27:02.350858919Z [2024-03-29 03:27:02,350: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:27:02.376811502Z [2024-03-29 03:27:02,376: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:27:02.378283393Z [2024-03-29 03:27:02,378: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:27:02.378405721Z [2024-03-29 03:27:02,378: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:27:02.378687198Z [2024-03-29 03:27:02,378: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:27:02.378791640Z [2024-03-29 03:27:02,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:27:02.379267817Z [2024-03-29 03:27:02,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:27:02.379276412Z [2024-03-29 03:27:02,379: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:27:02.404152763Z [2024-03-29 03:27:02,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:27:02.407599652Z [2024-03-29 03:27:02,407: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:27:02.432877906Z [2024-03-29 03:27:02,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:27:02.434427855Z [2024-03-29 03:27:02,434: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:27:02.434599867Z [2024-03-29 03:27:02,434: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:27:02.434832748Z [2024-03-29 03:27:02,434: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:27:02.435003672Z [2024-03-29 03:27:02,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:27:02.435384939Z [2024-03-29 03:27:02,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:27:02.435537538Z [2024-03-29 03:27:02,435: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:27:02.464431816Z [2024-03-29 03:27:02,464: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:27:02.526332770Z [2024-03-29 03:27:02,526: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:27:04.218102052Z [2024-03-29 03:27:04,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bea57e20-0208-4a3d-92d6-5337cbdfb50b] succeeded in 3.443442394000158s: None 2024-03-29T03:27:05.259739895Z [2024-03-29 03:27:05,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4e7d10f-861e-4a9c-9595-8758cbbbe31d] succeeded in 4.492559574999177s: None 2024-03-29T03:28:00.590329618Z [2024-03-29 03:28:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8a078c1-8aae-4098-ab3f-71544ce6f10e] received 2024-03-29T03:28:00.593645434Z [2024-03-29 03:28:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07db8359-33a8-43ff-b533-240cc0cb6a04] received 2024-03-29T03:28:00.601009256Z [2024-03-29 03:28:00,600: INFO/ForkPoolWorker-15] [e8a078c1-8aae-4098-ab3f-71544ce6f10e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:28:00.602712248Z [2024-03-29 03:28:00,602: INFO/ForkPoolWorker-16] [07db8359-33a8-43ff-b533-240cc0cb6a04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:28:00.604871578Z [2024-03-29 03:28:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21533ecb-ccbc-4443-af4d-86b61372dd9a] received 2024-03-29T03:28:00.615027300Z [2024-03-29 03:28:00,613: INFO/ForkPoolWorker-1] [21533ecb-ccbc-4443-af4d-86b61372dd9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:28:00.629299263Z [2024-03-29 03:28:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6298694-6b6c-42be-8f36-ae96999e4cf5] received 2024-03-29T03:28:00.639052898Z [2024-03-29 03:28:00,638: INFO/ForkPoolWorker-2] [b6298694-6b6c-42be-8f36-ae96999e4cf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:28:00.950131162Z [2024-03-29 03:28:00,947: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:28:00.968251147Z [2024-03-29 03:28:00,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:28:01.072979870Z [2024-03-29 03:28:01,069: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:28:01.230041523Z [2024-03-29 03:28:01,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:28:01.233922050Z [2024-03-29 03:28:01,233: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:28:01.237939635Z [2024-03-29 03:28:01,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:28:01.269897246Z [2024-03-29 03:28:01,269: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:28:01.271307600Z [2024-03-29 03:28:01,270: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:28:01.271444746Z [2024-03-29 03:28:01,271: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:28:01.271492143Z [2024-03-29 03:28:01,271: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:28:01.271720325Z [2024-03-29 03:28:01,271: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:28:01.382214961Z [2024-03-29 03:28:01,381: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:28:01.664302423Z [2024-03-29 03:28:01,663: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:28:02.136889631Z [2024-03-29 03:28:02,136: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b6298694-6b6c-42be-8f36-ae96999e4cf5] succeeded in 1.5056343989999732s: None 2024-03-29T03:28:02.452864214Z [2024-03-29 03:28:02,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8a078c1-8aae-4098-ab3f-71544ce6f10e] succeeded in 1.8599397500001942s: None 2024-03-29T03:28:02.506053364Z [2024-03-29 03:28:02,505: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:28:02.509608341Z [2024-03-29 03:28:02,509: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:28:02.546490730Z [2024-03-29 03:28:02,546: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:28:02.548279189Z [2024-03-29 03:28:02,547: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:28:02.548298875Z [2024-03-29 03:28:02,548: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:28:02.548447790Z [2024-03-29 03:28:02,548: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:28:02.548460132Z [2024-03-29 03:28:02,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:28:02.548869147Z [2024-03-29 03:28:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:28:02.549003004Z [2024-03-29 03:28:02,548: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:28:02.644110258Z [2024-03-29 03:28:02,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:28:02.715292070Z [2024-03-29 03:28:02,714: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:28:02.719432668Z [2024-03-29 03:28:02,718: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:28:02.759747992Z [2024-03-29 03:28:02,759: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:28:02.761474370Z [2024-03-29 03:28:02,761: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:28:02.761621039Z [2024-03-29 03:28:02,761: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:28:02.761779765Z [2024-03-29 03:28:02,761: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:28:02.761834683Z [2024-03-29 03:28:02,761: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:28:02.762192520Z [2024-03-29 03:28:02,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:28:02.762201387Z [2024-03-29 03:28:02,762: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:28:02.890931681Z [2024-03-29 03:28:02,890: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:28:04.625642211Z [2024-03-29 03:28:04,625: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21533ecb-ccbc-4443-af4d-86b61372dd9a] succeeded in 4.019099178000033s: None 2024-03-29T03:28:05.661070957Z [2024-03-29 03:28:05,660: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[07db8359-33a8-43ff-b533-240cc0cb6a04] succeeded in 5.064676658999815s: None 2024-03-29T03:29:00.379991137Z [2024-03-29 03:29:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c719f149-50ff-4df4-bb9e-ad4db78fd158] received 2024-03-29T03:29:00.392592793Z [2024-03-29 03:29:00,392: INFO/ForkPoolWorker-15] [c719f149-50ff-4df4-bb9e-ad4db78fd158] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:29:00.395133379Z [2024-03-29 03:29:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19aa5b61-4550-41dd-9df8-f53c62e63bbc] received 2024-03-29T03:29:00.413297031Z [2024-03-29 03:29:00,412: INFO/ForkPoolWorker-16] [19aa5b61-4550-41dd-9df8-f53c62e63bbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:29:00.486384637Z [2024-03-29 03:29:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b62a5dd-dd23-4440-8ef0-426c39aea4e7] received 2024-03-29T03:29:00.497362517Z [2024-03-29 03:29:00,497: INFO/ForkPoolWorker-1] [6b62a5dd-dd23-4440-8ef0-426c39aea4e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:29:00.776302607Z [2024-03-29 03:29:00,773: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:29:00.931133606Z [2024-03-29 03:29:00,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:29:00.989256317Z [2024-03-29 03:29:00,986: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:29:01.146305954Z [2024-03-29 03:29:01,145: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:29:01.150226690Z [2024-03-29 03:29:01,149: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:29:01.180150486Z [2024-03-29 03:29:01,179: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:29:01.181439494Z [2024-03-29 03:29:01,181: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:29:01.181633601Z [2024-03-29 03:29:01,181: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:29:01.181772711Z [2024-03-29 03:29:01,181: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:29:01.182497719Z [2024-03-29 03:29:01,182: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:29:01.293896169Z [2024-03-29 03:29:01,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:29:01.939550649Z [2024-03-29 03:29:01,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c719f149-50ff-4df4-bb9e-ad4db78fd158] succeeded in 1.5548985269997502s: None 2024-03-29T03:29:02.274603086Z [2024-03-29 03:29:02,274: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:29:02.277992372Z [2024-03-29 03:29:02,277: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:29:02.296396874Z [2024-03-29 03:29:02,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:29:02.297811507Z [2024-03-29 03:29:02,297: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:29:02.297841933Z [2024-03-29 03:29:02,297: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:29:02.297957519Z [2024-03-29 03:29:02,297: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:29:02.297988991Z [2024-03-29 03:29:02,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:29:02.298304190Z [2024-03-29 03:29:02,298: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:29:02.298364731Z [2024-03-29 03:29:02,298: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:29:02.380492461Z [2024-03-29 03:29:02,380: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:29:02.476974139Z [2024-03-29 03:29:02,476: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:29:02.482085316Z [2024-03-29 03:29:02,481: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:29:02.529920954Z [2024-03-29 03:29:02,529: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:29:02.532017354Z [2024-03-29 03:29:02,531: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:29:02.532040697Z [2024-03-29 03:29:02,531: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:29:02.532117317Z [2024-03-29 03:29:02,531: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:29:02.532178688Z [2024-03-29 03:29:02,532: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:29:02.532491464Z [2024-03-29 03:29:02,532: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:29:02.532504011Z [2024-03-29 03:29:02,532: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:29:02.654561290Z [2024-03-29 03:29:02,654: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:29:04.800716068Z [2024-03-29 03:29:04,800: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19aa5b61-4550-41dd-9df8-f53c62e63bbc] succeeded in 4.400870620000205s: None 2024-03-29T03:29:06.038429425Z [2024-03-29 03:29:06,038: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b62a5dd-dd23-4440-8ef0-426c39aea4e7] succeeded in 5.549724006999895s: None 2024-03-29T03:30:00.306955913Z [2024-03-29 03:30:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ff3c99b-0716-4234-a899-74bb8b20bb42] received 2024-03-29T03:30:00.310260520Z [2024-03-29 03:30:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a0f91ce-d8bb-4ea6-9f8d-395161735672] received 2024-03-29T03:30:00.312177320Z [2024-03-29 03:30:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b34e668b-43e4-4633-98a3-f330732025ec] received 2024-03-29T03:30:00.321594914Z [2024-03-29 03:30:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cadabff-b999-426a-8fd9-1b477964e078] received 2024-03-29T03:30:00.323902575Z [2024-03-29 03:30:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d813126-8a3a-4b30-a649-b2124d8d2cb2] received 2024-03-29T03:30:00.326191893Z [2024-03-29 03:30:00,325: INFO/ForkPoolWorker-15] [4ff3c99b-0716-4234-a899-74bb8b20bb42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:30:00.332097918Z [2024-03-29 03:30:00,331: INFO/ForkPoolWorker-16] [3a0f91ce-d8bb-4ea6-9f8d-395161735672] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:00.336712123Z [2024-03-29 03:30:00,336: INFO/ForkPoolWorker-1] [b34e668b-43e4-4633-98a3-f330732025ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:30:00.337514727Z [2024-03-29 03:30:00,337: INFO/ForkPoolWorker-2] [5cadabff-b999-426a-8fd9-1b477964e078] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:30:00.338203311Z [2024-03-29 03:30:00,336: INFO/ForkPoolWorker-3] [5d813126-8a3a-4b30-a649-b2124d8d2cb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:30:00.695788094Z [2024-03-29 03:30:00,689: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:30:00.715491908Z [2024-03-29 03:30:00,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:30:00.740886745Z [2024-03-29 03:30:00,733: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:30:00.820623516Z [2024-03-29 03:30:00,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:30:01.012463909Z [2024-03-29 03:30:01,007: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:30:01.152426187Z [2024-03-29 03:30:01,151: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:30:01.156766506Z [2024-03-29 03:30:01,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:01.192149822Z [2024-03-29 03:30:01,191: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:30:01.196607076Z [2024-03-29 03:30:01,196: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:30:01.196939607Z [2024-03-29 03:30:01,196: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:30:01.197027183Z [2024-03-29 03:30:01,196: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:30:01.197275446Z [2024-03-29 03:30:01,197: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:30:01.449147596Z [2024-03-29 03:30:01,448: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:01.552394932Z [2024-03-29 03:30:01,552: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:02.949607570Z [2024-03-29 03:30:02,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b34e668b-43e4-4633-98a3-f330732025ec] succeeded in 2.6333651500008273s: None 2024-03-29T03:30:02.959643643Z [2024-03-29 03:30:02,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ff3c99b-0716-4234-a899-74bb8b20bb42] succeeded in 2.6467742289987655s: None 2024-03-29T03:30:03.129371946Z [2024-03-29 03:30:03,128: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:30:03.133043078Z [2024-03-29 03:30:03,132: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:03.169871888Z [2024-03-29 03:30:03,169: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:30:03.171960250Z [2024-03-29 03:30:03,171: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:03.171979521Z [2024-03-29 03:30:03,171: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:03.172216775Z [2024-03-29 03:30:03,171: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:03.172289155Z [2024-03-29 03:30:03,172: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:30:03.172616945Z [2024-03-29 03:30:03,172: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:30:03.172687094Z [2024-03-29 03:30:03,172: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:03.241270988Z [2024-03-29 03:30:03,240: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-29T03:30:03.246264640Z [2024-03-29 03:30:03,245: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:03.303215788Z [2024-03-29 03:30:03,302: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:03.316237198Z [2024-03-29 03:30:03,315: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T03:30:03.318304122Z [2024-03-29 03:30:03,318: INFO/ForkPoolWorker-3] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:03.324202863Z [2024-03-29 03:30:03,323: INFO/ForkPoolWorker-3] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:03.324406872Z [2024-03-29 03:30:03,324: INFO/ForkPoolWorker-3] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:03.324509261Z [2024-03-29 03:30:03,324: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-29T03:30:03.324866922Z [2024-03-29 03:30:03,324: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:30:03.325523977Z [2024-03-29 03:30:03,325: INFO/ForkPoolWorker-3] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:03.482124010Z [2024-03-29 03:30:03,481: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:04.063053704Z [2024-03-29 03:30:04,062: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:30:04.067031823Z [2024-03-29 03:30:04,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:04.097099187Z [2024-03-29 03:30:04,096: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:30:04.099132195Z [2024-03-29 03:30:04,098: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:04.099203383Z [2024-03-29 03:30:04,099: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:04.099429485Z [2024-03-29 03:30:04,099: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:04.099549016Z [2024-03-29 03:30:04,099: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:30:04.100330112Z [2024-03-29 03:30:04,100: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:30:04.100436783Z [2024-03-29 03:30:04,100: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:04.212915575Z [2024-03-29 03:30:04,212: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:05.084306621Z [2024-03-29 03:30:05,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a0f91ce-d8bb-4ea6-9f8d-395161735672] succeeded in 4.7716332279997005s: None 2024-03-29T03:30:05.428463987Z [2024-03-29 03:30:05,427: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5d813126-8a3a-4b30-a649-b2124d8d2cb2] succeeded in 5.1007625380007084s: None 2024-03-29T03:30:05.600301196Z [2024-03-29 03:30:05,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d193d6be-8383-4cbb-8600-f8c72554c710] received 2024-03-29T03:30:05.626586756Z [2024-03-29 03:30:05,626: INFO/ForkPoolWorker-15] [d193d6be-8383-4cbb-8600-f8c72554c710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:06.102278182Z [2024-03-29 03:30:06,089: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:30:06.143457115Z [2024-03-29 03:30:06,143: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5cadabff-b999-426a-8fd9-1b477964e078] succeeded in 5.818383564001124s: None 2024-03-29T03:30:07.565743313Z [2024-03-29 03:30:07,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:30:07.569203067Z [2024-03-29 03:30:07,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:07.613491923Z [2024-03-29 03:30:07,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:30:07.619977519Z [2024-03-29 03:30:07,619: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:07.619999901Z [2024-03-29 03:30:07,619: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:07.620072596Z [2024-03-29 03:30:07,619: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:07.620135699Z [2024-03-29 03:30:07,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:30:07.620405186Z [2024-03-29 03:30:07,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:30:07.620442720Z [2024-03-29 03:30:07,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:07.853429504Z [2024-03-29 03:30:07,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:08.931329542Z [2024-03-29 03:30:08,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d193d6be-8383-4cbb-8600-f8c72554c710] succeeded in 3.3281240390006133s: None 2024-03-29T03:30:09.117882801Z [2024-03-29 03:30:09,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fac01c15-7dff-45d0-94af-e980b1847faa] received 2024-03-29T03:30:09.143201251Z [2024-03-29 03:30:09,142: INFO/ForkPoolWorker-15] [fac01c15-7dff-45d0-94af-e980b1847faa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:30:09.665893250Z [2024-03-29 03:30:09,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:30:11.017723960Z [2024-03-29 03:30:11,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:30:11.020923570Z [2024-03-29 03:30:11,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:11.057642632Z [2024-03-29 03:30:11,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:30:11.059798112Z [2024-03-29 03:30:11,059: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:11.060084055Z [2024-03-29 03:30:11,059: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:11.060383619Z [2024-03-29 03:30:11,060: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:11.060613155Z [2024-03-29 03:30:11,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:30:11.061254613Z [2024-03-29 03:30:11,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:30:11.061310880Z [2024-03-29 03:30:11,061: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:11.176314728Z [2024-03-29 03:30:11,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:11.746497024Z [2024-03-29 03:30:11,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fac01c15-7dff-45d0-94af-e980b1847faa] succeeded in 2.6228491330002726s: None 2024-03-29T03:30:12.576818290Z [2024-03-29 03:30:12,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a3c0928-f0ea-413f-9e1d-edc3eb447339] received 2024-03-29T03:30:12.584964563Z [2024-03-29 03:30:12,584: INFO/ForkPoolWorker-15] [5a3c0928-f0ea-413f-9e1d-edc3eb447339] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:12.980698579Z [2024-03-29 03:30:12,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:30:14.105638367Z [2024-03-29 03:30:14,105: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:30:14.108881667Z [2024-03-29 03:30:14,108: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:30:14.128118059Z [2024-03-29 03:30:14,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:30:14.129369714Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:30:14.129381626Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:30:14.129553044Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:30:14.129633067Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:30:14.130048470Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:30:14.130169384Z [2024-03-29 03:30:14,129: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:30:14.215904996Z [2024-03-29 03:30:14,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:14.793899256Z [2024-03-29 03:30:14,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a3c0928-f0ea-413f-9e1d-edc3eb447339] succeeded in 2.2153863299990917s: None 2024-03-29T03:30:57.931427377Z [2024-03-29 03:30:57,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04e3f28c-6cee-4735-abcf-413c45dfb625] received 2024-03-29T03:30:57.943581564Z [2024-03-29 03:30:57,943: INFO/ForkPoolWorker-15] [04e3f28c-6cee-4735-abcf-413c45dfb625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240329033057_908042', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-29T03:30:58.228123044Z [2024-03-29 03:30:58,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-03-29T03:30:58.469161980Z [2024-03-29 03:30:58,468: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:30:58.943791360Z [2024-03-29 03:30:58,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04e3f28c-6cee-4735-abcf-413c45dfb625] succeeded in 1.00999634299842s: None 2024-03-29T03:31:00.550074599Z [2024-03-29 03:31:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[712d3377-82f2-4e51-8aee-438af9ccf374] received 2024-03-29T03:31:00.556731951Z [2024-03-29 03:31:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aecaf611-eec5-4b64-8b20-832e74777b5d] received 2024-03-29T03:31:00.558694404Z [2024-03-29 03:31:00,558: INFO/ForkPoolWorker-15] [712d3377-82f2-4e51-8aee-438af9ccf374] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:31:00.567009768Z [2024-03-29 03:31:00,566: INFO/ForkPoolWorker-16] [aecaf611-eec5-4b64-8b20-832e74777b5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:31:00.567072454Z [2024-03-29 03:31:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75e10068-bea1-471e-a4f1-71ab87385e58] received 2024-03-29T03:31:00.577640798Z [2024-03-29 03:31:00,576: INFO/ForkPoolWorker-1] [75e10068-bea1-471e-a4f1-71ab87385e58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:31:00.900895679Z [2024-03-29 03:31:00,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:31:00.911526301Z [2024-03-29 03:31:00,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:31:00.960433259Z [2024-03-29 03:31:00,957: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:31:01.205475739Z [2024-03-29 03:31:01,204: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:31:01.209852094Z [2024-03-29 03:31:01,209: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:31:01.234931931Z [2024-03-29 03:31:01,234: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:31:01.236208921Z [2024-03-29 03:31:01,235: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:31:01.236272410Z [2024-03-29 03:31:01,236: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:31:01.236352475Z [2024-03-29 03:31:01,236: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:31:01.236549246Z [2024-03-29 03:31:01,236: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:31:01.332927472Z [2024-03-29 03:31:01,332: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:31:01.970891527Z [2024-03-29 03:31:01,970: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75e10068-bea1-471e-a4f1-71ab87385e58] succeeded in 1.4018202879997261s: None 2024-03-29T03:31:02.393770425Z [2024-03-29 03:31:02,393: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:31:02.397628225Z [2024-03-29 03:31:02,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:31:02.405112556Z [2024-03-29 03:31:02,404: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:31:02.409712482Z [2024-03-29 03:31:02,409: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:31:02.431976614Z [2024-03-29 03:31:02,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:31:02.433490487Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:31:02.433541973Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:31:02.433655545Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:31:02.433666577Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:31:02.433991299Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:31:02.434001269Z [2024-03-29 03:31:02,433: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:31:02.452670322Z [2024-03-29 03:31:02,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:31:02.454606289Z [2024-03-29 03:31:02,454: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:31:02.454674157Z [2024-03-29 03:31:02,454: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:31:02.454743189Z [2024-03-29 03:31:02,454: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:31:02.454758138Z [2024-03-29 03:31:02,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:31:02.456485154Z [2024-03-29 03:31:02,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:31:02.456604303Z [2024-03-29 03:31:02,456: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:31:02.551126313Z [2024-03-29 03:31:02,550: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:31:02.585528289Z [2024-03-29 03:31:02,585: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:31:04.300869044Z [2024-03-29 03:31:04,300: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aecaf611-eec5-4b64-8b20-832e74777b5d] succeeded in 3.741335426999285s: None 2024-03-29T03:31:05.093238185Z [2024-03-29 03:31:05,092: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[712d3377-82f2-4e51-8aee-438af9ccf374] succeeded in 4.539838385000621s: None 2024-03-29T03:32:00.376075130Z [2024-03-29 03:32:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d013bf7-0b9c-4325-b094-1363baa75eb1] received 2024-03-29T03:32:00.379311970Z [2024-03-29 03:32:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6c468f3-b6ba-48df-bee8-793f6398ebdb] received 2024-03-29T03:32:00.387017658Z [2024-03-29 03:32:00,386: INFO/ForkPoolWorker-16] [e6c468f3-b6ba-48df-bee8-793f6398ebdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:32:00.388268088Z [2024-03-29 03:32:00,388: INFO/ForkPoolWorker-15] [3d013bf7-0b9c-4325-b094-1363baa75eb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:32:00.403552240Z [2024-03-29 03:32:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1944317-4e14-48e2-9444-640540372c72] received 2024-03-29T03:32:00.407874017Z [2024-03-29 03:32:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b302ff2-1c69-479c-94e6-40648bbe9934] received 2024-03-29T03:32:00.450087564Z [2024-03-29 03:32:00,449: INFO/ForkPoolWorker-2] [0b302ff2-1c69-479c-94e6-40648bbe9934] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:32:00.450587993Z [2024-03-29 03:32:00,450: INFO/ForkPoolWorker-1] [f1944317-4e14-48e2-9444-640540372c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:32:00.852373261Z [2024-03-29 03:32:00,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:32:00.981467898Z [2024-03-29 03:32:00,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:32:01.101106555Z [2024-03-29 03:32:01,097: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:32:01.127442763Z [2024-03-29 03:32:01,124: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:32:01.318569345Z [2024-03-29 03:32:01,318: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:32:01.323247062Z [2024-03-29 03:32:01,322: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:32:01.380792177Z [2024-03-29 03:32:01,380: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:32:01.383734595Z [2024-03-29 03:32:01,383: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:32:01.383814719Z [2024-03-29 03:32:01,383: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:32:01.383848462Z [2024-03-29 03:32:01,383: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:32:01.384282988Z [2024-03-29 03:32:01,384: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:32:01.437810675Z [2024-03-29 03:32:01,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:32:01.594312642Z [2024-03-29 03:32:01,593: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:32:02.257720892Z [2024-03-29 03:32:02,257: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d013bf7-0b9c-4325-b094-1363baa75eb1] succeeded in 1.8740815199998906s: None 2024-03-29T03:32:02.554583245Z [2024-03-29 03:32:02,549: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b302ff2-1c69-479c-94e6-40648bbe9934] succeeded in 2.1344000899989624s: None 2024-03-29T03:32:02.839514089Z [2024-03-29 03:32:02,839: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:32:02.843179414Z [2024-03-29 03:32:02,842: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:32:02.868195549Z [2024-03-29 03:32:02,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:32:02.869710731Z [2024-03-29 03:32:02,869: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:32:02.869762107Z [2024-03-29 03:32:02,869: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:32:02.869976059Z [2024-03-29 03:32:02,869: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:32:02.870049791Z [2024-03-29 03:32:02,869: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:32:02.870598468Z [2024-03-29 03:32:02,870: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:32:02.870637811Z [2024-03-29 03:32:02,870: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:32:02.983252246Z [2024-03-29 03:32:02,982: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:32:03.015508331Z [2024-03-29 03:32:03,015: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:32:03.019214847Z [2024-03-29 03:32:03,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:32:03.047778838Z [2024-03-29 03:32:03,047: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:32:03.050234691Z [2024-03-29 03:32:03,049: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:32:03.050261595Z [2024-03-29 03:32:03,050: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:32:03.050598414Z [2024-03-29 03:32:03,050: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:32:03.050723507Z [2024-03-29 03:32:03,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:32:03.051173055Z [2024-03-29 03:32:03,050: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:32:03.052198202Z [2024-03-29 03:32:03,051: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:32:03.154006463Z [2024-03-29 03:32:03,153: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:32:04.587986122Z [2024-03-29 03:32:04,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6c468f3-b6ba-48df-bee8-793f6398ebdb] succeeded in 4.207123412999863s: None 2024-03-29T03:32:05.246715173Z [2024-03-29 03:32:05,246: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1944317-4e14-48e2-9444-640540372c72] succeeded in 4.839032378000411s: None 2024-03-29T03:33:01.095190381Z [2024-03-29 03:33:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cc74f1a-2c12-45d0-b68d-87c20db1439b] received 2024-03-29T03:33:01.107459275Z [2024-03-29 03:33:01,107: INFO/ForkPoolWorker-15] [2cc74f1a-2c12-45d0-b68d-87c20db1439b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:33:01.111396419Z [2024-03-29 03:33:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21027c78-76b4-4946-80af-cd16f5b4ca4c] received 2024-03-29T03:33:01.121502940Z [2024-03-29 03:33:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a8ed89-e0df-4fa3-8c16-29e8efecb3aa] received 2024-03-29T03:33:01.121587521Z [2024-03-29 03:33:01,121: INFO/ForkPoolWorker-16] [21027c78-76b4-4946-80af-cd16f5b4ca4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:33:01.137436146Z [2024-03-29 03:33:01,137: INFO/ForkPoolWorker-1] [a6a8ed89-e0df-4fa3-8c16-29e8efecb3aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:33:01.473671015Z [2024-03-29 03:33:01,470: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:33:01.495363424Z [2024-03-29 03:33:01,492: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:33:01.594345616Z [2024-03-29 03:33:01,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:33:01.641861847Z [2024-03-29 03:33:01,641: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:33:01.646261521Z [2024-03-29 03:33:01,645: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:33:01.675217337Z [2024-03-29 03:33:01,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:33:01.676944622Z [2024-03-29 03:33:01,676: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:33:01.677027606Z [2024-03-29 03:33:01,676: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:33:01.677033152Z [2024-03-29 03:33:01,676: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:33:01.677220426Z [2024-03-29 03:33:01,677: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:33:01.789769897Z [2024-03-29 03:33:01,789: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:33:02.496127126Z [2024-03-29 03:33:02,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6a8ed89-e0df-4fa3-8c16-29e8efecb3aa] succeeded in 1.3661962429996493s: None 2024-03-29T03:33:02.846187700Z [2024-03-29 03:33:02,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:33:02.850243362Z [2024-03-29 03:33:02,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:33:02.867316327Z [2024-03-29 03:33:02,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:33:02.871400365Z [2024-03-29 03:33:02,870: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:33:02.872994503Z [2024-03-29 03:33:02,872: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:33:02.874561019Z [2024-03-29 03:33:02,874: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:33:02.874710080Z [2024-03-29 03:33:02,874: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:33:02.874921477Z [2024-03-29 03:33:02,874: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:33:02.875056835Z [2024-03-29 03:33:02,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:33:02.875376003Z [2024-03-29 03:33:02,875: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:33:02.875488686Z [2024-03-29 03:33:02,875: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:33:02.895170332Z [2024-03-29 03:33:02,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:33:02.896611149Z [2024-03-29 03:33:02,896: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:33:02.896642695Z [2024-03-29 03:33:02,896: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:33:02.896789440Z [2024-03-29 03:33:02,896: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:33:02.896897567Z [2024-03-29 03:33:02,896: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:33:02.897250484Z [2024-03-29 03:33:02,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:33:02.897461623Z [2024-03-29 03:33:02,897: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:33:02.968677189Z [2024-03-29 03:33:02,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:33:02.998585032Z [2024-03-29 03:33:02,998: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:33:05.394992424Z [2024-03-29 03:33:05,394: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21027c78-76b4-4946-80af-cd16f5b4ca4c] succeeded in 4.281381505001264s: None 2024-03-29T03:33:05.470765403Z [2024-03-29 03:33:05,470: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cc74f1a-2c12-45d0-b68d-87c20db1439b] succeeded in 4.3712768079985835s: None 2024-03-29T03:34:00.469104126Z [2024-03-29 03:34:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc3fd277-29e8-44ea-b0dd-13f2c5e9f6e1] received 2024-03-29T03:34:00.471142892Z [2024-03-29 03:34:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60b92229-f795-4066-aa2a-a9c5e97005c8] received 2024-03-29T03:34:00.473211096Z [2024-03-29 03:34:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[811b6798-d173-4e4b-9e4f-13ae449d587a] received 2024-03-29T03:34:00.474851464Z [2024-03-29 03:34:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b431cf9-6515-45e5-aded-391dc6b27dba] received 2024-03-29T03:34:00.480380141Z [2024-03-29 03:34:00,480: INFO/ForkPoolWorker-16] [60b92229-f795-4066-aa2a-a9c5e97005c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:34:00.483034382Z [2024-03-29 03:34:00,482: INFO/ForkPoolWorker-2] [9b431cf9-6515-45e5-aded-391dc6b27dba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:34:00.483712198Z [2024-03-29 03:34:00,483: INFO/ForkPoolWorker-1] [811b6798-d173-4e4b-9e4f-13ae449d587a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:34:00.491349073Z [2024-03-29 03:34:00,491: INFO/ForkPoolWorker-15] [bc3fd277-29e8-44ea-b0dd-13f2c5e9f6e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:34:00.790345099Z [2024-03-29 03:34:00,787: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:34:00.806870160Z [2024-03-29 03:34:00,803: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:34:00.853596881Z [2024-03-29 03:34:00,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:34:00.964276078Z [2024-03-29 03:34:00,952: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:34:01.099635668Z [2024-03-29 03:34:01,099: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:34:01.264664210Z [2024-03-29 03:34:01,264: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:34:01.269522569Z [2024-03-29 03:34:01,268: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:34:01.304225766Z [2024-03-29 03:34:01,303: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:34:01.306079155Z [2024-03-29 03:34:01,305: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:34:01.306524101Z [2024-03-29 03:34:01,306: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:34:01.306707806Z [2024-03-29 03:34:01,306: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:34:01.307074310Z [2024-03-29 03:34:01,306: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:34:01.434509556Z [2024-03-29 03:34:01,434: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:34:01.788812678Z [2024-03-29 03:34:01,788: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60b92229-f795-4066-aa2a-a9c5e97005c8] succeeded in 1.314493683999899s: None 2024-03-29T03:34:02.244559554Z [2024-03-29 03:34:02,244: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9b431cf9-6515-45e5-aded-391dc6b27dba] succeeded in 1.7680300290012383s: None 2024-03-29T03:34:02.271992673Z [2024-03-29 03:34:02,271: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:34:02.275641936Z [2024-03-29 03:34:02,275: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:34:02.303276806Z [2024-03-29 03:34:02,302: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:34:02.305215288Z [2024-03-29 03:34:02,304: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:34:02.305276351Z [2024-03-29 03:34:02,305: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:34:02.305470211Z [2024-03-29 03:34:02,305: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:34:02.305535687Z [2024-03-29 03:34:02,305: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:34:02.307246166Z [2024-03-29 03:34:02,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:34:02.307306677Z [2024-03-29 03:34:02,307: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:34:02.416845122Z [2024-03-29 03:34:02,416: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:34:02.484523763Z [2024-03-29 03:34:02,484: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:34:02.488752392Z [2024-03-29 03:34:02,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:34:02.520422883Z [2024-03-29 03:34:02,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:34:02.524436666Z [2024-03-29 03:34:02,524: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:34:02.524590975Z [2024-03-29 03:34:02,524: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:34:02.524775679Z [2024-03-29 03:34:02,524: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:34:02.524831776Z [2024-03-29 03:34:02,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:34:02.525237490Z [2024-03-29 03:34:02,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:34:02.525359029Z [2024-03-29 03:34:02,525: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:34:02.640551706Z [2024-03-29 03:34:02,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:34:04.301300078Z [2024-03-29 03:34:04,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc3fd277-29e8-44ea-b0dd-13f2c5e9f6e1] succeeded in 3.8269272460001957s: None 2024-03-29T03:34:04.356135189Z [2024-03-29 03:34:04,355: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[811b6798-d173-4e4b-9e4f-13ae449d587a] succeeded in 3.8797441419992538s: None 2024-03-29T03:35:00.455793821Z [2024-03-29 03:35:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3779d768-0d45-4cf2-b929-44b89d9c8b27] received 2024-03-29T03:35:00.459667221Z [2024-03-29 03:35:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3089672f-6144-4182-9b7f-550aae98f58c] received 2024-03-29T03:35:00.462097529Z [2024-03-29 03:35:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[637fc434-16f9-401b-8550-6bff463a89a7] received 2024-03-29T03:35:00.463884973Z [2024-03-29 03:35:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a84fef65-f142-4e2a-adde-156d8c6e96b5] received 2024-03-29T03:35:00.464161744Z [2024-03-29 03:35:00,463: INFO/ForkPoolWorker-15] [3779d768-0d45-4cf2-b929-44b89d9c8b27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:00.470987104Z [2024-03-29 03:35:00,470: INFO/ForkPoolWorker-1] [637fc434-16f9-401b-8550-6bff463a89a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:35:00.473160059Z [2024-03-29 03:35:00,472: INFO/ForkPoolWorker-2] [a84fef65-f142-4e2a-adde-156d8c6e96b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:35:00.482062505Z [2024-03-29 03:35:00,481: INFO/ForkPoolWorker-16] [3089672f-6144-4182-9b7f-550aae98f58c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:35:00.772648463Z [2024-03-29 03:35:00,769: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:35:00.772696661Z [2024-03-29 03:35:00,769: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:35:00.814871530Z [2024-03-29 03:35:00,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:35:00.898812241Z [2024-03-29 03:35:00,894: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:35:00.957977243Z [2024-03-29 03:35:00,957: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:35:00.962395098Z [2024-03-29 03:35:00,961: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:01.010852343Z [2024-03-29 03:35:01,010: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:35:01.018222235Z [2024-03-29 03:35:01,015: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:35:01.018857103Z [2024-03-29 03:35:01,018: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:35:01.020430076Z [2024-03-29 03:35:01,020: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:35:01.020727795Z [2024-03-29 03:35:01,020: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:35:01.180129884Z [2024-03-29 03:35:01,179: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:01.947592078Z [2024-03-29 03:35:01,947: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a84fef65-f142-4e2a-adde-156d8c6e96b5] succeeded in 1.4796979910006485s: None 2024-03-29T03:35:02.304893441Z [2024-03-29 03:35:02,304: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:35:02.308406593Z [2024-03-29 03:35:02,307: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:02.354984125Z [2024-03-29 03:35:02,354: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:35:02.356706188Z [2024-03-29 03:35:02,356: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:02.356742556Z [2024-03-29 03:35:02,356: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:02.356950299Z [2024-03-29 03:35:02,356: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:02.357119449Z [2024-03-29 03:35:02,356: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:35:02.357566602Z [2024-03-29 03:35:02,357: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:35:02.357762131Z [2024-03-29 03:35:02,357: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:02.416999097Z [2024-03-29 03:35:02,416: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:35:02.421047714Z [2024-03-29 03:35:02,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:02.433861818Z [2024-03-29 03:35:02,433: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:35:02.437849944Z [2024-03-29 03:35:02,437: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:02.452477510Z [2024-03-29 03:35:02,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:35:02.454092760Z [2024-03-29 03:35:02,453: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:02.454110320Z [2024-03-29 03:35:02,453: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:02.454301951Z [2024-03-29 03:35:02,454: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:02.454325472Z [2024-03-29 03:35:02,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:35:02.454723470Z [2024-03-29 03:35:02,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:35:02.454866380Z [2024-03-29 03:35:02,454: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:02.466475414Z [2024-03-29 03:35:02,466: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:02.472978035Z [2024-03-29 03:35:02,472: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:35:02.474896294Z [2024-03-29 03:35:02,474: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:02.477472255Z [2024-03-29 03:35:02,474: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:02.477837503Z [2024-03-29 03:35:02,477: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:02.477973753Z [2024-03-29 03:35:02,477: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:35:02.478396918Z [2024-03-29 03:35:02,478: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:35:02.478998019Z [2024-03-29 03:35:02,478: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:02.563803958Z [2024-03-29 03:35:02,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:02.585867202Z [2024-03-29 03:35:02,585: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:03.283593717Z [2024-03-29 03:35:03,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3779d768-0d45-4cf2-b929-44b89d9c8b27] succeeded in 2.8257896049999545s: None 2024-03-29T03:35:04.007891444Z [2024-03-29 03:35:04,007: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[637fc434-16f9-401b-8550-6bff463a89a7] succeeded in 3.542412005001097s: None 2024-03-29T03:35:04.182905837Z [2024-03-29 03:35:04,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2070d301-b8ad-4365-8896-73c580c09da4] received 2024-03-29T03:35:04.192321177Z [2024-03-29 03:35:04,191: INFO/ForkPoolWorker-15] [2070d301-b8ad-4365-8896-73c580c09da4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:04.548130349Z [2024-03-29 03:35:04,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:35:04.613563225Z [2024-03-29 03:35:04,613: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3089672f-6144-4182-9b7f-550aae98f58c] succeeded in 4.150068880000617s: None 2024-03-29T03:35:05.942589031Z [2024-03-29 03:35:05,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:35:05.946580405Z [2024-03-29 03:35:05,945: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:06.026921791Z [2024-03-29 03:35:06,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:35:06.034588058Z [2024-03-29 03:35:06,031: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:06.034618570Z [2024-03-29 03:35:06,031: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:06.034624683Z [2024-03-29 03:35:06,031: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:06.034630003Z [2024-03-29 03:35:06,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:35:06.034633360Z [2024-03-29 03:35:06,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:35:06.034636737Z [2024-03-29 03:35:06,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:06.143544721Z [2024-03-29 03:35:06,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:06.854752324Z [2024-03-29 03:35:06,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2070d301-b8ad-4365-8896-73c580c09da4] succeeded in 2.669745639001121s: None 2024-03-29T03:35:06.922398387Z [2024-03-29 03:35:06,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b075b35-a9ac-40e1-9981-50d5960b31dc] received 2024-03-29T03:35:06.934724560Z [2024-03-29 03:35:06,934: INFO/ForkPoolWorker-15] [5b075b35-a9ac-40e1-9981-50d5960b31dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:35:07.459643793Z [2024-03-29 03:35:07,455: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:35:08.703148840Z [2024-03-29 03:35:08,702: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:35:08.706410828Z [2024-03-29 03:35:08,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:08.723996679Z [2024-03-29 03:35:08,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:35:08.725831140Z [2024-03-29 03:35:08,725: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:08.725843767Z [2024-03-29 03:35:08,725: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:08.725987738Z [2024-03-29 03:35:08,725: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:08.725994043Z [2024-03-29 03:35:08,725: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:35:08.726249360Z [2024-03-29 03:35:08,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:35:08.726253685Z [2024-03-29 03:35:08,726: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:08.814891486Z [2024-03-29 03:35:08,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:09.302416614Z [2024-03-29 03:35:09,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b075b35-a9ac-40e1-9981-50d5960b31dc] succeeded in 2.3765210050005408s: None 2024-03-29T03:35:09.967880838Z [2024-03-29 03:35:09,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef7918af-e79b-43fd-89a5-d25a83c54b6e] received 2024-03-29T03:35:09.974901748Z [2024-03-29 03:35:09,974: INFO/ForkPoolWorker-15] [ef7918af-e79b-43fd-89a5-d25a83c54b6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:10.317589287Z [2024-03-29 03:35:10,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:35:11.514932326Z [2024-03-29 03:35:11,514: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:35:11.518115659Z [2024-03-29 03:35:11,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:35:11.534932296Z [2024-03-29 03:35:11,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:35:11.536089215Z [2024-03-29 03:35:11,535: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:35:11.536100628Z [2024-03-29 03:35:11,536: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:35:11.536226685Z [2024-03-29 03:35:11,536: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:35:11.536236155Z [2024-03-29 03:35:11,536: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:35:11.536462792Z [2024-03-29 03:35:11,536: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:35:11.536477393Z [2024-03-29 03:35:11,536: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:35:11.613793215Z [2024-03-29 03:35:11,613: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:35:12.183051561Z [2024-03-29 03:35:12,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef7918af-e79b-43fd-89a5-d25a83c54b6e] succeeded in 2.2136557699996047s: None 2024-03-29T03:36:00.505570329Z [2024-03-29 03:36:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85bd9038-bb34-4cb0-84a7-d3d2963bdb74] received 2024-03-29T03:36:00.510636067Z [2024-03-29 03:36:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1455ba3-f5bd-4f83-bcfa-ded7b7176435] received 2024-03-29T03:36:00.513225544Z [2024-03-29 03:36:00,512: INFO/ForkPoolWorker-15] [85bd9038-bb34-4cb0-84a7-d3d2963bdb74] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:36:00.520455953Z [2024-03-29 03:36:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f13b9a0-828b-47c4-9a32-fb95978aeaa2] received 2024-03-29T03:36:00.521517722Z [2024-03-29 03:36:00,521: INFO/ForkPoolWorker-16] [a1455ba3-f5bd-4f83-bcfa-ded7b7176435] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:36:00.531421644Z [2024-03-29 03:36:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b62badde-9a0f-4d32-81dc-e81552985957] received 2024-03-29T03:36:00.536930771Z [2024-03-29 03:36:00,536: INFO/ForkPoolWorker-2] [b62badde-9a0f-4d32-81dc-e81552985957] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:36:00.543878185Z [2024-03-29 03:36:00,543: INFO/ForkPoolWorker-1] [4f13b9a0-828b-47c4-9a32-fb95978aeaa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:36:00.889875666Z [2024-03-29 03:36:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:36:00.903556434Z [2024-03-29 03:36:00,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:36:00.947946901Z [2024-03-29 03:36:00,944: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:36:00.952349980Z [2024-03-29 03:36:00,948: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:36:01.165441093Z [2024-03-29 03:36:01,164: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:36:01.170112450Z [2024-03-29 03:36:01,169: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:36:01.198669309Z [2024-03-29 03:36:01,198: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:36:01.200706983Z [2024-03-29 03:36:01,200: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:36:01.200908765Z [2024-03-29 03:36:01,200: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:36:01.201149096Z [2024-03-29 03:36:01,200: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:36:01.201651121Z [2024-03-29 03:36:01,201: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:36:01.292320319Z [2024-03-29 03:36:01,291: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:36:01.364748388Z [2024-03-29 03:36:01,364: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:36:02.005644586Z [2024-03-29 03:36:02,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b62badde-9a0f-4d32-81dc-e81552985957] succeeded in 1.4728127140006109s: None 2024-03-29T03:36:02.019086362Z [2024-03-29 03:36:02,018: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85bd9038-bb34-4cb0-84a7-d3d2963bdb74] succeeded in 1.5116425790001813s: None 2024-03-29T03:36:02.396846347Z [2024-03-29 03:36:02,396: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:36:02.400843417Z [2024-03-29 03:36:02,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:36:02.420654290Z [2024-03-29 03:36:02,420: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:36:02.422230154Z [2024-03-29 03:36:02,421: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:36:02.422246344Z [2024-03-29 03:36:02,422: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:36:02.422515613Z [2024-03-29 03:36:02,422: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:36:02.422656847Z [2024-03-29 03:36:02,422: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:36:02.423102640Z [2024-03-29 03:36:02,422: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:36:02.423161421Z [2024-03-29 03:36:02,423: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:36:02.489624201Z [2024-03-29 03:36:02,489: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:36:02.493402817Z [2024-03-29 03:36:02,492: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:36:02.517893381Z [2024-03-29 03:36:02,517: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:36:02.521155652Z [2024-03-29 03:36:02,520: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:36:02.526369032Z [2024-03-29 03:36:02,525: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:36:02.526580522Z [2024-03-29 03:36:02,526: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:36:02.526959971Z [2024-03-29 03:36:02,526: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:36:02.527275315Z [2024-03-29 03:36:02,526: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:36:02.528606546Z [2024-03-29 03:36:02,528: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:36:02.528818747Z [2024-03-29 03:36:02,528: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:36:02.625359897Z [2024-03-29 03:36:02,625: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:36:04.678551386Z [2024-03-29 03:36:04,677: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1455ba3-f5bd-4f83-bcfa-ded7b7176435] succeeded in 4.165429777000099s: None 2024-03-29T03:36:04.960795558Z [2024-03-29 03:36:04,959: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f13b9a0-828b-47c4-9a32-fb95978aeaa2] succeeded in 4.4271910800016485s: None 2024-03-29T03:37:00.689636877Z [2024-03-29 03:37:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56261779-28b5-41e1-89cb-a204ce98c388] received 2024-03-29T03:37:00.690991618Z [2024-03-29 03:37:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dda43cac-1cbf-4a2e-bf0a-5743cf828b2e] received 2024-03-29T03:37:00.696981728Z [2024-03-29 03:37:00,696: INFO/ForkPoolWorker-15] [56261779-28b5-41e1-89cb-a204ce98c388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:37:00.699559561Z [2024-03-29 03:37:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3de9d1b8-22d2-4191-aa73-f8e2c30832e2] received 2024-03-29T03:37:00.704902435Z [2024-03-29 03:37:00,704: INFO/ForkPoolWorker-16] [dda43cac-1cbf-4a2e-bf0a-5743cf828b2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:37:00.710938357Z [2024-03-29 03:37:00,710: INFO/ForkPoolWorker-1] [3de9d1b8-22d2-4191-aa73-f8e2c30832e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:37:01.036023330Z [2024-03-29 03:37:01,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:37:01.103991690Z [2024-03-29 03:37:01,100: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:37:01.160430452Z [2024-03-29 03:37:01,154: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:37:01.410683653Z [2024-03-29 03:37:01,410: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:37:01.416548122Z [2024-03-29 03:37:01,415: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:37:01.440613227Z [2024-03-29 03:37:01,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:37:01.441792470Z [2024-03-29 03:37:01,441: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:37:01.441953925Z [2024-03-29 03:37:01,441: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:37:01.442038894Z [2024-03-29 03:37:01,441: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:37:01.442254822Z [2024-03-29 03:37:01,442: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:37:01.544316317Z [2024-03-29 03:37:01,543: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:37:02.209626258Z [2024-03-29 03:37:02,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dda43cac-1cbf-4a2e-bf0a-5743cf828b2e] succeeded in 1.5149240030004876s: None 2024-03-29T03:37:02.502938469Z [2024-03-29 03:37:02,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:37:02.506408990Z [2024-03-29 03:37:02,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:37:02.544305658Z [2024-03-29 03:37:02,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:37:02.546719358Z [2024-03-29 03:37:02,546: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:37:02.546747025Z [2024-03-29 03:37:02,546: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:37:02.546954424Z [2024-03-29 03:37:02,546: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:37:02.547056999Z [2024-03-29 03:37:02,546: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:37:02.547574593Z [2024-03-29 03:37:02,547: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:37:02.547583002Z [2024-03-29 03:37:02,547: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:37:02.576169922Z [2024-03-29 03:37:02,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:37:02.579750102Z [2024-03-29 03:37:02,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:37:02.608908134Z [2024-03-29 03:37:02,608: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:37:02.610483344Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:37:02.610548489Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:37:02.610663246Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:37:02.610692273Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:37:02.611003598Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:37:02.611038504Z [2024-03-29 03:37:02,610: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:37:02.677686124Z [2024-03-29 03:37:02,677: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:37:02.706250599Z [2024-03-29 03:37:02,705: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:37:04.452186400Z [2024-03-29 03:37:04,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3de9d1b8-22d2-4191-aa73-f8e2c30832e2] succeeded in 3.748491751999609s: None 2024-03-29T03:37:04.932047244Z [2024-03-29 03:37:04,931: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56261779-28b5-41e1-89cb-a204ce98c388] succeeded in 4.2398004830010905s: None 2024-03-29T03:38:00.453102278Z [2024-03-29 03:38:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2d7107d-53f4-4bf0-8aa2-c27606610376] received 2024-03-29T03:38:00.466589025Z [2024-03-29 03:38:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6a9f51e-9fd8-4991-aefc-27bea0f1bf32] received 2024-03-29T03:38:00.466650568Z [2024-03-29 03:38:00,463: INFO/ForkPoolWorker-15] [a2d7107d-53f4-4bf0-8aa2-c27606610376] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:38:00.467157187Z [2024-03-29 03:38:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb6da522-4d15-4594-8b88-a34350f696c3] received 2024-03-29T03:38:00.475021689Z [2024-03-29 03:38:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef6bcb2a-ae5a-47f9-a5d2-dba7baa5c23f] received 2024-03-29T03:38:00.478709148Z [2024-03-29 03:38:00,478: INFO/ForkPoolWorker-1] [fb6da522-4d15-4594-8b88-a34350f696c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:38:00.480643948Z [2024-03-29 03:38:00,480: INFO/ForkPoolWorker-16] [e6a9f51e-9fd8-4991-aefc-27bea0f1bf32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:38:00.493478108Z [2024-03-29 03:38:00,493: INFO/ForkPoolWorker-2] [ef6bcb2a-ae5a-47f9-a5d2-dba7baa5c23f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:38:00.790092126Z [2024-03-29 03:38:00,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:38:00.841645308Z [2024-03-29 03:38:00,838: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:38:00.951817574Z [2024-03-29 03:38:00,948: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:38:01.079856909Z [2024-03-29 03:38:01,074: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:38:01.109543997Z [2024-03-29 03:38:01,109: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:38:01.157555287Z [2024-03-29 03:38:01,156: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:38:01.162167418Z [2024-03-29 03:38:01,161: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:38:01.186656578Z [2024-03-29 03:38:01,186: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:38:01.195870542Z [2024-03-29 03:38:01,195: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:38:01.196237299Z [2024-03-29 03:38:01,195: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:38:01.199241974Z [2024-03-29 03:38:01,199: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:38:01.199735208Z [2024-03-29 03:38:01,199: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:38:01.334259018Z [2024-03-29 03:38:01,333: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:38:01.732501565Z [2024-03-29 03:38:01,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2d7107d-53f4-4bf0-8aa2-c27606610376] succeeded in 1.277624721000393s: None 2024-03-29T03:38:02.095587960Z [2024-03-29 03:38:02,095: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef6bcb2a-ae5a-47f9-a5d2-dba7baa5c23f] succeeded in 1.6141048680001404s: None 2024-03-29T03:38:02.383247939Z [2024-03-29 03:38:02,382: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:38:02.387845169Z [2024-03-29 03:38:02,387: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:38:02.414551040Z [2024-03-29 03:38:02,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:38:02.417499655Z [2024-03-29 03:38:02,417: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:38:02.417868159Z [2024-03-29 03:38:02,417: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:38:02.418324914Z [2024-03-29 03:38:02,417: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:38:02.418673609Z [2024-03-29 03:38:02,418: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:38:02.419193084Z [2024-03-29 03:38:02,418: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:38:02.419526217Z [2024-03-29 03:38:02,419: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:38:02.533845438Z [2024-03-29 03:38:02,533: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:38:02.779362130Z [2024-03-29 03:38:02,778: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:38:02.782920506Z [2024-03-29 03:38:02,782: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:38:02.805480246Z [2024-03-29 03:38:02,805: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:38:02.807002415Z [2024-03-29 03:38:02,806: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:38:02.807020811Z [2024-03-29 03:38:02,806: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:38:02.807194377Z [2024-03-29 03:38:02,806: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:38:02.807257082Z [2024-03-29 03:38:02,807: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:38:02.807583162Z [2024-03-29 03:38:02,807: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:38:02.807604262Z [2024-03-29 03:38:02,807: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:38:02.893606621Z [2024-03-29 03:38:02,893: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:38:04.477524678Z [2024-03-29 03:38:04,476: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb6da522-4d15-4594-8b88-a34350f696c3] succeeded in 4.006281543001023s: None 2024-03-29T03:38:04.661750979Z [2024-03-29 03:38:04,661: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6a9f51e-9fd8-4991-aefc-27bea0f1bf32] succeeded in 4.192089240999849s: None 2024-03-29T03:39:01.223320010Z [2024-03-29 03:39:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a9cfdba-cd27-4967-969f-52b5a32575d7] received 2024-03-29T03:39:01.232330979Z [2024-03-29 03:39:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf38d66c-b91f-4d0f-8519-15428f95c9e9] received 2024-03-29T03:39:01.239061648Z [2024-03-29 03:39:01,238: INFO/ForkPoolWorker-15] [9a9cfdba-cd27-4967-969f-52b5a32575d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:39:01.244248041Z [2024-03-29 03:39:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39e5e5f5-dd90-41dd-855d-a714dd4ce9f9] received 2024-03-29T03:39:01.245395722Z [2024-03-29 03:39:01,245: INFO/ForkPoolWorker-16] [bf38d66c-b91f-4d0f-8519-15428f95c9e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:39:01.253722390Z [2024-03-29 03:39:01,253: INFO/ForkPoolWorker-1] [39e5e5f5-dd90-41dd-855d-a714dd4ce9f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:39:01.547677319Z [2024-03-29 03:39:01,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:39:01.738477160Z [2024-03-29 03:39:01,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:39:01.751003126Z [2024-03-29 03:39:01,750: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:39:01.755631646Z [2024-03-29 03:39:01,755: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:39:01.790527083Z [2024-03-29 03:39:01,790: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:39:01.801607367Z [2024-03-29 03:39:01,796: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:39:01.807327793Z [2024-03-29 03:39:01,806: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:39:01.809983862Z [2024-03-29 03:39:01,809: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:39:01.810138687Z [2024-03-29 03:39:01,809: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:39:01.810999128Z [2024-03-29 03:39:01,810: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:39:01.915831690Z [2024-03-29 03:39:01,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:39:02.793120649Z [2024-03-29 03:39:02,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a9cfdba-cd27-4967-969f-52b5a32575d7] succeeded in 1.5655975210011093s: None 2024-03-29T03:39:03.359468443Z [2024-03-29 03:39:03,359: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:39:03.363138919Z [2024-03-29 03:39:03,362: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:39:03.397713874Z [2024-03-29 03:39:03,397: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:39:03.403027332Z [2024-03-29 03:39:03,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:39:03.403426751Z [2024-03-29 03:39:03,402: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:39:03.408037442Z [2024-03-29 03:39:03,407: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:39:03.408278087Z [2024-03-29 03:39:03,407: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:39:03.408606042Z [2024-03-29 03:39:03,408: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:39:03.409492294Z [2024-03-29 03:39:03,408: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:39:03.410041937Z [2024-03-29 03:39:03,409: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:39:03.410541002Z [2024-03-29 03:39:03,409: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:39:03.432716675Z [2024-03-29 03:39:03,432: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:39:03.434753879Z [2024-03-29 03:39:03,434: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:39:03.434830267Z [2024-03-29 03:39:03,434: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:39:03.434998333Z [2024-03-29 03:39:03,434: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:39:03.435092292Z [2024-03-29 03:39:03,435: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:39:03.435492773Z [2024-03-29 03:39:03,435: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:39:03.435609581Z [2024-03-29 03:39:03,435: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:39:03.514348749Z [2024-03-29 03:39:03,513: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:39:03.542127071Z [2024-03-29 03:39:03,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:39:05.922340674Z [2024-03-29 03:39:05,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf38d66c-b91f-4d0f-8519-15428f95c9e9] succeeded in 4.687977719999253s: None 2024-03-29T03:39:06.877072715Z [2024-03-29 03:39:06,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39e5e5f5-dd90-41dd-855d-a714dd4ce9f9] succeeded in 5.630952536999757s: None 2024-03-29T03:40:00.826019251Z [2024-03-29 03:40:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d4821c9-0a81-4017-82f2-312484f6678c] received 2024-03-29T03:40:00.831706743Z [2024-03-29 03:40:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc8cd39e-3e33-4252-92fd-7d4c906e0890] received 2024-03-29T03:40:00.834955320Z [2024-03-29 03:40:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36be2a94-d4e4-43bc-ba7a-8616f7cf01e5] received 2024-03-29T03:40:00.836129507Z [2024-03-29 03:40:00,835: INFO/ForkPoolWorker-15] [3d4821c9-0a81-4017-82f2-312484f6678c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:00.842581881Z [2024-03-29 03:40:00,842: INFO/ForkPoolWorker-1] [36be2a94-d4e4-43bc-ba7a-8616f7cf01e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:40:00.853587079Z [2024-03-29 03:40:00,853: INFO/ForkPoolWorker-16] [fc8cd39e-3e33-4252-92fd-7d4c906e0890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:40:00.855885512Z [2024-03-29 03:40:00,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e699307d-72e8-4560-b8c6-95a6cfb2443b] received 2024-03-29T03:40:00.875481636Z [2024-03-29 03:40:00,875: INFO/ForkPoolWorker-2] [e699307d-72e8-4560-b8c6-95a6cfb2443b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:40:00.886345753Z [2024-03-29 03:40:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb000bc8-5e7d-4fa1-9846-e69a6d5b08e6] received 2024-03-29T03:40:00.902836819Z [2024-03-29 03:40:00,902: INFO/ForkPoolWorker-3] [bb000bc8-5e7d-4fa1-9846-e69a6d5b08e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:40:01.261945573Z [2024-03-29 03:40:01,258: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:40:01.406783166Z [2024-03-29 03:40:01,403: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:40:01.452374610Z [2024-03-29 03:40:01,447: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:40:01.671379446Z [2024-03-29 03:40:01,670: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-29T03:40:01.679125621Z [2024-03-29 03:40:01,678: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:01.686263886Z [2024-03-29 03:40:01,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:40:01.703106149Z [2024-03-29 03:40:01,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:40:01.742308784Z [2024-03-29 03:40:01,742: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-29T03:40:01.747929547Z [2024-03-29 03:40:01,747: INFO/ForkPoolWorker-3] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:40:01.747975004Z [2024-03-29 03:40:01,747: INFO/ForkPoolWorker-3] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:40:01.748014602Z [2024-03-29 03:40:01,747: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-29T03:40:01.748275497Z [2024-03-29 03:40:01,748: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:40:01.782616512Z [2024-03-29 03:40:01,782: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:01.940778453Z [2024-03-29 03:40:01,940: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:02.809867024Z [2024-03-29 03:40:02,809: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36be2a94-d4e4-43bc-ba7a-8616f7cf01e5] succeeded in 1.9732903059993987s: None 2024-03-29T03:40:02.824788775Z [2024-03-29 03:40:02,824: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bb000bc8-5e7d-4fa1-9846-e69a6d5b08e6] succeeded in 1.935607445999267s: None 2024-03-29T03:40:02.863268087Z [2024-03-29 03:40:02,862: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:40:02.867434741Z [2024-03-29 03:40:02,866: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:02.899588769Z [2024-03-29 03:40:02,899: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:40:02.903394159Z [2024-03-29 03:40:02,902: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:02.903425198Z [2024-03-29 03:40:02,903: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:02.903628173Z [2024-03-29 03:40:02,903: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:02.903724845Z [2024-03-29 03:40:02,903: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:40:02.904303687Z [2024-03-29 03:40:02,903: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:40:02.904325429Z [2024-03-29 03:40:02,904: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:03.057486635Z [2024-03-29 03:40:03,057: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:03.488821926Z [2024-03-29 03:40:03,488: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:40:03.494654497Z [2024-03-29 03:40:03,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:03.539489183Z [2024-03-29 03:40:03,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:40:03.546936870Z [2024-03-29 03:40:03,546: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:03.547064522Z [2024-03-29 03:40:03,546: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:03.547351157Z [2024-03-29 03:40:03,547: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:03.547538052Z [2024-03-29 03:40:03,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:40:03.548164168Z [2024-03-29 03:40:03,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:40:03.548203579Z [2024-03-29 03:40:03,548: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:03.666605642Z [2024-03-29 03:40:03,666: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:03.720614967Z [2024-03-29 03:40:03,720: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:40:03.724218489Z [2024-03-29 03:40:03,723: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:03.762707224Z [2024-03-29 03:40:03,762: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:40:03.764451470Z [2024-03-29 03:40:03,764: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:03.764535988Z [2024-03-29 03:40:03,764: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:03.764729027Z [2024-03-29 03:40:03,764: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:03.765062269Z [2024-03-29 03:40:03,764: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:40:03.765277620Z [2024-03-29 03:40:03,765: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:40:03.765372598Z [2024-03-29 03:40:03,765: INFO/ForkPoolWorker-2] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:03.860695422Z [2024-03-29 03:40:03,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d4821c9-0a81-4017-82f2-312484f6678c] succeeded in 3.0306607429993164s: None 2024-03-29T03:40:03.873528350Z [2024-03-29 03:40:03,873: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:03.928047559Z [2024-03-29 03:40:03,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e666eae9-bad7-4ed0-942b-ab9cceaeaa25] received 2024-03-29T03:40:03.935287358Z [2024-03-29 03:40:03,935: INFO/ForkPoolWorker-15] [e666eae9-bad7-4ed0-942b-ab9cceaeaa25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:04.433104788Z [2024-03-29 03:40:04,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:40:05.894792491Z [2024-03-29 03:40:05,893: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:40:05.898564172Z [2024-03-29 03:40:05,897: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:05.942583508Z [2024-03-29 03:40:05,938: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e699307d-72e8-4560-b8c6-95a6cfb2443b] succeeded in 5.082023983000909s: None 2024-03-29T03:40:05.993893252Z [2024-03-29 03:40:05,991: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc8cd39e-3e33-4252-92fd-7d4c906e0890] succeeded in 5.156293623000238s: None 2024-03-29T03:40:06.007599029Z [2024-03-29 03:40:06,007: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:40:06.009337251Z [2024-03-29 03:40:06,009: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:06.009419464Z [2024-03-29 03:40:06,009: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:06.009788621Z [2024-03-29 03:40:06,009: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:06.009825996Z [2024-03-29 03:40:06,009: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:40:06.010713402Z [2024-03-29 03:40:06,010: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:40:06.010767411Z [2024-03-29 03:40:06,010: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:06.149951101Z [2024-03-29 03:40:06,149: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:06.892986610Z [2024-03-29 03:40:06,892: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e666eae9-bad7-4ed0-942b-ab9cceaeaa25] succeeded in 2.9631366539997543s: None 2024-03-29T03:40:07.677130977Z [2024-03-29 03:40:07,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eec75324-c513-4866-800e-3e4eff68a25e] received 2024-03-29T03:40:07.695268132Z [2024-03-29 03:40:07,695: INFO/ForkPoolWorker-15] [eec75324-c513-4866-800e-3e4eff68a25e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:40:08.030622283Z [2024-03-29 03:40:08,027: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:40:09.176865853Z [2024-03-29 03:40:09,176: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:40:09.180066976Z [2024-03-29 03:40:09,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:09.199906547Z [2024-03-29 03:40:09,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:40:09.201393433Z [2024-03-29 03:40:09,201: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:09.201549964Z [2024-03-29 03:40:09,201: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:09.201763678Z [2024-03-29 03:40:09,201: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:09.201932421Z [2024-03-29 03:40:09,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:40:09.202501149Z [2024-03-29 03:40:09,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:40:09.202621048Z [2024-03-29 03:40:09,202: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:09.304633735Z [2024-03-29 03:40:09,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:09.915123930Z [2024-03-29 03:40:09,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eec75324-c513-4866-800e-3e4eff68a25e] succeeded in 2.235558372000014s: None 2024-03-29T03:40:09.944750500Z [2024-03-29 03:40:09,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe4e8a07-aa28-4283-ae0c-4f0911758ef1] received 2024-03-29T03:40:09.953538504Z [2024-03-29 03:40:09,953: INFO/ForkPoolWorker-15] [fe4e8a07-aa28-4283-ae0c-4f0911758ef1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:10.226594964Z [2024-03-29 03:40:10,223: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:40:11.344998786Z [2024-03-29 03:40:11,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:40:11.348403297Z [2024-03-29 03:40:11,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:40:11.364684001Z [2024-03-29 03:40:11,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:40:11.366066432Z [2024-03-29 03:40:11,365: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:40:11.366200402Z [2024-03-29 03:40:11,366: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:40:11.366403740Z [2024-03-29 03:40:11,366: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:40:11.366543268Z [2024-03-29 03:40:11,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:40:11.366855196Z [2024-03-29 03:40:11,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:40:11.367007594Z [2024-03-29 03:40:11,366: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:40:11.448274399Z [2024-03-29 03:40:11,447: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:40:12.022434848Z [2024-03-29 03:40:12,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe4e8a07-aa28-4283-ae0c-4f0911758ef1] succeeded in 2.0745679840001685s: None 2024-03-29T03:41:00.783290493Z [2024-03-29 03:41:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ad7f2fd-ac0f-41cf-9ed9-abbf759596d1] received 2024-03-29T03:41:00.787608032Z [2024-03-29 03:41:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67028319-7fc7-4eca-bf78-479fd1c21e27] received 2024-03-29T03:41:00.789604200Z [2024-03-29 03:41:00,788: INFO/ForkPoolWorker-15] [7ad7f2fd-ac0f-41cf-9ed9-abbf759596d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:41:00.791549232Z [2024-03-29 03:41:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb63da3e-c5f8-48a9-a1b9-81674e51e150] received 2024-03-29T03:41:00.812281836Z [2024-03-29 03:41:00,811: INFO/ForkPoolWorker-16] [67028319-7fc7-4eca-bf78-479fd1c21e27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:41:00.812738748Z [2024-03-29 03:41:00,812: INFO/ForkPoolWorker-1] [cb63da3e-c5f8-48a9-a1b9-81674e51e150] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:41:01.135045321Z [2024-03-29 03:41:01,131: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:41:01.157969014Z [2024-03-29 03:41:01,154: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:41:01.174667755Z [2024-03-29 03:41:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:41:01.481433740Z [2024-03-29 03:41:01,480: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-29T03:41:01.490638036Z [2024-03-29 03:41:01,489: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:41:01.572054924Z [2024-03-29 03:41:01,571: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:41:01.574064877Z [2024-03-29 03:41:01,573: INFO/ForkPoolWorker-15] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:41:01.574191862Z [2024-03-29 03:41:01,573: INFO/ForkPoolWorker-15] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:41:01.574399856Z [2024-03-29 03:41:01,574: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-29T03:41:01.574930459Z [2024-03-29 03:41:01,574: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:41:01.738055640Z [2024-03-29 03:41:01,737: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:41:02.473447504Z [2024-03-29 03:41:02,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ad7f2fd-ac0f-41cf-9ed9-abbf759596d1] succeeded in 1.688468133999777s: None 2024-03-29T03:41:02.513375054Z [2024-03-29 03:41:02,512: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:41:02.517852597Z [2024-03-29 03:41:02,517: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:41:02.524916874Z [2024-03-29 03:41:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:41:02.531504452Z [2024-03-29 03:41:02,530: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:41:02.551651947Z [2024-03-29 03:41:02,551: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:41:02.554232551Z [2024-03-29 03:41:02,553: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:41:02.554499392Z [2024-03-29 03:41:02,554: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:41:02.554892582Z [2024-03-29 03:41:02,554: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:41:02.555166471Z [2024-03-29 03:41:02,554: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:41:02.555730055Z [2024-03-29 03:41:02,555: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:41:02.555888566Z [2024-03-29 03:41:02,555: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:41:02.576361108Z [2024-03-29 03:41:02,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:41:02.578398812Z [2024-03-29 03:41:02,578: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:41:02.578774074Z [2024-03-29 03:41:02,578: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:41:02.579035546Z [2024-03-29 03:41:02,578: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:41:02.579214720Z [2024-03-29 03:41:02,579: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:41:02.579999696Z [2024-03-29 03:41:02,579: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:41:02.580201177Z [2024-03-29 03:41:02,579: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:41:02.646980507Z [2024-03-29 03:41:02,646: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:41:02.682067578Z [2024-03-29 03:41:02,681: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:41:04.791291325Z [2024-03-29 03:41:04,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67028319-7fc7-4eca-bf78-479fd1c21e27] succeeded in 3.998696435999591s: None 2024-03-29T03:41:04.945721464Z [2024-03-29 03:41:04,945: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb63da3e-c5f8-48a9-a1b9-81674e51e150] succeeded in 4.150243092000892s: None 2024-03-29T03:42:01.163286670Z [2024-03-29 03:42:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebc7b4f7-a8a0-4095-8abe-919ab4e4c1d0] received 2024-03-29T03:42:01.165362486Z [2024-03-29 03:42:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c2efb84-1c80-4ec1-89ac-9bef75d744c6] received 2024-03-29T03:42:01.170956507Z [2024-03-29 03:42:01,170: INFO/ForkPoolWorker-15] [ebc7b4f7-a8a0-4095-8abe-919ab4e4c1d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:42:01.172601376Z [2024-03-29 03:42:01,172: INFO/ForkPoolWorker-16] [7c2efb84-1c80-4ec1-89ac-9bef75d744c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:42:01.177860458Z [2024-03-29 03:42:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73c230e4-f390-41b9-8e97-9b95aa5d6680] received 2024-03-29T03:42:01.183904779Z [2024-03-29 03:42:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00c6900f-0c97-4e95-ac94-35959948e569] received 2024-03-29T03:42:01.191982639Z [2024-03-29 03:42:01,191: INFO/ForkPoolWorker-2] [00c6900f-0c97-4e95-ac94-35959948e569] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:42:01.203160906Z [2024-03-29 03:42:01,202: INFO/ForkPoolWorker-1] [73c230e4-f390-41b9-8e97-9b95aa5d6680] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:42:01.565657222Z [2024-03-29 03:42:01,561: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:42:01.708559182Z [2024-03-29 03:42:01,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:42:01.759087231Z [2024-03-29 03:42:01,758: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:42:01.763904861Z [2024-03-29 03:42:01,763: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:42:01.771170823Z [2024-03-29 03:42:01,765: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:42:01.799260377Z [2024-03-29 03:42:01,799: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:42:01.800841441Z [2024-03-29 03:42:01,800: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:42:01.801186855Z [2024-03-29 03:42:01,800: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:42:01.801385499Z [2024-03-29 03:42:01,801: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:42:01.801657403Z [2024-03-29 03:42:01,801: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:42:01.904768111Z [2024-03-29 03:42:01,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:42:01.912796369Z [2024-03-29 03:42:01,912: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:42:02.321585485Z [2024-03-29 03:42:02,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:42:02.624709653Z [2024-03-29 03:42:02,624: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[00c6900f-0c97-4e95-ac94-35959948e569] succeeded in 1.4389742210005352s: None 2024-03-29T03:42:03.129205535Z [2024-03-29 03:42:03,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ebc7b4f7-a8a0-4095-8abe-919ab4e4c1d0] succeeded in 1.963716113999908s: None 2024-03-29T03:42:03.437317497Z [2024-03-29 03:42:03,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:42:03.441102985Z [2024-03-29 03:42:03,440: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:42:03.476532907Z [2024-03-29 03:42:03,476: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:42:03.481610339Z [2024-03-29 03:42:03,481: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:42:03.481895955Z [2024-03-29 03:42:03,481: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:42:03.482207913Z [2024-03-29 03:42:03,481: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:42:03.482372099Z [2024-03-29 03:42:03,482: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:42:03.483049608Z [2024-03-29 03:42:03,482: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:42:03.483307708Z [2024-03-29 03:42:03,483: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:42:03.592153865Z [2024-03-29 03:42:03,591: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:42:03.709291462Z [2024-03-29 03:42:03,708: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:42:03.712796697Z [2024-03-29 03:42:03,712: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:42:03.747450963Z [2024-03-29 03:42:03,747: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:42:03.748933791Z [2024-03-29 03:42:03,748: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:42:03.748979412Z [2024-03-29 03:42:03,748: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:42:03.749137658Z [2024-03-29 03:42:03,748: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:42:03.749271790Z [2024-03-29 03:42:03,749: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:42:03.749749507Z [2024-03-29 03:42:03,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:42:03.749944211Z [2024-03-29 03:42:03,749: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:42:03.866926859Z [2024-03-29 03:42:03,866: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:42:05.926570562Z [2024-03-29 03:42:05,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c2efb84-1c80-4ec1-89ac-9bef75d744c6] succeeded in 4.759520093999527s: None 2024-03-29T03:42:06.079764450Z [2024-03-29 03:42:06,079: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73c230e4-f390-41b9-8e97-9b95aa5d6680] succeeded in 4.895937762999893s: None 2024-03-29T03:43:00.547820410Z [2024-03-29 03:43:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91be5a7f-3062-4c4f-a7d0-ba6764a6038c] received 2024-03-29T03:43:00.549946885Z [2024-03-29 03:43:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[127bc355-a22f-4199-965b-30426b1e0be4] received 2024-03-29T03:43:00.556150491Z [2024-03-29 03:43:00,555: INFO/ForkPoolWorker-15] [91be5a7f-3062-4c4f-a7d0-ba6764a6038c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:43:00.560746161Z [2024-03-29 03:43:00,560: INFO/ForkPoolWorker-16] [127bc355-a22f-4199-965b-30426b1e0be4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:43:00.566026975Z [2024-03-29 03:43:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81cd83a7-2c41-475a-9f7b-2f5f044dba4d] received 2024-03-29T03:43:00.573379398Z [2024-03-29 03:43:00,573: INFO/ForkPoolWorker-1] [81cd83a7-2c41-475a-9f7b-2f5f044dba4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:43:00.906257044Z [2024-03-29 03:43:00,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:43:00.957472481Z [2024-03-29 03:43:00,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:43:00.975381272Z [2024-03-29 03:43:00,972: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:43:01.232978805Z [2024-03-29 03:43:01,232: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:43:01.237182661Z [2024-03-29 03:43:01,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:43:01.271809601Z [2024-03-29 03:43:01,271: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:43:01.275662061Z [2024-03-29 03:43:01,275: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:43:01.276748792Z [2024-03-29 03:43:01,276: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:43:01.277511212Z [2024-03-29 03:43:01,276: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:43:01.278311299Z [2024-03-29 03:43:01,278: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:43:01.412682722Z [2024-03-29 03:43:01,412: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:43:02.093009820Z [2024-03-29 03:43:02,092: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81cd83a7-2c41-475a-9f7b-2f5f044dba4d] succeeded in 1.5247724699984246s: None 2024-03-29T03:43:02.129537415Z [2024-03-29 03:43:02,129: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:43:02.133201135Z [2024-03-29 03:43:02,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:43:02.154052727Z [2024-03-29 03:43:02,153: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:43:02.155651975Z [2024-03-29 03:43:02,155: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:43:02.155677919Z [2024-03-29 03:43:02,155: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:43:02.156043679Z [2024-03-29 03:43:02,155: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:43:02.156157089Z [2024-03-29 03:43:02,156: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:43:02.156568814Z [2024-03-29 03:43:02,156: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:43:02.156630695Z [2024-03-29 03:43:02,156: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:43:02.234973727Z [2024-03-29 03:43:02,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:43:02.238742732Z [2024-03-29 03:43:02,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:43:02.262429237Z [2024-03-29 03:43:02,262: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:43:02.264957251Z [2024-03-29 03:43:02,264: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:43:02.265147547Z [2024-03-29 03:43:02,264: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:43:02.265600013Z [2024-03-29 03:43:02,265: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:43:02.265887692Z [2024-03-29 03:43:02,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:43:02.266578884Z [2024-03-29 03:43:02,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:43:02.266876774Z [2024-03-29 03:43:02,266: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:43:02.267884762Z [2024-03-29 03:43:02,267: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:43:02.368188316Z [2024-03-29 03:43:02,367: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:43:03.870124038Z [2024-03-29 03:43:03,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91be5a7f-3062-4c4f-a7d0-ba6764a6038c] succeeded in 3.318757626999286s: None 2024-03-29T03:43:04.334523819Z [2024-03-29 03:43:04,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[127bc355-a22f-4199-965b-30426b1e0be4] succeeded in 3.781912051999825s: None 2024-03-29T03:44:00.268318323Z [2024-03-29 03:44:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a1040ac-1830-4fe5-8929-ccf664ed58da] received 2024-03-29T03:44:00.275767375Z [2024-03-29 03:44:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0a73890-3cfe-4234-bb8a-8a6160cd45eb] received 2024-03-29T03:44:00.284199336Z [2024-03-29 03:44:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62ee5889-b7ae-4015-832f-0c04bdad2684] received 2024-03-29T03:44:00.285213286Z [2024-03-29 03:44:00,284: INFO/ForkPoolWorker-15] [0a1040ac-1830-4fe5-8929-ccf664ed58da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:44:00.286214499Z [2024-03-29 03:44:00,285: INFO/ForkPoolWorker-16] [d0a73890-3cfe-4234-bb8a-8a6160cd45eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:44:00.290089528Z [2024-03-29 03:44:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06a4a467-3cde-4bc2-8694-291646f390e0] received 2024-03-29T03:44:00.292212393Z [2024-03-29 03:44:00,291: INFO/ForkPoolWorker-1] [62ee5889-b7ae-4015-832f-0c04bdad2684] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:44:00.315601292Z [2024-03-29 03:44:00,315: INFO/ForkPoolWorker-2] [06a4a467-3cde-4bc2-8694-291646f390e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:44:00.643414545Z [2024-03-29 03:44:00,639: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:44:00.667896610Z [2024-03-29 03:44:00,664: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:44:00.723220831Z [2024-03-29 03:44:00,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:44:00.801600603Z [2024-03-29 03:44:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:44:01.032734840Z [2024-03-29 03:44:01,032: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:44:01.041005890Z [2024-03-29 03:44:01,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:44:01.095737213Z [2024-03-29 03:44:01,095: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:44:01.099726837Z [2024-03-29 03:44:01,099: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:44:01.099886195Z [2024-03-29 03:44:01,099: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:44:01.099993284Z [2024-03-29 03:44:01,099: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:44:01.101756343Z [2024-03-29 03:44:01,100: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:44:01.133546727Z [2024-03-29 03:44:01,133: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:44:01.262393339Z [2024-03-29 03:44:01,262: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:44:01.962741635Z [2024-03-29 03:44:01,962: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0a73890-3cfe-4234-bb8a-8a6160cd45eb] succeeded in 1.6847851679995074s: None 2024-03-29T03:44:02.027562928Z [2024-03-29 03:44:02,027: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62ee5889-b7ae-4015-832f-0c04bdad2684] succeeded in 1.741123724001227s: None 2024-03-29T03:44:02.278026897Z [2024-03-29 03:44:02,277: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:44:02.281810783Z [2024-03-29 03:44:02,281: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:44:02.307542403Z [2024-03-29 03:44:02,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:44:02.309067184Z [2024-03-29 03:44:02,308: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:44:02.309156180Z [2024-03-29 03:44:02,309: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:44:02.309323235Z [2024-03-29 03:44:02,309: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:44:02.309413420Z [2024-03-29 03:44:02,309: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:44:02.309719196Z [2024-03-29 03:44:02,309: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:44:02.309829677Z [2024-03-29 03:44:02,309: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:44:02.325203722Z [2024-03-29 03:44:02,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:44:02.329217578Z [2024-03-29 03:44:02,328: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:44:02.353365200Z [2024-03-29 03:44:02,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:44:02.354868927Z [2024-03-29 03:44:02,354: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:44:02.354889842Z [2024-03-29 03:44:02,354: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:44:02.355061584Z [2024-03-29 03:44:02,354: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:44:02.355175289Z [2024-03-29 03:44:02,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:44:02.355515445Z [2024-03-29 03:44:02,355: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:44:02.355617708Z [2024-03-29 03:44:02,355: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:44:02.407510808Z [2024-03-29 03:44:02,407: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:44:02.447162333Z [2024-03-29 03:44:02,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:44:04.013582361Z [2024-03-29 03:44:04,013: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a1040ac-1830-4fe5-8929-ccf664ed58da] succeeded in 3.7356124959987937s: None 2024-03-29T03:44:04.294334677Z [2024-03-29 03:44:04,293: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06a4a467-3cde-4bc2-8694-291646f390e0] succeeded in 4.001046279001457s: None 2024-03-29T03:45:00.292049572Z [2024-03-29 03:45:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98aca2a0-1256-431f-877f-c01737cd330d] received 2024-03-29T03:45:00.295597782Z [2024-03-29 03:45:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f88b20-5938-4d6f-8ed2-6aa098bc7f33] received 2024-03-29T03:45:00.307587214Z [2024-03-29 03:45:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6d15336-668b-4581-a76c-004e7eb28c5c] received 2024-03-29T03:45:00.308599306Z [2024-03-29 03:45:00,308: INFO/ForkPoolWorker-15] [98aca2a0-1256-431f-877f-c01737cd330d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:00.308735929Z [2024-03-29 03:45:00,308: INFO/ForkPoolWorker-16] [75f88b20-5938-4d6f-8ed2-6aa098bc7f33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:45:00.309689992Z [2024-03-29 03:45:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56487abc-5add-455c-b01e-4027dff2e351] received 2024-03-29T03:45:00.320589181Z [2024-03-29 03:45:00,320: INFO/ForkPoolWorker-1] [d6d15336-668b-4581-a76c-004e7eb28c5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:45:00.330569976Z [2024-03-29 03:45:00,330: INFO/ForkPoolWorker-2] [56487abc-5add-455c-b01e-4027dff2e351] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:45:00.698019133Z [2024-03-29 03:45:00,693: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:45:00.699100536Z [2024-03-29 03:45:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:45:00.748383623Z [2024-03-29 03:45:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:45:00.758822506Z [2024-03-29 03:45:00,754: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:45:00.956092734Z [2024-03-29 03:45:00,955: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-29T03:45:00.963603112Z [2024-03-29 03:45:00,962: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:01.011460658Z [2024-03-29 03:45:01,011: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:45:01.013697101Z [2024-03-29 03:45:01,013: INFO/ForkPoolWorker-2] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:45:01.013796892Z [2024-03-29 03:45:01,013: INFO/ForkPoolWorker-2] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:45:01.013869332Z [2024-03-29 03:45:01,013: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-29T03:45:01.014157842Z [2024-03-29 03:45:01,014: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:45:01.110683724Z [2024-03-29 03:45:01,110: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:01.906746701Z [2024-03-29 03:45:01,906: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[56487abc-5add-455c-b01e-4027dff2e351] succeeded in 1.5945904119998886s: None 2024-03-29T03:45:02.155100659Z [2024-03-29 03:45:02,154: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-29T03:45:02.158705795Z [2024-03-29 03:45:02,158: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:02.186575813Z [2024-03-29 03:45:02,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:45:02.188436135Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:02.188494920Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:02.188594599Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:02.188660080Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-29T03:45:02.188912048Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:45:02.188993097Z [2024-03-29 03:45:02,188: INFO/ForkPoolWorker-1] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:02.294008818Z [2024-03-29 03:45:02,293: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:02.308426112Z [2024-03-29 03:45:02,307: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:45:02.312252065Z [2024-03-29 03:45:02,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:02.330946607Z [2024-03-29 03:45:02,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:45:02.332891297Z [2024-03-29 03:45:02,332: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:02.333124291Z [2024-03-29 03:45:02,332: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:02.333235305Z [2024-03-29 03:45:02,332: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:02.333412321Z [2024-03-29 03:45:02,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:45:02.333757207Z [2024-03-29 03:45:02,333: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:45:02.333812098Z [2024-03-29 03:45:02,333: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:02.362346380Z [2024-03-29 03:45:02,361: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:45:02.365890923Z [2024-03-29 03:45:02,365: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:02.389037176Z [2024-03-29 03:45:02,388: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:45:02.391012327Z [2024-03-29 03:45:02,390: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:02.391074461Z [2024-03-29 03:45:02,390: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:02.391166808Z [2024-03-29 03:45:02,390: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:02.391194540Z [2024-03-29 03:45:02,391: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:45:02.391456163Z [2024-03-29 03:45:02,391: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:45:02.391467399Z [2024-03-29 03:45:02,391: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:02.472542583Z [2024-03-29 03:45:02,472: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:02.513583495Z [2024-03-29 03:45:02,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:03.214536061Z [2024-03-29 03:45:03,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98aca2a0-1256-431f-877f-c01737cd330d] succeeded in 2.916948742000386s: None 2024-03-29T03:45:03.936874091Z [2024-03-29 03:45:03,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10cbc4b3-db51-4f45-8ef8-6c98d5233767] received 2024-03-29T03:45:03.947205433Z [2024-03-29 03:45:03,946: INFO/ForkPoolWorker-15] [10cbc4b3-db51-4f45-8ef8-6c98d5233767] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:03.979720142Z [2024-03-29 03:45:03,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6d15336-668b-4581-a76c-004e7eb28c5c] succeeded in 3.6674551439991774s: None 2024-03-29T03:45:04.227803977Z [2024-03-29 03:45:04,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:45:04.452745263Z [2024-03-29 03:45:04,452: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75f88b20-5938-4d6f-8ed2-6aa098bc7f33] succeeded in 4.151073357999849s: None 2024-03-29T03:45:05.535006889Z [2024-03-29 03:45:05,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:45:05.538235448Z [2024-03-29 03:45:05,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:05.558010454Z [2024-03-29 03:45:05,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:45:05.559418934Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:05.559451491Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:05.559534354Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:05.559554077Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:45:05.559842406Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:45:05.559857523Z [2024-03-29 03:45:05,559: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:05.686429904Z [2024-03-29 03:45:05,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:06.405623005Z [2024-03-29 03:45:06,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2622a9ae-ad02-4251-bfa6-5ff2686a7753] received 2024-03-29T03:45:06.408629425Z [2024-03-29 03:45:06,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10cbc4b3-db51-4f45-8ef8-6c98d5233767] succeeded in 2.4694016559988086s: None 2024-03-29T03:45:06.413324377Z [2024-03-29 03:45:06,413: INFO/ForkPoolWorker-16] [2622a9ae-ad02-4251-bfa6-5ff2686a7753] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:45:07.007756605Z [2024-03-29 03:45:07,003: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:45:08.399887115Z [2024-03-29 03:45:08,399: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:45:08.403168339Z [2024-03-29 03:45:08,402: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:08.422672689Z [2024-03-29 03:45:08,422: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:45:08.423943714Z [2024-03-29 03:45:08,423: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:08.423956280Z [2024-03-29 03:45:08,423: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:08.424137447Z [2024-03-29 03:45:08,423: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:08.424204175Z [2024-03-29 03:45:08,424: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:45:08.424464829Z [2024-03-29 03:45:08,424: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:45:08.424540535Z [2024-03-29 03:45:08,424: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:08.503450754Z [2024-03-29 03:45:08,503: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:08.989068818Z [2024-03-29 03:45:08,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2622a9ae-ad02-4251-bfa6-5ff2686a7753] succeeded in 2.580897089001155s: None 2024-03-29T03:45:09.032143870Z [2024-03-29 03:45:09,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72f9bce1-b8aa-492c-9574-977e2d9e0480] received 2024-03-29T03:45:09.040742194Z [2024-03-29 03:45:09,040: INFO/ForkPoolWorker-15] [72f9bce1-b8aa-492c-9574-977e2d9e0480] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:09.323289664Z [2024-03-29 03:45:09,320: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-29T03:45:10.521105054Z [2024-03-29 03:45:10,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:45:10.524573012Z [2024-03-29 03:45:10,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:45:10.545995514Z [2024-03-29 03:45:10,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:45:10.547412288Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:45:10.547454685Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:45:10.547564975Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:45:10.547640684Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:45:10.547983531Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-29T03:45:10.548006786Z [2024-03-29 03:45:10,547: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:45:10.632135178Z [2024-03-29 03:45:10,631: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:45:11.164535833Z [2024-03-29 03:45:11,164: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72f9bce1-b8aa-492c-9574-977e2d9e0480] succeeded in 2.1307710860000952s: None 2024-03-29T03:46:01.131062343Z [2024-03-29 03:46:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5221996-caec-4d4c-b49c-be073987abcb] received 2024-03-29T03:46:01.138318842Z [2024-03-29 03:46:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57c80f6e-be0d-437a-8902-f8e160dfb76f] received 2024-03-29T03:46:01.146543604Z [2024-03-29 03:46:01,146: INFO/ForkPoolWorker-15] [c5221996-caec-4d4c-b49c-be073987abcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:46:01.147267310Z [2024-03-29 03:46:01,146: INFO/ForkPoolWorker-16] [57c80f6e-be0d-437a-8902-f8e160dfb76f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:46:01.154368744Z [2024-03-29 03:46:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42ffe300-15a0-43d0-b369-a4d3a1775413] received 2024-03-29T03:46:01.157726120Z [2024-03-29 03:46:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39a000b3-d678-42fc-9c42-16d9e93b9048] received 2024-03-29T03:46:01.175403737Z [2024-03-29 03:46:01,175: INFO/ForkPoolWorker-1] [42ffe300-15a0-43d0-b369-a4d3a1775413] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:46:01.185653719Z [2024-03-29 03:46:01,185: INFO/ForkPoolWorker-2] [39a000b3-d678-42fc-9c42-16d9e93b9048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:46:01.672925574Z [2024-03-29 03:46:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:46:01.771112893Z [2024-03-29 03:46:01,767: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:46:01.852671773Z [2024-03-29 03:46:01,848: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:46:01.859975794Z [2024-03-29 03:46:01,856: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:46:02.099763851Z [2024-03-29 03:46:02,099: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:46:02.111001140Z [2024-03-29 03:46:02,110: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:46:02.117433646Z [2024-03-29 03:46:02,116: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:46:02.163324536Z [2024-03-29 03:46:02,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:46:02.167858037Z [2024-03-29 03:46:02,167: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:46:02.168261215Z [2024-03-29 03:46:02,167: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:46:02.168506145Z [2024-03-29 03:46:02,168: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:46:02.169004060Z [2024-03-29 03:46:02,168: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:46:02.316447713Z [2024-03-29 03:46:02,316: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:46:02.812623310Z [2024-03-29 03:46:02,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42ffe300-15a0-43d0-b369-a4d3a1775413] succeeded in 1.6534744320015307s: None 2024-03-29T03:46:03.128390064Z [2024-03-29 03:46:03,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57c80f6e-be0d-437a-8902-f8e160dfb76f] succeeded in 1.9876292600001761s: None 2024-03-29T03:46:03.259959310Z [2024-03-29 03:46:03,259: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:46:03.264659999Z [2024-03-29 03:46:03,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:46:03.284283574Z [2024-03-29 03:46:03,283: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:46:03.285886406Z [2024-03-29 03:46:03,285: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:46:03.285903056Z [2024-03-29 03:46:03,285: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:46:03.286009837Z [2024-03-29 03:46:03,285: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:46:03.286016947Z [2024-03-29 03:46:03,285: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:46:03.286319400Z [2024-03-29 03:46:03,286: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:46:03.286335664Z [2024-03-29 03:46:03,286: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:46:03.368376557Z [2024-03-29 03:46:03,367: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:46:03.371860644Z [2024-03-29 03:46:03,371: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:46:03.395392739Z [2024-03-29 03:46:03,395: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:46:03.398771891Z [2024-03-29 03:46:03,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:46:03.399741855Z [2024-03-29 03:46:03,399: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:46:03.400075571Z [2024-03-29 03:46:03,399: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:46:03.400271239Z [2024-03-29 03:46:03,400: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:46:03.400327701Z [2024-03-29 03:46:03,400: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:46:03.400645721Z [2024-03-29 03:46:03,400: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:46:03.400723877Z [2024-03-29 03:46:03,400: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:46:03.489500118Z [2024-03-29 03:46:03,489: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:46:04.921137786Z [2024-03-29 03:46:04,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5221996-caec-4d4c-b49c-be073987abcb] succeeded in 3.7880195979996643s: None 2024-03-29T03:46:05.507584408Z [2024-03-29 03:46:05,507: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39a000b3-d678-42fc-9c42-16d9e93b9048] succeeded in 4.336125010000615s: None 2024-03-29T03:47:01.217690785Z [2024-03-29 03:47:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b20d0cd4-6f78-4b64-8544-6c8727be7cd2] received 2024-03-29T03:47:01.221125703Z [2024-03-29 03:47:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[095aa263-97d0-4d0e-8677-73250360641e] received 2024-03-29T03:47:01.224541292Z [2024-03-29 03:47:01,224: INFO/ForkPoolWorker-15] [b20d0cd4-6f78-4b64-8544-6c8727be7cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:47:01.230434882Z [2024-03-29 03:47:01,230: INFO/ForkPoolWorker-16] [095aa263-97d0-4d0e-8677-73250360641e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:47:01.237325782Z [2024-03-29 03:47:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c910f0d3-a741-4451-b2d2-f17fb192e2a9] received 2024-03-29T03:47:01.247836049Z [2024-03-29 03:47:01,247: INFO/ForkPoolWorker-1] [c910f0d3-a741-4451-b2d2-f17fb192e2a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:47:01.563674199Z [2024-03-29 03:47:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:47:01.577627276Z [2024-03-29 03:47:01,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:47:01.698427778Z [2024-03-29 03:47:01,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:47:01.778491726Z [2024-03-29 03:47:01,777: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:47:01.782787017Z [2024-03-29 03:47:01,782: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:47:01.815164559Z [2024-03-29 03:47:01,814: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:47:01.819597553Z [2024-03-29 03:47:01,819: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:47:01.819699308Z [2024-03-29 03:47:01,819: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:47:01.819881234Z [2024-03-29 03:47:01,819: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:47:01.820212543Z [2024-03-29 03:47:01,820: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:47:01.938954216Z [2024-03-29 03:47:01,938: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:47:02.788312347Z [2024-03-29 03:47:02,787: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c910f0d3-a741-4451-b2d2-f17fb192e2a9] succeeded in 1.5489429400004155s: None 2024-03-29T03:47:03.137479011Z [2024-03-29 03:47:03,136: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:47:03.141590604Z [2024-03-29 03:47:03,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:47:03.165856052Z [2024-03-29 03:47:03,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:47:03.167456691Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:47:03.167479149Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:47:03.167590189Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:47:03.167603723Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:47:03.167907581Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:47:03.167924000Z [2024-03-29 03:47:03,167: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:47:03.191800105Z [2024-03-29 03:47:03,191: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:47:03.195699342Z [2024-03-29 03:47:03,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:47:03.244095048Z [2024-03-29 03:47:03,242: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:47:03.247684722Z [2024-03-29 03:47:03,247: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:47:03.248905621Z [2024-03-29 03:47:03,247: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:47:03.250066481Z [2024-03-29 03:47:03,249: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:47:03.250097607Z [2024-03-29 03:47:03,249: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:47:03.250101939Z [2024-03-29 03:47:03,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:47:03.250105771Z [2024-03-29 03:47:03,249: INFO/ForkPoolWorker-16] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:47:03.300414982Z [2024-03-29 03:47:03,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:47:03.372962004Z [2024-03-29 03:47:03,372: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:47:04.935596722Z [2024-03-29 03:47:04,935: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[095aa263-97d0-4d0e-8677-73250360641e] succeeded in 3.7122193230006815s: None 2024-03-29T03:47:05.810966456Z [2024-03-29 03:47:05,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b20d0cd4-6f78-4b64-8544-6c8727be7cd2] succeeded in 4.590003198998602s: None 2024-03-29T03:48:01.297803566Z [2024-03-29 03:48:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdc14b68-4d18-4524-9884-7db20f7be1a6] received 2024-03-29T03:48:01.303240681Z [2024-03-29 03:48:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d4c40af-fb2a-456b-b07e-499f444f1628] received 2024-03-29T03:48:01.309362853Z [2024-03-29 03:48:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bef96690-4434-41b2-9114-502a8b7a27ea] received 2024-03-29T03:48:01.313041252Z [2024-03-29 03:48:01,312: INFO/ForkPoolWorker-16] [0d4c40af-fb2a-456b-b07e-499f444f1628] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:48:01.314849413Z [2024-03-29 03:48:01,314: INFO/ForkPoolWorker-15] [cdc14b68-4d18-4524-9884-7db20f7be1a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:48:01.325790237Z [2024-03-29 03:48:01,325: INFO/ForkPoolWorker-1] [bef96690-4434-41b2-9114-502a8b7a27ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:48:01.334534846Z [2024-03-29 03:48:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7ff46dc-3326-40a5-a89e-4236dbf92384] received 2024-03-29T03:48:01.364279260Z [2024-03-29 03:48:01,363: INFO/ForkPoolWorker-2] [f7ff46dc-3326-40a5-a89e-4236dbf92384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:48:01.752334297Z [2024-03-29 03:48:01,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:48:01.851393025Z [2024-03-29 03:48:01,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:48:02.104238765Z [2024-03-29 03:48:02,103: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-29T03:48:02.108586869Z [2024-03-29 03:48:02,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:48:02.108722692Z [2024-03-29 03:48:02,104: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:48:02.130848608Z [2024-03-29 03:48:02,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-29T03:48:02.139064693Z [2024-03-29 03:48:02,138: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:48:02.141001563Z [2024-03-29 03:48:02,140: INFO/ForkPoolWorker-16] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:48:02.141230422Z [2024-03-29 03:48:02,140: INFO/ForkPoolWorker-16] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:48:02.141411810Z [2024-03-29 03:48:02,141: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-29T03:48:02.141705920Z [2024-03-29 03:48:02,141: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:48:02.312497009Z [2024-03-29 03:48:02,312: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:48:02.576702795Z [2024-03-29 03:48:02,576: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:48:03.279556779Z [2024-03-29 03:48:03,279: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d4c40af-fb2a-456b-b07e-499f444f1628] succeeded in 1.9746846660000301s: None 2024-03-29T03:48:03.425897043Z [2024-03-29 03:48:03,425: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bef96690-4434-41b2-9114-502a8b7a27ea] succeeded in 2.1133436689997325s: None 2024-03-29T03:48:03.854691032Z [2024-03-29 03:48:03,854: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-29T03:48:03.858334260Z [2024-03-29 03:48:03,857: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:48:03.881115279Z [2024-03-29 03:48:03,880: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-29T03:48:03.882977076Z [2024-03-29 03:48:03,882: INFO/ForkPoolWorker-2] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:48:03.883144509Z [2024-03-29 03:48:03,882: INFO/ForkPoolWorker-2] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:48:03.883436305Z [2024-03-29 03:48:03,883: INFO/ForkPoolWorker-2] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:48:03.883603059Z [2024-03-29 03:48:03,883: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-29T03:48:03.884027419Z [2024-03-29 03:48:03,883: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:48:03.884140916Z [2024-03-29 03:48:03,883: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:48:03.992040307Z [2024-03-29 03:48:03,991: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:48:04.002275630Z [2024-03-29 03:48:04,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:48:04.009191442Z [2024-03-29 03:48:04,008: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:48:04.049861066Z [2024-03-29 03:48:04,049: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:48:04.051553228Z [2024-03-29 03:48:04,051: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:48:04.052172253Z [2024-03-29 03:48:04,051: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:48:04.052512039Z [2024-03-29 03:48:04,052: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:48:04.052658939Z [2024-03-29 03:48:04,052: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:48:04.053093071Z [2024-03-29 03:48:04,052: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:48:04.053252312Z [2024-03-29 03:48:04,053: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:48:04.147348931Z [2024-03-29 03:48:04,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:48:06.218471098Z [2024-03-29 03:48:06,218: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdc14b68-4d18-4524-9884-7db20f7be1a6] succeeded in 4.913662221999402s: None 2024-03-29T03:48:06.385399502Z [2024-03-29 03:48:06,384: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7ff46dc-3326-40a5-a89e-4236dbf92384] succeeded in 5.041589249000026s: None 2024-03-29T03:49:01.020367842Z [2024-03-29 03:49:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b5a8041-892c-4faa-8264-f28281e3140e] received 2024-03-29T03:49:01.028259356Z [2024-03-29 03:49:01,027: INFO/ForkPoolWorker-15] [2b5a8041-892c-4faa-8264-f28281e3140e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:49:01.029134370Z [2024-03-29 03:49:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c379de41-7cbb-4e13-b86b-58ff07f28e47] received 2024-03-29T03:49:01.033837681Z [2024-03-29 03:49:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5558da7-8b75-4812-8d45-a0c625b10fe6] received 2024-03-29T03:49:01.039639193Z [2024-03-29 03:49:01,039: INFO/ForkPoolWorker-16] [c379de41-7cbb-4e13-b86b-58ff07f28e47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:49:01.049252702Z [2024-03-29 03:49:01,048: INFO/ForkPoolWorker-1] [a5558da7-8b75-4812-8d45-a0c625b10fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:49:01.348208162Z [2024-03-29 03:49:01,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-29T03:49:01.379695663Z [2024-03-29 03:49:01,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-29T03:49:01.488435958Z [2024-03-29 03:49:01,485: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-29T03:49:01.563310448Z [2024-03-29 03:49:01,562: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-29T03:49:01.567934934Z [2024-03-29 03:49:01,567: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:49:01.591534006Z [2024-03-29 03:49:01,591: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-29T03:49:01.592510220Z [2024-03-29 03:49:01,592: INFO/ForkPoolWorker-1] Read SDNC e20fc2af-43a6-4935-8c04-345f151865d1 (sdnc-osm) 2024-03-29T03:49:01.592607023Z [2024-03-29 03:49:01,592: INFO/ForkPoolWorker-1] [{'_id': 'e20fc2af-43a6-4935-8c04-345f151865d1', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-29T03:49:01.592627381Z [2024-03-29 03:49:01,592: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-29T03:49:01.592806391Z [2024-03-29 03:49:01,592: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 2024-03-29T03:49:01.704805796Z [2024-03-29 03:49:01,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:49:02.341090648Z [2024-03-29 03:49:02,340: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5558da7-8b75-4812-8d45-a0c625b10fe6] succeeded in 1.3045236120015034s: None 2024-03-29T03:49:02.683741123Z [2024-03-29 03:49:02,683: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-29T03:49:02.687322618Z [2024-03-29 03:49:02,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:49:02.707741171Z [2024-03-29 03:49:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-29T03:49:02.709248001Z [2024-03-29 03:49:02,708: INFO/ForkPoolWorker-16] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:49:02.709260714Z [2024-03-29 03:49:02,709: INFO/ForkPoolWorker-16] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:49:02.709409992Z [2024-03-29 03:49:02,709: INFO/ForkPoolWorker-16] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:49:02.709476909Z [2024-03-29 03:49:02,709: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-29T03:49:02.709752973Z [2024-03-29 03:49:02,709: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-29T03:49:02.709819173Z [2024-03-29 03:49:02,709: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:49:02.790056895Z [2024-03-29 03:49:02,789: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:49:02.790280965Z [2024-03-29 03:49:02,789: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-29T03:49:02.794193193Z [2024-03-29 03:49:02,793: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'R5YAcRU5ojutzpRtmHSbb0yRwJq0hyL5'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-29T03:49:02.818754730Z [2024-03-29 03:49:02,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-29T03:49:02.820713838Z [2024-03-29 03:49:02,820: INFO/ForkPoolWorker-15] Read VIM 2b0cf6e3-db08-411a-a3e4-cc09fce2067b (_system-osm-vim) 2024-03-29T03:49:02.820732240Z [2024-03-29 03:49:02,820: INFO/ForkPoolWorker-15] Read VIM 2b9dfa8e-2aeb-436c-b3da-c828c084082d (osm) 2024-03-29T03:49:02.820829348Z [2024-03-29 03:49:02,820: INFO/ForkPoolWorker-15] [{'_id': '2b0cf6e3-db08-411a-a3e4-cc09fce2067b', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-29T03:49:02.820942272Z [2024-03-29 03:49:02,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-29T03:49:02.821640116Z [2024-03-29 03:49:02,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-29T03:49:02.821683570Z [2024-03-29 03:49:02,821: INFO/ForkPoolWorker-15] Creating DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d 2024-03-29T03:49:02.948611916Z [2024-03-29 03:49:02,948: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-29T03:49:04.631973432Z [2024-03-29 03:49:04,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b5a8041-892c-4faa-8264-f28281e3140e] succeeded in 3.608600702000331s: None 2024-03-29T03:49:04.781107680Z [2024-03-29 03:49:04,780: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c379de41-7cbb-4e13-b86b-58ff07f28e47] succeeded in 3.749897696001426s: None