2024-06-14T15:10:38.189388711Z Loaded configuration:{'globalConfig': {'loglevel': 'DEBUG', 'logfile': None, 'nologging': False}, 'timeout': {'nsi_deploy': 7200, 'vca_on_error': 300, 'ns_deploy': 7200, 'ns_terminate': 1800, 'ns_heal': 1800, 'charm_delete': 600, 'primitive': 1800, 'ns_update': 1800, 'progress_primitive': 600, 'migrate': 1800, 'operate': 1800, 'verticalscale': 1800}, 'RO': {'host': 'ro', 'ng': False, 'port': 9090, 'uri': 'http://ro:9090/', 'tenant': 'osm', 'loglevel': 'ERROR', 'logfile': None, 'logger_name': 'lcm.roclient'}, 'VCA': {'host': 'vca', 'port': 17070, 'user': 'admin', 'secret': 'secret', 'cloud': 'lxd-cloud', 'k8s_cloud': 'k8scloud', 'helmpath': '/usr/local/bin/helm', 'helm3path': '/usr/local/bin/helm3', 'kubectlpath': '/usr/bin/kubectl', 'jujupath': '/usr/local/bin/juju', 'public_key': None, 'ca_cert': None, 'api_proxy': None, 'apt_mirror': None, 'eegrpcinittimeout': None, 'eegrpctimeout': None, 'eegrpc_tls_enforce': False, 'eegrpc_pod_admission_policy': 'baseline', 'loglevel': 'DEBUG', 'logfile': None, 'ca_store': '/etc/ssl/certs/osm-ca.crt', 'client_cert_path': '/etc/ssl/lcm-client/tls.crt', 'client_key_path': '/etc/ssl/lcm-client/tls.key', 'kubectl_osm_namespace': 'osm', 'kubectl_osm_cluster_name': '_system-osm-k8s', 'helm_ee_service_port': 50050, 'helm_max_initial_retry_time': 600, 'helm_max_retry_time': 30, 'helm_ee_retry_delay': 10}, 'database': {'driver': 'mongo', 'host': 'mongo', 'port': 27017, 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'replicaset': None, 'user': None, 'password': None, 'commonkey': '7gdUpPxZ6JLE0dc6VVjq5D6CDkit8syM', 'loglevel': 'DEBUG', 'logfile': None, 'logger_name': 'lcm.db'}, 'storage': {'driver': 'mongo', 'path': '/app/storage', 'loglevel': 'DEBUG', 'logfile': None, 'logger_name': 'lcm.fs', 'collection': 'files', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0'}, 'message': {'driver': 'kafka', 'path': '/app/storage/kafka', 'host': 'kafka', 'port': 9092, 'loglevel': 'DEBUG', 'logfile': None, 'group_id': 'lcm-server', 'logger_name': 'lcm.msg'}, 'tsdb': {'driver': 'prometheus', 'path': '/etc/prometheus', 'uri': 'http://prometheus:9090/', 'loglevel': 'DEBUG', 'logfile': None, 'logger_name': 'lcm.prometheus'}}
2024-06-14T15:10:38.254965328Z 2024-06-14T15:10:38 CRITICAL lcm lcm.py:141 starting osm/lcm version 9.0.0.post168+g8324363 2020-04-08
2024-06-14T15:10:38.354022437Z 2024-06-14T15:10:38 INFO lcm.db dbmongo.py:144 Connected to database osm version 1.2
2024-06-14T15:10:38.369457566Z /usr/local/lib/python3.10/dist-packages/gridfs/grid_file.py:881: UserWarning: use an explicit session with no_cursor_timeout=True otherwise the cursor may still timeout after 30 minutes, for more info see https://mongodb.com/docs/v4.4/reference/method/cursor.noCursorTimeout/#session-idle-timeout-overrides-nocursortimeout
2024-06-14T15:10:38.369467617Z   super().__init__(
2024-06-14T15:10:38.611496384Z 2024-06-14T15:10:38 INFO lcm lcm.py:221 Connected to RO version 9.0.0.post177+g2971241\n" new-generation version True
2024-06-14T15:10:38.612260992Z 2024-06-14T15:10:38 INFO lcm.ns n2vc_juju_conn.py:83 Initializing N2VC juju connector...
2024-06-14T15:10:38.624670437Z 2024-06-14T15:10:38 INFO lcm.ns n2vc_juju_conn.py:89 N2VC juju connector initialized
2024-06-14T15:10:38.624686145Z 2024-06-14T15:10:38 DEBUG lcm.ns lcm_helm_conn.py:114 Initialize helm N2VC connector
2024-06-14T15:10:38.627788276Z 2024-06-14T15:10:38 DEBUG lcm.ns lcm_helm_conn.py:115 initial vca_config: {'host': 'vca', 'port': 17070, 'user': 'admin', 'secret': 'secret', 'cloud': 'lxd-cloud', 'k8s_cloud': 'k8scloud', 'helmpath': '/usr/local/bin/helm', 'helm3path': '/usr/local/bin/helm3', 'kubectlpath': '/usr/bin/kubectl', 'jujupath': '/usr/local/bin/juju', 'public_key': None, 'ca_cert': None, 'api_proxy': None, 'apt_mirror': None, 'eegrpcinittimeout': None, 'eegrpctimeout': None, 'eegrpc_tls_enforce': False, 'eegrpc_pod_admission_policy': 'baseline', 'loglevel': 'DEBUG', 'logfile': None, 'ca_store': '/etc/ssl/certs/osm-ca.crt', 'client_cert_path': '/etc/ssl/lcm-client/tls.crt', 'client_key_path': '/etc/ssl/lcm-client/tls.key', 'kubectl_osm_namespace': 'osm', 'kubectl_osm_cluster_name': '_system-osm-k8s', 'helm_ee_service_port': 50050, 'helm_max_initial_retry_time': 600, 'helm_max_retry_time': 30, 'helm_ee_retry_delay': 10}
2024-06-14T15:10:38.627894297Z 2024-06-14T15:10:38 DEBUG lcm.ns lcm_helm_conn.py:120 Initial retry time: 600
2024-06-14T15:10:38.627977638Z 2024-06-14T15:10:38 DEBUG lcm.ns lcm_helm_conn.py:123 Retry time: 30
2024-06-14T15:10:38.628068823Z 2024-06-14T15:10:38 INFO lcm.ns k8s_helm_base_conn.py:74 Initializing K8S Helm connector
2024-06-14T15:10:38.628604552Z 2024-06-14T15:10:38 INFO lcm.ns k8s_helm3_conn.py:70 K8S Helm3 connector initialized
2024-06-14T15:10:38.628711409Z 2024-06-14T15:10:38 INFO lcm.ns lcm_helm_conn.py:136 Helm N2VC connector initialized
2024-06-14T15:10:38.628794411Z 2024-06-14T15:10:38 INFO lcm.ns k8s_helm_base_conn.py:74 Initializing K8S Helm connector
2024-06-14T15:10:38.629243468Z 2024-06-14T15:10:38 INFO lcm.ns k8s_helm3_conn.py:70 K8S Helm3 connector initialized
2024-06-14T15:10:38.629353367Z 2024-06-14T15:10:38 DEBUG lcm.ns k8s_juju_conn.py:68 Initializing K8S Juju connector
2024-06-14T15:10:38.631898061Z 2024-06-14T15:10:38 DEBUG lcm.ns k8s_juju_conn.py:75 K8S Juju connector initialized
2024-06-14T15:10:38.670653307Z 2024-06-14T15:10:38 INFO lcm.k8scluster k8s_helm_base_conn.py:74 Initializing K8S Helm connector
2024-06-14T15:10:38.679388523Z 2024-06-14T15:10:38 INFO lcm.k8scluster k8s_helm3_conn.py:70 K8S Helm3 connector initialized
2024-06-14T15:10:38.679404982Z 2024-06-14T15:10:38 DEBUG lcm.k8scluster k8s_juju_conn.py:68 Initializing K8S Juju connector
2024-06-14T15:10:38.682373864Z 2024-06-14T15:10:38 DEBUG lcm.k8scluster k8s_juju_conn.py:75 K8S Juju connector initialized
2024-06-14T15:10:38.710898086Z 2024-06-14T15:10:38 INFO lcm.vca n2vc_juju_conn.py:83 Initializing N2VC juju connector...
2024-06-14T15:10:38.713032205Z 2024-06-14T15:10:38 INFO lcm.vca n2vc_juju_conn.py:89 N2VC juju connector initialized
2024-06-14T15:10:38.719227333Z 2024-06-14T15:10:38 INFO lcm.k8srepo k8s_helm_base_conn.py:74 Initializing K8S Helm connector
2024-06-14T15:10:38.719815809Z 2024-06-14T15:10:38 INFO lcm.k8srepo k8s_helm3_conn.py:70 K8S Helm3 connector initialized
2024-06-14T15:10:38.720059584Z 2024-06-14T15:10:38 DEBUG lcm lcm.py:689 Task kafka_read Enter with worker_id=8b969fbd39b5
2024-06-14T15:10:38.720206579Z 2024-06-14T15:10:38 DEBUG lcm lcm.py:248 Task kafka_ping Enter
2024-06-14T15:10:38.859545027Z Topic nslcmops not found in cluster metadata
2024-06-14T15:10:38.859567472Z Topic vca not found in cluster metadata
2024-06-14T15:10:38.859607223Z Topic k8scluster not found in cluster metadata
2024-06-14T15:10:38.859617237Z Topic k8srepo not found in cluster metadata
2024-06-14T15:10:38.859668861Z Topic pla not found in cluster metadata
2024-06-14T15:10:42.332353970Z dummy message
2024-06-14T15:10:42.332388586Z 2024-06-14T15:10:42 DEBUG lcm lcm.py:302 Task kafka_read receives vim_account echo: dummy message
2024-06-14T15:10:42.363628445Z dummy message
2024-06-14T15:10:42.363666993Z 2024-06-14T15:10:42 DEBUG lcm lcm.py:302 Task kafka_read receives wim_account echo: dummy message
2024-06-14T15:10:42.363926605Z dummy message
2024-06-14T15:10:42.363947009Z 2024-06-14T15:10:42 DEBUG lcm lcm.py:302 Task kafka_read receives nsi echo: dummy message
2024-06-14T15:10:42.364190826Z dummy message
2024-06-14T15:10:42.364204492Z 2024-06-14T15:10:42 DEBUG lcm lcm.py:302 Task kafka_read receives sdn echo: dummy message
2024-06-14T15:10:42.387580498Z dummy message
2024-06-14T15:10:42.387615806Z 2024-06-14T15:10:42 DEBUG lcm lcm.py:302 Task kafka_read receives ns echo: dummy message
2024-06-14T15:07:09.912092979Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:13.914212821Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:17.922438032Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:21.928888110Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:25.937525018Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:29.941682552Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:33.945192254Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:37.952609033Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:41.955731697Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:45.961583926Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:49.965857266Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:53.971621918Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:07:57.974811762Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:01.979218179Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:05.988707167Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:09.990427985Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:14.005884232Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:18.009207527Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:22.018349633Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:26.026498110Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:30.037871063Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:34.056997185Z nc: kafka (10.105.102.0:9092): Operation timed out
2024-06-14T15:08:40.107313293Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:40.182298494Z nc: bad address 'ro'
2024-06-14T15:08:43.190335384Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:43.290023380Z nc: bad address 'ro'
2024-06-14T15:08:46.303087639Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:46.308673162Z nc: bad address 'ro'
2024-06-14T15:08:49.320281386Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:49.322990572Z nc: bad address 'ro'
2024-06-14T15:08:52.334152999Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:52.341861758Z nc: bad address 'ro'
2024-06-14T15:08:55.354725837Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:55.364723047Z nc: bad address 'ro'
2024-06-14T15:08:58.378680943Z kafka (10.105.102.0:9092) open
2024-06-14T15:08:58.380081370Z nc: bad address 'ro'
2024-06-14T15:09:01.388112184Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:01.395556553Z nc: bad address 'ro'
2024-06-14T15:09:04.426321151Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:04.443042435Z nc: bad address 'ro'
2024-06-14T15:09:07.446156384Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:07.448938929Z nc: bad address 'ro'
2024-06-14T15:09:10.459240385Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:10.496248787Z nc: bad address 'ro'
2024-06-14T15:09:13.507210604Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:13.582398398Z nc: bad address 'ro'
2024-06-14T15:09:16.589512449Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:16.639803537Z nc: bad address 'ro'
2024-06-14T15:09:19.644355337Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:19.647156019Z nc: bad address 'ro'
2024-06-14T15:09:22.675331439Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:22.682027936Z nc: bad address 'ro'
2024-06-14T15:09:25.694771797Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:25.792554664Z nc: bad address 'ro'
2024-06-14T15:09:28.798739821Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:28.809410879Z nc: bad address 'ro'
2024-06-14T15:09:31.827966108Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:31.836015213Z nc: bad address 'ro'
2024-06-14T15:09:34.840629392Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:34.844989039Z nc: bad address 'ro'
2024-06-14T15:09:37.854184734Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:37.856436699Z nc: bad address 'ro'
2024-06-14T15:09:40.871856822Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:40.876439594Z nc: bad address 'ro'
2024-06-14T15:09:43.894032691Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:44.000160969Z nc: bad address 'ro'
2024-06-14T15:09:47.016149134Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:47.058524114Z nc: bad address 'ro'
2024-06-14T15:09:50.068898625Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:50.072834466Z nc: bad address 'ro'
2024-06-14T15:09:53.081451549Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:53.088769174Z nc: bad address 'ro'
2024-06-14T15:09:56.093829502Z kafka (10.105.102.0:9092) open
2024-06-14T15:09:56.097304054Z ro (10.244.0.16:9090) open
2024-06-14T15:09:56.101611838Z mongodb-k8s (10.244.0.42:27017) open