2024-05-24T09:41:17.562288247Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:21.560597715Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:25.577104477Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:29.591750256Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:33.603167223Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:37.607975945Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:41.610456084Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:45.615144907Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:49.620206553Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:53.623507228Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:41:57.630018068Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:01.634035429Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:05.638089556Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:09.644330499Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:13.649559082Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:17.654181206Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:21.660121745Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:25.667999449Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:29.680190279Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:33.694389006Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:37.712379776Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:41.717738253Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:45.730083314Z nc: kafka (10.108.109.163:9092): Operation timed out
2024-05-24T09:42:51.741786554Z kafka (10.108.109.163:9092) open
2024-05-24T09:42:51.741815439Z mongodb-k8s (10.244.0.47:27017) open
2024-05-24T09:43:59.498217250Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=bootstrap-0 host=kafka:9092 <connecting> [IPv4 ('10.108.109.163', 9092)]>: connecting to kafka:9092 [('10.108.109.163', 9092) IPv4]
2024-05-24T09:43:59.498246155Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Probing node bootstrap-0 broker version
2024-05-24T09:43:59.501206752Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=bootstrap-0 host=kafka:9092 <connecting> [IPv4 ('10.108.109.163', 9092)]>: Connection complete.
2024-05-24T09:43:59.624327861Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Broker version identified as 2.5.0
2024-05-24T09:43:59.624665216Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Set configuration api_version=(2, 5, 0) to skip auto check_version requests on startup
2024-05-24T09:43:59.647542900Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=bootstrap-0 host=kafka:9092 <connecting> [IPv4 ('10.108.109.163', 9092)]>: connecting to kafka:9092 [('10.108.109.163', 9092) IPv4]
2024-05-24T09:43:59.648068827Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Probing node bootstrap-0 broker version
2024-05-24T09:43:59.652296588Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=bootstrap-0 host=kafka:9092 <connecting> [IPv4 ('10.108.109.163', 9092)]>: Connection complete.
2024-05-24T09:43:59.756557759Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Broker version identified as 2.5.0
2024-05-24T09:43:59.756658918Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - Set configuration api_version=(2, 5, 0) to skip auto check_version requests on startup
2024-05-24T09:43:59.919408340Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=1 host=kafka-controller-1.kafka-controller-headless.osm.svc.cluster.local:9092 <connecting> [IPv4 ('10.244.0.37', 9092)]>: connecting to kafka-controller-1.kafka-controller-headless.osm.svc.cluster.local:9092 [('10.244.0.37', 9092) IPv4]
2024-05-24T09:43:59.919425277Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=1 host=kafka-controller-1.kafka-controller-headless.osm.svc.cluster.local:9092 <connecting> [IPv4 ('10.244.0.37', 9092)]>: Connection complete.
2024-05-24T09:43:59.919429403Z 05/24/2024 09:43:59 AM - kafka.conn - INFO - <BrokerConnection node_id=bootstrap-0 host=kafka:9092 <connected> [IPv4 ('10.108.109.163', 9092)]>: Closing connection. 
2024-05-24T09:44:00.206601063Z 05/24/2024 09:44:00 AM - kafka.cluster - ERROR - Topic users not found in cluster metadata
2024-05-24T09:44:00.323386865Z 05/24/2024 09:44:00 AM - kafka.conn - INFO - <BrokerConnection node_id=0 host=kafka-controller-0.kafka-controller-headless.osm.svc.cluster.local:9092 <connecting> [IPv4 ('10.244.0.49', 9092)]>: connecting to kafka-controller-0.kafka-controller-headless.osm.svc.cluster.local:9092 [('10.244.0.49', 9092) IPv4]
2024-05-24T09:44:00.323410084Z 05/24/2024 09:44:00 AM - kafka.conn - INFO - <BrokerConnection node_id=0 host=kafka-controller-0.kafka-controller-headless.osm.svc.cluster.local:9092 <connecting> [IPv4 ('10.244.0.49', 9092)]>: Connection complete.
2024-05-24T09:44:00.336827769Z 05/24/2024 09:44:00 AM - kafka.producer.record_accumulator - WARNING - Produced messages to topic-partition TopicPartition(topic='users', partition=0) with base offset -1 log start offset -1 and error None.
2024-05-24T09:44:00.449833291Z 05/24/2024 09:44:00 AM - kafka.cluster - ERROR - Topic users not found in cluster metadata
2024-05-24T09:44:00.449849813Z 05/24/2024 09:44:00 AM - kafka.cluster - ERROR - Topic project not found in cluster metadata
2024-05-24T09:44:00.554591902Z 05/24/2024 09:44:00 AM - kafka.cluster - ERROR - Topic project not found in cluster metadata
2024-05-24T09:44:00.675196316Z 05/24/2024 09:44:00 AM - kafka.conn - INFO - <BrokerConnection node_id=1 host=kafka-controller-1.kafka-controller-headless.osm.svc.cluster.local:9092 <connected> [IPv4 ('10.244.0.37', 9092)]>: Closing connection. 
2024-05-24T09:44:00.684279930Z 05/24/2024 09:44:00 AM - kafka.conn - INFO - <BrokerConnection node_id=0 host=kafka-controller-0.kafka-controller-headless.osm.svc.cluster.local:9092 <connected> [IPv4 ('10.244.0.49', 9092)]>: Closing connection. 
2024-05-24T09:44:00.684318198Z 05/24/2024 09:44:00 AM - osm_mon.cmd.mon_dashboarder - INFO - Starting MON Dashboarder...
2024-05-24T09:44:00.731991084Z 05/24/2024 09:44:00 AM - db - INFO - Connected to database osm version None
2024-05-24T09:44:00.731999193Z 05/24/2024 09:44:00 AM - osm_mon.cmd.mon_dashboarder - INFO - Starting MON kafka Consumer...
2024-05-24T09:44:00.733129466Z 05/24/2024 09:44:00 AM - osm_mon.cmd.mon_dashboarder - INFO - Starting MON Dashboarder...
2024-05-24T09:44:00.840199842Z 05/24/2024 09:44:00 AM - aiokafka.consumer.subscription_state - INFO - Updating subscribed topics to: frozenset({'users', 'project'})
2024-05-24T09:44:00.841111772Z 05/24/2024 09:44:00 AM - aiokafka.consumer.consumer - INFO - Subscribed to topic(s): {'users', 'project'}
2024-05-24T09:44:00.898168751Z 05/24/2024 09:44:00 AM - aiokafka.consumer.group_coordinator - ERROR - Group Coordinator Request failed: [Error 15] CoordinatorNotAvailableError
2024-05-24T09:44:01.012942961Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - ERROR - Group Coordinator Request failed: [Error 15] CoordinatorNotAvailableError
2024-05-24T09:44:01.177230789Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - ERROR - Group Coordinator Request failed: [Error 15] CoordinatorNotAvailableError
2024-05-24T09:44:01.299100943Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - ERROR - Group Coordinator Request failed: [Error 15] CoordinatorNotAvailableError
2024-05-24T09:44:01.484621612Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:01.484638028Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - Revoking previously assigned partitions set() for group mon-consumer
2024-05-24T09:44:01.484979120Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:01.513126374Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:01.703684254Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:01.703899795Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:01.749591632Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:01.874332394Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:01.874340990Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:01.905739403Z 05/24/2024 09:44:01 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.065276659Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.065305832Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.080442055Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.209905677Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.209934822Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.230170191Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.356602023Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.356610384Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.369538642Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.471351239Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.471368792Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.488100109Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.595097959Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.595110049Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.601860352Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.705743556Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.705765421Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.730634348Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:02.944177930Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:02.944213016Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:02.956296931Z 05/24/2024 09:44:02 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.102536390Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.102565755Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.143979563Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.267760834Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.267798340Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.267805296Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.386205934Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.386278969Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.398220353Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.505780480Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.510225077Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.523654237Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.682395533Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.682456359Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.700696071Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.811947720Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.836861229Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.836876808Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:03.926170544Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:03.926188087Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:03.930189039Z 05/24/2024 09:44:03 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.273252879Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.273308990Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.281810080Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.426738954Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.426763089Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.442415455Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.575436365Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.575497609Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.598544208Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.711218787Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.711237754Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.715936689Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.820151273Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.820236990Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.826786896Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:04.937582797Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:04.937797033Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:04.940502668Z 05/24/2024 09:44:04 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.046884225Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.047134590Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:05.049160151Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.153877103Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.154107722Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:05.167468977Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.273132147Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.273278463Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:05.277966217Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.403525015Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.404531582Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:05.421885759Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.553181608Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.553200833Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:05.553663900Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - WARNING - Marking the coordinator dead (node 0)for group mon-consumer.
2024-05-24T09:44:05.728461793Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - Discovered coordinator 0 for group mon-consumer
2024-05-24T09:44:05.728481760Z 05/24/2024 09:44:05 AM - aiokafka.consumer.group_coordinator - INFO - (Re-)joining group mon-consumer
2024-05-24T09:44:08.990682409Z 05/24/2024 09:44:08 AM - aiokafka.consumer.group_coordinator - INFO - Joined group 'mon-consumer' (generation 1) with member_id aiokafka-0.8.1-22ae0bc3-5301-4170-b091-c0f810307c96
2024-05-24T09:44:08.990703551Z 05/24/2024 09:44:08 AM - aiokafka.consumer.group_coordinator - INFO - Elected group leader -- performing partition assignments using roundrobin
2024-05-24T09:44:09.104693316Z 05/24/2024 09:44:09 AM - aiokafka.consumer.group_coordinator - INFO - Successfully synced group mon-consumer with generation 1
2024-05-24T09:44:09.107972839Z 05/24/2024 09:44:09 AM - aiokafka.consumer.group_coordinator - INFO - Setting newly assigned partitions {TopicPartition(topic='project', partition=0), TopicPartition(topic='users', partition=0)} for group mon-consumer
2024-05-24T09:46:11.524296130Z 05/24/2024 09:46:11 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:46:11.524321513Z Traceback (most recent call last):
2024-05-24T09:46:11.524325294Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:46:11.524328614Z     sock = connection.create_connection(
2024-05-24T09:46:11.524332701Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:46:11.524336003Z     raise err
2024-05-24T09:46:11.524339307Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:46:11.524343132Z     sock.connect(sa)
2024-05-24T09:46:11.524346784Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:46:11.524349651Z 
2024-05-24T09:46:11.524353418Z The above exception was the direct cause of the following exception:
2024-05-24T09:46:11.524356237Z 
2024-05-24T09:46:11.524359280Z Traceback (most recent call last):
2024-05-24T09:46:11.524362477Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:46:11.524365445Z     response = self._make_request(
2024-05-24T09:46:11.524368590Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:46:11.524371925Z     conn.request(
2024-05-24T09:46:11.524375237Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:46:11.524378550Z     self.endheaders()
2024-05-24T09:46:11.524381939Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:46:11.524385069Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:46:11.524388537Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:46:11.524391461Z     self.send(msg)
2024-05-24T09:46:11.524395316Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:46:11.524398392Z     self.connect()
2024-05-24T09:46:11.524401544Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:46:11.524405631Z     self.sock = self._new_conn()
2024-05-24T09:46:11.524408715Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:46:11.524411681Z     raise ConnectTimeoutError(
2024-05-24T09:46:11.524418265Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c28b5e0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:46:11.524421160Z 
2024-05-24T09:46:11.524424277Z The above exception was the direct cause of the following exception:
2024-05-24T09:46:11.524427243Z 
2024-05-24T09:46:11.524430175Z Traceback (most recent call last):
2024-05-24T09:46:11.524433924Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:46:11.524436884Z     resp = conn.urlopen(
2024-05-24T09:46:11.524439948Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:46:11.524442902Z     retries = retries.increment(
2024-05-24T09:46:11.524446066Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:46:11.524449105Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:46:11.524454696Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c28b5e0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:46:11.524481079Z 
2024-05-24T09:46:11.524484420Z During handling of the above exception, another exception occurred:
2024-05-24T09:46:11.524487138Z 
2024-05-24T09:46:11.524490065Z Traceback (most recent call last):
2024-05-24T09:46:11.524493033Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:46:11.524495835Z     self.create_dashboards()
2024-05-24T09:46:11.524498914Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:46:11.524501849Z     self.service.create_dashboards()
2024-05-24T09:46:11.524504779Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:46:11.524507686Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:46:11.524511686Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:46:11.524514635Z     response = requests.request(
2024-05-24T09:46:11.524517556Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:46:11.524520464Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:46:11.524523531Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:46:11.524526500Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:46:11.524565741Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:46:11.524568962Z     r = adapter.send(request, **kwargs)
2024-05-24T09:46:11.524572070Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:46:11.524575047Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:46:11.524580731Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c28b5e0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:48:22.594366962Z 05/24/2024 09:48:22 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:48:22.594386751Z Traceback (most recent call last):
2024-05-24T09:48:22.594390159Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:48:22.594393225Z     sock = connection.create_connection(
2024-05-24T09:48:22.594396765Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:48:22.594399896Z     raise err
2024-05-24T09:48:22.594402862Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:48:22.594406451Z     sock.connect(sa)
2024-05-24T09:48:22.594409542Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:48:22.594412335Z 
2024-05-24T09:48:22.594415865Z The above exception was the direct cause of the following exception:
2024-05-24T09:48:22.594418608Z 
2024-05-24T09:48:22.594421533Z Traceback (most recent call last):
2024-05-24T09:48:22.594428522Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:48:22.594432212Z     response = self._make_request(
2024-05-24T09:48:22.594435149Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:48:22.594446588Z     conn.request(
2024-05-24T09:48:22.594449682Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:48:22.594452581Z     self.endheaders()
2024-05-24T09:48:22.594455480Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:48:22.594458527Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:48:22.594461679Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:48:22.594464551Z     self.send(msg)
2024-05-24T09:48:22.594468352Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:48:22.594471175Z     self.connect()
2024-05-24T09:48:22.594474132Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:48:22.594477510Z     self.sock = self._new_conn()
2024-05-24T09:48:22.594480399Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:48:22.594483284Z     raise ConnectTimeoutError(
2024-05-24T09:48:22.594486916Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c310ee0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:48:22.594489645Z 
2024-05-24T09:48:22.594492537Z The above exception was the direct cause of the following exception:
2024-05-24T09:48:22.594495247Z 
2024-05-24T09:48:22.594498069Z Traceback (most recent call last):
2024-05-24T09:48:22.594501005Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:48:22.594503882Z     resp = conn.urlopen(
2024-05-24T09:48:22.594506748Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:48:22.594510140Z     retries = retries.increment(
2024-05-24T09:48:22.594513187Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:48:22.594516041Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:48:22.594521382Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c310ee0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:48:22.594524160Z 
2024-05-24T09:48:22.594527074Z During handling of the above exception, another exception occurred:
2024-05-24T09:48:22.594529778Z 
2024-05-24T09:48:22.594532621Z Traceback (most recent call last):
2024-05-24T09:48:22.594535495Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:48:22.594538304Z     self.create_dashboards()
2024-05-24T09:48:22.594541220Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:48:22.594544282Z     self.service.create_dashboards()
2024-05-24T09:48:22.594547382Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:48:22.594550265Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:48:22.594553703Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:48:22.594556531Z     response = requests.request(
2024-05-24T09:48:22.594559407Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:48:22.594562241Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:48:22.594565209Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:48:22.594572235Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:48:22.594575166Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:48:22.594578052Z     r = adapter.send(request, **kwargs)
2024-05-24T09:48:22.594581118Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:48:22.594584247Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:48:22.594589257Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c310ee0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:50:33.665298447Z 05/24/2024 09:50:33 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:50:33.665324136Z Traceback (most recent call last):
2024-05-24T09:50:33.665327620Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:50:33.665330719Z     sock = connection.create_connection(
2024-05-24T09:50:33.665335837Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:50:33.665339223Z     raise err
2024-05-24T09:50:33.665342280Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:50:33.665346049Z     sock.connect(sa)
2024-05-24T09:50:33.665349094Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:50:33.665351903Z 
2024-05-24T09:50:33.665356459Z The above exception was the direct cause of the following exception:
2024-05-24T09:50:33.665359308Z 
2024-05-24T09:50:33.665362303Z Traceback (most recent call last):
2024-05-24T09:50:33.665365259Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:50:33.665368435Z     response = self._make_request(
2024-05-24T09:50:33.665371448Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:50:33.665374523Z     conn.request(
2024-05-24T09:50:33.665377684Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:50:33.665380558Z     self.endheaders()
2024-05-24T09:50:33.665383521Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:50:33.665386480Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:50:33.665389386Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:50:33.665392308Z     self.send(msg)
2024-05-24T09:50:33.665395897Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:50:33.665398900Z     self.connect()
2024-05-24T09:50:33.665401871Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:50:33.665405189Z     self.sock = self._new_conn()
2024-05-24T09:50:33.665408145Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:50:33.665411325Z     raise ConnectTimeoutError(
2024-05-24T09:50:33.665418327Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c3116c0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:50:33.665421377Z 
2024-05-24T09:50:33.665424343Z The above exception was the direct cause of the following exception:
2024-05-24T09:50:33.665427292Z 
2024-05-24T09:50:33.665439388Z Traceback (most recent call last):
2024-05-24T09:50:33.665442414Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:50:33.665445383Z     resp = conn.urlopen(
2024-05-24T09:50:33.665448288Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:50:33.665451206Z     retries = retries.increment(
2024-05-24T09:50:33.665454053Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:50:33.665456981Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:50:33.665461906Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c3116c0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:50:33.665464700Z 
2024-05-24T09:50:33.665467558Z During handling of the above exception, another exception occurred:
2024-05-24T09:50:33.665470282Z 
2024-05-24T09:50:33.665473201Z Traceback (most recent call last):
2024-05-24T09:50:33.665476061Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:50:33.665478888Z     self.create_dashboards()
2024-05-24T09:50:33.665481992Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:50:33.665485132Z     self.service.create_dashboards()
2024-05-24T09:50:33.665488095Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:50:33.665490975Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:50:33.665495335Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:50:33.665498335Z     response = requests.request(
2024-05-24T09:50:33.665501218Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:50:33.665504080Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:50:33.665506993Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:50:33.665509960Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:50:33.665512875Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:50:33.665515754Z     r = adapter.send(request, **kwargs)
2024-05-24T09:50:33.665518598Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:50:33.665521484Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:50:33.665534796Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c3116c0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:52:44.735464911Z 05/24/2024 09:52:44 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:52:44.735591566Z Traceback (most recent call last):
2024-05-24T09:52:44.735596565Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:52:44.735600655Z     sock = connection.create_connection(
2024-05-24T09:52:44.735606792Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:52:44.735610040Z     raise err
2024-05-24T09:52:44.735613245Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:52:44.735632309Z     sock.connect(sa)
2024-05-24T09:52:44.735635698Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:52:44.735638615Z 
2024-05-24T09:52:44.735642182Z The above exception was the direct cause of the following exception:
2024-05-24T09:52:44.735645062Z 
2024-05-24T09:52:44.735648059Z Traceback (most recent call last):
2024-05-24T09:52:44.735651245Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:52:44.735654276Z     response = self._make_request(
2024-05-24T09:52:44.735657720Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:52:44.735660756Z     conn.request(
2024-05-24T09:52:44.735663765Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:52:44.735666840Z     self.endheaders()
2024-05-24T09:52:44.735669859Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:52:44.735672816Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:52:44.735676018Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:52:44.735679053Z     self.send(msg)
2024-05-24T09:52:44.735682531Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:52:44.735685489Z     self.connect()
2024-05-24T09:52:44.735688459Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:52:44.735692690Z     self.sock = self._new_conn()
2024-05-24T09:52:44.735695670Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:52:44.735698694Z     raise ConnectTimeoutError(
2024-05-24T09:52:44.735702442Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c311ea0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:52:44.735705439Z 
2024-05-24T09:52:44.735708443Z The above exception was the direct cause of the following exception:
2024-05-24T09:52:44.735711436Z 
2024-05-24T09:52:44.735714451Z Traceback (most recent call last):
2024-05-24T09:52:44.735717408Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:52:44.735720419Z     resp = conn.urlopen(
2024-05-24T09:52:44.735723482Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:52:44.735726446Z     retries = retries.increment(
2024-05-24T09:52:44.735729583Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:52:44.735732644Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:52:44.735737616Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c311ea0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:52:44.735740514Z 
2024-05-24T09:52:44.735743488Z During handling of the above exception, another exception occurred:
2024-05-24T09:52:44.735746312Z 
2024-05-24T09:52:44.735749341Z Traceback (most recent call last):
2024-05-24T09:52:44.735752361Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:52:44.735755318Z     self.create_dashboards()
2024-05-24T09:52:44.735758314Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:52:44.735765297Z     self.service.create_dashboards()
2024-05-24T09:52:44.735768615Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:52:44.735771607Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:52:44.735775077Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:52:44.735778129Z     response = requests.request(
2024-05-24T09:52:44.735781111Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:52:44.735784100Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:52:44.735787224Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:52:44.735790354Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:52:44.735793442Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:52:44.735796434Z     r = adapter.send(request, **kwargs)
2024-05-24T09:52:44.735799616Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:52:44.735802688Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:52:44.735808657Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c311ea0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:54:55.806682380Z 05/24/2024 09:54:55 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:54:55.806735503Z Traceback (most recent call last):
2024-05-24T09:54:55.806746560Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:54:55.806755226Z     sock = connection.create_connection(
2024-05-24T09:54:55.806765066Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:54:55.806773830Z     raise err
2024-05-24T09:54:55.806782639Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:54:55.806792232Z     sock.connect(sa)
2024-05-24T09:54:55.806801357Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:54:55.806809426Z 
2024-05-24T09:54:55.806818918Z The above exception was the direct cause of the following exception:
2024-05-24T09:54:55.806826877Z 
2024-05-24T09:54:55.806835253Z Traceback (most recent call last):
2024-05-24T09:54:55.806843587Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:54:55.806852030Z     response = self._make_request(
2024-05-24T09:54:55.806860341Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:54:55.806868763Z     conn.request(
2024-05-24T09:54:55.806877099Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:54:55.806885556Z     self.endheaders()
2024-05-24T09:54:55.806894146Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:54:55.806902396Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:54:55.806910681Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:54:55.806919062Z     self.send(msg)
2024-05-24T09:54:55.806928311Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:54:55.806984116Z     self.connect()
2024-05-24T09:54:55.806993674Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:54:55.807003378Z     self.sock = self._new_conn()
2024-05-24T09:54:55.807011572Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:54:55.807019768Z     raise ConnectTimeoutError(
2024-05-24T09:54:55.807048390Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c28b610>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:54:55.807056738Z 
2024-05-24T09:54:55.807065241Z The above exception was the direct cause of the following exception:
2024-05-24T09:54:55.807073279Z 
2024-05-24T09:54:55.807081509Z Traceback (most recent call last):
2024-05-24T09:54:55.807089740Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:54:55.807098149Z     resp = conn.urlopen(
2024-05-24T09:54:55.807106429Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:54:55.807114673Z     retries = retries.increment(
2024-05-24T09:54:55.807128303Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:54:55.807137207Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:54:55.807147200Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c28b610>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:54:55.807155238Z 
2024-05-24T09:54:55.807163499Z During handling of the above exception, another exception occurred:
2024-05-24T09:54:55.807171378Z 
2024-05-24T09:54:55.807179762Z Traceback (most recent call last):
2024-05-24T09:54:55.807188048Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:54:55.807196499Z     self.create_dashboards()
2024-05-24T09:54:55.807204733Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:54:55.807213284Z     self.service.create_dashboards()
2024-05-24T09:54:55.807221564Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:54:55.807229764Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:54:55.807239027Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:54:55.807247436Z     response = requests.request(
2024-05-24T09:54:55.807255619Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:54:55.807263908Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:54:55.807272170Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:54:55.807281417Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:54:55.807289987Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:54:55.807298241Z     r = adapter.send(request, **kwargs)
2024-05-24T09:54:55.807306521Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:54:55.807315009Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:54:55.807329648Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c28b610>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:57:06.882899353Z 05/24/2024 09:57:06 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:57:06.882929562Z Traceback (most recent call last):
2024-05-24T09:57:06.882933257Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:57:06.882936594Z     sock = connection.create_connection(
2024-05-24T09:57:06.882942413Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:57:06.882945756Z     raise err
2024-05-24T09:57:06.882949332Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:57:06.882952909Z     sock.connect(sa)
2024-05-24T09:57:06.882956048Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:57:06.882959080Z 
2024-05-24T09:57:06.882962714Z The above exception was the direct cause of the following exception:
2024-05-24T09:57:06.882965639Z 
2024-05-24T09:57:06.882968669Z Traceback (most recent call last):
2024-05-24T09:57:06.882971772Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:57:06.882974776Z     response = self._make_request(
2024-05-24T09:57:06.882977861Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:57:06.882981105Z     conn.request(
2024-05-24T09:57:06.882984251Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:57:06.882987324Z     self.endheaders()
2024-05-24T09:57:06.882990467Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:57:06.882993448Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:57:06.882996439Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:57:06.882999385Z     self.send(msg)
2024-05-24T09:57:06.883002796Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:57:06.883005858Z     self.connect()
2024-05-24T09:57:06.883008956Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:57:06.883011909Z     self.sock = self._new_conn()
2024-05-24T09:57:06.883014964Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:57:06.883017914Z     raise ConnectTimeoutError(
2024-05-24T09:57:06.883021510Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c3115a0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:57:06.883024364Z 
2024-05-24T09:57:06.883027359Z The above exception was the direct cause of the following exception:
2024-05-24T09:57:06.883030206Z 
2024-05-24T09:57:06.883033143Z Traceback (most recent call last):
2024-05-24T09:57:06.883036142Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:57:06.883039131Z     resp = conn.urlopen(
2024-05-24T09:57:06.883042178Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:57:06.883045445Z     retries = retries.increment(
2024-05-24T09:57:06.883048442Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:57:06.883051448Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:57:06.883063510Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c3115a0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:57:06.883066569Z 
2024-05-24T09:57:06.883069487Z During handling of the above exception, another exception occurred:
2024-05-24T09:57:06.883072266Z 
2024-05-24T09:57:06.883075412Z Traceback (most recent call last):
2024-05-24T09:57:06.883078435Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:57:06.883081469Z     self.create_dashboards()
2024-05-24T09:57:06.883084581Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:57:06.883087564Z     self.service.create_dashboards()
2024-05-24T09:57:06.883090665Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:57:06.883093718Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:57:06.883097096Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:57:06.883100028Z     response = requests.request(
2024-05-24T09:57:06.883102952Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:57:06.883106288Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:57:06.883109293Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:57:06.883112231Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:57:06.883115219Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:57:06.883118152Z     r = adapter.send(request, **kwargs)
2024-05-24T09:57:06.883121097Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:57:06.883124322Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:57:06.883138337Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c3115a0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:59:17.949098755Z 05/24/2024 09:59:17 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T09:59:17.949123793Z Traceback (most recent call last):
2024-05-24T09:59:17.949127421Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T09:59:17.949130687Z     sock = connection.create_connection(
2024-05-24T09:59:17.949134248Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T09:59:17.949137382Z     raise err
2024-05-24T09:59:17.949140395Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T09:59:17.949143977Z     sock.connect(sa)
2024-05-24T09:59:17.949147044Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T09:59:17.949149868Z 
2024-05-24T09:59:17.949153341Z The above exception was the direct cause of the following exception:
2024-05-24T09:59:17.949156082Z 
2024-05-24T09:59:17.949159034Z Traceback (most recent call last):
2024-05-24T09:59:17.949161958Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T09:59:17.949164966Z     response = self._make_request(
2024-05-24T09:59:17.949177213Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T09:59:17.949180293Z     conn.request(
2024-05-24T09:59:17.949183247Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T09:59:17.949186263Z     self.endheaders()
2024-05-24T09:59:17.949189155Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T09:59:17.949192207Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T09:59:17.949195083Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T09:59:17.949200526Z     self.send(msg)
2024-05-24T09:59:17.949204098Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T09:59:17.949206965Z     self.connect()
2024-05-24T09:59:17.949209818Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T09:59:17.949213426Z     self.sock = self._new_conn()
2024-05-24T09:59:17.949216275Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T09:59:17.949219165Z     raise ConnectTimeoutError(
2024-05-24T09:59:17.949222642Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c310a30>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T09:59:17.949225442Z 
2024-05-24T09:59:17.949228330Z The above exception was the direct cause of the following exception:
2024-05-24T09:59:17.949231060Z 
2024-05-24T09:59:17.949233962Z Traceback (most recent call last):
2024-05-24T09:59:17.949236808Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T09:59:17.949239700Z     resp = conn.urlopen(
2024-05-24T09:59:17.949242645Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T09:59:17.949245460Z     retries = retries.increment(
2024-05-24T09:59:17.949248346Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T09:59:17.949251258Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T09:59:17.949255056Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c310a30>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T09:59:17.949257907Z 
2024-05-24T09:59:17.949261102Z During handling of the above exception, another exception occurred:
2024-05-24T09:59:17.949263793Z 
2024-05-24T09:59:17.949266621Z Traceback (most recent call last):
2024-05-24T09:59:17.949269733Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T09:59:17.949272632Z     self.create_dashboards()
2024-05-24T09:59:17.949275472Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T09:59:17.949278480Z     self.service.create_dashboards()
2024-05-24T09:59:17.949281345Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T09:59:17.949284183Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T09:59:17.949287449Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T09:59:17.949290276Z     response = requests.request(
2024-05-24T09:59:17.949293087Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T09:59:17.949299795Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T09:59:17.949302687Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T09:59:17.949305578Z     resp = self.send(prep, **send_kwargs)
2024-05-24T09:59:17.949308422Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T09:59:17.949311289Z     r = adapter.send(request, **kwargs)
2024-05-24T09:59:17.949314152Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T09:59:17.949317019Z     raise ConnectTimeout(e, request=request)
2024-05-24T09:59:17.949325346Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c310a30>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:01:29.019378606Z 05/24/2024 10:01:29 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:01:29.019446278Z Traceback (most recent call last):
2024-05-24T10:01:29.019450760Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:01:29.019453987Z     sock = connection.create_connection(
2024-05-24T10:01:29.019460077Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:01:29.019463279Z     raise err
2024-05-24T10:01:29.019466407Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:01:29.019470136Z     sock.connect(sa)
2024-05-24T10:01:29.019473459Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:01:29.019476384Z 
2024-05-24T10:01:29.019480092Z The above exception was the direct cause of the following exception:
2024-05-24T10:01:29.019482993Z 
2024-05-24T10:01:29.019486045Z Traceback (most recent call last):
2024-05-24T10:01:29.019489170Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:01:29.019492266Z     response = self._make_request(
2024-05-24T10:01:29.019495291Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:01:29.019498500Z     conn.request(
2024-05-24T10:01:29.019501841Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:01:29.019505167Z     self.endheaders()
2024-05-24T10:01:29.019508252Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:01:29.019511287Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:01:29.019514478Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:01:29.019517463Z     self.send(msg)
2024-05-24T10:01:29.019521064Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:01:29.019524119Z     self.connect()
2024-05-24T10:01:29.019527547Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:01:29.019531228Z     self.sock = self._new_conn()
2024-05-24T10:01:29.019534253Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:01:29.019537248Z     raise ConnectTimeoutError(
2024-05-24T10:01:29.019541251Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6c312710>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:01:29.019556934Z 
2024-05-24T10:01:29.019560122Z The above exception was the direct cause of the following exception:
2024-05-24T10:01:29.019563153Z 
2024-05-24T10:01:29.019566081Z Traceback (most recent call last):
2024-05-24T10:01:29.019569160Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:01:29.019572391Z     resp = conn.urlopen(
2024-05-24T10:01:29.019575433Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:01:29.019578366Z     retries = retries.increment(
2024-05-24T10:01:29.019581417Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:01:29.019584394Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:01:29.019589560Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c312710>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:01:29.019592565Z 
2024-05-24T10:01:29.019595639Z During handling of the above exception, another exception occurred:
2024-05-24T10:01:29.019598487Z 
2024-05-24T10:01:29.019601557Z Traceback (most recent call last):
2024-05-24T10:01:29.019604568Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:01:29.019607861Z     self.create_dashboards()
2024-05-24T10:01:29.019611003Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:01:29.019613988Z     self.service.create_dashboards()
2024-05-24T10:01:29.019616986Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:01:29.019620090Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:01:29.019624485Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:01:29.019627551Z     response = requests.request(
2024-05-24T10:01:29.019630551Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:01:29.019633760Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:01:29.019636844Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:01:29.019639971Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:01:29.019642993Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:01:29.019645937Z     r = adapter.send(request, **kwargs)
2024-05-24T10:01:29.019648981Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:01:29.019651972Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:01:29.019667212Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6c312710>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:03:40.096948503Z 05/24/2024 10:03:40 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:03:40.097000581Z Traceback (most recent call last):
2024-05-24T10:03:40.097005811Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:03:40.097010241Z     sock = connection.create_connection(
2024-05-24T10:03:40.097015170Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:03:40.097037438Z     raise err
2024-05-24T10:03:40.097041840Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:03:40.097046845Z     sock.connect(sa)
2024-05-24T10:03:40.097051205Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:03:40.097055030Z 
2024-05-24T10:03:40.097060735Z The above exception was the direct cause of the following exception:
2024-05-24T10:03:40.097064618Z 
2024-05-24T10:03:40.097068707Z Traceback (most recent call last):
2024-05-24T10:03:40.097072698Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:03:40.097076852Z     response = self._make_request(
2024-05-24T10:03:40.097081092Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:03:40.097085216Z     conn.request(
2024-05-24T10:03:40.097089685Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:03:40.097093844Z     self.endheaders()
2024-05-24T10:03:40.097097906Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:03:40.097102029Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:03:40.097106038Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:03:40.097110213Z     self.send(msg)
2024-05-24T10:03:40.097115206Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:03:40.097119367Z     self.connect()
2024-05-24T10:03:40.097123592Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:03:40.097128465Z     self.sock = self._new_conn()
2024-05-24T10:03:40.097132837Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:03:40.097142247Z     raise ConnectTimeoutError(
2024-05-24T10:03:40.097147430Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc763e0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:03:40.097151208Z 
2024-05-24T10:03:40.097155265Z The above exception was the direct cause of the following exception:
2024-05-24T10:03:40.097159094Z 
2024-05-24T10:03:40.097162987Z Traceback (most recent call last):
2024-05-24T10:03:40.097167255Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:03:40.097171316Z     resp = conn.urlopen(
2024-05-24T10:03:40.097175405Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:03:40.097179364Z     retries = retries.increment(
2024-05-24T10:03:40.097183590Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:03:40.097187627Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:03:40.097194934Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc763e0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:03:40.097198916Z 
2024-05-24T10:03:40.097203214Z During handling of the above exception, another exception occurred:
2024-05-24T10:03:40.097207083Z 
2024-05-24T10:03:40.097211063Z Traceback (most recent call last):
2024-05-24T10:03:40.097215118Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:03:40.097225323Z     self.create_dashboards()
2024-05-24T10:03:40.097229575Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:03:40.097233870Z     self.service.create_dashboards()
2024-05-24T10:03:40.097238050Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:03:40.097242128Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:03:40.097246745Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:03:40.097250867Z     response = requests.request(
2024-05-24T10:03:40.097255112Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:03:40.097259235Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:03:40.097263544Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:03:40.097267855Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:03:40.097271960Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:03:40.097276087Z     r = adapter.send(request, **kwargs)
2024-05-24T10:03:40.097280286Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:03:40.097284260Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:03:40.097318522Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc763e0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:05:51.163224865Z 05/24/2024 10:05:51 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:05:51.163293802Z Traceback (most recent call last):
2024-05-24T10:05:51.163308997Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:05:51.163322882Z     sock = connection.create_connection(
2024-05-24T10:05:51.163337273Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:05:51.163347031Z     raise err
2024-05-24T10:05:51.163355718Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:05:51.163364930Z     sock.connect(sa)
2024-05-24T10:05:51.163373918Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:05:51.163381964Z 
2024-05-24T10:05:51.163391716Z The above exception was the direct cause of the following exception:
2024-05-24T10:05:51.163399745Z 
2024-05-24T10:05:51.163425267Z Traceback (most recent call last):
2024-05-24T10:05:51.163434735Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:05:51.163443411Z     response = self._make_request(
2024-05-24T10:05:51.163451882Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:05:51.163460524Z     conn.request(
2024-05-24T10:05:51.163468975Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:05:51.163477415Z     self.endheaders()
2024-05-24T10:05:51.163485909Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:05:51.163494330Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:05:51.163503332Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:05:51.163536385Z     self.send(msg)
2024-05-24T10:05:51.163546265Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:05:51.163554855Z     self.connect()
2024-05-24T10:05:51.163563030Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:05:51.163572340Z     self.sock = self._new_conn()
2024-05-24T10:05:51.163580697Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:05:51.163588960Z     raise ConnectTimeoutError(
2024-05-24T10:05:51.163603707Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc74970>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:05:51.163611965Z 
2024-05-24T10:05:51.163620496Z The above exception was the direct cause of the following exception:
2024-05-24T10:05:51.163628660Z 
2024-05-24T10:05:51.163639262Z Traceback (most recent call last):
2024-05-24T10:05:51.163664090Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:05:51.163686120Z     resp = conn.urlopen(
2024-05-24T10:05:51.163700278Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:05:51.163713349Z     retries = retries.increment(
2024-05-24T10:05:51.163727319Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:05:51.163740366Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:05:51.163774504Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc74970>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:05:51.163788357Z 
2024-05-24T10:05:51.163800986Z During handling of the above exception, another exception occurred:
2024-05-24T10:05:51.163811456Z 
2024-05-24T10:05:51.163819784Z Traceback (most recent call last):
2024-05-24T10:05:51.163828082Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:05:51.163836440Z     self.create_dashboards()
2024-05-24T10:05:51.163844701Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:05:51.163853118Z     self.service.create_dashboards()
2024-05-24T10:05:51.163861366Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:05:51.163869701Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:05:51.163878999Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:05:51.163887285Z     response = requests.request(
2024-05-24T10:05:51.163895475Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:05:51.163903634Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:05:51.163911874Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:05:51.163920219Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:05:51.163928618Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:05:51.163936796Z     r = adapter.send(request, **kwargs)
2024-05-24T10:05:51.163944996Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:05:51.163967340Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:05:51.163985535Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc74970>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:08:02.235837057Z 05/24/2024 10:08:02 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:08:02.235874900Z Traceback (most recent call last):
2024-05-24T10:08:02.235880305Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:08:02.235884847Z     sock = connection.create_connection(
2024-05-24T10:08:02.235889680Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:08:02.235894357Z     raise err
2024-05-24T10:08:02.235899123Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:08:02.235904012Z     sock.connect(sa)
2024-05-24T10:08:02.235908703Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:08:02.235912992Z 
2024-05-24T10:08:02.235918523Z The above exception was the direct cause of the following exception:
2024-05-24T10:08:02.235923369Z 
2024-05-24T10:08:02.235928499Z Traceback (most recent call last):
2024-05-24T10:08:02.235933406Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:08:02.235937824Z     response = self._make_request(
2024-05-24T10:08:02.235942196Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:08:02.235946877Z     conn.request(
2024-05-24T10:08:02.235951222Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:08:02.235955397Z     self.endheaders()
2024-05-24T10:08:02.235959866Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:08:02.235964561Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:08:02.235969796Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:08:02.235974248Z     self.send(msg)
2024-05-24T10:08:02.235979133Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:08:02.235983595Z     self.connect()
2024-05-24T10:08:02.235987991Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:08:02.235992812Z     self.sock = self._new_conn()
2024-05-24T10:08:02.235997128Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:08:02.236001608Z     raise ConnectTimeoutError(
2024-05-24T10:08:02.236007294Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc75270>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:08:02.236011702Z 
2024-05-24T10:08:02.236016675Z The above exception was the direct cause of the following exception:
2024-05-24T10:08:02.236020866Z 
2024-05-24T10:08:02.236025332Z Traceback (most recent call last):
2024-05-24T10:08:02.236030949Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:08:02.236036043Z     resp = conn.urlopen(
2024-05-24T10:08:02.236040584Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:08:02.236045175Z     retries = retries.increment(
2024-05-24T10:08:02.236050615Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:08:02.236070647Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:08:02.236076367Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75270>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:08:02.236101097Z 
2024-05-24T10:08:02.236106807Z During handling of the above exception, another exception occurred:
2024-05-24T10:08:02.236110933Z 
2024-05-24T10:08:02.236115414Z Traceback (most recent call last):
2024-05-24T10:08:02.236119908Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:08:02.236124391Z     self.create_dashboards()
2024-05-24T10:08:02.236129040Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:08:02.236133683Z     self.service.create_dashboards()
2024-05-24T10:08:02.236138514Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:08:02.236143047Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:08:02.236148396Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:08:02.236152985Z     response = requests.request(
2024-05-24T10:08:02.236157204Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:08:02.236162038Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:08:02.236166596Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:08:02.236171059Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:08:02.236175337Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:08:02.236179518Z     r = adapter.send(request, **kwargs)
2024-05-24T10:08:02.236183845Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:08:02.236188216Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:08:02.236240292Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75270>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:10:13.309805591Z 05/24/2024 10:10:13 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:10:13.309843631Z Traceback (most recent call last):
2024-05-24T10:10:13.309847473Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:10:13.309850668Z     sock = connection.create_connection(
2024-05-24T10:10:13.309855207Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:10:13.309858328Z     raise err
2024-05-24T10:10:13.309861438Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:10:13.309865494Z     sock.connect(sa)
2024-05-24T10:10:13.309868810Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:10:13.309871705Z 
2024-05-24T10:10:13.309875855Z The above exception was the direct cause of the following exception:
2024-05-24T10:10:13.309878711Z 
2024-05-24T10:10:13.309881846Z Traceback (most recent call last):
2024-05-24T10:10:13.309895268Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:10:13.309898437Z     response = self._make_request(
2024-05-24T10:10:13.309901408Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:10:13.309904657Z     conn.request(
2024-05-24T10:10:13.309907696Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:10:13.309910735Z     self.endheaders()
2024-05-24T10:10:13.309913785Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:10:13.309916812Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:10:13.309919779Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:10:13.309922717Z     self.send(msg)
2024-05-24T10:10:13.309926699Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:10:13.309929819Z     self.connect()
2024-05-24T10:10:13.309933054Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:10:13.309937527Z     self.sock = self._new_conn()
2024-05-24T10:10:13.309940496Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:10:13.309943484Z     raise ConnectTimeoutError(
2024-05-24T10:10:13.309951795Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc75a50>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:10:13.309954778Z 
2024-05-24T10:10:13.309957856Z The above exception was the direct cause of the following exception:
2024-05-24T10:10:13.309960788Z 
2024-05-24T10:10:13.309963808Z Traceback (most recent call last):
2024-05-24T10:10:13.309966778Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:10:13.309969767Z     resp = conn.urlopen(
2024-05-24T10:10:13.309972765Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:10:13.309975839Z     retries = retries.increment(
2024-05-24T10:10:13.309978802Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:10:13.309981744Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:10:13.309986254Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75a50>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:10:13.309989119Z 
2024-05-24T10:10:13.309992139Z During handling of the above exception, another exception occurred:
2024-05-24T10:10:13.309994949Z 
2024-05-24T10:10:13.309998048Z Traceback (most recent call last):
2024-05-24T10:10:13.310001077Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:10:13.310004113Z     self.create_dashboards()
2024-05-24T10:10:13.310007132Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:10:13.310010117Z     self.service.create_dashboards()
2024-05-24T10:10:13.310013236Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:10:13.310016294Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:10:13.310020228Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:10:13.310027525Z     response = requests.request(
2024-05-24T10:10:13.310030571Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:10:13.310033509Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:10:13.310036560Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:10:13.310039519Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:10:13.310042484Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:10:13.310045431Z     r = adapter.send(request, **kwargs)
2024-05-24T10:10:13.310048420Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:10:13.310051644Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:10:13.310057445Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75a50>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:12:24.380073400Z 05/24/2024 10:12:24 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:12:24.380103543Z Traceback (most recent call last):
2024-05-24T10:12:24.380112749Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:12:24.380121098Z     sock = connection.create_connection(
2024-05-24T10:12:24.380130419Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:12:24.380139114Z     raise err
2024-05-24T10:12:24.380147577Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:12:24.380178368Z     sock.connect(sa)
2024-05-24T10:12:24.380187861Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:12:24.380195893Z 
2024-05-24T10:12:24.380205322Z The above exception was the direct cause of the following exception:
2024-05-24T10:12:24.380267589Z 
2024-05-24T10:12:24.380276475Z Traceback (most recent call last):
2024-05-24T10:12:24.380284812Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:12:24.380293280Z     response = self._make_request(
2024-05-24T10:12:24.380301807Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:12:24.380310319Z     conn.request(
2024-05-24T10:12:24.380318771Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:12:24.380327159Z     self.endheaders()
2024-05-24T10:12:24.380335639Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:12:24.380344337Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:12:24.380352610Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:12:24.380361026Z     self.send(msg)
2024-05-24T10:12:24.380370163Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:12:24.380378524Z     self.connect()
2024-05-24T10:12:24.380393441Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:12:24.380402666Z     self.sock = self._new_conn()
2024-05-24T10:12:24.380411103Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:12:24.380419526Z     raise ConnectTimeoutError(
2024-05-24T10:12:24.380429048Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc75fc0>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:12:24.380461306Z 
2024-05-24T10:12:24.380470224Z The above exception was the direct cause of the following exception:
2024-05-24T10:12:24.380478293Z 
2024-05-24T10:12:24.380486568Z Traceback (most recent call last):
2024-05-24T10:12:24.380494821Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:12:24.380514080Z     resp = conn.urlopen(
2024-05-24T10:12:24.380522772Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:12:24.380530952Z     retries = retries.increment(
2024-05-24T10:12:24.380539158Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:12:24.380547372Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:12:24.380556999Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75fc0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:12:24.380564992Z 
2024-05-24T10:12:24.380573420Z During handling of the above exception, another exception occurred:
2024-05-24T10:12:24.380581238Z 
2024-05-24T10:12:24.380589515Z Traceback (most recent call last):
2024-05-24T10:12:24.380598204Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:12:24.380606481Z     self.create_dashboards()
2024-05-24T10:12:24.380614692Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:12:24.380623051Z     self.service.create_dashboards()
2024-05-24T10:12:24.380631343Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:12:24.380639611Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:12:24.380648673Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:12:24.380656869Z     response = requests.request(
2024-05-24T10:12:24.380665078Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:12:24.380673350Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:12:24.380681926Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:12:24.380690635Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:12:24.380698946Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:12:24.380707123Z     r = adapter.send(request, **kwargs)
2024-05-24T10:12:24.380715475Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:12:24.380724572Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:12:24.380738442Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc75fc0>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:14:35.452790395Z 05/24/2024 10:14:35 AM - osm_mon.dashboarder.dashboarder - ERROR - Error creating dashboards
2024-05-24T10:14:35.452857489Z Traceback (most recent call last):
2024-05-24T10:14:35.452868842Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 203, in _new_conn
2024-05-24T10:14:35.452910554Z     sock = connection.create_connection(
2024-05-24T10:14:35.452923969Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-05-24T10:14:35.452936212Z     raise err
2024-05-24T10:14:35.452946958Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-05-24T10:14:35.452959694Z     sock.connect(sa)
2024-05-24T10:14:35.452970558Z TimeoutError: [Errno 110] Connection timed out
2024-05-24T10:14:35.452981354Z 
2024-05-24T10:14:35.452993142Z The above exception was the direct cause of the following exception:
2024-05-24T10:14:35.453003151Z 
2024-05-24T10:14:35.453013686Z Traceback (most recent call last):
2024-05-24T10:14:35.453024108Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-05-24T10:14:35.453035570Z     response = self._make_request(
2024-05-24T10:14:35.453046989Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 496, in _make_request
2024-05-24T10:14:35.453058141Z     conn.request(
2024-05-24T10:14:35.453068462Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 395, in request
2024-05-24T10:14:35.453078868Z     self.endheaders()
2024-05-24T10:14:35.453089335Z   File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
2024-05-24T10:14:35.453100392Z     self._send_output(message_body, encode_chunked=encode_chunked)
2024-05-24T10:14:35.453112153Z   File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
2024-05-24T10:14:35.453123141Z     self.send(msg)
2024-05-24T10:14:35.453135272Z   File "/usr/lib/python3.10/http/client.py", line 976, in send
2024-05-24T10:14:35.453146417Z     self.connect()
2024-05-24T10:14:35.453156831Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 243, in connect
2024-05-24T10:14:35.453169221Z     self.sock = self._new_conn()
2024-05-24T10:14:35.453180411Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 212, in _new_conn
2024-05-24T10:14:35.453192206Z     raise ConnectTimeoutError(
2024-05-24T10:14:35.453205329Z urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7f3c6cc77100>, 'Connection to grafana timed out. (connect timeout=None)')
2024-05-24T10:14:35.453215325Z 
2024-05-24T10:14:35.453226977Z The above exception was the direct cause of the following exception:
2024-05-24T10:14:35.453237719Z 
2024-05-24T10:14:35.453249376Z Traceback (most recent call last):
2024-05-24T10:14:35.453259950Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
2024-05-24T10:14:35.453270455Z     resp = conn.urlopen(
2024-05-24T10:14:35.453281339Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
2024-05-24T10:14:35.453292296Z     retries = retries.increment(
2024-05-24T10:14:35.453303416Z   File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
2024-05-24T10:14:35.453313776Z     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-05-24T10:14:35.453327149Z urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc77100>, 'Connection to grafana timed out. (connect timeout=None)'))
2024-05-24T10:14:35.453337020Z 
2024-05-24T10:14:35.453348453Z During handling of the above exception, another exception occurred:
2024-05-24T10:14:35.453358029Z 
2024-05-24T10:14:35.453381674Z Traceback (most recent call last):
2024-05-24T10:14:35.453392545Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 147, in dashboard_forever
2024-05-24T10:14:35.453402905Z     self.create_dashboards()
2024-05-24T10:14:35.453412672Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/dashboarder.py", line 153, in create_dashboards
2024-05-24T10:14:35.453423613Z     self.service.create_dashboards()
2024-05-24T10:14:35.453434163Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/service.py", line 52, in create_dashboards
2024-05-24T10:14:35.453444512Z     dashboard_uids = self.grafana.get_all_dashboard_uids()
2024-05-24T10:14:35.453456439Z   File "/usr/lib/python3/dist-packages/osm_mon/dashboarder/backends/grafana.py", line 48, in get_all_dashboard_uids
2024-05-24T10:14:35.453467308Z     response = requests.request(
2024-05-24T10:14:35.453478238Z   File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 59, in request
2024-05-24T10:14:35.453489566Z     return session.request(method=method, url=url, **kwargs)
2024-05-24T10:14:35.453500233Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
2024-05-24T10:14:35.453511463Z     resp = self.send(prep, **send_kwargs)
2024-05-24T10:14:35.453522585Z   File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
2024-05-24T10:14:35.453534000Z     r = adapter.send(request, **kwargs)
2024-05-24T10:14:35.453545797Z   File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 507, in send
2024-05-24T10:14:35.453557270Z     raise ConnectTimeout(e, request=request)
2024-05-24T10:14:35.453583942Z requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='grafana', port=3000): Max retries exceeded with url: /api/search?tag=osm_automated (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f3c6cc77100>, 'Connection to grafana timed out. (connect timeout=None)'))