FailedConsole Output

Skipping 1,041 KB.. Full Log
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 7.0 MB/s eta 0:00:00
[?25hDownloading prettytable-3.9.0-py3-none-any.whl (27 kB)
Downloading python_magic-0.4.27-py2.py3-none-any.whl (13 kB)
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[?25l   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/62.6 kB ? eta -:--:--
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 5.6 MB/s eta 0:00:00
[?25hDownloading urllib3-2.0.5-py3-none-any.whl (123 kB)
[?25l   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/123.8 kB ? eta -:--:--
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.8/123.8 kB 13.2 MB/s eta 0:00:00
[?25hDownloading verboselogs-1.7-py2.py3-none-any.whl (11 kB)
Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
DEPRECATION: distro-info 1.1build1 has a non-standard version number. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of distro-info or contact the author to suggest that they release a version with a conforming version number. Discussion can be found at https://github.com/pypa/pip/issues/12063
DEPRECATION: python-debian 0.1.43ubuntu1 has a non-standard version number. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of python-debian or contact the author to suggest that they release a version with a conforming version number. Discussion can be found at https://github.com/pypa/pip/issues/12063
Installing collected packages: wcwidth, verboselogs, ply, urllib3, python-magic, prettytable, packaging, markupsafe, jsonpath-ng, idna, click, charset-normalizer, certifi, requests, jinja2
  WARNING: The script jsonpath_ng is installed in '/home/ubuntu/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script normalizer is installed in '/home/ubuntu/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed certifi-2023.7.22 charset-normalizer-3.3.0 click-8.1.7 idna-3.4 jinja2-3.1.2 jsonpath-ng-1.6.0 markupsafe-2.1.3 packaging-23.2 ply-3.11 prettytable-3.9.0 python-magic-0.4.27 requests-2.31.0 urllib3-2.0.5 verboselogs-1.7 wcwidth-0.2.8

OSM client installed
OSM client assumes that OSM host is running in localhost (127.0.0.1).
In case you want to interact with a different OSM host, you will have to configure this env variable in your .bashrc file:
     export OSM_HOSTNAME=<OSM_host>
Track osmclient osmclient_ok: https://osm.etsi.org/InstallLog.php?&installation_id=1712182595-bThgT9XVfh4CdfjF&local_ts=1712183205&event=osmclient&operation=osmclient_ok&value=&comment=&tags=
Checking OSM health state...
helm -n osm list
NAME        	NAMESPACE	REVISION	UPDATED                                	STATUS  	CHART                        	APP VERSION
airflow     	osm      	1       	2024-04-03 22:22:05.14933441 +0000 UTC 	deployed	airflow-1.9.0                	2.5.3      
alertmanager	osm      	1       	2024-04-03 22:25:16.970328445 +0000 UTC	deployed	alertmanager-0.22.0          	v0.24.0    
osm         	osm      	1       	2024-04-03 22:22:00.083857034 +0000 UTC	deployed	osm-0.0.1                    	14         
pushgateway 	osm      	1       	2024-04-03 22:25:11.371724962 +0000 UTC	deployed	prometheus-pushgateway-1.18.2	1.4.2      
helm -n osm status osm
NAME: osm
LAST DEPLOYED: Wed Apr  3 22:22:00 2024
NAMESPACE: osm
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
1. Get the application URL by running these commands:
  export NODE_PORT=$(kubectl get --namespace osm -o jsonpath="{.spec.ports[0].nodePort}" services nbi)
  export NODE_IP=$(kubectl get nodes --namespace osm -o jsonpath="{.items[0].status.addresses[0].address}")
  echo http://$NODE_IP:$NODE_PORT
===> Successful checks: 1/24
===> Successful checks: 2/24

Bootstraping... 1 attempts of 84
2 of 14 deployments starting:
                 lcm	0/1	0
                  ro	0/1	0


Bootstraping... 2 attempts of 84
3 of 14 deployments starting:
                 lcm	0/1	0
                 nbi	0/1	0
                  ro	0/1	0


Bootstraping... 3 attempts of 84
3 of 14 deployments starting:
                 lcm	0/1	0
                 nbi	0/1	0
                  ro	0/1	0


Bootstraping... 4 attempts of 84
2 of 14 deployments starting:
                 nbi	0/1	0
                  ro	0/1	0


Bootstraping... 5 attempts of 84
1 of 14 deployments starting:
                 nbi	0/1	0


Bootstraping... 6 attempts of 84
1 of 14 deployments starting:
                 nbi	0/1	0

===> Successful checks: 1/24
===> Successful checks: 2/24
===> Successful checks: 3/24
===> Successful checks: 4/24
===> Successful checks: 5/24
===> Successful checks: 6/24
===> Successful checks: 7/24
===> Successful checks: 8/24
===> Successful checks: 9/24

Bootstraping... 1 attempts of 84
1 of 14 deployments starting:
                 lcm	0/1	0


Bootstraping... 2 attempts of 84
1 of 14 deployments starting:
                 lcm	0/1	0


Bootstraping... 3 attempts of 84
1 of 14 deployments starting:
                 lcm	0/1	0


Bootstraping... 4 attempts of 84
1 of 14 deployments starting:
                 lcm	0/1	0


Bootstraping... 5 attempts of 84
1 of 14 deployments starting:
                 lcm	0/1	0

===> Successful checks: 1/24
===> Successful checks: 2/24
===> Successful checks: 3/24
===> Successful checks: 4/24
===> Successful checks: 5/24
===> Successful checks: 6/24
===> Successful checks: 7/24
===> Successful checks: 8/24
===> Successful checks: 9/24
===> Successful checks: 10/24
===> Successful checks: 11/24
===> Successful checks: 12/24
===> Successful checks: 13/24
===> Successful checks: 14/24
===> Successful checks: 15/24
===> Successful checks: 16/24
===> Successful checks: 17/24
===> Successful checks: 18/24
===> Successful checks: 19/24
===> Successful checks: 20/24
===> Successful checks: 21/24
===> Successful checks: 22/24
===> Successful checks: 23/24
===> Successful checks: 24/24

SYSTEM IS READY
Track healthchecks after_healthcheck_ok: https://osm.etsi.org/InstallLog.php?&installation_id=1712182595-bThgT9XVfh4CdfjF&local_ts=1712183450&event=healthchecks&operation=after_healthcheck_ok&value=&comment=&tags=
0a888e1c-bdd1-4a1b-80ba-dd1eaf7e8a19
e0ae5cdf-b7a0-45fd-b319-e8581d7b12f7
Track final_ops add_local_k8scluster_ok: https://osm.etsi.org/InstallLog.php?&installation_id=1712182595-bThgT9XVfh4CdfjF&local_ts=1712183453&event=final_ops&operation=add_local_k8scluster_ok&value=&comment=&tags=
Fixing firewall so docker and LXD can share the same host without affecting each other.
# Generated by iptables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*mangle

:PREROUTING ACCEPT [0:0]

:INPUT ACCEPT [0:0]

:FORWARD ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:POSTROUTING ACCEPT [0:0]

:KUBE-IPTABLES-HINT - [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-PROXY-CANARY - [0:0]

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

# Generated by iptables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*filter

:INPUT ACCEPT [0:0]

:FORWARD ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:DOCKER - [0:0]

:DOCKER-ISOLATION-STAGE-1 - [0:0]

:DOCKER-ISOLATION-STAGE-2 - [0:0]

:DOCKER-USER - [0:0]

:FLANNEL-FWD - [0:0]

:KUBE-EXTERNAL-SERVICES - [0:0]

:KUBE-FIREWALL - [0:0]

:KUBE-FORWARD - [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-NODEPORTS - [0:0]

:KUBE-PROXY-CANARY - [0:0]

:KUBE-PROXY-FIREWALL - [0:0]

:KUBE-SERVICES - [0:0]

-A INPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A INPUT -m comment --comment "kubernetes health check service ports" -j KUBE-NODEPORTS

-A INPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes externally-visible service portals" -j KUBE-EXTERNAL-SERVICES

-A INPUT -j KUBE-FIREWALL

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A FORWARD -m comment --comment "kubernetes forwarding rules" -j KUBE-FORWARD

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes externally-visible service portals" -j KUBE-EXTERNAL-SERVICES

-A FORWARD -j DOCKER-USER

-A FORWARD -j DOCKER-ISOLATION-STAGE-1

-A FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT

-A FORWARD -o docker0 -j DOCKER

-A FORWARD -i docker0 ! -o docker0 -j ACCEPT

-A FORWARD -i docker0 -o docker0 -j ACCEPT

-A FORWARD -m comment --comment "flanneld forward" -j FLANNEL-FWD

-A OUTPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A OUTPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A OUTPUT -j KUBE-FIREWALL

-A DOCKER-ISOLATION-STAGE-1 -i docker0 ! -o docker0 -j DOCKER-ISOLATION-STAGE-2

-A DOCKER-ISOLATION-STAGE-1 -j RETURN

-A DOCKER-ISOLATION-STAGE-2 -o docker0 -j DROP

-A DOCKER-ISOLATION-STAGE-2 -j RETURN

-A DOCKER-USER -j ACCEPT

-A DOCKER-USER -j RETURN

-A FLANNEL-FWD -s 10.244.0.0/16 -m comment --comment "flanneld forward" -j ACCEPT

-A FLANNEL-FWD -d 10.244.0.0/16 -m comment --comment "flanneld forward" -j ACCEPT

-A KUBE-FIREWALL ! -s 127.0.0.0/8 -d 127.0.0.0/8 -m comment --comment "block incoming localnet connections" -m conntrack ! --ctstate RELATED,ESTABLISHED,DNAT -j DROP

-A KUBE-FIREWALL -m comment --comment "kubernetes firewall for dropping marked packets" -m mark --mark 0x8000/0x8000 -j DROP

-A KUBE-FORWARD -m conntrack --ctstate INVALID -j DROP

-A KUBE-FORWARD -m comment --comment "kubernetes forwarding rules" -j ACCEPT

-A KUBE-FORWARD -m comment --comment "kubernetes forwarding conntrack rule" -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

# Generated by iptables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*nat

:PREROUTING ACCEPT [0:0]

:INPUT ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:POSTROUTING ACCEPT [0:0]

:DOCKER - [0:0]

:FLANNEL-POSTRTG - [0:0]

:KUBE-EXT-BF2LB5WJRBPLA42J - [0:0]

:KUBE-EXT-FQUXG555W5IVIWW3 - [0:0]

:KUBE-EXT-GZN4S7ND4PF6YXD6 - [0:0]

:KUBE-EXT-MD4PSIBW5SPF2DB3 - [0:0]

:KUBE-EXT-PQIZCPF63EFIBBJY - [0:0]

:KUBE-EXT-VTS3SY4BGCZLE3HK - [0:0]

:KUBE-EXT-XUD4OEZNIHB47KQL - [0:0]

:KUBE-EXT-YA74QX5VY2UAABIX - [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-MARK-DROP - [0:0]

:KUBE-MARK-MASQ - [0:0]

:KUBE-NODEPORTS - [0:0]

:KUBE-POSTROUTING - [0:0]

:KUBE-PROXY-CANARY - [0:0]

:KUBE-SEP-22L6GZVKJQ7YNV5X - [0:0]

:KUBE-SEP-3E6HOAZVYXQ2ZDB3 - [0:0]

:KUBE-SEP-4LIA3Y34QCXKCG3N - [0:0]

:KUBE-SEP-5TCW6LIAZ6PXMBU3 - [0:0]

:KUBE-SEP-5XVCWZLMPM6ZDMAK - [0:0]

:KUBE-SEP-6KM2F4K4I7A2VM2U - [0:0]

:KUBE-SEP-AENM4W7JPZLDGIAD - [0:0]

:KUBE-SEP-FOB2KBXV2FRZH6LW - [0:0]

:KUBE-SEP-FVQSBIWR5JTECIVC - [0:0]

:KUBE-SEP-GWMQ2Y7ZXCC5ITOI - [0:0]

:KUBE-SEP-HJ7EWOW62IX6GL6R - [0:0]

:KUBE-SEP-IO5GMPCAE4NCTD57 - [0:0]

:KUBE-SEP-ISHFB2I4PMRIVC6G - [0:0]

:KUBE-SEP-K5ETGAT6VOT2SO74 - [0:0]

:KUBE-SEP-LASJGFFJP3UOS6RQ - [0:0]

:KUBE-SEP-LPGSDLJ3FDW46N4W - [0:0]

:KUBE-SEP-MD73VJOVN7ABXUHC - [0:0]

:KUBE-SEP-MZ4ZQS46JTVFQNMO - [0:0]

:KUBE-SEP-OP4AXEAS4OXHBEQX - [0:0]

:KUBE-SEP-OPH4JJMJB5UPXJLN - [0:0]

:KUBE-SEP-PTWV2T2EKTG677AU - [0:0]

:KUBE-SEP-QTEADDRAHUZGD5RY - [0:0]

:KUBE-SEP-R7EMXN5TTQQVP4UW - [0:0]

:KUBE-SEP-SNBC75DWVTB4NYRD - [0:0]

:KUBE-SEP-XB7L2DO3RPDK4ADW - [0:0]

:KUBE-SEP-XZVNOPGBKFOKTOOW - [0:0]

:KUBE-SERVICES - [0:0]

:KUBE-SVC-5QOWUZVRO3UICSLI - [0:0]

:KUBE-SVC-BF2LB5WJRBPLA42J - [0:0]

:KUBE-SVC-ENRSJAVYEHAULETD - [0:0]

:KUBE-SVC-ERIFXISQEP7F7OF4 - [0:0]

:KUBE-SVC-FQUXG555W5IVIWW3 - [0:0]

:KUBE-SVC-GZ25SP4UFGF7SAVL - [0:0]

:KUBE-SVC-GZN4S7ND4PF6YXD6 - [0:0]

:KUBE-SVC-ISGVRIWHYABKE5G2 - [0:0]

:KUBE-SVC-JD5MR3NA4I4DYORP - [0:0]

:KUBE-SVC-MD4PSIBW5SPF2DB3 - [0:0]

:KUBE-SVC-NPX46M4PTMTKRN6Y - [0:0]

:KUBE-SVC-O36IMWM6WEZJKHBK - [0:0]

:KUBE-SVC-PQIZCPF63EFIBBJY - [0:0]

:KUBE-SVC-QE77U7R3P7AE7O5U - [0:0]

:KUBE-SVC-TCOU7JCQXEZGVUNU - [0:0]

:KUBE-SVC-TKW2NMFFUMK6R533 - [0:0]

:KUBE-SVC-TTTQGL2HNUNQKPOG - [0:0]

:KUBE-SVC-USIDOZAE2VTXK5OJ - [0:0]

:KUBE-SVC-VTS3SY4BGCZLE3HK - [0:0]

:KUBE-SVC-XUD4OEZNIHB47KQL - [0:0]

:KUBE-SVC-YA74QX5VY2UAABIX - [0:0]

:KUBE-SVC-YO4WYSW77CAYSOKE - [0:0]

:KUBE-SVC-ZUD4L6KQKCHD52W4 - [0:0]

-A PREROUTING -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A PREROUTING -m addrtype --dst-type LOCAL -j DOCKER

-A OUTPUT -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A OUTPUT ! -d 127.0.0.0/8 -m addrtype --dst-type LOCAL -j DOCKER

-A POSTROUTING -m comment --comment "kubernetes postrouting rules" -j KUBE-POSTROUTING

-A POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE

-A POSTROUTING -m comment --comment "flanneld masq" -j FLANNEL-POSTRTG

-A DOCKER -i docker0 -j RETURN

-A FLANNEL-POSTRTG -m comment --comment "flanneld masq" -j RETURN

-A FLANNEL-POSTRTG -s 10.244.0.0/24 -d 10.244.0.0/16 -m comment --comment "flanneld masq" -j RETURN

-A FLANNEL-POSTRTG -s 10.244.0.0/16 -d 10.244.0.0/24 -m comment --comment "flanneld masq" -j RETURN

-A FLANNEL-POSTRTG ! -s 10.244.0.0/16 -d 10.244.0.0/24 -m comment --comment "flanneld masq" -j RETURN

-A FLANNEL-POSTRTG -s 10.244.0.0/16 ! -d 224.0.0.0/4 -m comment --comment "flanneld masq" -j MASQUERADE --random-fully

-A FLANNEL-POSTRTG ! -s 10.244.0.0/16 -d 10.244.0.0/16 -m comment --comment "flanneld masq" -j MASQUERADE --random-fully

-A KUBE-EXT-BF2LB5WJRBPLA42J -m comment --comment "masquerade traffic for osm/airflow-webserver:airflow-ui external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-BF2LB5WJRBPLA42J -j KUBE-SVC-BF2LB5WJRBPLA42J

-A KUBE-EXT-FQUXG555W5IVIWW3 -m comment --comment "masquerade traffic for osm/nbi external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-FQUXG555W5IVIWW3 -j KUBE-SVC-FQUXG555W5IVIWW3

-A KUBE-EXT-GZN4S7ND4PF6YXD6 -m comment --comment "masquerade traffic for osm/alertmanager:http external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-GZN4S7ND4PF6YXD6 -j KUBE-SVC-GZN4S7ND4PF6YXD6

-A KUBE-EXT-MD4PSIBW5SPF2DB3 -m comment --comment "masquerade traffic for osm/prometheus external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-MD4PSIBW5SPF2DB3 -j KUBE-SVC-MD4PSIBW5SPF2DB3

-A KUBE-EXT-PQIZCPF63EFIBBJY -m comment --comment "masquerade traffic for osm/grafana:service external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-PQIZCPF63EFIBBJY -j KUBE-SVC-PQIZCPF63EFIBBJY

-A KUBE-EXT-VTS3SY4BGCZLE3HK -m comment --comment "masquerade traffic for controller-osm/controller-service:api-server external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-VTS3SY4BGCZLE3HK -j KUBE-SVC-VTS3SY4BGCZLE3HK

-A KUBE-EXT-XUD4OEZNIHB47KQL -m comment --comment "masquerade traffic for osm/webhook-translator external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-XUD4OEZNIHB47KQL -j KUBE-SVC-XUD4OEZNIHB47KQL

-A KUBE-EXT-YA74QX5VY2UAABIX -m comment --comment "masquerade traffic for osm/ng-ui external destinations" -j KUBE-MARK-MASQ

-A KUBE-EXT-YA74QX5VY2UAABIX -j KUBE-SVC-YA74QX5VY2UAABIX

-A KUBE-MARK-DROP -j MARK --set-xmark 0x8000/0x8000

-A KUBE-MARK-MASQ -j MARK --set-xmark 0x4000/0x4000

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/ng-ui" -j KUBE-EXT-YA74QX5VY2UAABIX

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/prometheus" -j KUBE-EXT-MD4PSIBW5SPF2DB3

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/webhook-translator" -j KUBE-EXT-XUD4OEZNIHB47KQL

-A KUBE-NODEPORTS -p tcp -m comment --comment "controller-osm/controller-service:api-server" -j KUBE-EXT-VTS3SY4BGCZLE3HK

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/nbi" -j KUBE-EXT-FQUXG555W5IVIWW3

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/grafana:service" -j KUBE-EXT-PQIZCPF63EFIBBJY

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/airflow-webserver:airflow-ui" -j KUBE-EXT-BF2LB5WJRBPLA42J

-A KUBE-NODEPORTS -p tcp -m comment --comment "osm/alertmanager:http" -j KUBE-EXT-GZN4S7ND4PF6YXD6

-A KUBE-POSTROUTING -j RETURN

-A KUBE-POSTROUTING -j MARK --set-xmark 0x4000/0x0

-A KUBE-POSTROUTING -m comment --comment "kubernetes service traffic requiring SNAT" -j MASQUERADE --random-fully

-A KUBE-SEP-22L6GZVKJQ7YNV5X -s 10.244.0.18/32 -m comment --comment "osm/grafana:service" -j KUBE-MARK-MASQ

-A KUBE-SEP-22L6GZVKJQ7YNV5X -p tcp -m comment --comment "osm/grafana:service" -m tcp -j DNAT --to-destination 10.244.0.18:3000

-A KUBE-SEP-3E6HOAZVYXQ2ZDB3 -s 10.244.0.30/32 -m comment --comment "osm/airflow-statsd:statsd-scrape" -j KUBE-MARK-MASQ

-A KUBE-SEP-3E6HOAZVYXQ2ZDB3 -p tcp -m comment --comment "osm/airflow-statsd:statsd-scrape" -m tcp -j DNAT --to-destination 10.244.0.30:9102

-A KUBE-SEP-4LIA3Y34QCXKCG3N -s 10.244.0.36/32 -m comment --comment "osm/mongodb-k8s-operator" -j KUBE-MARK-MASQ

-A KUBE-SEP-4LIA3Y34QCXKCG3N -p tcp -m comment --comment "osm/mongodb-k8s-operator" -m tcp -j DNAT --to-destination 10.244.0.36:30666

-A KUBE-SEP-5TCW6LIAZ6PXMBU3 -s 10.244.0.41/32 -m comment --comment "osm/mongodb-k8s:mongodb" -j KUBE-MARK-MASQ

-A KUBE-SEP-5TCW6LIAZ6PXMBU3 -p tcp -m comment --comment "osm/mongodb-k8s:mongodb" -m tcp -j DNAT --to-destination 10.244.0.41:27017

-A KUBE-SEP-5XVCWZLMPM6ZDMAK -s 10.244.0.24/32 -m comment --comment "osm/ng-ui" -j KUBE-MARK-MASQ

-A KUBE-SEP-5XVCWZLMPM6ZDMAK -p tcp -m comment --comment "osm/ng-ui" -m tcp -j DNAT --to-destination 10.244.0.24:80

-A KUBE-SEP-6KM2F4K4I7A2VM2U -s 10.244.0.37/32 -m comment --comment "osm/airflow-postgresql:tcp-postgresql" -j KUBE-MARK-MASQ

-A KUBE-SEP-6KM2F4K4I7A2VM2U -p tcp -m comment --comment "osm/airflow-postgresql:tcp-postgresql" -m tcp -j DNAT --to-destination 10.244.0.37:5432

-A KUBE-SEP-AENM4W7JPZLDGIAD -s 10.244.0.22/32 -m comment --comment "osm/prometheus" -j KUBE-MARK-MASQ

-A KUBE-SEP-AENM4W7JPZLDGIAD -p tcp -m comment --comment "osm/prometheus" -m tcp -j DNAT --to-destination 10.244.0.22:9090

-A KUBE-SEP-FOB2KBXV2FRZH6LW -s 10.244.0.43/32 -m comment --comment "osm/pushgateway-prometheus-pushgateway:http" -j KUBE-MARK-MASQ

-A KUBE-SEP-FOB2KBXV2FRZH6LW -p tcp -m comment --comment "osm/pushgateway-prometheus-pushgateway:http" -m tcp -j DNAT --to-destination 10.244.0.43:9091

-A KUBE-SEP-FVQSBIWR5JTECIVC -s 10.244.0.5/32 -m comment --comment "kube-system/kube-dns:metrics" -j KUBE-MARK-MASQ

-A KUBE-SEP-FVQSBIWR5JTECIVC -p tcp -m comment --comment "kube-system/kube-dns:metrics" -m tcp -j DNAT --to-destination 10.244.0.5:9153

-A KUBE-SEP-GWMQ2Y7ZXCC5ITOI -s 10.244.0.30/32 -m comment --comment "osm/airflow-statsd:statsd-ingest" -j KUBE-MARK-MASQ

-A KUBE-SEP-GWMQ2Y7ZXCC5ITOI -p udp -m comment --comment "osm/airflow-statsd:statsd-ingest" -m udp -j DNAT --to-destination 10.244.0.30:9125

-A KUBE-SEP-HJ7EWOW62IX6GL6R -s 10.244.0.10/32 -m comment --comment "kube-system/kube-dns:metrics" -j KUBE-MARK-MASQ

-A KUBE-SEP-HJ7EWOW62IX6GL6R -p tcp -m comment --comment "kube-system/kube-dns:metrics" -m tcp -j DNAT --to-destination 10.244.0.10:9153

-A KUBE-SEP-IO5GMPCAE4NCTD57 -s 10.244.0.39/32 -m comment --comment "osm/airflow-redis:redis-db" -j KUBE-MARK-MASQ

-A KUBE-SEP-IO5GMPCAE4NCTD57 -p tcp -m comment --comment "osm/airflow-redis:redis-db" -m tcp -j DNAT --to-destination 10.244.0.39:6379

-A KUBE-SEP-ISHFB2I4PMRIVC6G -s 10.244.0.13/32 -m comment --comment "controller-osm/modeloperator" -j KUBE-MARK-MASQ

-A KUBE-SEP-ISHFB2I4PMRIVC6G -p tcp -m comment --comment "controller-osm/modeloperator" -m tcp -j DNAT --to-destination 10.244.0.13:17071

-A KUBE-SEP-K5ETGAT6VOT2SO74 -s 10.244.0.45/32 -m comment --comment "osm/alertmanager:http" -j KUBE-MARK-MASQ

-A KUBE-SEP-K5ETGAT6VOT2SO74 -p tcp -m comment --comment "osm/alertmanager:http" -m tcp -j DNAT --to-destination 10.244.0.45:9093

-A KUBE-SEP-LASJGFFJP3UOS6RQ -s 10.244.0.5/32 -m comment --comment "kube-system/kube-dns:dns-tcp" -j KUBE-MARK-MASQ

-A KUBE-SEP-LASJGFFJP3UOS6RQ -p tcp -m comment --comment "kube-system/kube-dns:dns-tcp" -m tcp -j DNAT --to-destination 10.244.0.5:53

-A KUBE-SEP-LPGSDLJ3FDW46N4W -s 10.244.0.5/32 -m comment --comment "kube-system/kube-dns:dns" -j KUBE-MARK-MASQ

-A KUBE-SEP-LPGSDLJ3FDW46N4W -p udp -m comment --comment "kube-system/kube-dns:dns" -m udp -j DNAT --to-destination 10.244.0.5:53

-A KUBE-SEP-MD73VJOVN7ABXUHC -s 10.244.0.14/32 -m comment --comment "osm/modeloperator" -j KUBE-MARK-MASQ

-A KUBE-SEP-MD73VJOVN7ABXUHC -p tcp -m comment --comment "osm/modeloperator" -m tcp -j DNAT --to-destination 10.244.0.14:17071

-A KUBE-SEP-MZ4ZQS46JTVFQNMO -s 172.21.248.73/32 -m comment --comment "default/kubernetes:https" -j KUBE-MARK-MASQ

-A KUBE-SEP-MZ4ZQS46JTVFQNMO -p tcp -m comment --comment "default/kubernetes:https" -m tcp -j DNAT --to-destination 172.21.248.73:6443

-A KUBE-SEP-OP4AXEAS4OXHBEQX -s 10.244.0.10/32 -m comment --comment "kube-system/kube-dns:dns-tcp" -j KUBE-MARK-MASQ

-A KUBE-SEP-OP4AXEAS4OXHBEQX -p tcp -m comment --comment "kube-system/kube-dns:dns-tcp" -m tcp -j DNAT --to-destination 10.244.0.10:53

-A KUBE-SEP-OPH4JJMJB5UPXJLN -s 10.244.0.25/32 -m comment --comment "osm/nbi" -j KUBE-MARK-MASQ

-A KUBE-SEP-OPH4JJMJB5UPXJLN -p tcp -m comment --comment "osm/nbi" -m tcp -j DNAT --to-destination 10.244.0.25:9999

-A KUBE-SEP-PTWV2T2EKTG677AU -s 10.244.0.15/32 -m comment --comment "osm/webhook-translator" -j KUBE-MARK-MASQ

-A KUBE-SEP-PTWV2T2EKTG677AU -p tcp -m comment --comment "osm/webhook-translator" -m tcp -j DNAT --to-destination 10.244.0.15:9998

-A KUBE-SEP-QTEADDRAHUZGD5RY -s 10.244.0.12/32 -m comment --comment "controller-osm/controller-service:api-server" -j KUBE-MARK-MASQ

-A KUBE-SEP-QTEADDRAHUZGD5RY -p tcp -m comment --comment "controller-osm/controller-service:api-server" -m tcp -j DNAT --to-destination 10.244.0.12:17070

-A KUBE-SEP-R7EMXN5TTQQVP4UW -s 10.244.0.10/32 -m comment --comment "kube-system/kube-dns:dns" -j KUBE-MARK-MASQ

-A KUBE-SEP-R7EMXN5TTQQVP4UW -p udp -m comment --comment "kube-system/kube-dns:dns" -m udp -j DNAT --to-destination 10.244.0.10:53

-A KUBE-SEP-SNBC75DWVTB4NYRD -s 10.244.0.7/32 -m comment --comment "cert-manager/cert-manager-webhook:https" -j KUBE-MARK-MASQ

-A KUBE-SEP-SNBC75DWVTB4NYRD -p tcp -m comment --comment "cert-manager/cert-manager-webhook:https" -m tcp -j DNAT --to-destination 10.244.0.7:10250

-A KUBE-SEP-XB7L2DO3RPDK4ADW -s 10.244.0.28/32 -m comment --comment "osm/airflow-webserver:airflow-ui" -j KUBE-MARK-MASQ

-A KUBE-SEP-XB7L2DO3RPDK4ADW -p tcp -m comment --comment "osm/airflow-webserver:airflow-ui" -m tcp -j DNAT --to-destination 10.244.0.28:8080

-A KUBE-SEP-XZVNOPGBKFOKTOOW -s 10.244.0.4/32 -m comment --comment "metallb-system/metallb-webhook-service" -j KUBE-MARK-MASQ

-A KUBE-SEP-XZVNOPGBKFOKTOOW -p tcp -m comment --comment "metallb-system/metallb-webhook-service" -m tcp -j DNAT --to-destination 10.244.0.4:9443

-A KUBE-SERVICES -d 10.106.65.70/32 -p tcp -m comment --comment "osm/ng-ui cluster IP" -j KUBE-SVC-YA74QX5VY2UAABIX

-A KUBE-SERVICES -d 10.102.243.215/32 -p tcp -m comment --comment "osm/prometheus cluster IP" -j KUBE-SVC-MD4PSIBW5SPF2DB3

-A KUBE-SERVICES -d 10.105.142.117/32 -p tcp -m comment --comment "osm/webhook-translator cluster IP" -j KUBE-SVC-XUD4OEZNIHB47KQL

-A KUBE-SERVICES -d 10.96.0.1/32 -p tcp -m comment --comment "default/kubernetes:https cluster IP" -j KUBE-SVC-NPX46M4PTMTKRN6Y

-A KUBE-SERVICES -d 10.96.0.10/32 -p tcp -m comment --comment "kube-system/kube-dns:metrics cluster IP" -j KUBE-SVC-JD5MR3NA4I4DYORP

-A KUBE-SERVICES -d 10.99.221.222/32 -p tcp -m comment --comment "metallb-system/metallb-webhook-service cluster IP" -j KUBE-SVC-GZ25SP4UFGF7SAVL

-A KUBE-SERVICES -d 10.99.46.183/32 -p tcp -m comment --comment "controller-osm/controller-service:api-server cluster IP" -j KUBE-SVC-VTS3SY4BGCZLE3HK

-A KUBE-SERVICES -d 172.21.248.73/32 -p tcp -m comment --comment "controller-osm/controller-service:api-server loadbalancer IP" -j KUBE-EXT-VTS3SY4BGCZLE3HK

-A KUBE-SERVICES -d 10.96.236.169/32 -p tcp -m comment --comment "osm/modeloperator cluster IP" -j KUBE-SVC-TKW2NMFFUMK6R533

-A KUBE-SERVICES -d 10.97.123.255/32 -p tcp -m comment --comment "osm/mongodb-k8s-operator cluster IP" -j KUBE-SVC-ISGVRIWHYABKE5G2

-A KUBE-SERVICES -d 10.102.220.56/32 -p tcp -m comment --comment "osm/airflow-postgresql:tcp-postgresql cluster IP" -j KUBE-SVC-QE77U7R3P7AE7O5U

-A KUBE-SERVICES -d 10.101.110.15/32 -p tcp -m comment --comment "osm/airflow-redis:redis-db cluster IP" -j KUBE-SVC-USIDOZAE2VTXK5OJ

-A KUBE-SERVICES -d 10.97.112.253/32 -p tcp -m comment --comment "osm/pushgateway-prometheus-pushgateway:http cluster IP" -j KUBE-SVC-5QOWUZVRO3UICSLI

-A KUBE-SERVICES -d 10.103.175.241/32 -p udp -m comment --comment "osm/airflow-statsd:statsd-ingest cluster IP" -j KUBE-SVC-O36IMWM6WEZJKHBK

-A KUBE-SERVICES -d 10.105.107.61/32 -p tcp -m comment --comment "osm/mongodb-k8s:mongodb cluster IP" -j KUBE-SVC-ENRSJAVYEHAULETD

-A KUBE-SERVICES -d 10.96.0.10/32 -p udp -m comment --comment "kube-system/kube-dns:dns cluster IP" -j KUBE-SVC-TCOU7JCQXEZGVUNU

-A KUBE-SERVICES -d 10.96.0.10/32 -p tcp -m comment --comment "kube-system/kube-dns:dns-tcp cluster IP" -j KUBE-SVC-ERIFXISQEP7F7OF4

-A KUBE-SERVICES -d 10.103.2.197/32 -p tcp -m comment --comment "cert-manager/cert-manager-webhook:https cluster IP" -j KUBE-SVC-ZUD4L6KQKCHD52W4

-A KUBE-SERVICES -d 10.110.220.219/32 -p tcp -m comment --comment "controller-osm/modeloperator cluster IP" -j KUBE-SVC-YO4WYSW77CAYSOKE

-A KUBE-SERVICES -d 10.105.177.55/32 -p tcp -m comment --comment "osm/nbi cluster IP" -j KUBE-SVC-FQUXG555W5IVIWW3

-A KUBE-SERVICES -d 10.97.250.250/32 -p tcp -m comment --comment "osm/grafana:service cluster IP" -j KUBE-SVC-PQIZCPF63EFIBBJY

-A KUBE-SERVICES -d 10.109.155.244/32 -p tcp -m comment --comment "osm/airflow-webserver:airflow-ui cluster IP" -j KUBE-SVC-BF2LB5WJRBPLA42J

-A KUBE-SERVICES -d 10.104.222.142/32 -p tcp -m comment --comment "osm/alertmanager:http cluster IP" -j KUBE-SVC-GZN4S7ND4PF6YXD6

-A KUBE-SERVICES -d 10.103.175.241/32 -p tcp -m comment --comment "osm/airflow-statsd:statsd-scrape cluster IP" -j KUBE-SVC-TTTQGL2HNUNQKPOG

-A KUBE-SERVICES -m comment --comment "kubernetes service nodeports; NOTE: this must be the last rule in this chain" -m addrtype --dst-type LOCAL -j KUBE-NODEPORTS

-A KUBE-SVC-5QOWUZVRO3UICSLI ! -s 10.244.0.0/16 -d 10.97.112.253/32 -p tcp -m comment --comment "osm/pushgateway-prometheus-pushgateway:http cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-5QOWUZVRO3UICSLI -m comment --comment "osm/pushgateway-prometheus-pushgateway:http -> 10.244.0.43:9091" -j KUBE-SEP-FOB2KBXV2FRZH6LW

-A KUBE-SVC-BF2LB5WJRBPLA42J ! -s 10.244.0.0/16 -d 10.109.155.244/32 -p tcp -m comment --comment "osm/airflow-webserver:airflow-ui cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-BF2LB5WJRBPLA42J -m comment --comment "osm/airflow-webserver:airflow-ui -> 10.244.0.28:8080" -j KUBE-SEP-XB7L2DO3RPDK4ADW

-A KUBE-SVC-ENRSJAVYEHAULETD ! -s 10.244.0.0/16 -d 10.105.107.61/32 -p tcp -m comment --comment "osm/mongodb-k8s:mongodb cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-ENRSJAVYEHAULETD -m comment --comment "osm/mongodb-k8s:mongodb -> 10.244.0.41:27017" -j KUBE-SEP-5TCW6LIAZ6PXMBU3

-A KUBE-SVC-ERIFXISQEP7F7OF4 ! -s 10.244.0.0/16 -d 10.96.0.10/32 -p tcp -m comment --comment "kube-system/kube-dns:dns-tcp cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-ERIFXISQEP7F7OF4 -m comment --comment "kube-system/kube-dns:dns-tcp -> 10.244.0.10:53" -m statistic --mode random --probability 0.50000000000 -j KUBE-SEP-OP4AXEAS4OXHBEQX

-A KUBE-SVC-ERIFXISQEP7F7OF4 -m comment --comment "kube-system/kube-dns:dns-tcp -> 10.244.0.5:53" -j KUBE-SEP-LASJGFFJP3UOS6RQ

-A KUBE-SVC-FQUXG555W5IVIWW3 ! -s 10.244.0.0/16 -d 10.105.177.55/32 -p tcp -m comment --comment "osm/nbi cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-FQUXG555W5IVIWW3 -m comment --comment "osm/nbi -> 10.244.0.25:9999" -j KUBE-SEP-OPH4JJMJB5UPXJLN

-A KUBE-SVC-GZ25SP4UFGF7SAVL ! -s 10.244.0.0/16 -d 10.99.221.222/32 -p tcp -m comment --comment "metallb-system/metallb-webhook-service cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-GZ25SP4UFGF7SAVL -m comment --comment "metallb-system/metallb-webhook-service -> 10.244.0.4:9443" -j KUBE-SEP-XZVNOPGBKFOKTOOW

-A KUBE-SVC-GZN4S7ND4PF6YXD6 ! -s 10.244.0.0/16 -d 10.104.222.142/32 -p tcp -m comment --comment "osm/alertmanager:http cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-GZN4S7ND4PF6YXD6 -m comment --comment "osm/alertmanager:http -> 10.244.0.45:9093" -j KUBE-SEP-K5ETGAT6VOT2SO74

-A KUBE-SVC-ISGVRIWHYABKE5G2 ! -s 10.244.0.0/16 -d 10.97.123.255/32 -p tcp -m comment --comment "osm/mongodb-k8s-operator cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-ISGVRIWHYABKE5G2 -m comment --comment "osm/mongodb-k8s-operator -> 10.244.0.36:30666" -j KUBE-SEP-4LIA3Y34QCXKCG3N

-A KUBE-SVC-JD5MR3NA4I4DYORP ! -s 10.244.0.0/16 -d 10.96.0.10/32 -p tcp -m comment --comment "kube-system/kube-dns:metrics cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-JD5MR3NA4I4DYORP -m comment --comment "kube-system/kube-dns:metrics -> 10.244.0.10:9153" -m statistic --mode random --probability 0.50000000000 -j KUBE-SEP-HJ7EWOW62IX6GL6R

-A KUBE-SVC-JD5MR3NA4I4DYORP -m comment --comment "kube-system/kube-dns:metrics -> 10.244.0.5:9153" -j KUBE-SEP-FVQSBIWR5JTECIVC

-A KUBE-SVC-MD4PSIBW5SPF2DB3 ! -s 10.244.0.0/16 -d 10.102.243.215/32 -p tcp -m comment --comment "osm/prometheus cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-MD4PSIBW5SPF2DB3 -m comment --comment "osm/prometheus -> 10.244.0.22:9090" -j KUBE-SEP-AENM4W7JPZLDGIAD

-A KUBE-SVC-NPX46M4PTMTKRN6Y ! -s 10.244.0.0/16 -d 10.96.0.1/32 -p tcp -m comment --comment "default/kubernetes:https cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-NPX46M4PTMTKRN6Y -m comment --comment "default/kubernetes:https -> 172.21.248.73:6443" -j KUBE-SEP-MZ4ZQS46JTVFQNMO

-A KUBE-SVC-O36IMWM6WEZJKHBK ! -s 10.244.0.0/16 -d 10.103.175.241/32 -p udp -m comment --comment "osm/airflow-statsd:statsd-ingest cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-O36IMWM6WEZJKHBK -m comment --comment "osm/airflow-statsd:statsd-ingest -> 10.244.0.30:9125" -j KUBE-SEP-GWMQ2Y7ZXCC5ITOI

-A KUBE-SVC-PQIZCPF63EFIBBJY ! -s 10.244.0.0/16 -d 10.97.250.250/32 -p tcp -m comment --comment "osm/grafana:service cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-PQIZCPF63EFIBBJY -m comment --comment "osm/grafana:service -> 10.244.0.18:3000" -j KUBE-SEP-22L6GZVKJQ7YNV5X

-A KUBE-SVC-QE77U7R3P7AE7O5U ! -s 10.244.0.0/16 -d 10.102.220.56/32 -p tcp -m comment --comment "osm/airflow-postgresql:tcp-postgresql cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-QE77U7R3P7AE7O5U -m comment --comment "osm/airflow-postgresql:tcp-postgresql -> 10.244.0.37:5432" -j KUBE-SEP-6KM2F4K4I7A2VM2U

-A KUBE-SVC-TCOU7JCQXEZGVUNU ! -s 10.244.0.0/16 -d 10.96.0.10/32 -p udp -m comment --comment "kube-system/kube-dns:dns cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-TCOU7JCQXEZGVUNU -m comment --comment "kube-system/kube-dns:dns -> 10.244.0.10:53" -m statistic --mode random --probability 0.50000000000 -j KUBE-SEP-R7EMXN5TTQQVP4UW

-A KUBE-SVC-TCOU7JCQXEZGVUNU -m comment --comment "kube-system/kube-dns:dns -> 10.244.0.5:53" -j KUBE-SEP-LPGSDLJ3FDW46N4W

-A KUBE-SVC-TKW2NMFFUMK6R533 ! -s 10.244.0.0/16 -d 10.96.236.169/32 -p tcp -m comment --comment "osm/modeloperator cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-TKW2NMFFUMK6R533 -m comment --comment "osm/modeloperator -> 10.244.0.14:17071" -j KUBE-SEP-MD73VJOVN7ABXUHC

-A KUBE-SVC-TTTQGL2HNUNQKPOG ! -s 10.244.0.0/16 -d 10.103.175.241/32 -p tcp -m comment --comment "osm/airflow-statsd:statsd-scrape cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-TTTQGL2HNUNQKPOG -m comment --comment "osm/airflow-statsd:statsd-scrape -> 10.244.0.30:9102" -j KUBE-SEP-3E6H# Warning: iptables-legacy tables present, use iptables-legacy-save to see them

OAZVYXQ2ZDB3

-A KUBE-SVC-USIDOZAE2VTXK5OJ ! -s 10.244.0.0/16 -d 10.101.110.15/32 -p tcp -m comment --comment "osm/airflow-redis:redis-db cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-USIDOZAE2VTXK5OJ -m comment --comment "osm/airflow-redis:redis-db -> 10.244.0.39:6379" -j KUBE-SEP-IO5GMPCAE4NCTD57

-A KUBE-SVC-VTS3SY4BGCZLE3HK ! -s 10.244.0.0/16 -d 10.99.46.183/32 -p tcp -m comment --comment "controller-osm/controller-service:api-server cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-VTS3SY4BGCZLE3HK -m comment --comment "controller-osm/controller-service:api-server -> 10.244.0.12:17070" -j KUBE-SEP-QTEADDRAHUZGD5RY

-A KUBE-SVC-XUD4OEZNIHB47KQL ! -s 10.244.0.0/16 -d 10.105.142.117/32 -p tcp -m comment --comment "osm/webhook-translator cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-XUD4OEZNIHB47KQL -m comment --comment "osm/webhook-translator -> 10.244.0.15:9998" -j KUBE-SEP-PTWV2T2EKTG677AU

-A KUBE-SVC-YA74QX5VY2UAABIX ! -s 10.244.0.0/16 -d 10.106.65.70/32 -p tcp -m comment --comment "osm/ng-ui cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-YA74QX5VY2UAABIX -m comment --comment "osm/ng-ui -> 10.244.0.24:80" -j KUBE-SEP-5XVCWZLMPM6ZDMAK

-A KUBE-SVC-YO4WYSW77CAYSOKE ! -s 10.244.0.0/16 -d 10.110.220.219/32 -p tcp -m comment --comment "controller-osm/modeloperator cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-YO4WYSW77CAYSOKE -m comment --comment "controller-osm/modeloperator -> 10.244.0.13:17071" -j KUBE-SEP-ISHFB2I4PMRIVC6G

-A KUBE-SVC-ZUD4L6KQKCHD52W4 ! -s 10.244.0.0/16 -d 10.103.2.197/32 -p tcp -m comment --comment "cert-manager/cert-manager-webhook:https cluster IP" -j KUBE-MARK-MASQ

-A KUBE-SVC-ZUD4L6KQKCHD52W4 -m comment --comment "cert-manager/cert-manager-webhook:https -> 10.244.0.7:10250" -j KUBE-SEP-SNBC75DWVTB4NYRD

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

# Warning: ip6tables-legacy tables present, use ip6tables-legacy-save to see them

# Generated by ip6tables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*mangle

:PREROUTING ACCEPT [0:0]

:INPUT ACCEPT [0:0]

:FORWARD ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:POSTROUTING ACCEPT [0:0]

:KUBE-IPTABLES-HINT - [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-PROXY-CANARY - [0:0]

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

# Generated by ip6tables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*filter

:INPUT ACCEPT [0:0]

:FORWARD ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:KUBE-EXTERNAL-SERVICES - [0:0]

:KUBE-FIREWALL - [0:0]

:KUBE-FORWARD - [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-NODEPORTS - [0:0]

:KUBE-PROXY-CANARY - [0:0]

:KUBE-PROXY-FIREWALL - [0:0]

:KUBE-SERVICES - [0:0]

-A INPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A INPUT -m comment --comment "kubernetes health check service ports" -j KUBE-NODEPORTS

-A INPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes externally-visible service portals" -j KUBE-EXTERNAL-SERVICES

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A FORWARD -m comment --comment "kubernetes forwarding rules" -j KUBE-FORWARD

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A FORWARD -m conntrack --ctstate NEW -m comment --comment "kubernetes externally-visible service portals" -j KUBE-EXTERNAL-SERVICES

-A OUTPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes load balancer firewall" -j KUBE-PROXY-FIREWALL

-A OUTPUT -m conntrack --ctstate NEW -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A KUBE-FIREWALL -m comment --comment "kubernetes firewall for dropping marked packets" -m mark --mark 0x8000/0x8000 -j DROP

-A KUBE-FORWARD -m conntrack --ctstate INVALID -j DROP

-A KUBE-FORWARD -m comment --comment "kubernetes forwarding rules" -j ACCEPT

-A KUBE-FORWARD -m comment --comment "kubernetes forwarding conntrack rule" -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

# Generated by ip6tables-save v1.8.7 on Wed Apr  3 22:30:53 2024

*nat

:PREROUTING ACCEPT [0:0]

:INPUT ACCEPT [0:0]

:OUTPUT ACCEPT [0:0]

:POSTROUTING ACCEPT [0:0]

:KUBE-KUBELET-CANARY - [0:0]

:KUBE-MARK-DROP - [0:0]

:KUBE-MARK-MASQ - [0:0]

:KUBE-NODEPORTS - [0:0]

:KUBE-POSTROUTING - [0:0]

:KUBE-PROXY-CANARY - [0:0]

:KUBE-SERVICES - [0:0]

-A PREROUTING -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A OUTPUT -m comment --comment "kubernetes service portals" -j KUBE-SERVICES

-A POSTROUTING -m comment --comment "kubernetes postrouting rules" -j KUBE-POSTROUTING

-A KUBE-MARK-DROP -j MARK --set-xmark 0x8000/0x8000

-A KUBE-MARK-MASQ -j MARK --set-xmark 0x4000/0x4000

-A KUBE-POSTROUTING -j RETURN

-A KUBE-POSTROUTING -j MARK --set-xmark 0x4000/0x0

-A KUBE-POSTROUTING -m comment --comment "kubernetes service traffic requiring SNAT" -j MASQUERADE --random-fully

-A KUBE-SERVICES ! -d ::1/128 -m comment --comment "kubernetes service nodeports; NOTE: this must be the last rule in this chain" -m addrtype --dst-type LOCAL -j KUBE-NODEPORTS

COMMIT

# Completed on Wed Apr  3 22:30:53 2024

Track end end: https://osm.etsi.org/InstallLog.php?&installation_id=1712182595-bThgT9XVfh4CdfjF&local_ts=1712183453&event=end&operation=end&value=&comment=&tags=
/etc/osm
/etc/osm/kubeadm-config.yaml
/etc/osm/helm
/etc/osm/helm/osm-values.yaml
/etc/osm/helm/airflow-values.yaml
/etc/osm/helm/alertmanager-values.yaml
/etc/osm/metallb-ipaddrpool.yaml

DONE
Success command osm-v140-merge-286#1686: 
                                ./install_osm.sh -y                                     -u http://172.21.249.4:41577                                     -k pubkey.asc                                     -R release -r unstable                                     -d ****:****@osm.etsi.org:5050/devops/cicd/                                     -p http://172.21.1.1:5000                                     -t osm-v140-merge-286                                     
                            
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (OSM Health)
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1687: 
                        /usr/share/osm-devops/installers/osm_health.sh -k -s osm
                    
helm -n osm list
NAME        	NAMESPACE	REVISION	UPDATED                                	STATUS  	CHART                        	APP VERSION
airflow     	osm      	1       	2024-04-03 22:22:05.14933441 +0000 UTC 	deployed	airflow-1.9.0                	2.5.3      
alertmanager	osm      	1       	2024-04-03 22:25:16.970328445 +0000 UTC	deployed	alertmanager-0.22.0          	v0.24.0    
osm         	osm      	1       	2024-04-03 22:22:00.083857034 +0000 UTC	deployed	osm-0.0.1                    	14         
pushgateway 	osm      	1       	2024-04-03 22:25:11.371724962 +0000 UTC	deployed	prometheus-pushgateway-1.18.2	1.4.2      
helm -n osm status osm
NAME: osm
LAST DEPLOYED: Wed Apr  3 22:22:00 2024
NAMESPACE: osm
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
1. Get the application URL by running these commands:
  export NODE_PORT=$(kubectl get --namespace osm -o jsonpath="{.spec.ports[0].nodePort}" services nbi)
  export NODE_IP=$(kubectl get nodes --namespace osm -o jsonpath="{.items[0].status.addresses[0].address}")
  echo http://$NODE_IP:$NODE_PORT
===> Successful checks: 1/24
===> Successful checks: 2/24
===> Successful checks: 3/24
===> Successful checks: 4/24
===> Successful checks: 5/24
===> Successful checks: 6/24
===> Successful checks: 7/24
===> Successful checks: 8/24
===> Successful checks: 9/24
===> Successful checks: 10/24
===> Successful checks: 11/24
===> Successful checks: 12/24
===> Successful checks: 13/24
===> Successful checks: 14/24
===> Successful checks: 15/24
===> Successful checks: 16/24
===> Successful checks: 17/24
===> Successful checks: 18/24
===> Successful checks: 19/24
===> Successful checks: 20/24
===> Successful checks: 21/24
===> Successful checks: 22/24
===> Successful checks: 23/24
===> Successful checks: 24/24

SYSTEM IS READY
Success command osm-v140-merge-286#1687: 
                        /usr/share/osm-devops/installers/osm_health.sh -k -s osm
                    
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (System Integration Test)
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1688: 
                            echo `juju gui 2>&1 | grep password | cut -d: -f2`
                        
38095f2735236f80fba722b06f95b624
Success command osm-v140-merge-286#1688: 
                            echo `juju gui 2>&1 | grep password | cut -d: -f2`
                        
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sh
[osm-devops] Running shell script
+ mktemp -d
[Pipeline] sh
[osm-devops] Running shell script
+ docker run --env OSM_HOSTNAME=172.21.248.73 --env PROMETHEUS_HOSTNAME=172.21.248.73 --env PROMETHEUS_PORT=9091 --env JUJU_PASSWORD=38095f2735236f80fba722b06f95b624 --env-file /home/jenkins/hive/robot-systest.cfg -v /home/jenkins/hive/clouds.yaml:/etc/openstack/clouds.yaml -v /home/jenkins/hive/cicd_rsa:/root/osm_id_rsa -v /home/jenkins/hive/kubeconfig.yaml:/root/.kube/config -v /tmp/tmp.BSemEryRpn:/robot-systest/reports -v /home/jenkins/hive/port-mapping-etsi-vim.yaml:/root/port-mapping.yaml opensourcemano/tests:osm-v140-merge-286 -c -t daily

2024-04-03_22:33:08 Creating VIM osm
0540373a-0aa2-4524-8406-f67f8a6c2758
VIM status: | osm | 0540373a-0aa2-4524-8406-f67f8a6c2758 | admin | ENABLED | N/A |
e2152827-0a65-4ce0-9dc1-cfeb3381d4fb
Checking status of SDNC sdnc-osm to see if it is enabled
SDNC enabled
Checking status of VIM osm to see if there is port-mapping
|                 |   "sdn-port-mapping": [                                     |
Port-mapping correctly added

2024-04-03_22:33:26 Creating K8s Cluster
03418462-dbaa-428c-a120-a006c8cac130
K8s cluster stuck for more than 50 seconds:
+----------------+------------------------------------------------------------------------------------------------------+
| key            | attribute                                                                                            |
+----------------+------------------------------------------------------------------------------------------------------+
| _id            | "03418462-dbaa-428c-a120-a006c8cac130"                                                               |
| name           | "osm"                                                                                                |
| credentials    | {                                                                                                    |
|                |   "apiVersion": "v1",                                                                                |
|                |   "clusters": [                                                                                      |
|                |     {                                                                                                |
|                |       "cluster": {                                                                                   |
|                |         "certificate-authority-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ |
|                | 0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EY3dOekl5TlRrM |
|                | U9Gb1hEVE15TURjd05ESXlOVGsxT0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BU |
|                | UVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTFVDCjdXUkFZTU90SmJ1U1loQ2FrVDZ3VUdKZEtZdUdRb29xd3F5WStnRW8yU1RnZEhPZ |
|                | EdpZzVJMjF3cG9tdFV1V2sKREhmZUJHMHIvRGkvUHdML3VEb0tqUFVvdU5JdTBYc1FTYXIrOGNMTkdWSDczSnBJcWRaZDVEREthd |
|                | WFacU9ONQovdlJjdVBiWHdLNldkRmdldDB3RWQycVlKQytmNk9Dcm5oUnlSOGJvWVdxZ2kvNzhNSHFwMERNQ0I4TDFHRHVmCjdJV |
|                | EFodUtBaUM1a2llQ1NzY1cwT0NVdTZPazdCVTZVc3dhd2phRVlWbUVkS0Flb0o2UWNGTHBnWkFvdDA2aFIKYlRqTmNkLzdLRDNCZ |
|                | VJWc3QycGZqL2lQdlVXaDBiR1VWREZDRXV1UC9VTUNRdHZ6SWVIUEhZamtjNkZYSldWSwpyZGk5bGNuV1FRSlVJVENLcFlzQ0F3R |
|                | UFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQMGRZVzdhV |
|                | VlMZ0dpNk53aW1iV3llUWh0bjZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnR |
|                | UJBQVBoNGhOUGlPUlZVZXQzRXgwTgpHekNUM1Q1OUtzMHFaa0JUMnpkM29qc0tsUS9LTS85TzJEa2YzdElnbkV6ZWlIdlMzUExTa |
|                | TZkaDhISzE3MlNQCnMyUy95bW5nTWZMMlkyYU85ZTA2L3B1NEFvUG56c2ZSOFhzNnVXc2N5UkdVbXNMcjR5eVBFaythL0F4OXcxS |
|                | 2MKeHFQZDB2bXo4OVZMVHFHb2hjZVJKcmVkMU1RcnNnMnMzR1pzRDU4MVRpVlI0bGQ3VlpNSnpGM01Wa3hOazNnagp6dm5SQU01M |
|                | HhPdmx1ek9ZVHo5aEthRjk0QTVta2pzck02ZStmdHN0dEpzQWduWnpIVHlaUFFkYW9TTE9YeWx6CnY2VGhrYjZvLzFXWjVTQjMrc |
|                | CttRlJYYmN4UC9tS04zNktiem5UOWJpVlJTRkVXcWswTmdHdUZiNDBvNkJLM3gKckFRPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tL |
|                | S0tCg==",                                                                                            |
|                |         "server": "https://172.21.248.125:6443"                                                      |
|                |       },                                                                                             |
|                |       "name": "cluster.local"                                                                        |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "contexts": [                                                                                      |
|                |     {                                                                                                |
|                |       "context": {                                                                                   |
|                |         "cluster": "cluster.local",                                                                  |
|                |         "user": "kubernetes-admin"                                                                   |
|                |       },                                                                                             |
|                |       "name": "kubernetes-admin@cluster.local"                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current-context": "kubernetes-admin@cluster.local",                                               |
|                |   "kind": "Config",                                                                                  |
|                |   "preferences": {},                                                                                 |
|                |   "users": [                                                                                         |
|                |     {                                                                                                |
|                |       "name": "kubernetes-admin",                                                                    |
|                |       "user": {                                                                                      |
|                |         "client-certificate-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURJVENDQWdtZ0F3SUJBZ0lJ |
|                | RlhiYW9UR0N5cGN3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TWpBM01E |
|                | Y3lNalU1TlRoYUZ3MHlOREEwTURJeU1qSTFORFZhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lE |
|                | VlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXZv |
|                | ZVNEL2d5MGNhZDZxNm0KNEptL01qNHRKTFp4amQ0OFlFenF3YUwxcS9OREFSaDl6ZDJnS1pVMnFtUW1Ub3E3QWFIWEg4bkZqRklt |
|                | Y3R6bgpGckF1MURtR05IdGZhRTJPQlBtNlVPZGtmUjM4eUhsd3pWWFk2d1ZPdGoyOUJrOG5lNE1FcXE4NHlQUFloNlFXCngwaHRJ |
|                | c2RLeG1kc3R4VGlwTVBDd3NYWjdIRnIwdVg0UEJPUys4RGpLYWpjOURRYS8xYUJjQW5xRjZyalVvZVoKb3BNcWZRbHFmMjFGNGtK |
|                | VmNmRXprY094S3E5MFBXbVl5dnNPdThiWEdyeEI0ZHpSY1hDdE5iV1diSVlsTjlodwppbVBORHJQY3BUVk9saXhHMU0yaFBQOGdV |
|                | WUt2M1VycTB6aElzU3NMZ3Z1MFpSckFEODNVeThJL0gyZm90NXRhCi85MmN0UUlEQVFBQm8xWXdWREFPQmdOVkhROEJBZjhFQkFN |
|                | Q0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RBWURWUjBUQVFIL0JBSXdBREFmQmdOVkhTTUVHREFXZ0JUOUhXRnUy |
|                | bEdDNEJvdWpjSXBtMXNua0liWgorakFOQmdrcWhraUc5dzBCQVFzRkFBT0NBUUVBUW9BZmF1RTI1RTZxN0M5YTI3ZkViQnByUkhs |
|                | Qnd2ZVhFbzZWCk82ZDNFaS9WcGtxcjlJVlhLOW9HZ2duUkg1cExlVFdGSXJPVmFyaEtSZlF5TTlqWU9hYS9vajVoeUNkdElVMzMK |
|                | SnBGRXRsWW5nNzZQRXgxVW16M3Z3Q2VkMzU4aGdvRW91R0lkSWtYNm41RUZvZStMYnVjdWxnSHBNeWNxRWxVcwpsdHF4cEhPNlh5 |
|                | bWdSekd0V0ZnMVo3V0YrcDhNQi85aVpoWFc4dkpGb1p1OURhWnVyZFlnOUo3a0xZNkU5MkNaClNXeDJ2c2d5dG5iUHlReWhnbFoy |
|                | OEduZHhZek9jZW50VkNQK25ib1FralBkQXRWQXVzWkhIdlEvUCs2aUNsQ3IKM0NoOExvSzQ5d3hCL2RaMVFrbjF5dVBOQnJRSzFH |
|                | QkpLaDFWOGltRmlRbUM4bllGVlE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",                               |
|                |         "client-key-data": "LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb2dJQkFBS0NBUUVBdm9lU0Qv |
|                | Z3kwY2FkNnE2bTRKbS9NajR0SkxaeGpkNDhZRXpxd2FMMXEvTkRBUmg5CnpkMmdLWlUycW1RbVRvcTdBYUhYSDhuRmpGSW1jdHpu |
|                | RnJBdTFEbUdOSHRmYUUyT0JQbTZVT2RrZlIzOHlIbHcKelZYWTZ3Vk90ajI5Qms4bmU0TUVxcTg0eVBQWWg2UVd4MGh0SXNkS3ht |
|                | ZHN0eFRpcE1QQ3dzWFo3SEZyMHVYNApQQk9TKzhEakthamM5RFFhLzFhQmNBbnFGNnJqVW9lWm9wTXFmUWxxZjIxRjRrSlZjZkV6 |
|                | a2NPeEtxOTBQV21ZCnl2c091OGJYR3J4QjRkelJjWEN0TmJXV2JJWWxOOWh3aW1QTkRyUGNwVFZPbGl4RzFNMmhQUDhnVVlLdjNV |
|                | cnEKMHpoSXNTc0xndnUwWlJyQUQ4M1V5OEkvSDJmb3Q1dGEvOTJjdFFJREFRQUJBb0lCQUM1czJGRmQxL3czbWtrUgo3NFd3ME43 |
|                | TU9iSEZadHY3dDloN1JZU1RVYXRwWmYxQlczNHJMNWlTVERTdW5JcnMwTzV2NGZ4VDdQZnBHSWRLCmZtQ1A0NGxBend2QXVCbXhO |
|                | QmJRUnU3cHd4bWRrZmZEWjVJUkJmOFdWdnlmQkkwaUFtdmRHK2ovTXlYOEROblkKU05pY05FT1NMZzAwTEZCY0hYR3FaYTJTQ2l6 |
|                | TGRxbEJNcmF1QTNTVng3VzA5YmVMZldCZlNQMlh3Y1NaSUg1UQphaE4xd2xxN3N2UG53dWMrUWJuWmxZa1dHUWdXOWQyRnowZ3Fw |
|                | SUZ2ODN1Qkp3TkovajlGSFU3Ym1NUmludkxsCmpxK2RVQ2IwYlF0R2M1QWNXT2NibUtnNmhHcEF2NytqVDRKcUw0a3dWSlIwbk5o |
|                | VTBSM3VlWHl0QjU3WDBqenMKM2lyMEN5MENnWUVBM3U3Q3o5KytuNitjbGV2NVYwcDZualZIcm1zS211eGtZakZQRWdDc2gwUSs4 |
|                | UlZ1T2pjagpyRm1xbVRsemdwY2ViOXNBai9GWkN2d1NxYWVUYlpBSkJoVE1oSFByZ2t1MWIybjFnL3lzWCtzOFp5UVppZHJUCkI3 |
|                | aGhtRHZNT2Y5K3J2QWUrQWZYemhWMXZ4UVZraWU3bmVwbkNnc3Q0ZUJkLzMzS3dHNWZTVThDZ1lFQTJzcGsKeWhGa0dQb1ROVGYz |
|                | eEc2NkdRL3hWbDBzRkFaWGJvYlR3SmZCZ3p0akdGSDhmK3owN3FMSGVHMjBXNjlRL1dNYQoxcE85R0tzSVQxRHdaRW1hY1ZQRk1L |
|                | RHhlUk40b1ZNRUtjSGx5cms4VGUydHpFb2JUV01zMUJiR0drUEM2dUNtCmhRQ0tidG41bURjbjU0VFQxUktpdmRBU3c2L1BaWGg2 |
|                | Zy9lbjhMc0NnWUJnZXY2T3ptdUdXbzh2QnhnN0lmMmQKT0x2VURYbGlnUW9Vd1BoU2R6NHpzR0o1SGVnOWc1Mkp1cWl0ZFlLN01z |
|                | RzJjUloyTldKdThaYjJHNU1mYUtXdgpIeE5BQTVjYUpiL1kvd2VGWHJZUE1SUk1Jd0IyZStDMng2SmRLd3dBMGNVMjJxN2NjekIv |
|                | ZlNRZlZRYmM0UnMrCmhiS2dVeVJCVEVRQ0RhUFEwak9rMndLQmdGN3JEMjdhdktKWlc1dnEvQUtzUnZBNGltcjlZUElQRGo5Vkh1 |
|                | aWUKN2NVUkxweU9kUXpLc0RnWFJwSm9oYWFCR0pIVlBQOTZlTDhLOUQvMHpWVzAyTnZ4aThyZEIrV1BIUFpnSFo1QQpFSUV5ZTRj |
|                | VFppTUt3MjEvYVNOWi9mZkhEZmo0SFVYMlJoaHhXR2RCQm43YWtVd1BHYXRmYWNTYnNVNUVSbUthClByR2hBb0dBVEJkc1crTzhh |
|                | Snd6YnJlZ2Qwd2U5cDFobHd6bFZyZEwyTWNvTlNLL2FpTi9QbURRUERoYVZxamsKaGhWQm5KazB1eFVZeUFxL2dYOW1yMnV4NDc1 |
|                | SzZmTHp6b25EYnRoTWJxbDNnMVBMMjFJMjFSVytZWE9JQ3NEbAptaG9YemVYSW84WXJpQTBvRDcrZEk0TU9rUUM0Wndvd3hwS2o0 |
|                | YUVRaTIvVm9xTnZPRUk9Ci0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg=="                                    |
|                |       }                                                                                              |
|                |     }                                                                                                |
|                |   ]                                                                                                  |
|                | }                                                                                                    |
| k8s_version    | "v1"                                                                                                 |
| vim_account    | "0540373a-0aa2-4524-8406-f67f8a6c2758"                                                               |
| nets           | {                                                                                                    |
|                |   "net1": "osm-ext"                                                                                  |
|                | }                                                                                                    |
| description    | "Robot cluster"                                                                                      |
| namespace      | "kube-system"                                                                                        |
| _admin         | {                                                                                                    |
|                |   "created": 1712183608.174133,                                                                      |
|                |   "modified": 1712183613.2675562,                                                                    |
|                |   "projects_read": [                                                                                 |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "projects_write": [                                                                                |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "operationalState": "DEGRADED",                                                                    |
|                |   "operations": [                                                                                    |
|                |     {                                                                                                |
|                |       "lcmOperationType": "create",                                                                  |
|                |       "operationState": "COMPLETED",                                                                 |
|                |       "startTime": 1712183608.1741745,                                                               |
|                |       "statusEnteredTime": 1712183608.1741745,                                                       |
|                |       "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:          |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'af587a2d-430a-4310-bc60-99d8026c3132', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:33:28 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:33:28.419338     119 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:33:28.424319     119                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:33:28.426470     119 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:33:28.429335        |
|                | 119 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:33:28.430882     119 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |       "operationParams": null,                                                                       |
|                |       "worker": null                                                                                 |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current_operation": null,                                                                         |
|                |   "helm_chart_repos": [],                                                                            |
|                |   "juju_bundle_repos": [],                                                                           |
|                |   "juju-bundle": {                                                                                   |
|                |     "error_msg": "(401)\nReason: Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':    |
|                | 'af587a2d-430a-4310-bc60-99d8026c3132', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:33:28 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n",                            |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart": {                                                                                    |
|                |     "error_msg": "E0403 22:33:28.419338     119 memcache.go:265] couldn't get current server API     |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:33:28.424319        |
|                | 119 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:33:28.426470     119 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nE0403 22:33:28.429335    |
|                | 119 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:33:28.430882     119 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart-v3": {                                                                                 |
|                |     "created": false,                                                                                |
|                |     "error_msg": null,                                                                               |
|                |     "id": "03418462-dbaa-428c-a120-a006c8cac130",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   },                                                                                                 |
|                |   "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:              |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'af587a2d-430a-4310-bc60-99d8026c3132', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:33:28 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:33:28.419338     119 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:33:28.424319     119                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:33:28.426470     119 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:33:28.429335        |
|                | 119 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:33:28.430882     119 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)"                |
|                | }                                                                                                    |
| schema_version | "1.11"                                                                                               |
+----------------+------------------------------------------------------------------------------------------------------+
Deletion in progress

2024-04-03_22:34:18 Creating K8s Cluster
ce85f685-525f-4134-9262-1880eef346fd
K8s cluster stuck for more than 50 seconds:
+----------------+------------------------------------------------------------------------------------------------------+
| key            | attribute                                                                                            |
+----------------+------------------------------------------------------------------------------------------------------+
| _id            | "ce85f685-525f-4134-9262-1880eef346fd"                                                               |
| name           | "osm"                                                                                                |
| credentials    | {                                                                                                    |
|                |   "apiVersion": "v1",                                                                                |
|                |   "clusters": [                                                                                      |
|                |     {                                                                                                |
|                |       "cluster": {                                                                                   |
|                |         "certificate-authority-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ |
|                | 0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EY3dOekl5TlRrM |
|                | U9Gb1hEVE15TURjd05ESXlOVGsxT0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BU |
|                | UVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTFVDCjdXUkFZTU90SmJ1U1loQ2FrVDZ3VUdKZEtZdUdRb29xd3F5WStnRW8yU1RnZEhPZ |
|                | EdpZzVJMjF3cG9tdFV1V2sKREhmZUJHMHIvRGkvUHdML3VEb0tqUFVvdU5JdTBYc1FTYXIrOGNMTkdWSDczSnBJcWRaZDVEREthd |
|                | WFacU9ONQovdlJjdVBiWHdLNldkRmdldDB3RWQycVlKQytmNk9Dcm5oUnlSOGJvWVdxZ2kvNzhNSHFwMERNQ0I4TDFHRHVmCjdJV |
|                | EFodUtBaUM1a2llQ1NzY1cwT0NVdTZPazdCVTZVc3dhd2phRVlWbUVkS0Flb0o2UWNGTHBnWkFvdDA2aFIKYlRqTmNkLzdLRDNCZ |
|                | VJWc3QycGZqL2lQdlVXaDBiR1VWREZDRXV1UC9VTUNRdHZ6SWVIUEhZamtjNkZYSldWSwpyZGk5bGNuV1FRSlVJVENLcFlzQ0F3R |
|                | UFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQMGRZVzdhV |
|                | VlMZ0dpNk53aW1iV3llUWh0bjZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnR |
|                | UJBQVBoNGhOUGlPUlZVZXQzRXgwTgpHekNUM1Q1OUtzMHFaa0JUMnpkM29qc0tsUS9LTS85TzJEa2YzdElnbkV6ZWlIdlMzUExTa |
|                | TZkaDhISzE3MlNQCnMyUy95bW5nTWZMMlkyYU85ZTA2L3B1NEFvUG56c2ZSOFhzNnVXc2N5UkdVbXNMcjR5eVBFaythL0F4OXcxS |
|                | 2MKeHFQZDB2bXo4OVZMVHFHb2hjZVJKcmVkMU1RcnNnMnMzR1pzRDU4MVRpVlI0bGQ3VlpNSnpGM01Wa3hOazNnagp6dm5SQU01M |
|                | HhPdmx1ek9ZVHo5aEthRjk0QTVta2pzck02ZStmdHN0dEpzQWduWnpIVHlaUFFkYW9TTE9YeWx6CnY2VGhrYjZvLzFXWjVTQjMrc |
|                | CttRlJYYmN4UC9tS04zNktiem5UOWJpVlJTRkVXcWswTmdHdUZiNDBvNkJLM3gKckFRPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tL |
|                | S0tCg==",                                                                                            |
|                |         "server": "https://172.21.248.125:6443"                                                      |
|                |       },                                                                                             |
|                |       "name": "cluster.local"                                                                        |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "contexts": [                                                                                      |
|                |     {                                                                                                |
|                |       "context": {                                                                                   |
|                |         "cluster": "cluster.local",                                                                  |
|                |         "user": "kubernetes-admin"                                                                   |
|                |       },                                                                                             |
|                |       "name": "kubernetes-admin@cluster.local"                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current-context": "kubernetes-admin@cluster.local",                                               |
|                |   "kind": "Config",                                                                                  |
|                |   "preferences": {},                                                                                 |
|                |   "users": [                                                                                         |
|                |     {                                                                                                |
|                |       "name": "kubernetes-admin",                                                                    |
|                |       "user": {                                                                                      |
|                |         "client-certificate-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURJVENDQWdtZ0F3SUJBZ0lJ |
|                | RlhiYW9UR0N5cGN3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TWpBM01E |
|                | Y3lNalU1TlRoYUZ3MHlOREEwTURJeU1qSTFORFZhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lE |
|                | VlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXZv |
|                | ZVNEL2d5MGNhZDZxNm0KNEptL01qNHRKTFp4amQ0OFlFenF3YUwxcS9OREFSaDl6ZDJnS1pVMnFtUW1Ub3E3QWFIWEg4bkZqRklt |
|                | Y3R6bgpGckF1MURtR05IdGZhRTJPQlBtNlVPZGtmUjM4eUhsd3pWWFk2d1ZPdGoyOUJrOG5lNE1FcXE4NHlQUFloNlFXCngwaHRJ |
|                | c2RLeG1kc3R4VGlwTVBDd3NYWjdIRnIwdVg0UEJPUys4RGpLYWpjOURRYS8xYUJjQW5xRjZyalVvZVoKb3BNcWZRbHFmMjFGNGtK |
|                | VmNmRXprY094S3E5MFBXbVl5dnNPdThiWEdyeEI0ZHpSY1hDdE5iV1diSVlsTjlodwppbVBORHJQY3BUVk9saXhHMU0yaFBQOGdV |
|                | WUt2M1VycTB6aElzU3NMZ3Z1MFpSckFEODNVeThJL0gyZm90NXRhCi85MmN0UUlEQVFBQm8xWXdWREFPQmdOVkhROEJBZjhFQkFN |
|                | Q0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RBWURWUjBUQVFIL0JBSXdBREFmQmdOVkhTTUVHREFXZ0JUOUhXRnUy |
|                | bEdDNEJvdWpjSXBtMXNua0liWgorakFOQmdrcWhraUc5dzBCQVFzRkFBT0NBUUVBUW9BZmF1RTI1RTZxN0M5YTI3ZkViQnByUkhs |
|                | Qnd2ZVhFbzZWCk82ZDNFaS9WcGtxcjlJVlhLOW9HZ2duUkg1cExlVFdGSXJPVmFyaEtSZlF5TTlqWU9hYS9vajVoeUNkdElVMzMK |
|                | SnBGRXRsWW5nNzZQRXgxVW16M3Z3Q2VkMzU4aGdvRW91R0lkSWtYNm41RUZvZStMYnVjdWxnSHBNeWNxRWxVcwpsdHF4cEhPNlh5 |
|                | bWdSekd0V0ZnMVo3V0YrcDhNQi85aVpoWFc4dkpGb1p1OURhWnVyZFlnOUo3a0xZNkU5MkNaClNXeDJ2c2d5dG5iUHlReWhnbFoy |
|                | OEduZHhZek9jZW50VkNQK25ib1FralBkQXRWQXVzWkhIdlEvUCs2aUNsQ3IKM0NoOExvSzQ5d3hCL2RaMVFrbjF5dVBOQnJRSzFH |
|                | QkpLaDFWOGltRmlRbUM4bllGVlE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",                               |
|                |         "client-key-data": "LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb2dJQkFBS0NBUUVBdm9lU0Qv |
|                | Z3kwY2FkNnE2bTRKbS9NajR0SkxaeGpkNDhZRXpxd2FMMXEvTkRBUmg5CnpkMmdLWlUycW1RbVRvcTdBYUhYSDhuRmpGSW1jdHpu |
|                | RnJBdTFEbUdOSHRmYUUyT0JQbTZVT2RrZlIzOHlIbHcKelZYWTZ3Vk90ajI5Qms4bmU0TUVxcTg0eVBQWWg2UVd4MGh0SXNkS3ht |
|                | ZHN0eFRpcE1QQ3dzWFo3SEZyMHVYNApQQk9TKzhEakthamM5RFFhLzFhQmNBbnFGNnJqVW9lWm9wTXFmUWxxZjIxRjRrSlZjZkV6 |
|                | a2NPeEtxOTBQV21ZCnl2c091OGJYR3J4QjRkelJjWEN0TmJXV2JJWWxOOWh3aW1QTkRyUGNwVFZPbGl4RzFNMmhQUDhnVVlLdjNV |
|                | cnEKMHpoSXNTc0xndnUwWlJyQUQ4M1V5OEkvSDJmb3Q1dGEvOTJjdFFJREFRQUJBb0lCQUM1czJGRmQxL3czbWtrUgo3NFd3ME43 |
|                | TU9iSEZadHY3dDloN1JZU1RVYXRwWmYxQlczNHJMNWlTVERTdW5JcnMwTzV2NGZ4VDdQZnBHSWRLCmZtQ1A0NGxBend2QXVCbXhO |
|                | QmJRUnU3cHd4bWRrZmZEWjVJUkJmOFdWdnlmQkkwaUFtdmRHK2ovTXlYOEROblkKU05pY05FT1NMZzAwTEZCY0hYR3FaYTJTQ2l6 |
|                | TGRxbEJNcmF1QTNTVng3VzA5YmVMZldCZlNQMlh3Y1NaSUg1UQphaE4xd2xxN3N2UG53dWMrUWJuWmxZa1dHUWdXOWQyRnowZ3Fw |
|                | SUZ2ODN1Qkp3TkovajlGSFU3Ym1NUmludkxsCmpxK2RVQ2IwYlF0R2M1QWNXT2NibUtnNmhHcEF2NytqVDRKcUw0a3dWSlIwbk5o |
|                | VTBSM3VlWHl0QjU3WDBqenMKM2lyMEN5MENnWUVBM3U3Q3o5KytuNitjbGV2NVYwcDZualZIcm1zS211eGtZakZQRWdDc2gwUSs4 |
|                | UlZ1T2pjagpyRm1xbVRsemdwY2ViOXNBai9GWkN2d1NxYWVUYlpBSkJoVE1oSFByZ2t1MWIybjFnL3lzWCtzOFp5UVppZHJUCkI3 |
|                | aGhtRHZNT2Y5K3J2QWUrQWZYemhWMXZ4UVZraWU3bmVwbkNnc3Q0ZUJkLzMzS3dHNWZTVThDZ1lFQTJzcGsKeWhGa0dQb1ROVGYz |
|                | eEc2NkdRL3hWbDBzRkFaWGJvYlR3SmZCZ3p0akdGSDhmK3owN3FMSGVHMjBXNjlRL1dNYQoxcE85R0tzSVQxRHdaRW1hY1ZQRk1L |
|                | RHhlUk40b1ZNRUtjSGx5cms4VGUydHpFb2JUV01zMUJiR0drUEM2dUNtCmhRQ0tidG41bURjbjU0VFQxUktpdmRBU3c2L1BaWGg2 |
|                | Zy9lbjhMc0NnWUJnZXY2T3ptdUdXbzh2QnhnN0lmMmQKT0x2VURYbGlnUW9Vd1BoU2R6NHpzR0o1SGVnOWc1Mkp1cWl0ZFlLN01z |
|                | RzJjUloyTldKdThaYjJHNU1mYUtXdgpIeE5BQTVjYUpiL1kvd2VGWHJZUE1SUk1Jd0IyZStDMng2SmRLd3dBMGNVMjJxN2NjekIv |
|                | ZlNRZlZRYmM0UnMrCmhiS2dVeVJCVEVRQ0RhUFEwak9rMndLQmdGN3JEMjdhdktKWlc1dnEvQUtzUnZBNGltcjlZUElQRGo5Vkh1 |
|                | aWUKN2NVUkxweU9kUXpLc0RnWFJwSm9oYWFCR0pIVlBQOTZlTDhLOUQvMHpWVzAyTnZ4aThyZEIrV1BIUFpnSFo1QQpFSUV5ZTRj |
|                | VFppTUt3MjEvYVNOWi9mZkhEZmo0SFVYMlJoaHhXR2RCQm43YWtVd1BHYXRmYWNTYnNVNUVSbUthClByR2hBb0dBVEJkc1crTzhh |
|                | Snd6YnJlZ2Qwd2U5cDFobHd6bFZyZEwyTWNvTlNLL2FpTi9QbURRUERoYVZxamsKaGhWQm5KazB1eFVZeUFxL2dYOW1yMnV4NDc1 |
|                | SzZmTHp6b25EYnRoTWJxbDNnMVBMMjFJMjFSVytZWE9JQ3NEbAptaG9YemVYSW84WXJpQTBvRDcrZEk0TU9rUUM0Wndvd3hwS2o0 |
|                | YUVRaTIvVm9xTnZPRUk9Ci0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg=="                                    |
|                |       }                                                                                              |
|                |     }                                                                                                |
|                |   ]                                                                                                  |
|                | }                                                                                                    |
| k8s_version    | "v1"                                                                                                 |
| vim_account    | "0540373a-0aa2-4524-8406-f67f8a6c2758"                                                               |
| nets           | {                                                                                                    |
|                |   "net1": "osm-ext"                                                                                  |
|                | }                                                                                                    |
| description    | "Robot cluster"                                                                                      |
| namespace      | "kube-system"                                                                                        |
| _admin         | {                                                                                                    |
|                |   "created": 1712183659.350317,                                                                      |
|                |   "modified": 1712183663.90264,                                                                      |
|                |   "projects_read": [                                                                                 |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "projects_write": [                                                                                |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "operationalState": "DEGRADED",                                                                    |
|                |   "operations": [                                                                                    |
|                |     {                                                                                                |
|                |       "lcmOperationType": "create",                                                                  |
|                |       "operationState": "COMPLETED",                                                                 |
|                |       "startTime": 1712183659.3503494,                                                               |
|                |       "statusEnteredTime": 1712183659.3503494,                                                       |
|                |       "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:          |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'd4a0e041-90db-49ea-9c5f-7bc1ea31bde3', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:34:19 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:34:19.505909     148 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:34:19.513515     148                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:34:19.516862     148 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:34:19.519392        |
|                | 148 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:34:19.521487     148 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |       "operationParams": null,                                                                       |
|                |       "worker": null                                                                                 |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current_operation": null,                                                                         |
|                |   "helm_chart_repos": [],                                                                            |
|                |   "juju_bundle_repos": [],                                                                           |
|                |   "juju-bundle": {                                                                                   |
|                |     "error_msg": "(401)\nReason: Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':    |
|                | 'd4a0e041-90db-49ea-9c5f-7bc1ea31bde3', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:34:19 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n",                            |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart": {                                                                                    |
|                |     "error_msg": "E0403 22:34:19.505909     148 memcache.go:265] couldn't get current server API     |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:34:19.513515        |
|                | 148 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:34:19.516862     148 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nE0403 22:34:19.519392    |
|                | 148 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:34:19.521487     148 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart-v3": {                                                                                 |
|                |     "created": false,                                                                                |
|                |     "error_msg": null,                                                                               |
|                |     "id": "ce85f685-525f-4134-9262-1880eef346fd",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   },                                                                                                 |
|                |   "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:              |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'd4a0e041-90db-49ea-9c5f-7bc1ea31bde3', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:34:19 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:34:19.505909     148 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:34:19.513515     148                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:34:19.516862     148 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:34:19.519392        |
|                | 148 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:34:19.521487     148 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)"                |
|                | }                                                                                                    |
| schema_version | "1.11"                                                                                               |
+----------------+------------------------------------------------------------------------------------------------------+
Deletion in progress

2024-04-03_22:35:10 Creating K8s Cluster
cf4e94ef-3f46-4a27-b563-e5ee76eb7f9c
K8s cluster stuck for more than 50 seconds:
+----------------+------------------------------------------------------------------------------------------------------+
| key            | attribute                                                                                            |
+----------------+------------------------------------------------------------------------------------------------------+
| _id            | "cf4e94ef-3f46-4a27-b563-e5ee76eb7f9c"                                                               |
| name           | "osm"                                                                                                |
| credentials    | {                                                                                                    |
|                |   "apiVersion": "v1",                                                                                |
|                |   "clusters": [                                                                                      |
|                |     {                                                                                                |
|                |       "cluster": {                                                                                   |
|                |         "certificate-authority-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ |
|                | 0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EY3dOekl5TlRrM |
|                | U9Gb1hEVE15TURjd05ESXlOVGsxT0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BU |
|                | UVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTFVDCjdXUkFZTU90SmJ1U1loQ2FrVDZ3VUdKZEtZdUdRb29xd3F5WStnRW8yU1RnZEhPZ |
|                | EdpZzVJMjF3cG9tdFV1V2sKREhmZUJHMHIvRGkvUHdML3VEb0tqUFVvdU5JdTBYc1FTYXIrOGNMTkdWSDczSnBJcWRaZDVEREthd |
|                | WFacU9ONQovdlJjdVBiWHdLNldkRmdldDB3RWQycVlKQytmNk9Dcm5oUnlSOGJvWVdxZ2kvNzhNSHFwMERNQ0I4TDFHRHVmCjdJV |
|                | EFodUtBaUM1a2llQ1NzY1cwT0NVdTZPazdCVTZVc3dhd2phRVlWbUVkS0Flb0o2UWNGTHBnWkFvdDA2aFIKYlRqTmNkLzdLRDNCZ |
|                | VJWc3QycGZqL2lQdlVXaDBiR1VWREZDRXV1UC9VTUNRdHZ6SWVIUEhZamtjNkZYSldWSwpyZGk5bGNuV1FRSlVJVENLcFlzQ0F3R |
|                | UFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQMGRZVzdhV |
|                | VlMZ0dpNk53aW1iV3llUWh0bjZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnR |
|                | UJBQVBoNGhOUGlPUlZVZXQzRXgwTgpHekNUM1Q1OUtzMHFaa0JUMnpkM29qc0tsUS9LTS85TzJEa2YzdElnbkV6ZWlIdlMzUExTa |
|                | TZkaDhISzE3MlNQCnMyUy95bW5nTWZMMlkyYU85ZTA2L3B1NEFvUG56c2ZSOFhzNnVXc2N5UkdVbXNMcjR5eVBFaythL0F4OXcxS |
|                | 2MKeHFQZDB2bXo4OVZMVHFHb2hjZVJKcmVkMU1RcnNnMnMzR1pzRDU4MVRpVlI0bGQ3VlpNSnpGM01Wa3hOazNnagp6dm5SQU01M |
|                | HhPdmx1ek9ZVHo5aEthRjk0QTVta2pzck02ZStmdHN0dEpzQWduWnpIVHlaUFFkYW9TTE9YeWx6CnY2VGhrYjZvLzFXWjVTQjMrc |
|                | CttRlJYYmN4UC9tS04zNktiem5UOWJpVlJTRkVXcWswTmdHdUZiNDBvNkJLM3gKckFRPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tL |
|                | S0tCg==",                                                                                            |
|                |         "server": "https://172.21.248.125:6443"                                                      |
|                |       },                                                                                             |
|                |       "name": "cluster.local"                                                                        |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "contexts": [                                                                                      |
|                |     {                                                                                                |
|                |       "context": {                                                                                   |
|                |         "cluster": "cluster.local",                                                                  |
|                |         "user": "kubernetes-admin"                                                                   |
|                |       },                                                                                             |
|                |       "name": "kubernetes-admin@cluster.local"                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current-context": "kubernetes-admin@cluster.local",                                               |
|                |   "kind": "Config",                                                                                  |
|                |   "preferences": {},                                                                                 |
|                |   "users": [                                                                                         |
|                |     {                                                                                                |
|                |       "name": "kubernetes-admin",                                                                    |
|                |       "user": {                                                                                      |
|                |         "client-certificate-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURJVENDQWdtZ0F3SUJBZ0lJ |
|                | RlhiYW9UR0N5cGN3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TWpBM01E |
|                | Y3lNalU1TlRoYUZ3MHlOREEwTURJeU1qSTFORFZhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lE |
|                | VlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXZv |
|                | ZVNEL2d5MGNhZDZxNm0KNEptL01qNHRKTFp4amQ0OFlFenF3YUwxcS9OREFSaDl6ZDJnS1pVMnFtUW1Ub3E3QWFIWEg4bkZqRklt |
|                | Y3R6bgpGckF1MURtR05IdGZhRTJPQlBtNlVPZGtmUjM4eUhsd3pWWFk2d1ZPdGoyOUJrOG5lNE1FcXE4NHlQUFloNlFXCngwaHRJ |
|                | c2RLeG1kc3R4VGlwTVBDd3NYWjdIRnIwdVg0UEJPUys4RGpLYWpjOURRYS8xYUJjQW5xRjZyalVvZVoKb3BNcWZRbHFmMjFGNGtK |
|                | VmNmRXprY094S3E5MFBXbVl5dnNPdThiWEdyeEI0ZHpSY1hDdE5iV1diSVlsTjlodwppbVBORHJQY3BUVk9saXhHMU0yaFBQOGdV |
|                | WUt2M1VycTB6aElzU3NMZ3Z1MFpSckFEODNVeThJL0gyZm90NXRhCi85MmN0UUlEQVFBQm8xWXdWREFPQmdOVkhROEJBZjhFQkFN |
|                | Q0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RBWURWUjBUQVFIL0JBSXdBREFmQmdOVkhTTUVHREFXZ0JUOUhXRnUy |
|                | bEdDNEJvdWpjSXBtMXNua0liWgorakFOQmdrcWhraUc5dzBCQVFzRkFBT0NBUUVBUW9BZmF1RTI1RTZxN0M5YTI3ZkViQnByUkhs |
|                | Qnd2ZVhFbzZWCk82ZDNFaS9WcGtxcjlJVlhLOW9HZ2duUkg1cExlVFdGSXJPVmFyaEtSZlF5TTlqWU9hYS9vajVoeUNkdElVMzMK |
|                | SnBGRXRsWW5nNzZQRXgxVW16M3Z3Q2VkMzU4aGdvRW91R0lkSWtYNm41RUZvZStMYnVjdWxnSHBNeWNxRWxVcwpsdHF4cEhPNlh5 |
|                | bWdSekd0V0ZnMVo3V0YrcDhNQi85aVpoWFc4dkpGb1p1OURhWnVyZFlnOUo3a0xZNkU5MkNaClNXeDJ2c2d5dG5iUHlReWhnbFoy |
|                | OEduZHhZek9jZW50VkNQK25ib1FralBkQXRWQXVzWkhIdlEvUCs2aUNsQ3IKM0NoOExvSzQ5d3hCL2RaMVFrbjF5dVBOQnJRSzFH |
|                | QkpLaDFWOGltRmlRbUM4bllGVlE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",                               |
|                |         "client-key-data": "LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb2dJQkFBS0NBUUVBdm9lU0Qv |
|                | Z3kwY2FkNnE2bTRKbS9NajR0SkxaeGpkNDhZRXpxd2FMMXEvTkRBUmg5CnpkMmdLWlUycW1RbVRvcTdBYUhYSDhuRmpGSW1jdHpu |
|                | RnJBdTFEbUdOSHRmYUUyT0JQbTZVT2RrZlIzOHlIbHcKelZYWTZ3Vk90ajI5Qms4bmU0TUVxcTg0eVBQWWg2UVd4MGh0SXNkS3ht |
|                | ZHN0eFRpcE1QQ3dzWFo3SEZyMHVYNApQQk9TKzhEakthamM5RFFhLzFhQmNBbnFGNnJqVW9lWm9wTXFmUWxxZjIxRjRrSlZjZkV6 |
|                | a2NPeEtxOTBQV21ZCnl2c091OGJYR3J4QjRkelJjWEN0TmJXV2JJWWxOOWh3aW1QTkRyUGNwVFZPbGl4RzFNMmhQUDhnVVlLdjNV |
|                | cnEKMHpoSXNTc0xndnUwWlJyQUQ4M1V5OEkvSDJmb3Q1dGEvOTJjdFFJREFRQUJBb0lCQUM1czJGRmQxL3czbWtrUgo3NFd3ME43 |
|                | TU9iSEZadHY3dDloN1JZU1RVYXRwWmYxQlczNHJMNWlTVERTdW5JcnMwTzV2NGZ4VDdQZnBHSWRLCmZtQ1A0NGxBend2QXVCbXhO |
|                | QmJRUnU3cHd4bWRrZmZEWjVJUkJmOFdWdnlmQkkwaUFtdmRHK2ovTXlYOEROblkKU05pY05FT1NMZzAwTEZCY0hYR3FaYTJTQ2l6 |
|                | TGRxbEJNcmF1QTNTVng3VzA5YmVMZldCZlNQMlh3Y1NaSUg1UQphaE4xd2xxN3N2UG53dWMrUWJuWmxZa1dHUWdXOWQyRnowZ3Fw |
|                | SUZ2ODN1Qkp3TkovajlGSFU3Ym1NUmludkxsCmpxK2RVQ2IwYlF0R2M1QWNXT2NibUtnNmhHcEF2NytqVDRKcUw0a3dWSlIwbk5o |
|                | VTBSM3VlWHl0QjU3WDBqenMKM2lyMEN5MENnWUVBM3U3Q3o5KytuNitjbGV2NVYwcDZualZIcm1zS211eGtZakZQRWdDc2gwUSs4 |
|                | UlZ1T2pjagpyRm1xbVRsemdwY2ViOXNBai9GWkN2d1NxYWVUYlpBSkJoVE1oSFByZ2t1MWIybjFnL3lzWCtzOFp5UVppZHJUCkI3 |
|                | aGhtRHZNT2Y5K3J2QWUrQWZYemhWMXZ4UVZraWU3bmVwbkNnc3Q0ZUJkLzMzS3dHNWZTVThDZ1lFQTJzcGsKeWhGa0dQb1ROVGYz |
|                | eEc2NkdRL3hWbDBzRkFaWGJvYlR3SmZCZ3p0akdGSDhmK3owN3FMSGVHMjBXNjlRL1dNYQoxcE85R0tzSVQxRHdaRW1hY1ZQRk1L |
|                | RHhlUk40b1ZNRUtjSGx5cms4VGUydHpFb2JUV01zMUJiR0drUEM2dUNtCmhRQ0tidG41bURjbjU0VFQxUktpdmRBU3c2L1BaWGg2 |
|                | Zy9lbjhMc0NnWUJnZXY2T3ptdUdXbzh2QnhnN0lmMmQKT0x2VURYbGlnUW9Vd1BoU2R6NHpzR0o1SGVnOWc1Mkp1cWl0ZFlLN01z |
|                | RzJjUloyTldKdThaYjJHNU1mYUtXdgpIeE5BQTVjYUpiL1kvd2VGWHJZUE1SUk1Jd0IyZStDMng2SmRLd3dBMGNVMjJxN2NjekIv |
|                | ZlNRZlZRYmM0UnMrCmhiS2dVeVJCVEVRQ0RhUFEwak9rMndLQmdGN3JEMjdhdktKWlc1dnEvQUtzUnZBNGltcjlZUElQRGo5Vkh1 |
|                | aWUKN2NVUkxweU9kUXpLc0RnWFJwSm9oYWFCR0pIVlBQOTZlTDhLOUQvMHpWVzAyTnZ4aThyZEIrV1BIUFpnSFo1QQpFSUV5ZTRj |
|                | VFppTUt3MjEvYVNOWi9mZkhEZmo0SFVYMlJoaHhXR2RCQm43YWtVd1BHYXRmYWNTYnNVNUVSbUthClByR2hBb0dBVEJkc1crTzhh |
|                | Snd6YnJlZ2Qwd2U5cDFobHd6bFZyZEwyTWNvTlNLL2FpTi9QbURRUERoYVZxamsKaGhWQm5KazB1eFVZeUFxL2dYOW1yMnV4NDc1 |
|                | SzZmTHp6b25EYnRoTWJxbDNnMVBMMjFJMjFSVytZWE9JQ3NEbAptaG9YemVYSW84WXJpQTBvRDcrZEk0TU9rUUM0Wndvd3hwS2o0 |
|                | YUVRaTIvVm9xTnZPRUk9Ci0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg=="                                    |
|                |       }                                                                                              |
|                |     }                                                                                                |
|                |   ]                                                                                                  |
|                | }                                                                                                    |
| k8s_version    | "v1"                                                                                                 |
| vim_account    | "0540373a-0aa2-4524-8406-f67f8a6c2758"                                                               |
| nets           | {                                                                                                    |
|                |   "net1": "osm-ext"                                                                                  |
|                | }                                                                                                    |
| description    | "Robot cluster"                                                                                      |
| namespace      | "kube-system"                                                                                        |
| _admin         | {                                                                                                    |
|                |   "created": 1712183710.6770632,                                                                     |
|                |   "modified": 1712183716.0268097,                                                                    |
|                |   "projects_read": [                                                                                 |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "projects_write": [                                                                                |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "operationalState": "DEGRADED",                                                                    |
|                |   "operations": [                                                                                    |
|                |     {                                                                                                |
|                |       "lcmOperationType": "create",                                                                  |
|                |       "operationState": "COMPLETED",                                                                 |
|                |       "startTime": 1712183710.677125,                                                                |
|                |       "statusEnteredTime": 1712183710.677125,                                                        |
|                |       "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:          |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'caf1b377-78c8-42a8-8f8e-24a33fcdc9d7', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:35:10 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:35:10.844667     176 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:35:10.847010     176                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:35:10.849055     176 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:35:10.850919        |
|                | 176 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:35:10.852617     176 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |       "operationParams": null,                                                                       |
|                |       "worker": null                                                                                 |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current_operation": null,                                                                         |
|                |   "helm_chart_repos": [],                                                                            |
|                |   "juju_bundle_repos": [],                                                                           |
|                |   "juju-bundle": {                                                                                   |
|                |     "error_msg": "(401)\nReason: Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':    |
|                | 'caf1b377-78c8-42a8-8f8e-24a33fcdc9d7', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:35:10 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n",                            |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart": {                                                                                    |
|                |     "error_msg": "E0403 22:35:10.844667     176 memcache.go:265] couldn't get current server API     |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:35:10.847010        |
|                | 176 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:35:10.849055     176 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nE0403 22:35:10.850919    |
|                | 176 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:35:10.852617     176 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart-v3": {                                                                                 |
|                |     "created": false,                                                                                |
|                |     "error_msg": null,                                                                               |
|                |     "id": "cf4e94ef-3f46-4a27-b563-e5ee76eb7f9c",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   },                                                                                                 |
|                |   "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:              |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | 'caf1b377-78c8-42a8-8f8e-24a33fcdc9d7', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:35:10 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:35:10.844667     176 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:35:10.847010     176                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:35:10.849055     176 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:35:10.850919        |
|                | 176 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:35:10.852617     176 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)"                |
|                | }                                                                                                    |
| schema_version | "1.11"                                                                                               |
+----------------+------------------------------------------------------------------------------------------------------+
Deletion in progress

2024-04-03_22:36:01 Creating K8s Cluster
6e77b4b1-d5ca-438e-b72c-2a74ea2bfc56
K8s cluster stuck for more than 50 seconds:
+----------------+------------------------------------------------------------------------------------------------------+
| key            | attribute                                                                                            |
+----------------+------------------------------------------------------------------------------------------------------+
| _id            | "6e77b4b1-d5ca-438e-b72c-2a74ea2bfc56"                                                               |
| name           | "osm"                                                                                                |
| credentials    | {                                                                                                    |
|                |   "apiVersion": "v1",                                                                                |
|                |   "clusters": [                                                                                      |
|                |     {                                                                                                |
|                |       "cluster": {                                                                                   |
|                |         "certificate-authority-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ |
|                | 0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EY3dOekl5TlRrM |
|                | U9Gb1hEVE15TURjd05ESXlOVGsxT0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BU |
|                | UVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTFVDCjdXUkFZTU90SmJ1U1loQ2FrVDZ3VUdKZEtZdUdRb29xd3F5WStnRW8yU1RnZEhPZ |
|                | EdpZzVJMjF3cG9tdFV1V2sKREhmZUJHMHIvRGkvUHdML3VEb0tqUFVvdU5JdTBYc1FTYXIrOGNMTkdWSDczSnBJcWRaZDVEREthd |
|                | WFacU9ONQovdlJjdVBiWHdLNldkRmdldDB3RWQycVlKQytmNk9Dcm5oUnlSOGJvWVdxZ2kvNzhNSHFwMERNQ0I4TDFHRHVmCjdJV |
|                | EFodUtBaUM1a2llQ1NzY1cwT0NVdTZPazdCVTZVc3dhd2phRVlWbUVkS0Flb0o2UWNGTHBnWkFvdDA2aFIKYlRqTmNkLzdLRDNCZ |
|                | VJWc3QycGZqL2lQdlVXaDBiR1VWREZDRXV1UC9VTUNRdHZ6SWVIUEhZamtjNkZYSldWSwpyZGk5bGNuV1FRSlVJVENLcFlzQ0F3R |
|                | UFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQMGRZVzdhV |
|                | VlMZ0dpNk53aW1iV3llUWh0bjZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnR |
|                | UJBQVBoNGhOUGlPUlZVZXQzRXgwTgpHekNUM1Q1OUtzMHFaa0JUMnpkM29qc0tsUS9LTS85TzJEa2YzdElnbkV6ZWlIdlMzUExTa |
|                | TZkaDhISzE3MlNQCnMyUy95bW5nTWZMMlkyYU85ZTA2L3B1NEFvUG56c2ZSOFhzNnVXc2N5UkdVbXNMcjR5eVBFaythL0F4OXcxS |
|                | 2MKeHFQZDB2bXo4OVZMVHFHb2hjZVJKcmVkMU1RcnNnMnMzR1pzRDU4MVRpVlI0bGQ3VlpNSnpGM01Wa3hOazNnagp6dm5SQU01M |
|                | HhPdmx1ek9ZVHo5aEthRjk0QTVta2pzck02ZStmdHN0dEpzQWduWnpIVHlaUFFkYW9TTE9YeWx6CnY2VGhrYjZvLzFXWjVTQjMrc |
|                | CttRlJYYmN4UC9tS04zNktiem5UOWJpVlJTRkVXcWswTmdHdUZiNDBvNkJLM3gKckFRPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tL |
|                | S0tCg==",                                                                                            |
|                |         "server": "https://172.21.248.125:6443"                                                      |
|                |       },                                                                                             |
|                |       "name": "cluster.local"                                                                        |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "contexts": [                                                                                      |
|                |     {                                                                                                |
|                |       "context": {                                                                                   |
|                |         "cluster": "cluster.local",                                                                  |
|                |         "user": "kubernetes-admin"                                                                   |
|                |       },                                                                                             |
|                |       "name": "kubernetes-admin@cluster.local"                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current-context": "kubernetes-admin@cluster.local",                                               |
|                |   "kind": "Config",                                                                                  |
|                |   "preferences": {},                                                                                 |
|                |   "users": [                                                                                         |
|                |     {                                                                                                |
|                |       "name": "kubernetes-admin",                                                                    |
|                |       "user": {                                                                                      |
|                |         "client-certificate-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURJVENDQWdtZ0F3SUJBZ0lJ |
|                | RlhiYW9UR0N5cGN3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TWpBM01E |
|                | Y3lNalU1TlRoYUZ3MHlOREEwTURJeU1qSTFORFZhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lE |
|                | VlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXZv |
|                | ZVNEL2d5MGNhZDZxNm0KNEptL01qNHRKTFp4amQ0OFlFenF3YUwxcS9OREFSaDl6ZDJnS1pVMnFtUW1Ub3E3QWFIWEg4bkZqRklt |
|                | Y3R6bgpGckF1MURtR05IdGZhRTJPQlBtNlVPZGtmUjM4eUhsd3pWWFk2d1ZPdGoyOUJrOG5lNE1FcXE4NHlQUFloNlFXCngwaHRJ |
|                | c2RLeG1kc3R4VGlwTVBDd3NYWjdIRnIwdVg0UEJPUys4RGpLYWpjOURRYS8xYUJjQW5xRjZyalVvZVoKb3BNcWZRbHFmMjFGNGtK |
|                | VmNmRXprY094S3E5MFBXbVl5dnNPdThiWEdyeEI0ZHpSY1hDdE5iV1diSVlsTjlodwppbVBORHJQY3BUVk9saXhHMU0yaFBQOGdV |
|                | WUt2M1VycTB6aElzU3NMZ3Z1MFpSckFEODNVeThJL0gyZm90NXRhCi85MmN0UUlEQVFBQm8xWXdWREFPQmdOVkhROEJBZjhFQkFN |
|                | Q0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RBWURWUjBUQVFIL0JBSXdBREFmQmdOVkhTTUVHREFXZ0JUOUhXRnUy |
|                | bEdDNEJvdWpjSXBtMXNua0liWgorakFOQmdrcWhraUc5dzBCQVFzRkFBT0NBUUVBUW9BZmF1RTI1RTZxN0M5YTI3ZkViQnByUkhs |
|                | Qnd2ZVhFbzZWCk82ZDNFaS9WcGtxcjlJVlhLOW9HZ2duUkg1cExlVFdGSXJPVmFyaEtSZlF5TTlqWU9hYS9vajVoeUNkdElVMzMK |
|                | SnBGRXRsWW5nNzZQRXgxVW16M3Z3Q2VkMzU4aGdvRW91R0lkSWtYNm41RUZvZStMYnVjdWxnSHBNeWNxRWxVcwpsdHF4cEhPNlh5 |
|                | bWdSekd0V0ZnMVo3V0YrcDhNQi85aVpoWFc4dkpGb1p1OURhWnVyZFlnOUo3a0xZNkU5MkNaClNXeDJ2c2d5dG5iUHlReWhnbFoy |
|                | OEduZHhZek9jZW50VkNQK25ib1FralBkQXRWQXVzWkhIdlEvUCs2aUNsQ3IKM0NoOExvSzQ5d3hCL2RaMVFrbjF5dVBOQnJRSzFH |
|                | QkpLaDFWOGltRmlRbUM4bllGVlE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",                               |
|                |         "client-key-data": "LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb2dJQkFBS0NBUUVBdm9lU0Qv |
|                | Z3kwY2FkNnE2bTRKbS9NajR0SkxaeGpkNDhZRXpxd2FMMXEvTkRBUmg5CnpkMmdLWlUycW1RbVRvcTdBYUhYSDhuRmpGSW1jdHpu |
|                | RnJBdTFEbUdOSHRmYUUyT0JQbTZVT2RrZlIzOHlIbHcKelZYWTZ3Vk90ajI5Qms4bmU0TUVxcTg0eVBQWWg2UVd4MGh0SXNkS3ht |
|                | ZHN0eFRpcE1QQ3dzWFo3SEZyMHVYNApQQk9TKzhEakthamM5RFFhLzFhQmNBbnFGNnJqVW9lWm9wTXFmUWxxZjIxRjRrSlZjZkV6 |
|                | a2NPeEtxOTBQV21ZCnl2c091OGJYR3J4QjRkelJjWEN0TmJXV2JJWWxOOWh3aW1QTkRyUGNwVFZPbGl4RzFNMmhQUDhnVVlLdjNV |
|                | cnEKMHpoSXNTc0xndnUwWlJyQUQ4M1V5OEkvSDJmb3Q1dGEvOTJjdFFJREFRQUJBb0lCQUM1czJGRmQxL3czbWtrUgo3NFd3ME43 |
|                | TU9iSEZadHY3dDloN1JZU1RVYXRwWmYxQlczNHJMNWlTVERTdW5JcnMwTzV2NGZ4VDdQZnBHSWRLCmZtQ1A0NGxBend2QXVCbXhO |
|                | QmJRUnU3cHd4bWRrZmZEWjVJUkJmOFdWdnlmQkkwaUFtdmRHK2ovTXlYOEROblkKU05pY05FT1NMZzAwTEZCY0hYR3FaYTJTQ2l6 |
|                | TGRxbEJNcmF1QTNTVng3VzA5YmVMZldCZlNQMlh3Y1NaSUg1UQphaE4xd2xxN3N2UG53dWMrUWJuWmxZa1dHUWdXOWQyRnowZ3Fw |
|                | SUZ2ODN1Qkp3TkovajlGSFU3Ym1NUmludkxsCmpxK2RVQ2IwYlF0R2M1QWNXT2NibUtnNmhHcEF2NytqVDRKcUw0a3dWSlIwbk5o |
|                | VTBSM3VlWHl0QjU3WDBqenMKM2lyMEN5MENnWUVBM3U3Q3o5KytuNitjbGV2NVYwcDZualZIcm1zS211eGtZakZQRWdDc2gwUSs4 |
|                | UlZ1T2pjagpyRm1xbVRsemdwY2ViOXNBai9GWkN2d1NxYWVUYlpBSkJoVE1oSFByZ2t1MWIybjFnL3lzWCtzOFp5UVppZHJUCkI3 |
|                | aGhtRHZNT2Y5K3J2QWUrQWZYemhWMXZ4UVZraWU3bmVwbkNnc3Q0ZUJkLzMzS3dHNWZTVThDZ1lFQTJzcGsKeWhGa0dQb1ROVGYz |
|                | eEc2NkdRL3hWbDBzRkFaWGJvYlR3SmZCZ3p0akdGSDhmK3owN3FMSGVHMjBXNjlRL1dNYQoxcE85R0tzSVQxRHdaRW1hY1ZQRk1L |
|                | RHhlUk40b1ZNRUtjSGx5cms4VGUydHpFb2JUV01zMUJiR0drUEM2dUNtCmhRQ0tidG41bURjbjU0VFQxUktpdmRBU3c2L1BaWGg2 |
|                | Zy9lbjhMc0NnWUJnZXY2T3ptdUdXbzh2QnhnN0lmMmQKT0x2VURYbGlnUW9Vd1BoU2R6NHpzR0o1SGVnOWc1Mkp1cWl0ZFlLN01z |
|                | RzJjUloyTldKdThaYjJHNU1mYUtXdgpIeE5BQTVjYUpiL1kvd2VGWHJZUE1SUk1Jd0IyZStDMng2SmRLd3dBMGNVMjJxN2NjekIv |
|                | ZlNRZlZRYmM0UnMrCmhiS2dVeVJCVEVRQ0RhUFEwak9rMndLQmdGN3JEMjdhdktKWlc1dnEvQUtzUnZBNGltcjlZUElQRGo5Vkh1 |
|                | aWUKN2NVUkxweU9kUXpLc0RnWFJwSm9oYWFCR0pIVlBQOTZlTDhLOUQvMHpWVzAyTnZ4aThyZEIrV1BIUFpnSFo1QQpFSUV5ZTRj |
|                | VFppTUt3MjEvYVNOWi9mZkhEZmo0SFVYMlJoaHhXR2RCQm43YWtVd1BHYXRmYWNTYnNVNUVSbUthClByR2hBb0dBVEJkc1crTzhh |
|                | Snd6YnJlZ2Qwd2U5cDFobHd6bFZyZEwyTWNvTlNLL2FpTi9QbURRUERoYVZxamsKaGhWQm5KazB1eFVZeUFxL2dYOW1yMnV4NDc1 |
|                | SzZmTHp6b25EYnRoTWJxbDNnMVBMMjFJMjFSVytZWE9JQ3NEbAptaG9YemVYSW84WXJpQTBvRDcrZEk0TU9rUUM0Wndvd3hwS2o0 |
|                | YUVRaTIvVm9xTnZPRUk9Ci0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg=="                                    |
|                |       }                                                                                              |
|                |     }                                                                                                |
|                |   ]                                                                                                  |
|                | }                                                                                                    |
| k8s_version    | "v1"                                                                                                 |
| vim_account    | "0540373a-0aa2-4524-8406-f67f8a6c2758"                                                               |
| nets           | {                                                                                                    |
|                |   "net1": "osm-ext"                                                                                  |
|                | }                                                                                                    |
| description    | "Robot cluster"                                                                                      |
| namespace      | "kube-system"                                                                                        |
| _admin         | {                                                                                                    |
|                |   "created": 1712183761.890917,                                                                      |
|                |   "modified": 1712183767.2422144,                                                                    |
|                |   "projects_read": [                                                                                 |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "projects_write": [                                                                                |
|                |     "1617ec48-8121-4e89-a801-cfeffd08fbc8"                                                           |
|                |   ],                                                                                                 |
|                |   "operationalState": "DEGRADED",                                                                    |
|                |   "operations": [                                                                                    |
|                |     {                                                                                                |
|                |       "lcmOperationType": "create",                                                                  |
|                |       "operationState": "COMPLETED",                                                                 |
|                |       "startTime": 1712183761.890967,                                                                |
|                |       "statusEnteredTime": 1712183761.890967,                                                        |
|                |       "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:          |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | '1344a3fd-124a-48c8-8049-6eeadd6d4549', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:36:02 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:36:02.105968     204 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:36:02.108359     204                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:36:02.110750     204 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:36:02.113498        |
|                | 204 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:36:02.116832     204 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |       "operationParams": null,                                                                       |
|                |       "worker": null                                                                                 |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current_operation": null,                                                                         |
|                |   "helm_chart_repos": [],                                                                            |
|                |   "juju_bundle_repos": [],                                                                           |
|                |   "juju-bundle": {                                                                                   |
|                |     "error_msg": "(401)\nReason: Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':    |
|                | '1344a3fd-124a-48c8-8049-6eeadd6d4549', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:36:02 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n",                            |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart": {                                                                                    |
|                |     "error_msg": "E0403 22:36:02.105968     204 memcache.go:265] couldn't get current server API     |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:36:02.108359        |
|                | 204 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:36:02.110750     204 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nE0403 22:36:02.113498    |
|                | 204 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:36:02.116832     204 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)",               |
|                |     "id": null,                                                                                      |
|                |     "operationalState": "ERROR"                                                                      |
|                |   },                                                                                                 |
|                |   "helm-chart-v3": {                                                                                 |
|                |     "created": false,                                                                                |
|                |     "error_msg": null,                                                                               |
|                |     "id": "6e77b4b1-d5ca-438e-b72c-2a74ea2bfc56",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   },                                                                                                 |
|                |   "detailed-status": "ready for helm-chart-v3; Failing init juju-bundle: (401)\nReason:              |
|                | Unauthorized\nHTTP response headers: HTTPHeaderDict({'Audit-Id':                                     |
|                | '1344a3fd-124a-48c8-8049-6eeadd6d4549', 'Cache-Control': 'no-cache, private', 'Content-Type':        |
|                | 'application/json', 'Date': 'Wed, 03 Apr 2024 22:36:02 GMT', 'Content-Length': '129'})\nHTTP         |
|                | response body: {\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"m |
|                | essage\":\"Unauthorized\",\"reason\":\"Unauthorized\",\"code\":401}\n\n;Failing init helm-chart:     |
|                | E0403 22:36:02.105968     204 memcache.go:265] couldn't get current server API group list: the       |
|                | server has asked for the client to provide credentials\nE0403 22:36:02.108359     204                |
|                | memcache.go:265] couldn't get current server API group list: the server has asked for the client to  |
|                | provide credentials\nE0403 22:36:02.110750     204 memcache.go:265] couldn't get current server API  |
|                | group list: the server has asked for the client to provide credentials\nE0403 22:36:02.113498        |
|                | 204 memcache.go:265] couldn't get current server API group list: the server has asked for the client |
|                | to provide credentials\nE0403 22:36:02.116832     204 memcache.go:265] couldn't get current server   |
|                | API group list: the server has asked for the client to provide credentials\nerror: You must be       |
|                | logged in to the server (the server has asked for the client to provide credentials)"                |
|                | }                                                                                                    |
| schema_version | "1.11"                                                                                               |
+----------------+------------------------------------------------------------------------------------------------------+
Deletion in progress
K8s cluster failed to enter ENABLED state
[Pipeline] sh
[osm-devops] Running shell script
+ cp /tmp/tmp.BSemEryRpn/*.xml .
cp: cannot stat '/tmp/tmp.BSemEryRpn/*.xml': No such file or directory
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (After System Integration test)
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // dir
[Pipeline] stage
[Pipeline] { (Archive Container Logs)
[Pipeline] echo
Archiving container logs
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1689: mkdir -p logs/dags
Success command osm-v140-merge-286#1689: mkdir -p logs/dags
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1690: 
            for deployment in `kubectl -n osm get deployments | grep -v operator | grep -v NAME| awk '{print $1}'`; do
                echo "Extracting log for $deployment"
                kubectl -n osm logs deployments/$deployment --timestamps=true --all-containers 2>&1                 > logs/$deployment.log
            done
        
Extracting log for airflow-scheduler
Extracting log for airflow-statsd
Extracting log for airflow-triggerer
Extracting log for airflow-webserver
Extracting log for grafana
Extracting log for keystone
Extracting log for lcm
Extracting log for mon
Extracting log for nbi
Extracting log for ngui
Extracting log for pushgateway-prometheus-pushgateway
Extracting log for ro
Extracting log for webhook-translator
Success command osm-v140-merge-286#1690: 
            for deployment in `kubectl -n osm get deployments | grep -v operator | grep -v NAME| awk '{print $1}'`; do
                echo "Extracting log for $deployment"
                kubectl -n osm logs deployments/$deployment --timestamps=true --all-containers 2>&1                 > logs/$deployment.log
            done
        
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1691: 
            for statefulset in `kubectl -n osm get statefulsets | grep -v operator | grep -v NAME| awk '{print $1}'`; do
                echo "Extracting log for $statefulset"
                kubectl -n osm logs statefulsets/$statefulset --timestamps=true --all-containers 2>&1                 > logs/$statefulset.log
            done
        
Extracting log for airflow-postgresql
Extracting log for airflow-redis
Extracting log for airflow-worker
Extracting log for alertmanager
Extracting log for kafka
Extracting log for mongodb-k8s
Extracting log for mysql
Extracting log for prometheus
Extracting log for zookeeper
Success command osm-v140-merge-286#1691: 
            for statefulset in `kubectl -n osm get statefulsets | grep -v operator | grep -v NAME| awk '{print $1}'`; do
                echo "Extracting log for $statefulset"
                kubectl -n osm logs statefulsets/$statefulset --timestamps=true --all-containers 2>&1                 > logs/$statefulset.log
            done
        
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1692: 
            schedulerPod="$(kubectl get pods -n osm | grep airflow-scheduler| awk '{print $1; exit}')";             echo "Extracting logs from Airflow DAGs from pod ${schedulerPod}";             kubectl cp -n osm ${schedulerPod}:/opt/airflow/logs/scheduler/latest/dags logs/dags -c scheduler
        
Extracting logs from Airflow DAGs from pod airflow-scheduler-f97f9f9d4-nw2f9
tar: Removing leading `/' from member names
Success command osm-v140-merge-286#1692: 
            schedulerPod="$(kubectl get pods -n osm | grep airflow-scheduler| awk '{print $1; exit}')";             echo "Extracting logs from Airflow DAGs from pod ${schedulerPod}";             kubectl cp -n osm ${schedulerPod}:/opt/airflow/logs/scheduler/latest/dags logs/dags -c scheduler
        
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sh
[osm-stage_3-merge_v14.0@3] Running shell script
+ rm -rf logs
[Pipeline] sshCommand
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Started command osm-v140-merge-286#1693: ls -al logs
total 1768
drwxrwxr-x 3 ubuntu ubuntu   4096 Apr  3 22:37 .
drwxr-x--- 9 ubuntu ubuntu   4096 Apr  3 22:36 ..
-rw-rw-r-- 1 ubuntu ubuntu  34469 Apr  3 22:36 airflow-postgresql.log
-rw-rw-r-- 1 ubuntu ubuntu   1202 Apr  3 22:36 airflow-redis.log
-rw-rw-r-- 1 ubuntu ubuntu 107462 Apr  3 22:36 airflow-scheduler.log
-rw-rw-r-- 1 ubuntu ubuntu    692 Apr  3 22:36 airflow-statsd.log
-rw-rw-r-- 1 ubuntu ubuntu   2994 Apr  3 22:36 airflow-triggerer.log
-rw-rw-r-- 1 ubuntu ubuntu 179326 Apr  3 22:36 airflow-webserver.log
-rw-rw-r-- 1 ubuntu ubuntu  67606 Apr  3 22:36 airflow-worker.log
-rw-rw-r-- 1 ubuntu ubuntu   2903 Apr  3 22:36 alertmanager.log
drwxrwxr-x 2 ubuntu ubuntu   4096 Apr  3 22:37 dags
-rw-rw-r-- 1 ubuntu ubuntu  58710 Apr  3 22:36 grafana.log
-rw-rw-r-- 1 ubuntu ubuntu 185105 Apr  3 22:36 kafka.log
-rw-rw-r-- 1 ubuntu ubuntu   1922 Apr  3 22:36 keystone.log
-rw-rw-r-- 1 ubuntu ubuntu 160742 Apr  3 22:36 lcm.log
-rw-rw-r-- 1 ubuntu ubuntu  12934 Apr  3 22:36 mon.log
-rw-rw-r-- 1 ubuntu ubuntu 763764 Apr  3 22:36 mongodb-k8s.log
-rw-rw-r-- 1 ubuntu ubuntu  19649 Apr  3 22:37 mysql.log
-rw-rw-r-- 1 ubuntu ubuntu  82504 Apr  3 22:36 nbi.log
-rw-rw-r-- 1 ubuntu ubuntu      0 Apr  3 22:36 ngui.log
-rw-rw-r-- 1 ubuntu ubuntu   6193 Apr  3 22:37 prometheus.log
-rw-rw-r-- 1 ubuntu ubuntu    607 Apr  3 22:36 pushgateway-prometheus-pushgateway.log
-rw-rw-r-- 1 ubuntu ubuntu   7527 Apr  3 22:36 ro.log
-rw-rw-r-- 1 ubuntu ubuntu    316 Apr  3 22:36 webhook-translator.log
-rw-rw-r-- 1 ubuntu ubuntu  52326 Apr  3 22:37 zookeeper.log
Success command osm-v140-merge-286#1693: ls -al logs
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] sshGet
Host key checking is off. It may be vulnerable to man-in-the-middle attacks.
[jsch] Permanently added '172.21.248.73' (RSA) to the list of known hosts.
Connected to osm-v140-merge-286[172.21.248.73:22] (SSH-2.0-OpenSSH_8.9p1 Ubuntu-3)
Received file from osm-v140-merge-286: airflow-redis.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-redis.log
Received file from osm-v140-merge-286: mon.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/mon.log
Received file from osm-v140-merge-286: kafka.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/kafka.log
Received file from osm-v140-merge-286: ngui.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/ngui.log
Received file from osm-v140-merge-286: alertmanager.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/alertmanager.log
Received file from osm-v140-merge-286: webhook-translator.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/webhook-translator.log
Received file from osm-v140-merge-286: airflow-triggerer.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-triggerer.log
Received file from osm-v140-merge-286: airflow-postgresql.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-postgresql.log
Received file from osm-v140-merge-286: keystone.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/keystone.log
Received file from osm-v140-merge-286: airflow-scheduler.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-scheduler.log
Received file from osm-v140-merge-286: airflow-statsd.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-statsd.log
Received file from osm-v140-merge-286: pushgateway-prometheus-pushgateway.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/pushgateway-prometheus-pushgateway.log
Received file from osm-v140-merge-286: airflow-webserver.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-webserver.log
Received file from osm-v140-merge-286: lcm.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/lcm.log
Received file from osm-v140-merge-286: airflow-worker.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/airflow-worker.log
Received file from osm-v140-merge-286: mongodb-k8s.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/mongodb-k8s.log
Received file from osm-v140-merge-286: grafana.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/grafana.log
Received file from osm-v140-merge-286: mysql.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/mysql.log
Received file from osm-v140-merge-286: nbi.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/nbi.log
Received file from osm-v140-merge-286: zookeeper.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/zookeeper.log
Received file from osm-v140-merge-286: ro.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/ro.log
Received file from osm-v140-merge-286: prometheus.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/prometheus.log
Received file from osm-v140-merge-286: vdu_down.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/vdu_down.py.log
Received file from osm-v140-merge-286: multivim_vm_status.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/multivim_vm_status.py.log
Received file from osm-v140-merge-286: vdu_alarm.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/vdu_alarm.py.log
Received file from osm-v140-merge-286: ns_topology.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/ns_topology.py.log
Received file from osm-v140-merge-286: multisdnc_sdnc_status.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/multisdnc_sdnc_status.py.log
Received file from osm-v140-merge-286: multivim_vm_metrics.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/multivim_vm_metrics.py.log
Received file from osm-v140-merge-286: scalein_vdu.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/scalein_vdu.py.log
Received file from osm-v140-merge-286: scaleout_vdu.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/scaleout_vdu.py.log
Received file from osm-v140-merge-286: multivim_vim_status.py.log -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3/logs/dags/multivim_vim_status.py.log
Received directory from osm-v140-merge-286: logs -> /home/jenkins/workspace/osm-stage_3-merge_v14.0@3
Disconnected from osm-v140-merge-286[172.21.248.73:22]
[Pipeline] step
Archiving artifacts
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Cleanup)
[Pipeline] echo
Deleting VM: abe97eb2-d66b-441e-901e-f2a9c5868080
[Pipeline] sh
[osm-stage_3-merge_v14.0@3] Running shell script
[Pipeline] sh
[osm-stage_3-merge_v14.0@3] Running shell script
+ docker stop osm-v140-merge-286-apache
osm-v140-merge-286-apache
[Pipeline] sh
[osm-stage_3-merge_v14.0@3] Running shell script
+ docker rm osm-v140-merge-286-apache
osm-v140-merge-286-apache
[Pipeline] sh
[osm-stage_3-merge_v14.0@3] Running shell script
+ rm -rf /tmp/tmp.rodf2WLTHd
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 1
Finished: FAILURE