SuccessConsole Output

[azure_robot_tests] Running shell script
+ . /robot-systest/results/osm_environment.rc
+ export CLOUD_TYPE=azure
+ export OSM_HOSTNAME=172.21.23.13
+ export OSM_IMAGE_NAME=osmtest202402181216
+ export JUJU_PASSWORD=secret
+ . /robot-systest/results/k8s_environment.rc
+ export CLOUD_TYPE=azure
+ export USE_PAAS_K8S=FALSE
+ export K8S_IP=172.21.23.12
+ export K8S_IMAGE_NAME=k8stest202402181209
+ export K8S_CREDENTIALS=/robot-systest/results/kubeconfig.yaml
+ /robot-systest/run_test.sh -t azure
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiates the NS for the t... | FAIL |
'+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name    | id                                   | date                | ns state | current operation | error details                           |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_06_charm_test | 94b45b9b-7aa1-4776-a807-52ad9367b892 | 2024-02-18T12:35:50 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.e3e713fc-0ee8- |
|                     |                                      |                     |          |                   | 4e08-9f96-0aaa0b0acbe3, Stage 2/5:      |
|                     |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                     |                                      |                     |          |                   | environments.                           |
|                     |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                     |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                     |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                     |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check VNF Charm Application Name :: Checks that the charm applicat... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_06_charm_test == basic_06_charm_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | FAIL |
12 tests, 2 passed, 10 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service :: Instantiate NS for t... | FAIL |
'+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name               | id                                   | date                | ns state | current operation | error details                           |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_07_secure_key_management | 42bcf38b-919a-4a45-bf10-c3b10909b686 | 2024-02-18T13:11:55 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0231705a-a87f- |
|                                |                                      |                     |          |                   | 4ded-b5f2-5332ab2aa6b8, Stage 2/5:      |
|                                |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                |                                      |                     |          |                   | environments.                           |
|                                |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                |                                      |                     |          |                   | environment. 'cacert'                   |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id.                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the VNF ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | FAIL |
The ns-action with id 6a512f08-df37-4f12-b97a-1f2be7e0dc82 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_07_secure_key_management == basic_07_secure_key_management
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_11_native_charms | 6cfeaeea-1c9c-4d48-9946-4206e44f7e9c | 2024-02-18T13:56:17 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.dddfc169-c6d4- |
|                        |                                      |                     |          |                   | 49ec-a8fb-5ae453df0fd7, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | {'hostname': '172.21.23.5', 'username': |
|                        |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA      |
|                        |                                      |                     |          |                   | vnf2.mgmtVM: register execution         |
|                        |                                      |                     |          |                   | environment {'hostname': '172.21.23.6', |
|                        |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'         |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_11_native_charms == basic_11_native_charms
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 2 passed, 7 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds :: Upload VNF packages for the testsuite.                | PASS |
------------------------------------------------------------------------------
Upload Nsd :: Upload NS package for the testsuite.                    | PASS |
------------------------------------------------------------------------------
Instantiate NS :: Instantiate NS for the testsuite.                   | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| test_nscharm     | 0a5fb80b-6755-44ae-adef-bef2a0949bb3 | 2024-02-18T14:33:01 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.421d51af-63f1- |
|                  |                                      |                     |          |                   | 4943-80a1-ff46390f4cdc, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA 1.userVM: create  |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA 2.policyVM: create        |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA .: create execution       |
|                  |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check NS Charm Application Name :: Check that the NS charm has the... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name :: Check that the VDU charm has t... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Delete NS :: Delete NS instance.                                      | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: test_nscharm == test_nscharm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 3 passed, 6 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                           |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_13_ns_relations_test | b03a7734-cc8c-45fc-84fd-34363062a497 | 2024-02-18T15:10:37 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.fe325a62-f39c- |
|                            |                                      |                     |          |                   | 4808-891e-2ab3b69524b6, Stage 2/5:      |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | '172.21.23.5', 'username': 'ubuntu'}.   |
|                            |                                      |                     |          |                   | 'cacert'. Deploying VCA vnf2.: register |
|                            |                                      |                     |          |                   | execution environment {'hostname':      |
|                            |                                      |                     |          |                   | '172.21.23.6', 'username': 'ubuntu'}.   |
|                            |                                      |                     |          |                   | 'cacert'                                |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_13_ns_relations_test == basic_13_ns_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Provides :: Delete first VNF package from OSM.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Requires :: Delete second VNF package from OSM. | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name            | id                                   | date                | ns state | current operation | error details                           |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_14_vnf_relations_test | a8373ba6-b67f-432b-9e8e-73b521cbde5d | 2024-02-18T15:47:40 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.24539e77-454c- |
|                             |                                      |                     |          |                   | 4bf8-a008-6262ae6cdb74, Stage 2/5:      |
|                             |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                             |                                      |                     |          |                   | environments.                ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'.        |
|                             |                                      |                     |          |                   | Deploying VCA vnf.simple_requires:      |
|                             |                                      |                     |          |                   | register execution environment          |
|                             |                                      |                     |          |                   | {'hostname': '172.21.23.5', 'username': |
|                             |                                      |                     |          |                   | 'ubuntu'}. 'cacert'                     |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_14_vnf_relations_test == basic_14_vnf_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | FAIL |
6 tests, 2 passed, 4 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
'+----------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                 | id                                   | date                | ns state | current operation | error details                           |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_20_manual_vdu_scaling_test | 4bf1b628-1cb8-4ded-94a7-ce47994c1d0f | 2024-02-18T16:34:47 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.1934074f-01f3- |
|                                  |                                      |                     |          |                   | 4886-b50f-13d20b420598, Stage 2/5:      |
|                                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                  |                                      |                     |          |                   | environments.           ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | {'hostname': '172.21.23.5', 'username': |
|                                  |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA      |
|                                  |                                      |                     |          |                   | vnf.mgmtVM: register execution          |
|                                  |                                      |                     |          |                   | environment {'hostname': '172.21.23.6', |
|                                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'         |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on            | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | FAIL |
There are not 2 application name in the application list after Scale Out
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_20_manual_vdu_scaling_test == basic_20_manual_vdu_scaling_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfcloudinit == hfcloudinit
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfmultivdu == hfmultivdu
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor :: Upload NF package for the test... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s       | fbccc91c-1dd5-426f-ac8c-7100ede724a3 | 2024-02-18T17:56:43 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.f8bfb3e5-f2c0- |
|                  |                                      |                     |          |                   | 4dc3-9fbe-b1cc6c4b462a, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '28c81fb5-6cd3-42aa-9eb3-2ecf58d47eb7'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id b13d0f38-65e0-4172-b135-98669a483d96 was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete tar.gz NF and NS package files.      | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_05-k8s_proxy_charm | 2fd2150b-0624-4aa1-be11-487c329c7da7 | 2024-02-18T18:00:32 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0a1eba44-84fb- |
|                        |                                      |                     |          |                   | 4c05-9d1c-108ad184c5bb, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_05-k8s_proxy_charm == k8s_05-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                           |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | ec6dd930-28db-424c-9d51-7cc114ea56a6 | 2024-02-18T18:36:18 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.204994e4-ee5c- |
|                                 |                                      |                     |          |                   | 4708-8a38-bfc7021c068d, Stage 2/5:      |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                 |                                      |                     |          |                   | environments.                           |
|                                 |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                 |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                 |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                 |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get the NS id and save it NS_ID suite variable to use... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 4974d785-57e0-433f-8250-5fa60d875c63 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_06-nopasswd_k8s_proxy_charm == k8s_06-nopasswd_k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor :: Upload VNF package for t... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor :: Upload NS package for the... | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s-scale | b24bdb49-a38a-4d34-b50a-9a4d372f5b7b | 2024-02-18T19:15:13 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.8b21d558-eaf0- |
|                  |                                      |                     |          |                   | 422f-a14a-e4999177037d, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '28c81fb5-6cd3-42aa-9eb3-2ecf58d47eb7'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | FAIL |
native-kdu
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | FAIL |
Invalid IF condition: Evaluating expression ' != 2' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${INITIAL_KDU_COUNT} != ${INSTANTIATION_COUNT}' were resolved before the expression was evaluated. Try using '$INITIAL_KDU_COUNT != $INSTANTIATION_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | FAIL |
The ns-action with id 2658a483-20c0-4f96-93bd-5b3301df24af was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | FAIL |
Invalid IF condition: Evaluating expression ' !=  + 1' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT} + 1' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT + 1' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | FAIL |
The ns-action with id edfb5462-4c02-45c4-bfaf-dbbf0d07c998 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | FAIL |
Invalid IF condition: Evaluating expression ' != ' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT}' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor :: Upload VNF package for the tes... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| pebble-charm-k8s | 00e08f67-8daf-47be-ae8e-104a0a51b67f | 2024-02-18T19:15:59 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.89bc642c-774a- |
|                  |                                      |                     |          |                   | 446b-8163-186ed0cc230f, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '28c81fb5-6cd3-42aa-9eb3-2ecf58d47eb7'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id d1a93fe5-f84f-422f-a99f-44dcedb9abea was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS package.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF package.                 | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete the tar.gz files associated to th... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_10-k8s_proxy_charm | 0cb07f8a-776a-4a0a-96fc-c51e8084b5d4 | 2024-02-18T19:16:34 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.d91d1d5a-89fe- |
|                        |                                      |                     |          |                   | 4ff6-aef1-9876cb3cd870, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_10-k8s_proxy_charm == k8s_10-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register K8s cluster in OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ldap             | eff1f072-c563-4a64-abb0-b4c1fafa1c44 | 2024-02-18T19:53:00 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0d4a1f28-712d- |
|                  |                                      |                     |          |                   | 4962-b8c3-74b5ea32bbe3, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA openldap.: create |
|                  |                                      |                     |          |                   | execution environment. 'cacert'         |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id from OSM.                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get VNF instance id from OSM.                           /bin/sh: 2: Syntax error: "|" unexpected
| FAIL |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| vnf id                               | name | ns id                                | vnf member index | vnfd name    | vim account id                       | ip address |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| c6669d6d-d59b-41a3-b05b-09ef5f3dd58e | -    | eff1f072-c563-4a64-abb0-b4c1fafa1c44 | openldap         | openldap_knf | 946dec68-6289-4311-b8c8-cc7f7b0d12e3 | None       |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | FAIL |
The ns-action with id cd8da3be-8924-4602-9b9f-f57ba9641d14 was not completed
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: ldap == ldap
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | FAIL |
15 tests, 6 passed, 9 failed
==============================================================================
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 61: Setting variable '${REPO_PASSWORD}' failed: Environment variable '%{OCI_REGISTRY_PASSWORD}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 59: Setting variable '${REPO_URI}' failed: Environment variable '%{OCI_REGISTRY_URL}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 60: Setting variable '${REPO_USER}' failed: Environment variable '%{OCI_REGISTRY_USER}' not found.
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | FAIL |
Variable '${REPO_URI}' not found.
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details                            |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ldap             | eff1f072-c563-4a64-abb0-b4c1fafa1c44 | 2024-02-18T19:53:00 | BROKEN   | IDLE (None)                                          | Operation: TERMINATING.204746bb-b1bb-    |
|                  |                                      |                     |          |                                                      | 40d9-957a-7748375df9a0, Stage 3/3 delete |
|                  |                                      |                     |          |                                                      | all..                                    |
|                  |                                      |                     |          |                                                      | Detail: Terminating all VCA: 'cacert'    |
| ldap             | eee7390a-cd4d-489c-aa65-075f2f30dd72 | 2024-02-18T20:30:06 | BUILDING | INSTANTIATING (83c8558e-81c3-417e-ab81-e82582245fb0) | N/A                                      |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           /bin/sh: 2: eee7390a-cd4d-489c-aa65-075f2f30dd72: not found
/bin/sh: 3: eee7390a-cd4d-489c-aa65-075f2f30dd72: not found
| PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82df190>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8304670>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8305090>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82cc460>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81cc1c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81cdde0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8305930>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b83062f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82dc550>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82dfdf0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82dd150>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81ce8c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81cd210>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82cc520>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81cf7f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
| FAIL |
Keyword 'Get Metric' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82cf7f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81fb1c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81cc880>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b820d3c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b820f0a0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8234d00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b820f730>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b820f0d0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b84a20e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8305de0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8305de0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81fb6a0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b81fb880>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8234d60>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8259000>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b825a500>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
| FAIL |
Keyword 'Check VIM-based Metric Exceeds Threshold' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b825a110>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b8275a50>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D
| FAIL |
ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220a86b81b-6243-4fa2-b20f-2c9e00b7d303%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7fe7b82751b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | FAIL |
15 tests, 12 passed, 3 failed
==============================================================================
Testsuite                                                             | FAIL |
287 tests, 172 passed, 115 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html