SuccessConsole Output

[azure_robot_tests] Running shell script
+ . /robot-systest/results/osm_environment.rc
+ export CLOUD_TYPE=azure
+ export OSM_IP_ADDRESS=172.21.23.13
+ export OSM_HOSTNAME=nbi.172.21.23.13.nip.io
+ export OSM_IMAGE_NAME=osmtest202406301118
+ export JUJU_PASSWORD=secret
+ . /robot-systest/results/k8s_environment.rc
+ export CLOUD_TYPE=azure
+ export USE_PAAS_K8S=FALSE
+ export K8S_IP=172.21.23.12
+ export K8S_IMAGE_NAME=k8stest202406301109
+ export K8S_CREDENTIALS=/robot-systest/results/kubeconfig.yaml
+ /robot-systest/run_test.sh -t azure
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | FAIL |
'+------------------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                         | id                                   | date                | ns state | current operation | error details                            |
+------------------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_05_instantiation_params_cloud_init | 80cd4f76-1e01-4b10-bbd8-3c14c2f157ca | 2024-06-30T11:31:11 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.44a917fd-8217-  |
|                                          |                                      |                     |          |                   | 4a7b-80b9-ffabb4c04004, Stage 2/5:       |
|                                          |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                                          |                                      |                     |          |                   | environments.   ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | name can be up to 80 characters long. It |
|                                          |                                      |                     |          |                   | must begin with a word character, and it |
|                                          |                                      |                     |          |                   | must end with a word character or with   |
|                                          |                                      |                     |          |                   | '_'. The name may contain word           |
|                                          |                                      |                     |          |                   | characters or '.', '-', '_'.             |
+------------------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | FAIL |
msg=IP address of the management VNF is not available
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | FAIL |
8 tests, 5 passed, 3 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiates the NS for the t... | FAIL |
'+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name    | id                                   | date                | ns state | current operation | error details                           |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_06_charm_test | c4cdb12c-7db0-4407-9f74-8c103ab560b9 | 2024-06-30T11:32:32 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.7c995ab8-7b14- |
|                     |                                      |                     |          |                   | 4669-ae33-aee8937dacf5, Stage 2/5:      |
|                     |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                     |                                      |                     |          |                   | environments.                           |
|                     |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                     |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                     |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                     |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check VNF Charm Application Name :: Checks that the charm applicat... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_06_charm_test == basic_06_charm_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | FAIL |
12 tests, 2 passed, 10 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service :: Instantiate NS for t... | FAIL |
'+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name               | id                                   | date                | ns state | current operation | error details                           |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_07_secure_key_management | c8d54087-804f-49e0-8a02-4d5c0153405f | 2024-06-30T12:09:23 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.97e5473b-6192- |
|                                |                                      |                     |          |                   | 4daa-9a29-df1030594e9a, Stage 2/5:      |
|                                |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                |                                      |                     |          |                   | environments.                           |
|                                |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                |                                      |                     |          |                   | environment. 'cacert'                   |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id.                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the VNF ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | FAIL |
The ns-action with id 4ef5cdc2-e6aa-4d7b-91fa-2828d0c17d12 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_07_secure_key_management == basic_07_secure_key_management
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | FAIL |
'+------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name             | id                                   | date                | ns state | current operation | error details                            |
+------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_09_manual_scaling_test | 2c63a105-1d43-478a-9045-eb362c2be53d | 2024-06-30T12:46:21 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0d88ef3c-6f6b-  |
|                              |                                      |                     |          |                   | 4728-9ac8-d59ffc4e1181, Stage 2/5:       |
|                              |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                              |                                      |                     |          |                   | environments.               ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | long. It must begin with a word          |
|                              |                                      |                     |          |                   | character, and it must end with a word   |
|                              |                                      |                     |          |                   | character or with '_'. The name may      |
|                              |                                      |                     |          |                   | contain word characters or '.', '-',     |
|                              |                                      |                     |          |                   | '_'.                                     |
+------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
The ns-action with id c36517aa-c8fd-4d45-82c2-f6ab146a1c0e was not completed
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
The ns-action with id 610157ba-e701-4099-a4d2-d9f8bb523a0e was not completed
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
There is the same number of VDU records in the VNF after Scale In
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | FAIL |
13 tests, 9 passed, 4 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_11_native_charms | 8b8a8f73-4741-493f-949d-b47046f05222 | 2024-06-30T12:48:16 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.663e908c-5d1a-  |
|                        |                                      |                     |          |                   | 43b6-96cc-a06c2bc1ee7d, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.14', 'username': |
|                        |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                        |                                      |                     |          |                   | vnf2.mgmtVM: register execution          |
|                        |                                      |                     |          |                   | environment {'hostname': '172.21.23.15', |
|                        |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_11_native_charms == basic_11_native_charms
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 2 passed, 7 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds :: Upload VNF packages for the testsuite.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Upload Nsd :: Upload NS package for the testsuite.                    | FAIL |
1 != 0
------------------------------------------------------------------------------
Instantiate NS :: Instantiate NS for the testsuite.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Check NS Charm Application Name :: Check that the NS charm has the... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name :: Check that the VDU charm has t... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Delete NS :: Delete NS instance.                                      | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 1 passed, 8 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                           |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_13_ns_relations_test | 247c7346-47c3-45a2-a760-dc23494fd8ca | 2024-06-30T13:25:10 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.9dd1b5b5-a699- |
|                            |                                      |                     |          |                   | 433b-8a9b-ecd79d56408d, Stage 2/5:      |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | '172.21.23.14', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'. Deploying VCA vnf2.: register |
|                            |                                      |                     |          |                   | execution environment {'hostname':      |
|                            |                                      |                     |          |                   | '172.21.23.15', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'                                |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_13_ns_relations_test == basic_13_ns_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Provides :: Delete first VNF package from OSM.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Requires :: Delete second VNF package from OSM. | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name            | id                                   | date                | ns state | current operation | error details                            |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_14_vnf_relations_test | d00e26b3-ecd7-40bf-89a5-f5346939f911 | 2024-06-30T14:02:47 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.591fb893-5d24-  |
|                             |                                      |                     |          |                   | 41a7-8e50-3135390e100c, Stage 2/5:       |
|                             |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                             |                                      |                     |          |                   | environments.                ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'.         |
|                             |                                      |                     |          |                   | Deploying VCA vnf.simple_provides:       |
|                             |                                      |                     |          |                   | register execution environment           |
|                             |                                      |                     |          |                   | {'hostname': '172.21.23.15', 'username': |
|                             |                                      |                     |          |                   | 'ubuntu'}. 'cacert'                      |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_14_vnf_relations_test == basic_14_vnf_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | FAIL |
6 tests, 2 passed, 4 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
'+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                 | id                                   | date                | ns state | current operation | error details                            |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_20_manual_vdu_scaling_test | 88aa0b37-0908-4a3a-a325-6bb5f718ac8f | 2024-06-30T14:50:11 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.f3307c01-d054-  |
|                                  |                                      |                     |          |                   | 4a65-9167-d7dbb2102bd7, Stage 2/5:       |
|                                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                                  |                                      |                     |          |                   | environments.           ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.15', 'username': |
|                                  |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                                  |                                      |                     |          |                   | vnf.mgmtVM: register execution           |
|                                  |                                      |                     |          |                   | environment {'hostname': '172.21.23.14', |
|                                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on            | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | FAIL |
There are not 2 application name in the application list after Scale Out
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_20_manual_vdu_scaling_test == basic_20_manual_vdu_scaling_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfcloudinit == hfcloudinit
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfmultivdu == hfmultivdu
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor :: Upload NF package for the test... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s       | b44c9588-66b8-4cf9-96c1-d9559d3e78a1 | 2024-06-30T16:11:14 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.fb0fc3bc-263a- |
|                  |                                      |                     |          |                   | 408e-bb82-3624423380bc, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | 'ae490151-82e2-4a05-b9ea-3343bcfec0c1'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 3053738f-3e9e-4a9a-9d1d-b75a60bb3a3a was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete tar.gz NF and NS package files.      | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_05-k8s_proxy_charm | 48867a45-5f1c-4e20-834c-f0e0e282ae1a | 2024-06-30T16:15:09 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.f293cd5e-7873- |
|                        |                                      |                     |          |                   | 484b-ac66-a1b6983a96f5, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_05-k8s_proxy_charm == k8s_05-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                           |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | c55f5480-3f8b-4148-b3a4-2c9336aa1e56 | 2024-06-30T16:52:05 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.922722d6-fb27- |
|                                 |                                      |                     |          |                   | 4a18-adf2-76d84b5cd85e, Stage 2/5:      |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                 |                                      |                     |          |                   | environments.                           |
|                                 |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                 |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                 |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                 |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get the NS id and save it NS_ID suite variable to use... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 99002d1c-5055-47c8-9704-2236874a15ea was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_06-nopasswd_k8s_proxy_charm == k8s_06-nopasswd_k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | FAIL |
Keyword 'Check For VIM Target' failed after retrying for 1 minute. The last error was: k8s07_dummy == k8s07_dummy
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | FAIL |
10 tests, 9 passed, 1 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor :: Upload VNF package for t... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor :: Upload NS package for the... | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s-scale | e7f7bc3b-33d4-4e1d-ad2f-dc6ba118a2e7 | 2024-06-30T17:33:27 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.c5ade9ed-907f- |
|                  |                                      |                     |          |                   | 4fd6-8dbf-e492588acbbf, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | 'ae490151-82e2-4a05-b9ea-3343bcfec0c1'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | FAIL |
native-kdu
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | FAIL |
Invalid IF condition: Evaluating expression ' != 2' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${INITIAL_KDU_COUNT} != ${INSTANTIATION_COUNT}' were resolved before the expression was evaluated. Try using '$INITIAL_KDU_COUNT != $INSTANTIATION_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | FAIL |
The ns-action with id ab0b4931-be1f-41fa-a919-2d88f8100317 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | FAIL |
Invalid IF condition: Evaluating expression ' !=  + 1' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT} + 1' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT + 1' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | FAIL |
The ns-action with id e52a432f-3bbe-4503-941a-4271aecc3cef was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | FAIL |
Invalid IF condition: Evaluating expression ' != ' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT}' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor :: Upload VNF package for the tes... | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
1 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
ERROR: ns 'pebble-charm-k8s' not found
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS package.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF package.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete the tar.gz files associated to th... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | FAIL |
8 tests, 1 passed, 7 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_10-k8s_proxy_charm | e201aacc-8856-4e08-b15f-ddab15f19913 | 2024-06-30T17:34:42 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.fc638c59-9d9c- |
|                        |                                      |                     |          |                   | 4681-9280-238198b8114d, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_10-k8s_proxy_charm == k8s_10-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF :: Upload VNF package for the test... | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | FAIL |
1 != 0
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register K8s cluster in OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id from OSM.                             | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Get Vnf Id :: Get VNF instance id from OSM.                           | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | FAIL |
ERROR: ns 'ldap' not found
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | FAIL |
ERROR: ns 'ldap' not found
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | FAIL |
ERROR: ns 'ldap' not found
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | FAIL |
15 tests, 1 passed, 14 failed
==============================================================================
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 61: Setting variable '${REPO_PASSWORD}' failed: Environment variable '%{OCI_REGISTRY_PASSWORD}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 59: Setting variable '${REPO_URI}' failed: Environment variable '%{OCI_REGISTRY_URL}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 60: Setting variable '${REPO_USER}' failed: Environment variable '%{OCI_REGISTRY_USER}' not found.
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | FAIL |
Variable '${REPO_URI}' not found.
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ldap             | bf30ec1d-f52e-428d-9ff4-a37869ead267 | 2024-06-30T18:12:51 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.eed335c6-3770-  |
|                  |                                      |                     |          |                   | 4edf-a988-9f84f09960c2, Stage 2/5:       |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                  |                                      |                     |          |                   | environments.                            |
|                  |                                      |                     |          |                   | Detail: Deploying KDU ldap: Error        |
|                  |                                      |                     |          |                   | executing command: env KUBECONFIG=/app/s |
|                  |                                      |                     |          |                   | torage/ae490151-82e2-4a05-b9ea-         ...
    [ Message content over the limit has been removed. ]
...|          |                   | /usr/local/bin/helm3 install osm-gitlab- |
|                  |                                      |                     |          |                   | openldap-0080592321 --atomic --output    |
|                  |                                      |                     |          |                   | yaml  -f 0027128105.yaml --timeout 1800s |
|                  |                                      |                     |          |                   | --namespace                              |
|                  |                                      |                     |          |                   | 44ae844e-83bc-4b42-8d58-408200d0f0e7     |
|                  |                                      |                     |          |                   | osm-gitlab/openldap                      |
|                  |                                      |                     |          |                   | Output: Error: INSTALLATION FAILED: repo |
|                  |                                      |                     |          |                   | osm-gitlab not found                     |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           /bin/sh: 2: Syntax error: "|" unexpected
| FAIL |
+--------------------------------------+------+--------------------------------------+------------------+------------------+--------------------------------------+------------+
| vnf id                               | name | ns id                                | vnf member index | vnfd name        | vim account id                       | ip address |
+--------------------------------------+------+--------------------------------------+------------------+------------------+--------------------------------------+------------+
| 11077e0a-1737-4d14-a80b-44d8b670c4d5 | -    | bf30ec1d-f52e-428d-9ff4-a37869ead267 | two_helm_oci     | two_helm_oci_knf | 798fb69b-191f-4ce5-aca1-c81ea2d3d235 | None       |
+--------------------------------------+------+--------------------------------------+------------------+------------------+--------------------------------------+------------+
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | FAIL |
The ns-action with id 2075a96f-170f-4fbf-8cc8-f730bf30cfca was not completed
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | FAIL |
The ns-action with id dac09120-e9f2-4cb4-a87f-7a1715546d74 was not completed
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | FAIL |
18 tests, 8 passed, 10 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a89ca00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a754820>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a756530>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a757040>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48d8a1d0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48da3a30>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4bba4580>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a755810>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48d49540>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4bbcd420>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a757a30>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4bbcd9c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a6f4820>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48da1fc0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48da1090>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
| FAIL |
Keyword 'Get Metric' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48da19f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48cbafe0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48cbad10>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48ad2680>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48aedb40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48aefd90>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48ad0d00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48ad3580>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4bbceb00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48ad3640>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48d4ae30>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d4a6f6aa0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48cba920>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48cbb5e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48aef520>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48b0c3a0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
| FAIL |
Keyword 'Check VIM-based Metric Exceeds Threshold' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48b0c5e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48b0e920>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D
| FAIL |
ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%220336d1d6-26b1-4f09-95d4-fbccdc214a79%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f4d48b0eb60>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | FAIL |
15 tests, 12 passed, 3 failed
==============================================================================
Testsuite                                                             | FAIL |
287 tests, 153 passed, 134 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html