SuccessConsole Output

[azure_robot_tests] Running shell script
+ . /robot-systest/results/osm_environment.rc
+ export CLOUD_TYPE=azure
+ export OSM_HOSTNAME=172.21.23.11
+ export OSM_IMAGE_NAME=osmtest202405191116
+ export JUJU_PASSWORD=secret
+ . /robot-systest/results/k8s_environment.rc
+ export CLOUD_TYPE=azure
+ export USE_PAAS_K8S=FALSE
+ export K8S_IP=172.21.23.10
+ export K8S_IMAGE_NAME=k8stest202405191109
+ export K8S_CREDENTIALS=/robot-systest/results/kubeconfig.yaml
+ /robot-systest/run_test.sh -t azure
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiates the NS for the t... | FAIL |
'+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name    | id                                   | date                | ns state | current operation | error details                           |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_06_charm_test | 457dbb5c-a1f0-4554-8ef7-9d5fcfa69671 | 2024-05-19T11:34:57 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.d6f1cd86-078a- |
|                     |                                      |                     |          |                   | 48ac-b09e-48defd47d122, Stage 2/5:      |
|                     |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                     |                                      |                     |          |                   | environments.                           |
|                     |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                     |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                     |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                     |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check VNF Charm Application Name :: Checks that the charm applicat... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_06_charm_test == basic_06_charm_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | FAIL |
12 tests, 2 passed, 10 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service :: Instantiate NS for t... | FAIL |
'+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name               | id                                   | date                | ns state | current operation | error details                           |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_07_secure_key_management | 100c404e-7f26-408c-a344-75a69df7c710 | 2024-05-19T12:11:08 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.dea1c123-5402- |
|                                |                                      |                     |          |                   | 4581-b955-0441b34cf198, Stage 2/5:      |
|                                |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                |                                      |                     |          |                   | environments.                           |
|                                |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                |                                      |                     |          |                   | environment. 'cacert'                   |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id.                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the VNF ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | FAIL |
The ns-action with id 77186c29-815b-44dc-bfeb-50ee2a3ab02b was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_07_secure_key_management == basic_07_secure_key_management
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_11_native_charms | c8216328-1664-4b83-bc0c-8b94a54c5709 | 2024-05-19T12:53:47 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.69a52517-1499-  |
|                        |                                      |                     |          |                   | 40f4-826a-1b7125f583e4, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.12', 'username': |
|                        |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                        |                                      |                     |          |                   | vnf2.mgmtVM: register execution          |
|                        |                                      |                     |          |                   | environment {'hostname': '172.21.23.13', |
|                        |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_11_native_charms == basic_11_native_charms
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 2 passed, 7 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds :: Upload VNF packages for the testsuite.                | PASS |
------------------------------------------------------------------------------
Upload Nsd :: Upload NS package for the testsuite.                    | PASS |
------------------------------------------------------------------------------
Instantiate NS :: Instantiate NS for the testsuite.                   | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| test_nscharm     | 8b3d9fbf-f68d-49d8-83af-d32e8629b2b3 | 2024-05-19T13:29:47 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.34bb7a06-40e2- |
|                  |                                      |                     |          |                   | 4540-aba9-e27221335391, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA 1.userVM: create  |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA 2.policyVM: create        |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA .: create execution       |
|                  |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check NS Charm Application Name :: Check that the NS charm has the... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name :: Check that the VDU charm has t... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Delete NS :: Delete NS instance.                                      | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: test_nscharm == test_nscharm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 3 passed, 6 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                           |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_13_ns_relations_test | 24b24da6-68e1-4854-a334-9decc7a570f9 | 2024-05-19T14:06:39 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.43e49e31-9ab9- |
|                            |                                      |                     |          |                   | 4829-91f6-34541a71df91, Stage 2/5:      |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | '172.21.23.12', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'. Deploying VCA vnf2.: register |
|                            |                                      |                     |          |                   | execution environment {'hostname':      |
|                            |                                      |                     |          |                   | '172.21.23.13', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'                                |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_13_ns_relations_test == basic_13_ns_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Provides :: Delete first VNF package from OSM.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Requires :: Delete second VNF package from OSM. | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name            | id                                   | date                | ns state | current operation | error details                            |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_14_vnf_relations_test | e3e43726-fa46-4d35-8f0b-568ab928f9fe | 2024-05-19T14:43:33 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.14f440f2-19b4-  |
|                             |                                      |                     |          |                   | 4b5d-9498-12813d6eb469, Stage 2/5:       |
|                             |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                             |                                      |                     |          |                   | environments.                ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'.         |
|                             |                                      |                     |          |                   | Deploying VCA vnf.simple_provides:       |
|                             |                                      |                     |          |                   | register execution environment           |
|                             |                                      |                     |          |                   | {'hostname': '172.21.23.13', 'username': |
|                             |                                      |                     |          |                   | 'ubuntu'}. 'cacert'                      |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_14_vnf_relations_test == basic_14_vnf_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | FAIL |
6 tests, 2 passed, 4 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
'+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                 | id                                   | date                | ns state | current operation | error details                            |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_20_manual_vdu_scaling_test | f48129dd-9637-4529-bee5-898acf5255e6 | 2024-05-19T15:30:48 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0fee11db-3660-  |
|                                  |                                      |                     |          |                   | 44dc-862e-44fcb16789c3, Stage 2/5:       |
|                                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                                  |                                      |                     |          |                   | environments.           ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.12', 'username': |
|                                  |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                                  |                                      |                     |          |                   | vnf.mgmtVM: register execution           |
|                                  |                                      |                     |          |                   | environment {'hostname': '172.21.23.13', |
|                                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on            | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | FAIL |
There are not 2 application name in the application list after Scale Out
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_20_manual_vdu_scaling_test == basic_20_manual_vdu_scaling_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfcloudinit == hfcloudinit
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfmultivdu == hfmultivdu
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor :: Upload NF package for the test... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s       | bd03f535-7a9a-4577-9541-63d9addb9b51 | 2024-05-19T16:51:24 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.8f7bb978-0cce- |
|                  |                                      |                     |          |                   | 481f-b9a0-7842e36e2b5b, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | 'b23452a1-ee8e-425f-a7f4-d08b2acd86e0'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 33497e6e-f825-4705-8c47-a8820ba63574 was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete tar.gz NF and NS package files.      | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_05-k8s_proxy_charm | a25f5037-00cf-4b20-82fc-d3d8d678bcaa | 2024-05-19T16:55:15 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.2668d9f7-5853- |
|                        |                                      |                     |          |                   | 44cc-b962-caf3a5a4866e, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_05-k8s_proxy_charm == k8s_05-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                           |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | cfae7422-c2f8-44f2-89e9-d90c5e5eb727 | 2024-05-19T17:31:01 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.b03d62f2-6eaf- |
|                                 |                                      |                     |          |                   | 4374-a00c-71e9e1d38dc9, Stage 2/5:      |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                 |                                      |                     |          |                   | environments.                           |
|                                 |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                 |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                 |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                 |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get the NS id and save it NS_ID suite variable to use... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 387e2153-f058-4660-b20e-127399782dfa was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_06-nopasswd_k8s_proxy_charm == k8s_06-nopasswd_k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor :: Upload VNF package for t... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor :: Upload NS package for the... | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s-scale | 93323628-0a93-4dd2-89bf-f937481eda19 | 2024-05-19T18:09:58 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.dfdca3b4-4ef9- |
|                  |                                      |                     |          |                   | 4f6e-89a0-762b2c3d31f4, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | 'b23452a1-ee8e-425f-a7f4-d08b2acd86e0'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | FAIL |
native-kdu
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | FAIL |
Invalid IF condition: Evaluating expression ' != 2' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${INITIAL_KDU_COUNT} != ${INSTANTIATION_COUNT}' were resolved before the expression was evaluated. Try using '$INITIAL_KDU_COUNT != $INSTANTIATION_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | FAIL |
The ns-action with id acdde691-9157-449d-90da-a10ccf84e748 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | FAIL |
Invalid IF condition: Evaluating expression ' !=  + 1' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT} + 1' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT + 1' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | FAIL |
The ns-action with id c9aea220-f51d-40ca-b2a9-e7a7387bccf2 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | FAIL |
Invalid IF condition: Evaluating expression ' != ' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT}' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor :: Upload VNF package for the tes... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| pebble-charm-k8s | 2f39ba83-de8b-4a26-b3bb-dffb70cfca1e | 2024-05-19T18:10:47 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.ae5013dc-9b3f- |
|                  |                                      |                     |          |                   | 4813-8413-e3e075f791aa, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | 'b23452a1-ee8e-425f-a7f4-d08b2acd86e0'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id bf02cac9-537a-43a2-807c-e859b45c7ca5 was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS package.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF package.                 | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete the tar.gz files associated to th... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_10-k8s_proxy_charm | a945f83a-7d95-4682-8872-68f2edb88fd0 | 2024-05-19T18:11:25 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.60a11d2f-6b7a- |
|                        |                                      |                     |          |                   | 4e8b-898d-2d377cbca5d1, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_10-k8s_proxy_charm == k8s_10-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register K8s cluster in OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ldap             | e511ee65-cb49-40ff-9faf-11cbc9e0ebd8 | 2024-05-19T18:47:51 | BROKEN   | IDLE (None)       | Operation:                               |
|                  |                                      |                     |          |                   | INSTANTIATING.438840ad-9784-4fdf-        |
|                  |                                      |                     |          |                   | afec-208c56c4ede0, Stage 2/5: deployment |
|                  |                                      |                     |          |                   | of KDUs, VMs and execution environments. |
|                  |                                      |                     |          |                   | Detail: Deploying VCA openldap.: create  |
|                  |                                      |                     |          |                   | execution environment. 'cacert'          |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id from OSM.                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get VNF instance id from OSM.                           /bin/sh: 2: Syntax error: "|" unexpected
| FAIL |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| vnf id                               | name | ns id                                | vnf member index | vnfd name    | vim account id                       | ip address |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| bfa02c64-ee03-4ca6-abcb-545b7cb1e28e | -    | e511ee65-cb49-40ff-9faf-11cbc9e0ebd8 | openldap         | openldap_knf | 2b84634f-fece-475d-a2b2-757fb39255d6 | None       |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | FAIL |
The ns-action with id 1806490d-14a2-4b27-8642-f296bc29f248 was not completed
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: ldap == ldap
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | FAIL |
15 tests, 6 passed, 9 failed
==============================================================================
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 61: Setting variable '${REPO_PASSWORD}' failed: Environment variable '%{OCI_REGISTRY_PASSWORD}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 59: Setting variable '${REPO_URI}' failed: Environment variable '%{OCI_REGISTRY_URL}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 60: Setting variable '${REPO_USER}' failed: Environment variable '%{OCI_REGISTRY_USER}' not found.
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | FAIL |
Variable '${REPO_URI}' not found.
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details                            |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ldap             | e511ee65-cb49-40ff-9faf-11cbc9e0ebd8 | 2024-05-19T18:47:51 | BROKEN   | IDLE (None)                                          | Operation: TERMINATING.1f5bbfd9-026c-    |
|                  |                                      |                     |          |                                                      | 4f07-b675-84fadb67567a, Stage 3/3 delete |
|                  |                                      |                     |          |                                                      | all..                                    |
|                  |                                      |                     |          |                                                      | Detail: Terminating all VCA: 'cacert'    |
| ldap             | c3462060-51ca-4603-8ec1-0f01f049e7d2 | 2024-05-19T19:25:04 | BUILDING | INSTANTIATING (3fe80bd8-0eae-4177-9cc0-a936e5bcf196) | N/A                                      |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           /bin/sh: 2: c3462060-51ca-4603-8ec1-0f01f049e7d2: not found
/bin/sh: 3: c3462060-51ca-4603-8ec1-0f01f049e7d2: not found
| PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625ed15a0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f06260368f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0628e89ed0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625ec0340>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f06260a1780>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f06260a2470>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625ec2e00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625eeba90>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625de9630>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625deb190>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625de8250>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e049d0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e06c80>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e30820>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e32380>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
| FAIL |
Keyword 'Get Metric' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e325c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625de9c00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625deb5b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f06260a0940>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0628f3d840>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625ee9b40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0628e68160>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625ed3220>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e30850>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e4de10>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e4ff40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e660e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e84310>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e86440>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e65390>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e66620>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
| FAIL |
Keyword 'Check VIM-based Metric Exceeds Threshold' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e67160>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e4fe50>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D
| FAIL |
ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%2244dead10-4641-4375-b972-d12a107856a5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f0625e4f160>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | FAIL |
15 tests, 12 passed, 3 failed
==============================================================================
Testsuite                                                             | FAIL |
287 tests, 172 passed, 115 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html