SuccessConsole Output

[azure_robot_tests] Running shell script
+ . /robot-systest/results/osm_environment.rc
+ export CLOUD_TYPE=azure
+ export OSM_HOSTNAME=172.21.23.11
+ export OSM_IMAGE_NAME=osmtest202405051115
+ export JUJU_PASSWORD=secret
+ . /robot-systest/results/k8s_environment.rc
+ export CLOUD_TYPE=azure
+ export USE_PAAS_K8S=FALSE
+ export K8S_IP=172.21.23.10
+ export K8S_IMAGE_NAME=k8stest202405051108
+ export K8S_CREDENTIALS=/robot-systest/results/kubeconfig.yaml
+ /robot-systest/run_test.sh -t azure
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiates the NS for the t... | FAIL |
'+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name    | id                                   | date                | ns state | current operation | error details                           |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_06_charm_test | 55eaa0eb-dce2-4735-8bf4-87add1c21177 | 2024-05-05T11:34:27 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.0002c917-d4df- |
|                     |                                      |                     |          |                   | 43a9-9a4f-48d9f7be0876, Stage 2/5:      |
|                     |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                     |                                      |                     |          |                   | environments.                           |
|                     |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                     |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                     |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                     |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check VNF Charm Application Name :: Checks that the charm applicat... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_06_charm_test == basic_06_charm_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | FAIL |
12 tests, 2 passed, 10 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service :: Instantiate NS for t... | FAIL |
'+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name               | id                                   | date                | ns state | current operation | error details                           |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_07_secure_key_management | c1764e6d-c87d-41c7-93db-1de508ac5dcf | 2024-05-05T12:10:55 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.bfba7cc0-6131- |
|                                |                                      |                     |          |                   | 4b1c-9c61-649770a08f19, Stage 2/5:      |
|                                |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                |                                      |                     |          |                   | environments.                           |
|                                |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                |                                      |                     |          |                   | environment. 'cacert'                   |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id.                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the VNF ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | FAIL |
The ns-action with id 6077386b-9f6c-4369-a42a-5d0938a898e7 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_07_secure_key_management == basic_07_secure_key_management
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_11_native_charms | 9e2f6243-eb10-434b-aa58-dc875950023b | 2024-05-05T12:54:53 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.548a1e89-5965-  |
|                        |                                      |                     |          |                   | 45c8-87d3-0117317a4437, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.12', 'username': |
|                        |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                        |                                      |                     |          |                   | vnf2.mgmtVM: register execution          |
|                        |                                      |                     |          |                   | environment {'hostname': '172.21.23.13', |
|                        |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_11_native_charms == basic_11_native_charms
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 2 passed, 7 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds :: Upload VNF packages for the testsuite.                | PASS |
------------------------------------------------------------------------------
Upload Nsd :: Upload NS package for the testsuite.                    | PASS |
------------------------------------------------------------------------------
Instantiate NS :: Instantiate NS for the testsuite.                   | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| test_nscharm     | cbd01d1d-e5d0-46af-b18c-38d5c21efd81 | 2024-05-05T13:30:57 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.a5027e3c-69a5- |
|                  |                                      |                     |          |                   | 439d-9086-c3e33219a612, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA 1.userVM: create  |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA 2.policyVM: create        |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                  |                                      |                     |          |                   | Deploying VCA .: create execution       |
|                  |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check NS Charm Application Name :: Check that the NS charm has the... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name :: Check that the VDU charm has t... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Delete NS :: Delete NS instance.                                      | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: test_nscharm == test_nscharm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 3 passed, 6 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                           |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_13_ns_relations_test | 9ec11fcd-8d1f-4bc0-8f8c-f68d54c09ca6 | 2024-05-05T14:07:52 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.b87cb651-b487- |
|                            |                                      |                     |          |                   | 4719-bd75-e31a9cfd6528, Stage 2/5:      |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | '172.21.23.12', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'. Deploying VCA vnf2.: register |
|                            |                                      |                     |          |                   | execution environment {'hostname':      |
|                            |                                      |                     |          |                   | '172.21.23.13', 'username': 'ubuntu'}.  |
|                            |                                      |                     |          |                   | 'cacert'                                |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_13_ns_relations_test == basic_13_ns_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Provides :: Delete first VNF package from OSM.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Requires :: Delete second VNF package from OSM. | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name            | id                                   | date                | ns state | current operation | error details                            |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_14_vnf_relations_test | eac1e4e1-6e42-4ade-b4a2-5780bb25a31c | 2024-05-05T14:44:49 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.df6b0919-1b2c-  |
|                             |                                      |                     |          |                   | 40c2-a9c2-3aee8183e1d5, Stage 2/5:       |
|                             |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                             |                                      |                     |          |                   | environments.                ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'.         |
|                             |                                      |                     |          |                   | Deploying VCA vnf.simple_provides:       |
|                             |                                      |                     |          |                   | register execution environment           |
|                             |                                      |                     |          |                   | {'hostname': '172.21.23.13', 'username': |
|                             |                                      |                     |          |                   | 'ubuntu'}. 'cacert'                      |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_14_vnf_relations_test == basic_14_vnf_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | FAIL |
6 tests, 2 passed, 4 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
'+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                 | id                                   | date                | ns state | current operation | error details                            |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_20_manual_vdu_scaling_test | 57d13ad0-b847-4f05-9fa2-77af87c61b05 | 2024-05-05T15:31:53 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.c6cbfaaa-       |
|                                  |                                      |                     |          |                   | bf35-49cc-9d52-9971be48468d, Stage 2/5:  |
|                                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                                  |                                      |                     |          |                   | environments.           ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.12', 'username': |
|                                  |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                                  |                                      |                     |          |                   | vnf.mgmtVM: register execution           |
|                                  |                                      |                     |          |                   | environment {'hostname': '172.21.23.13', |
|                                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on            | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | FAIL |
There are not 2 application name in the application list after Scale Out
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_20_manual_vdu_scaling_test == basic_20_manual_vdu_scaling_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfcloudinit == hfcloudinit
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfmultivdu == hfmultivdu
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor :: Upload NF package for the test... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s       | 96611b59-953b-4d79-a1cf-44106c69360b | 2024-05-05T16:52:51 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.88a90d9d-f8b8- |
|                  |                                      |                     |          |                   | 4724-ac45-e810d711f863, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '84b977b4-1606-47ce-b7cb-feffb690b158'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id d061c4dc-f1a8-4d73-87c5-54150ec7870d was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete tar.gz NF and NS package files.      | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_05-k8s_proxy_charm | f96f20da-7e0e-43ba-9785-422a73a5e3c3 | 2024-05-05T16:56:42 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.c6625368-89b1- |
|                        |                                      |                     |          |                   | 4229-8322-44868f43b874, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_05-k8s_proxy_charm == k8s_05-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                           |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | 8b6cf100-b130-4940-9b04-a2c907ed7982 | 2024-05-05T17:32:26 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.80f4bbc8-c59c- |
|                                 |                                      |                     |          |                   | 4254-a7de-e6d9ccd3d8fa, Stage 2/5:      |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                 |                                      |                     |          |                   | environments.                           |
|                                 |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                 |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                 |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                 |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get the NS id and save it NS_ID suite variable to use... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id ac7b575d-6e56-4af2-bfcc-50de233c21a6 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_06-nopasswd_k8s_proxy_charm == k8s_06-nopasswd_k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor :: Upload VNF package for t... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor :: Upload NS package for the... | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s-scale | 73dadc9b-7b09-42e4-8843-afbf93ff8a6a | 2024-05-05T18:12:04 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.722b6648-47aa- |
|                  |                                      |                     |          |                   | 4d5e-ad0c-7845220de546, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '84b977b4-1606-47ce-b7cb-feffb690b158'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | FAIL |
native-kdu
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | FAIL |
Invalid IF condition: Evaluating expression ' != 2' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${INITIAL_KDU_COUNT} != ${INSTANTIATION_COUNT}' were resolved before the expression was evaluated. Try using '$INITIAL_KDU_COUNT != $INSTANTIATION_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | FAIL |
The ns-action with id 4d9188d5-be17-415e-9cbf-52cd3170a902 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | FAIL |
Invalid IF condition: Evaluating expression ' !=  + 1' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT} + 1' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT + 1' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | FAIL |
The ns-action with id 740be613-bdbc-436f-9582-1d8bab009a9c was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | FAIL |
Invalid IF condition: Evaluating expression ' != ' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT}' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor :: Upload VNF package for the tes... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| pebble-charm-k8s | eb9de824-3898-4736-871c-e06cdec6327a | 2024-05-05T18:12:52 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.eeeafbbb-c6f5- |
|                  |                                      |                     |          |                   | 447d-baba-971f06901d86, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '84b977b4-1606-47ce-b7cb-feffb690b158'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 3e765527-50c2-4840-b535-8700cd44e8c7 was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS package.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF package.                 | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete the tar.gz files associated to th... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_10-k8s_proxy_charm | 4f46f3a3-4674-4ff4-a80d-cee7a5de6b97 | 2024-05-05T18:13:29 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.20fae48b-72dd- |
|                        |                                      |                     |          |                   | 4425-8331-946b800b2e22, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_10-k8s_proxy_charm == k8s_10-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register K8s cluster in OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ldap             | 43c65036-8df0-4305-93b9-422023264286 | 2024-05-05T18:49:54 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.9195e404-e93f- |
|                  |                                      |                     |          |                   | 4943-994a-dd9c64432be9, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA openldap.: create |
|                  |                                      |                     |          |                   | execution environment. 'cacert'         |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id from OSM.                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get VNF instance id from OSM.                           /bin/sh: 2: Syntax error: "|" unexpected
| FAIL |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| vnf id                               | name | ns id                                | vnf member index | vnfd name    | vim account id                       | ip address |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| 53e480f6-481a-4f16-a412-91d3a91e0447 | -    | 43c65036-8df0-4305-93b9-422023264286 | openldap         | openldap_knf | 97fa17bf-6a80-4d6d-8cf8-0031f034edc8 | None       |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | FAIL |
The ns-action with id 9e372b9a-634f-422e-a651-38e784842dc3 was not completed
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: ldap == ldap
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | FAIL |
15 tests, 6 passed, 9 failed
==============================================================================
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 61: Setting variable '${REPO_PASSWORD}' failed: Environment variable '%{OCI_REGISTRY_PASSWORD}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 59: Setting variable '${REPO_URI}' failed: Environment variable '%{OCI_REGISTRY_URL}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 60: Setting variable '${REPO_USER}' failed: Environment variable '%{OCI_REGISTRY_USER}' not found.
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | FAIL |
Variable '${REPO_URI}' not found.
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details                            |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ldap             | 43c65036-8df0-4305-93b9-422023264286 | 2024-05-05T18:49:54 | BROKEN   | IDLE (None)                                          | Operation: TERMINATING.536ae72f-a7a2-    |
|                  |                                      |                     |          |                                                      | 4995-a113-39b9d24ac746, Stage 3/3 delete |
|                  |                                      |                     |          |                                                      | all..                                    |
|                  |                                      |                     |          |                                                      | Detail: Terminating all VCA: 'cacert'    |
| ldap             | ef331fd7-04d0-4a62-b8ce-be0ad394de38 | 2024-05-05T19:27:07 | BUILDING | INSTANTIATING (185db62d-3613-4829-bc31-a51a3b82000d) | N/A                                      |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           /bin/sh: 2: ef331fd7-04d0-4a62-b8ce-be0ad394de38: not found
/bin/sh: 3: ef331fd7-04d0-4a62-b8ce-be0ad394de38: not found
| PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cc08e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e91cf0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e77880>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e76e30>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a3d591e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e76770>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a2ab7760>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cd88b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cda410>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cd9900>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cda6b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a2ab7280>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a2ab6740>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a2ab51b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e765f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
| FAIL |
Keyword 'Get Metric' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e75f90>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0cc0340>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e913c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e92530>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0bc5990>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e91120>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0bde2c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0c004f0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0c026e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0c1c910>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0bdec20>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0c02ef0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0bded70>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0bc5210>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e93fa0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e91d20>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
| FAIL |
Keyword 'Check VIM-based Metric Exceeds Threshold' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e937c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a0e76d10>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D
| FAIL |
ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%222eeab13b-925f-42ea-a809-9432ae74f2ee%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f75a2975060>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | FAIL |
15 tests, 12 passed, 3 failed
==============================================================================
Testsuite                                                             | FAIL |
287 tests, 172 passed, 115 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html