SuccessConsole Output

[azure_robot_tests] Running shell script
+ . /robot-systest/results/osm_environment.rc
+ export CLOUD_TYPE=azure
+ export OSM_HOSTNAME=172.21.23.6
+ export OSM_IMAGE_NAME=osmtest202401281215
+ export JUJU_PASSWORD=secret
+ . /robot-systest/results/k8s_environment.rc
+ export CLOUD_TYPE=azure
+ export USE_PAAS_K8S=FALSE
+ export K8S_IP=172.21.23.5
+ export K8S_IMAGE_NAME=k8stest202401281208
+ export K8S_CREDENTIALS=/robot-systest/results/kubeconfig.yaml
+ /robot-systest/run_test.sh -t azure
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiates the NS for the t... | FAIL |
'+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name    | id                                   | date                | ns state | current operation | error details                           |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_06_charm_test | 324f06f7-8db3-4a7e-ba6f-f7f60d2e2103 | 2024-01-28T12:34:42 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.f045c40d-6c68- |
|                     |                                      |                     |          |                   | 49a3-afd1-47e0cdac52a4, Stage 2/5:      |
|                     |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                     |                                      |                     |          |                   | environments.                           |
|                     |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                     |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                     |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                     |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check VNF Charm Application Name :: Checks that the charm applicat... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_06_charm_test == basic_06_charm_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | FAIL |
12 tests, 2 passed, 10 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service :: Instantiate NS for t... | FAIL |
'+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name               | id                                   | date                | ns state | current operation | error details                           |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_07_secure_key_management | b8e4f0d7-b8a9-4c6e-9061-e7a30f87f37b | 2024-01-28T13:11:19 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.188517b1-74d1- |
|                                |                                      |                     |          |                   | 49ca-844c-2be889804f6f, Stage 2/5:      |
|                                |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                |                                      |                     |          |                   | environments.                           |
|                                |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                |                                      |                     |          |                   | environment. 'cacert'                   |
+--------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id.                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the VNF ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | FAIL |
The ns-action with id 908ca66e-87b4-460e-8080-03ed84e489f7 was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_07_secure_key_management == basic_07_secure_key_management
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_11_native_charms | 7fe56503-c19f-460b-8759-09189f075487 | 2024-01-28T13:54:20 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.df374067-b818- |
|                        |                                      |                     |          |                   | 4c21-9821-eeed34089ddf, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | {'hostname': '172.21.23.7', 'username': |
|                        |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA      |
|                        |                                      |                     |          |                   | vnf2.mgmtVM: register execution         |
|                        |                                      |                     |          |                   | environment {'hostname': '172.21.23.8', |
|                        |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'         |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_11_native_charms == basic_11_native_charms
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 2 passed, 7 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds :: Upload VNF packages for the testsuite.                | PASS |
------------------------------------------------------------------------------
Upload Nsd :: Upload NS package for the testsuite.                    | PASS |
------------------------------------------------------------------------------
Instantiate NS :: Instantiate NS for the testsuite.                   | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| test_nscharm     | 5490a5f9-a434-4cf1-b644-1d87cecd0636 | 2024-01-28T14:31:05 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.85f05102-af00-  |
|                  |                                      |                     |          |                   | 457a-a546-683a69de4259, Stage 2/5:       |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                  |                                      |                     |          |                   | environments.                            |
|                  |                                      |                     |          |                   | Detail: Deploying VCA 1.userVM: create   |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.         |
|                  |                                      |                     |          |                   | Deploying VCA 2.policyVM: create         |
|                  |                                      |                     |          |                   | execution environment. 'cacert'.         |
|                  |                                      |                     |          |                   | Deploying VCA .: create execution        |
|                  |                                      |                     |          |                   | environment. 'cacert'. Deploying at VIM: |
|                  |                                      |                     |          |                   | Error at create vdu: unknown             |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check NS Charm Application Name :: Check that the NS charm has the... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name :: Check that the VDU charm has t... | FAIL |
Variable '${MODEL_NAME}' not found.
------------------------------------------------------------------------------
Delete NS :: Delete NS instance.                                      | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: test_nscharm == test_nscharm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 3 passed, 6 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                           |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_13_ns_relations_test | 3c7ff0ec-160f-428d-8531-067ec35e9faa | 2024-01-28T15:08:26 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.500162dd-c02f- |
|                            |                                      |                     |          |                   | 4861-8913-d756b39ed782, Stage 2/5:      |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | '172.21.23.7', 'username': 'ubuntu'}.   |
|                            |                                      |                     |          |                   | 'cacert'. Deploying VCA vnf2.: register |
|                            |                                      |                     |          |                   | execution environment {'hostname':      |
|                            |                                      |                     |          |                   | '172.21.23.8', 'username': 'ubuntu'}.   |
|                            |                                      |                     |          |                   | 'cacert'                                |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_13_ns_relations_test == basic_13_ns_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Provides :: Delete first VNF package from OSM.  | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Requires :: Delete second VNF package from OSM. | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name            | id                                   | date                | ns state | current operation | error details                           |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| basic_14_vnf_relations_test | 108e08dd-f942-4e36-8709-cf7ac9f84e48 | 2024-01-28T15:45:45 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.71d623a1-7dd8- |
|                             |                                      |                     |          |                   | 49d9-8998-9c896c863793, Stage 2/5:      |
|                             |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                             |                                      |                     |          |                   | environments.                ...
    [ Message content over the limit has been removed. ]
...                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'.        |
|                             |                                      |                     |          |                   | Deploying VCA vnf.simple_provides:      |
|                             |                                      |                     |          |                   | register execution environment          |
|                             |                                      |                     |          |                   | {'hostname': '172.21.23.8', 'username': |
|                             |                                      |                     |          |                   | 'ubuntu'}. 'cacert'                     |
+-----------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_14_vnf_relations_test == basic_14_vnf_relations_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | FAIL |
6 tests, 2 passed, 4 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
'+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                 | id                                   | date                | ns state | current operation | error details                            |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_20_manual_vdu_scaling_test | 25806f1d-123d-41e7-9aee-8565448e2d57 | 2024-01-28T16:32:32 | BROKEN   | IDLE (None)       | Operation:                               |
|                                  |                                      |                     |          |                   | INSTANTIATING.be6f37bf-c22d-4bed-        |
|                                  |                                      |                     |          |                   | ab0c-991c67dd0dcf, Stage 2/5: deployment |
|                                  |                                      |                     |          |                   | of KDUs, VMs and executi...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | {'hostname': '172.21.23.12', 'username': |
|                                  |                                      |                     |          |                   | 'ubuntu'}. 'cacert'. Deploying VCA       |
|                                  |                                      |                     |          |                   | vnf.mgmtVM: register execution           |
|                                  |                                      |                     |          |                   | environment {'hostname': '172.21.23.13', |
|                                  |                                      |                     |          |                   | 'username': 'ubuntu'}. 'cacert'          |
+----------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on            | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | FAIL |
There are not 2 application name in the application list after Scale Out
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: basic_20_manual_vdu_scaling_test == basic_20_manual_vdu_scaling_test
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfcloudinit == hfcloudinit
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: hfmultivdu == hfmultivdu
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor :: Upload NF package for the test... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s       | b1f5aff8-7bc7-4ae7-8a95-3346832e7c70 | 2024-01-28T17:53:41 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.6ee702ae-a54e- |
|                  |                                      |                     |          |                   | 4b10-a532-742b66ab2f9f, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '8a58a7c3-e2b3-49a5-8884-3e53705a889e'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 9b916142-6913-4d57-8620-ad7bfd84638f was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete tar.gz NF and NS package files.      | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_05-k8s_proxy_charm | 72e2bc35-8850-43e8-9eee-9235b4c52569 | 2024-01-28T17:57:29 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.bc574d6a-f6fe- |
|                        |                                      |                     |          |                   | 4d12-9669-39a322e427bd, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_05-k8s_proxy_charm == k8s_05-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                           |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | aafcf868-ad60-426f-9e6c-7a775649d637 | 2024-01-28T18:33:08 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.520b6dcd-416b- |
|                                 |                                      |                     |          |                   | 4e1c-a377-3dee90e26279, Stage 2/5:      |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                                 |                                      |                     |          |                   | environments.                           |
|                                 |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                                 |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                                 |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                                 |                                      |                     |          |                   | environment. 'cacert'                   |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get the NS id and save it NS_ID suite variable to use... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP address of the two ... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
2 != 0
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id d68500d3-097c-4384-a93a-ac6f6af67f1f was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
2 != 0
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_06-nopasswd_k8s_proxy_charm == k8s_06-nopasswd_k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete NF package from OSM.                  | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor :: Upload VNF package for t... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor :: Upload NS package for the... | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| native-k8s-scale | 0fdfc021-0d38-43a4-a27e-07125940ab53 | 2024-01-28T19:12:08 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.b90f5e5d-0546- |
|                  |                                      |                     |          |                   | 423f-88d2-3b150b2c307d, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '8a58a7c3-e2b3-49a5-8884-3e53705a889e'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | FAIL |
native-kdu
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | FAIL |
Invalid IF condition: Evaluating expression ' != 2' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${INITIAL_KDU_COUNT} != ${INSTANTIATION_COUNT}' were resolved before the expression was evaluated. Try using '$INITIAL_KDU_COUNT != $INSTANTIATION_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | FAIL |
The ns-action with id c5f74b30-4abc-4d82-becd-7cb3ebe9bdd3 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | FAIL |
Invalid IF condition: Evaluating expression ' !=  + 1' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT} + 1' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT + 1' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | FAIL |
The ns-action with id 1a751c36-2377-45a7-894a-8aae42844c26 was not completed
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | FAIL |
Invalid IF condition: Evaluating expression ' != ' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression '${kdu_count} != ${INITIAL_KDU_COUNT}' were resolved before the expression was evaluated. Try using '$kdu_count != $INITIAL_KDU_COUNT' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor :: Upload VNF package for the tes... | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test :: Instantiate NS for the testsu... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| pebble-charm-k8s | dd57b09c-b50a-4cfd-af80-90ab7d524ac0 | 2024-01-28T19:13:01 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.69e48c78-cfd2- |
|                  |                                      |                     |          |                   | 4762-a2c4-0be874734355, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: K8s cluster                     |
|                  |                                      |                     |          |                   | '8a58a7c3-e2b3-49a5-8884-3e53705a889e'  |
|                  |                                      |                     |          |                   | has not been initialized for 'juju-     |
|                  |                                      |                     |          |                   | bundle'                                 |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id 15708044-2f08-4924-a128-0175db0e6416 was not completed
------------------------------------------------------------------------------
Delete NS K8s Instance Test :: Delete NS instance.                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS package.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF package.                 | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages :: Delete the tar.gz files associated to th... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | FAIL |
8 tests, 6 passed, 2 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor :: Upload VNF package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor :: Upload NS package for the testsuite.    | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service :: Instantiate NS for the testsu... | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                           |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| k8s_10-k8s_proxy_charm | 5cef0979-0e80-4d0a-8183-d1f0e30a4206 | 2024-01-28T19:13:37 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.c0abe342-5776- |
|                        |                                      |                     |          |                   | 4345-9c7c-0027f9817f36, Stage 2/5:      |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                        |                                      |                     |          |                   | environments.                           |
|                        |                                      |                     |          |                   | Detail: Deploying VCA vnf1.: create     |
|                        |                                      |                     |          |                   | execution environment. 'cacert'.        |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.: create execution   |
|                        |                                      |                     |          |                   | environment. 'cacert'                   |
+------------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Test SSH Access :: Check that both VNF are accessible via SSH in t... | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${VNF_1_IP_ADDR}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: k8s_10-k8s_proxy_charm == k8s_10-k8s_proxy_charm
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 2 passed, 9 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register K8s cluster in OSM.                | FAIL |
1 != 0
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ldap             | 1f31ab9a-b773-4961-99ac-3c8b9c292466 | 2024-01-28T19:50:02 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.2efb3656-12a6- |
|                  |                                      |                     |          |                   | 40a0-9ed9-ab54c92f2eb3, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA openldap.: create |
|                  |                                      |                     |          |                   | execution environment. 'cacert'         |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get NS instance id from OSM.                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get VNF instance id from OSM.                           /bin/sh: 2: Syntax error: "|" unexpected
| FAIL |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| vnf id                               | name | ns id                                | vnf member index | vnfd name    | vim account id                       | ip address |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
| 87a4aaaa-b113-457c-ac50-a88a72f6d96e | -    | 1f31ab9a-b773-4961-99ac-3c8b9c292466 | openldap         | openldap_knf | c4879064-bcdc-4524-9bed-e00d0ca80311 | None       |
+--------------------------------------+------+--------------------------------------+------------------+--------------+--------------------------------------+------------+
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | FAIL |
The ns-action with id f41640df-189f-41f9-8504-9c8b5f49d0b0 was not completed
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
    ${NS_ID}
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | FAIL |
Keyword 'Check For NS Instance To Be Deleted' failed after retrying for 16 minutes. The last error was: ldap == ldap
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | FAIL |
15 tests, 6 passed, 9 failed
==============================================================================
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 61: Setting variable '${REPO_PASSWORD}' failed: Environment variable '%{OCI_REGISTRY_PASSWORD}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 59: Setting variable '${REPO_URI}' failed: Environment variable '%{OCI_REGISTRY_URL}' not found.
[ ERROR ] Error in file '/robot-systest/testsuite/k8s_13-two_helm_kdu.robot' on line 60: Setting variable '${REPO_USER}' failed: Environment variable '%{OCI_REGISTRY_USER}' not found.
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | FAIL |
Variable '${REPO_URI}' not found.
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details                            |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
| ldap             | 1f31ab9a-b773-4961-99ac-3c8b9c292466 | 2024-01-28T19:50:02 | BROKEN   | IDLE (None)                                          | Operation: TERMINATING.29f86f8b-2c1a-    |
|                  |                                      |                     |          |                                                      | 4ab1-8d82-7aad7875754a, Stage 3/3 delete |
|                  |                                      |                     |          |                                                      | all..                                    |
|                  |                                      |                     |          |                                                      | Detail: Terminating all VCA: 'cacert'    |
| ldap             | a7b1e57b-4317-41a7-94d4-df6f40767f23 | 2024-01-28T20:27:11 | BUILDING | INSTANTIATING (12e05993-b224-41dd-9e2d-b1df9ede45b2) | N/A                                      |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           /bin/sh: 2: a7b1e57b-4317-41a7-94d4-df6f40767f23: not found
/bin/sh: 3: a7b1e57b-4317-41a7-94d4-df6f40767f23: not found
| PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | FAIL |
'' cannot be converted to an integer: ValueError: invalid literal for int() with base 10: ''
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | FAIL |
ERROR: failed to exec operation ldap:
error:
Error 400: {
    "code": "BAD_REQUEST",
    "status": 400,
    "detail": "Invalid parameter member_vnf_index='two_helm_oci' is not one of the nsd:constituent-vnfd"
}
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | FAIL |
1 != 0
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | FAIL |
18 tests, 7 passed, 11 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f421dc00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423d0c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423dd50>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423f400>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410df60>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410fb80>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410cd30>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410f2e0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423f700>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423f1c0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410cd00>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423cb20>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f421ffa0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f421ca60>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f41ec0d0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
| FAIL |
Keyword 'Get Metric' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f41d1ba0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f413f910>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f414d090>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f414ed40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f4178a60>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f4178370>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f4198790>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f417b580>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f4179b10>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f414c3a0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f421e0b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f414ccd0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f423ea40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f410cf40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f413f2b0>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
[ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f413de70>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
| FAIL |
Keyword 'Check VIM-based Metric Exceeds Threshold' failed after retrying 15 times. The last error was: ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f413fc10>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... [ WARN ] Retrying (RetryAdapter(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f4199b40>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)")': /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D
| FAIL |
ConnectionError: HTTPConnectionPool(host='unknown', port=9090): Max retries exceeded with url: /api/v1/query?query=osm_cpu_utilization%7Bns_id=%22b518f0e9-1e84-4ecf-a520-3ab5b3ee73e5%22,%7D (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x7f57f41b0730>: Failed to resolve 'unknown' ([Errno -2] Name or service not known)"))
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | FAIL |
15 tests, 12 passed, 3 failed
==============================================================================
Testsuite                                                             | FAIL |
287 tests, 172 passed, 115 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html