SuccessConsole Output

Skipping 35 KB.. Full Log
--------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_11_native_charms | f89e723f-dcda-475c-acb3-bc7ddb0a37ee | 2024-02-24T00:08:24 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.81f1ef6f-0afe-  |
|                        |                                      |                     |          |                   | 4c25-854f-d8bcab862cbb, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | key because target VM is in error state. |
|                        |                                      |                     |          |                   | Deploying VCA vnf2.mgmtVM: Waiting to VM |
|                        |                                      |                     |          |                   | being up and getting IP address. Cannot  |
|                        |                                      |                     |          |                   | inject ssh-key because target VM is in   |
|                        |                                      |                     |          |                   | error state                              |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${vnf_1_ip_addr}' not found.
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds                                                          | PASS |
------------------------------------------------------------------------------
Upload Nsd                                                            | PASS |
------------------------------------------------------------------------------
Instantiate NS                                                        | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| test_nscharm     | ad999a34-09c2-40c1-b5c1-0bf8abf0989e | 2024-02-24T00:15:35 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.a124d923-1559- |
|                  |                                      |                     |          |                   | 4c8b-950f-bd40c017b33e, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA 1.userVM: Waiting |
|                  |                                      |                     |          |                   | to VM being up and getting IP address.  |
|                  |                                      |                     |          |                   | Cannot inject ssh-key because target VM ...
    [ Message content over the limit has been removed. ]
... |          |                   | execute initial config primitive.       |
|                  |                                      |                     |          |                   | Configuration aborted because dependent |
|                  |                                      |                     |          |                   | charm/s has failed. Deploying at VIM:   |
|                  |                                      |                     |          |                   | Error at create vdu: unknown. Deploying |
|                  |                                      |                     |          |                   | VCA 2.policyVM: Waiting to VM being up  |
|                  |                                      |                     |          |                   | and getting IP address. Cannot inject   |
|                  |                                      |                     |          |                   | ssh-key because target VM is in error   |
|                  |                                      |                     |          |                   | state                                   |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Check NS Charm Application Name                                       | FAIL |
Variable '${model_name}' not found.
------------------------------------------------------------------------------
Check VDU Charm Application Name                                      | FAIL |
Variable '${model_name}' not found.
------------------------------------------------------------------------------
Delete NS                                                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | FAIL |
9 tests, 6 passed, 3 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides                                  | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires                                  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Provides                                        | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Requires                                        | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Provides                                        | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | PASS |
6 tests, 6 passed, 0 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User                                              | PASS |
------------------------------------------------------------------------------
Assign Role To User                                                   | PASS |
------------------------------------------------------------------------------
Run Action As User                                                    | PASS |
------------------------------------------------------------------------------
Create And Update Project                                             | PASS |
------------------------------------------------------------------------------
Create And Validate Role                                              | PASS |
------------------------------------------------------------------------------
Update Role Information                                               | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor                                         | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor                                          | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service                                   | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out                                          | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In                                           | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package                                             | PASS |
------------------------------------------------------------------------------
Delete NS Package                                                     | PASS |
------------------------------------------------------------------------------
Delete VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with a virtual...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnfs Info                                                         | PASS |
------------------------------------------------------------------------------
Check Vnf1 IPs                                                        | PASS |
------------------------------------------------------------------------------
Check Vnf2 IPs                                                        | PASS |
------------------------------------------------------------------------------
Verify Vnf1 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Verify Vnf2 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2                                                | PASS |
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1                                                | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with ... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single VNF and tw...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnf Info                                                          | PASS |
------------------------------------------------------------------------------
Check Vnf IPs                                                         | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single V... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | PASS |
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out                                          | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In                                           | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | PASS |
18 tests, 18 passed, 0 failed
==============================================================================
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only one VDU an...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Get Volumes From VNFD                                                 | PASS |
------------------------------------------------------------------------------
Get VNF IP Address                                                    | PASS |
------------------------------------------------------------------------------
Check VDU disks                                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only o... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Basic 22-Cross Model Relations :: [BASIC-22] Cross-model relations  
==============================================================================
Create Charm VNF Descriptor 1                                         | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor 2                                         | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor 1                                               | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor 2                                               | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 22-Cross Model Relations :: [BASIC-22] Cross-model... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package                                             | PASS |
------------------------------------------------------------------------------
Delete NS Package                                                     | PASS |
------------------------------------------------------------------------------
Delete VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs belongin...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Check Vnf Affinity Groups                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 25-Update Charm In Running Vnf Instance :: [BASIC-25] Updat...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | FAIL |
'+----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name           | id                                   | date                | ns state | current operation | error details                            |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| basic_25_charm_update_test | 3f9c818d-2519-4f83-9ec3-2e4fcf45541e | 2024-02-24T01:02:41 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.ca04fe2f-d58f-  |
|                            |                                      |                     |          |                   | 4c05-a49a-2a1d1b3fdcb3, Stage 2/5:       |
|                            |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                            |                                      |                     |          |                   | environments.                 ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | W5emEC24y4fV+Uw1yXKCefY+vzKt5Szpx1T7rNyD |
|                            |                                      |                     |          |                   | ZH1aOW+TzBu9vKZZ110oZw==                 |
|                            |                                      |                     |          |                   | root@juju-8ab21c-0                       |
|                            |                                      |                     |          |                   | . Cannot inject ssh-key because target   |
|                            |                                      |                     |          |                   | VNF is in error state                    |
+----------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Set NS Update Config                                                  | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Management Ip Address                                             | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operation :: The Charm VNF ha... | FAIL |
Variable '${vnf_ip_addr}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operation :: Performs one Day 2 operation on the VNF... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote File Created Via Day 2 Operation :: Check whether the... | FAIL |
Variable '${vnf_ip_addr}' not found.
------------------------------------------------------------------------------
Update VNFD Package :: Updates the VNFD by using new VNFD package ... | PASS |
------------------------------------------------------------------------------
Update Running VNF Instance :: Updates the running VNF instance by... | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operation on Upgraded Charm :: Performs one Day 2 op... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Folder Created Via Day 2 Operation :: Check whether t... | FAIL |
Variable '${vnf_ip_addr}' not found.
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 25-Update Charm In Running Vnf Instance :: [BASIC-... | FAIL |
16 tests, 6 passed, 10 failed
==============================================================================
Testsuite.Basic 26-Secure Helm Execution Environment :: [BASIC-26] Secure c...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Management Ip Address                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 1 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Get data from EE pod                                                  | PASS |
------------------------------------------------------------------------------
Fail when trying to access gRPC server without TLS                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 26-Secure Helm Execution Environment :: [BASIC-26]... | PASS |
11 tests, 11 passed, 0 failed
==============================================================================
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASIC-27] Upd...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Set NS Update Config                                                  | PASS |
------------------------------------------------------------------------------
Get Management Ip Address                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operation :: The VNF has a Da... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation :: Performs one Day 2 operation on the VNF... | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 2 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Update VNFD Package :: Updates the VNFD by using new VNFD package ... | PASS |
------------------------------------------------------------------------------
Update Running VNF Instance :: Updates the running VNF instance by... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation on Upgraded Helm EE :: Performs one Day 2 ... | PASS |
------------------------------------------------------------------------------
Check Remote Folder Created Via Day 2 Operation :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASI... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with one VDU wh...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Check Persistent Volume Counts                                        | PASS |
------------------------------------------------------------------------------
Set Persistent Volume Ids                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Check Persistent Root Volume in VIM after NS Deleted                  | PASS |
------------------------------------------------------------------------------
Check Persistent Ordinary Volume in VIM after NS Deleted              | PASS |
------------------------------------------------------------------------------
Prepare Ns Config With Volume Id                                      | PASS |
------------------------------------------------------------------------------
Network Service Instance With Existing Volumes Test                   | PASS |
------------------------------------------------------------------------------
Verify the Attachment Of Existing Persistent Volumes                  | PASS |
------------------------------------------------------------------------------
Delete NS Instance With Existing Volumes Test                         | PASS |
------------------------------------------------------------------------------
Check Existence of Persistent Volumes                                 | PASS |
------------------------------------------------------------------------------
Delete Persistent Volumes                                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with o... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single VNF and ...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| basic_29         | b3a8cf1f-bcb5-439b-9887-57233bbc5c80 | 2024-02-24T01:20:40 | BUILDING | INSTANTIATING (35e4c85d-81b0-40f6-9eeb-3a6ea062245f) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Info                                                          | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vnf IPs                                                         | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check that ipv6 address_mode and ra_mode are set                      | FAIL |
Variable '${vnf_id}' not found. Did you mean:
    ${vnfd_pkg}
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single VNF and t...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| basic_30         | 47256581-3962-4fcb-8566-8934f45490ca | 2024-02-24T01:27:14 | BUILDING | INSTANTIATING (bafc75bb-2c6e-43ca-90c6-92f4ec40a045) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnfs Info                                                         | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vnf1 IPs                                                        | FAIL |
msg=VNF1 is not available
------------------------------------------------------------------------------
Check Vnf2 IPs                                                        | FAIL |
msg=VNF2 is not available
------------------------------------------------------------------------------
Verify Vnf1 Interfaces                                                | FAIL |
msg=IP address of the data VNF 'vnf1' is not available
------------------------------------------------------------------------------
Verify Vnf2 Interfaces                                                | FAIL |
msg=IP address of the data VNF 'vnf2' is not available
------------------------------------------------------------------------------
Check that ipv6 address_mode and ra_mode are set                      | FAIL |
Variable '${vnf_id1}' not found.
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic NS with ...
==============================================================================
Create Multiattach VNF Descriptor                                     | PASS |
------------------------------------------------------------------------------
Create Multiattach NS Descriptor                                      | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf ID                                                            | PASS |
------------------------------------------------------------------------------
Get Vnf Management Ip Addresses                                       | PASS |
------------------------------------------------------------------------------
Ensure that VDUs can share data                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.            
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name      | id                                   | date                | ns state | current operation                                    | error details |
+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| epa_01-epa_sriov_test | 8a8284d9-68fb-4853-a64d-aa3117eff8ae | 2024-02-24T01:36:38 | BUILDING | INSTANTIATING (bcb343e4-e60d-4cb1-9478-5f15d17baf38) | N/A           |
+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get VNF IP Address                                                    | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Check SR-IOV Interface                                                | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.    | FAIL |
8 tests, 5 passed, 3 failed
==============================================================================
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for additional...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF Server ID                                                     | PASS |
------------------------------------------------------------------------------
Get Server Flavor Properties                                          | PASS |
------------------------------------------------------------------------------
Check Flavor Quota Properties                                         | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for a... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operations on SDN...
==============================================================================
Create Basic SDNC                                                     | PASS |
------------------------------------------------------------------------------
Check SDNC Status Is Healthy                                          | PASS |
------------------------------------------------------------------------------
Delete Basic SDNC                                                     | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operatio... | PASS |
3 tests, 3 passed, 0 failed
==============================================================================
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.          
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2                                                | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1                                                | FAIL |
1 != 0
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.  | FAIL |
9 tests, 7 passed, 2 failed
==============================================================================
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF with 2 V...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Cannot Instantiate Network Service                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance And Check VIM                                      | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF... | PASS |
6 tests, 6 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor                                  | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor                                   | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | PASS |
------------------------------------------------------------------------------
Test Ping                                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor                              | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor                               | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| hfcloudinit      | 8447ee04-0c55-456a-bf35-5bafd3e26cd6 | 2024-02-24T01:56:51 | BUILDING | INSTANTIATING (790c765c-6f27-4af1-8ebb-ba02805f8635) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init                             | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor                               | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor                                | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| hfmultivdu       | 62fde12d-2b4d-4564-83fa-9e5907c590e5 | 2024-02-24T02:03:23 | BUILDING | INSTANTIATING (2ea60957-70bf-409b-8d1e-9b7ed8c32e63) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Test Ping                                                             | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a multi-volume...
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| heal_01          | 12380882-a758-4fc1-941b-5fb1cc6b2920 | 2024-02-24T02:10:03 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.68756c6c-a476- |
|                  |                                      |                     |          |                   | 43a2-bf87-c323b5ad3a96, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA charm_vnf.mgmtVM: |
|                  |                                      |                     |          |                   | Waiting to VM being up and getting IP   |
|                  |                                      |                     |          |                   | address. Cannot inject ssh-key because  |
|                  |                                      |                     |          |                   | target VM is in error state. Deploying  |
|                  |                                      |                     |          |                   | VCA charm_vnf.mgmtVM: Waiting to VM     |
|                  |                                      |                     |          |                   | being up and getting IP address. Cannot |
|                  |                                      |                     |          |                   | inject ssh-key because target VM is in  |
|                  |                                      |                     |          |                   | error state. Deploying at VIM: Error at |
|                  |                                      |                     |          |                   | create vdu: unknown. Error at create    |
|                  |                                      |                     |          |                   | vdu: unknown                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get NS Id                                                             | FAIL |
Invalid IF condition: Evaluating expression 'not "${ns_id}" in "{'${/}': '/', '${:}': ':', '${\\n}': '\n', '${DEBUG_FILE}': 'NONE', '${delete_max_wait_time}': '1min', '${delete_pol_time}': '15sec', '${EXECDIR}': '/robot-systest', '${failure_return_code}': '1', '${False}': False, '${healing_pol_time}': '15sec', '${LOG_FILE}': '/robot-systest/reports/log.html', '${LOG_LEVEL}': 'INFO', '${None}': None, '${ns_action_max_wait_time}': '1min', '${ns_action_pol_time}': '15sec', '${ns_config}': '{vld: [ {name: mgmtnet, vim-network-name: osm-ext} ] }', '${ns_delete_pol_time}': '15sec', '${nsd_name}': 'volumes_nativecharm-ns', '${nsd_pkg}': 'volumes_nativecharm_ns', '${ns_launch_pol_time}': '30sec', '${ns_name}': 'heal_01', '${ns_timeout}': '6min', '${null}': None, '${OUTPUT_DIR}': '/robot-systest/reports', '${OUTPUT_FILE}': '/robot-systest/reports/output.xml', '${password}': '', '${PREV_TEST_MESSAGE}': '\'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| ns instance name | id                                   | date                | ns state | current operation | error details                           |\n+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| heal_01          | 12380882-a758-4fc1-941b-5fb1cc6b2920 | 2024-02-24T02:10:03 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.68756c6c-a476- |\n|                  |    ...
    [ Message content over the limit has been removed. ]
...vatekey}': '/root/.ssh/id_rsa', '${publickey}': '/root/.ssh/id_rsa.pub', '${REPORT_FILE}': '/robot-systest/reports/report.html', '${SPACE}': ' ', '${success_return_code}': '0', '${SUITE_DOCUMENTATION}': '[HEAL-01] Healing of a multi-volume VDU', '${SUITE_NAME}': 'Testsuite.Heal 01-Volume Vdu Healing', '${SUITE_SOURCE}': '/robot-systest/testsuite/heal_01-volume_vdu_healing.robot', '${TEMPDIR}': '/tmp', '${TEST_DOCUMENTATION}': '', '${TEST_NAME}': 'Get NS Id', '${True}': True, '${username}': 'ubuntu', '${vdu_volumes_name}': 'several_volumes-VM', '${vim_timeout_multiplier}': '1.0', '${vnfd_charm_name}': 'native_manual_scale_charm-vnf', '${vnfd_charm_pkg}': 'charm-packages/native_manual_scale_charm_vnf', '${vnfd_volumes_name}': 'several_volumes-vnf', '${vnfd_volumes_pkg}': 'several_volumes_vnf', '${vnf_scale_pol_time}': '15sec', '${vnf_several_index}': 'several_volumes_vnf', '&{OPTIONS}': {'include': ['daily'], 'exclude': [], 'skip': [], 'skip_on_failure': []}, '&{SUITE_METADATA}': Metadata(), '@{TEST_TAGS}': ['cleanup', 'cluster_heal', 'daily', 'heal_01'], '@{vim_vdus}': [], '@{vim_volumes}': []}"' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression 'not "\${ns_id}" in "${variables}"' were resolved before the expression was evaluated. Try using 'not "\${ns_id}" in "$variables"' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Get VIM Objects                                                       | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Volume VNF Info                                                   | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Volumes Info                                                      | FAIL |
Variable '${vdu_volumes_id}' not found.
------------------------------------------------------------------------------
Check VDU Disks                                                       | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Delete Persistent Volume VDU                                          | FAIL |
msg=VDU is not available
------------------------------------------------------------------------------
Heal Persistent Volume VDU                                            | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check VNF After Healing                                               | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Update VIM Objects                                                    | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a mul... | FAIL |
16 tests, 6 passed, 10 failed
==============================================================================
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled charm VDUs 
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Create Test Flavor                                                    | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| heal_02          | 60130c77-3eb6-46a6-a943-96b44dd681aa | 2024-02-24T02:17:29 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.7d33085a-057d-  |
|                  |                                      |                     |          |                   | 4cf5-b572-ba2695b9c4f5, Stage 2/5:       |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                  |                                      |                     |          |                   | environments.                            |
|                  |                                      |                     |          |                   | Detail: Deploying at VIM: Error at       |
|                  |                                      |                     |          |                   | create vdu: 'NoneType' object does not   |
|                  |                                      |                     |          |                   | support item assignment. Deploying VCA   |
|                  |                                      |                     |          |                   | charm_vnf.mgmtVM: Waiting to VM being up |
|                  |                                      |                     |          |                   | and getting IP address. Cannot inject    |
|                  |                                      |                     |          |                   | ssh-key because target VM is in error    |
|                  |                                      |                     |          |                   | state. Deploying VCA charm_vnf.mgmtVM:   |
|                  |                                      |                     |          |                   | Waiting to VM being up and getting IP    |
|                  |                                      |                     |          |                   | address. Cannot inject ssh-key because   |
|                  |                                      |                     |          |                   | target VM is in error state              |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get NS Id                                                             | FAIL |
Invalid IF condition: Evaluating expression 'not "${ns_id}" in "{'${/}': '/', '${:}': ':', '${\\n}': '\n', '${DEBUG_FILE}': 'NONE', '${delete_max_wait_time}': '1min', '${delete_pol_time}': '15sec', '${EXECDIR}': '/robot-systest', '${failure_return_code}': '1', '${False}': False, '${flavor_id}': '83ccd119-8a9c-4afa-bcc0-b0002a0d1f5d', '${flavor_name_prefix}': 'osm.heal02', '${healing_pol_time}': '15sec', '${LOG_FILE}': '/robot-systest/reports/log.html', '${LOG_LEVEL}': 'INFO', '${None}': None, '${ns_action_max_wait_time}': '1min', '${ns_action_pol_time}': '15sec', '${ns_delete_pol_time}': '15sec', '${nsd_name}': 'volumes_nativecharm-ns', '${nsd_pkg}': 'volumes_nativecharm_ns', '${ns_launch_pol_time}': '30sec', '${ns_name}': 'heal_02', '${ns_timeout}': '6min', '${null}': None, '${OUTPUT_DIR}': '/robot-systest/reports', '${OUTPUT_FILE}': '/robot-systest/reports/output.xml', '${password}': '', '${PREV_TEST_MESSAGE}': '\'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+\n| ns instance name | id                                   | date                | ns state | current operation | error details                            |\n+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+\n| heal_02          | 60130c77-3eb6-46a6-a943-96b44dd681aa | 2024-02-24T02:17:29 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.7d33085a-057d-  |\...
    [ Message content over the limit has been removed. ]
...aled charm VDUs', '${SUITE_NAME}': 'Testsuite.Heal 02-Scale Vdu Healing', '${SUITE_SOURCE}': '/robot-systest/testsuite/heal_02-scale_vdu_healing.robot', '${TEMPDIR}': '/tmp', '${TEST_DOCUMENTATION}': '', '${TEST_NAME}': 'Get NS Id', '${True}': True, '${username}': 'ubuntu', '${vdu_charm_name}': 'mgmtVM', '${vdu_volumes_name}': 'several_volumes-VM', '${vim_timeout_multiplier}': '1.0', '${vnf_charm_cloudinit_file}': '/root/helloworld.txt', '${vnf_charm_day1_file}': '/home/ubuntu/first-touch', '${vnf_charm_index}': 'charm_vnf', '${vnf_charm_scaling_group}': 'manual-scaling_mgmtVM', '${vnfd_charm_name}': 'native_manual_scale_charm-vnf', '${vnfd_charm_pkg}': 'charm-packages/native_manual_scale_charm_vnf', '${vnfd_volumes_name}': 'several_volumes-vnf', '${vnfd_volumes_pkg}': 'several_volumes_vnf', '${vnf_scale_pol_time}': '15sec', '${vnf_several_index}': 'several_volumes_vnf', '&{OPTIONS}': {'include': ['daily'], 'exclude': [], 'skip': [], 'skip_on_failure': []}, '&{SUITE_METADATA}': Metadata(), '@{TEST_TAGS}': ['cleanup', 'cluster_heal', 'daily', 'heal_02'], '@{vim_vdus}': [], '@{vim_volumes}': []}"' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression 'not "\${ns_id}" in "${variables}"' were resolved before the expression was evaluated. Try using 'not "\${ns_id}" in "$variables"' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Scale Out Charm VNF                                                   | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Get VIM Objects                                                       | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Charm VNF Info                                                    | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Halt Charm VDU                                                        | FAIL |
msg=VDU is not available
------------------------------------------------------------------------------
Heal Charm VDU                                                        | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check VNF After Healing                                               | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Update VIM Objects                                                    | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled... | FAIL |
16 tests, 7 passed, 9 failed
==============================================================================
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multiple VDUs      
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| heal_03          | 15929bcd-309e-417f-94bb-9d7473de43e3 | 2024-02-24T02:24:49 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.76f97707-2327- |
|                  |                                      |                     |          |                   | 4cec-a2f0-c5c734cd3026, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying VCA charm_vnf.mgmtVM: |
|                  |                                      |                     |          |                   | Waiting to VM being up and getting IP   |
|                  |                                      |                     |          |                   | address. Cannot inject ssh-key because  |
|                  |                                      |                     |          |                   | target VM is in error state. Deploying  |
|                  |                                      |                     |          |                   | VCA charm_vnf.mgmtVM: Waiting to VM     |
|                  |                                      |                     |          |                   | being up and getting IP address. Cannot |
|                  |                                      |                     |          |                   | inject ssh-key because target VM is in  |
|                  |                                      |                     |          |                   | error state. Deploying at VIM: Error at |
|                  |                                      |                     |          |                   | create vdu: unknown. Error at create    |
|                  |                                      |                     |          |                   | vdu: unknown                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get NS Id                                                             | FAIL |
Invalid IF condition: Evaluating expression 'not "${ns_id}" in "{'${/}': '/', '${:}': ':', '${\\n}': '\n', '${DEBUG_FILE}': 'NONE', '${delete_max_wait_time}': '1min', '${delete_pol_time}': '15sec', '${EXECDIR}': '/robot-systest', '${failure_return_code}': '1', '${False}': False, '${healing_pol_time}': '15sec', '${LOG_FILE}': '/robot-systest/reports/log.html', '${LOG_LEVEL}': 'INFO', '${None}': None, '${ns_action_max_wait_time}': '1min', '${ns_action_pol_time}': '15sec', '${ns_config}': '{vld: [ {name: mgmtnet, vim-network-name: osm-ext} ] }', '${ns_delete_pol_time}': '15sec', '${nsd_name}': 'volumes_nativecharm-ns', '${nsd_pkg}': 'volumes_nativecharm_ns', '${ns_launch_pol_time}': '30sec', '${ns_name}': 'heal_03', '${ns_timeout}': '6min', '${null}': None, '${OUTPUT_DIR}': '/robot-systest/reports', '${OUTPUT_FILE}': '/robot-systest/reports/output.xml', '${password}': '', '${PREV_TEST_MESSAGE}': '\'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| ns instance name | id                                   | date                | ns state | current operation | error details                           |\n+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| heal_03          | 15929bcd-309e-417f-94bb-9d7473de43e3 | 2024-02-24T02:24:49 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.76f97707-2327- |\n|                  |    ...
    [ Message content over the limit has been removed. ]
... of multiple VDUs', '${SUITE_NAME}': 'Testsuite.Heal 03-Multiple Healing', '${SUITE_SOURCE}': '/robot-systest/testsuite/heal_03-multiple_healing.robot', '${TEMPDIR}': '/tmp', '${TEST_DOCUMENTATION}': '', '${TEST_NAME}': 'Get NS Id', '${True}': True, '${username}': 'ubuntu', '${vdu_charm_name}': 'mgmtVM', '${vdu_volumes_name}': 'several_volumes-VM', '${vim_timeout_multiplier}': '1.0', '${vnf_charm_cloudinit_file}': '/root/helloworld.txt', '${vnf_charm_day1_file}': '/home/ubuntu/first-touch', '${vnf_charm_index}': 'charm_vnf', '${vnf_charm_scaling_group}': 'manual-scaling_mgmtVM', '${vnfd_charm_name}': 'native_manual_scale_charm-vnf', '${vnfd_charm_pkg}': 'charm-packages/native_manual_scale_charm_vnf', '${vnfd_volumes_name}': 'several_volumes-vnf', '${vnfd_volumes_pkg}': 'several_volumes_vnf', '${vnf_scale_pol_time}': '15sec', '${vnf_several_index}': 'several_volumes_vnf', '&{OPTIONS}': {'include': ['daily'], 'exclude': [], 'skip': [], 'skip_on_failure': []}, '&{SUITE_METADATA}': Metadata(), '@{TEST_TAGS}': ['cleanup', 'cluster_heal', 'daily', 'heal_03'], '@{vim_vdus}': [], '@{vim_volumes}': []}"' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression 'not "\${ns_id}" in "${variables}"' were resolved before the expression was evaluated. Try using 'not "\${ns_id}" in "$variables"' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Scale Out Charm VNF                                                   | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Get VIM Objects                                                       | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Charm VNF Info                                                    | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Volume VNF Info                                                   | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Stop VDUs                                                             | FAIL |
msg=Charm VDUs are not available
------------------------------------------------------------------------------
Heal VDUs                                                             | FAIL |
msg=Charm VNF is not available
------------------------------------------------------------------------------
Check VNFs After Healing                                              | FAIL |
msg=Charm VNF is not available
------------------------------------------------------------------------------
Update VIM Objects                                                    | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multipl... | FAIL |
16 tests, 6 passed, 10 failed
==============================================================================
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS                  
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Get VIM Objects                                                       | PASS |
------------------------------------------------------------------------------
Get VNF Info                                                          | PASS |
------------------------------------------------------------------------------
Stop Autoheal VDU                                                     | PASS |
------------------------------------------------------------------------------
Wait For Autohealing To Be Completed                                  | PASS |
------------------------------------------------------------------------------
Check VNF After Healing                                               | PASS |
------------------------------------------------------------------------------
Update VIM Objects                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS          | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor                                      | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor                                          | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages                                                | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation                                             | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation                                | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation                                            | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation                               | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| k8s_05-k8s_proxy_charm | 8b502b81-2e7f-479a-bd08-874683ae4c22 | 2024-02-24T02:46:36 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.d2af1c61-2421-  |
|                        |                                      |                     |          |                   | 468c-9158-4ad9c0432850, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | ee-z0-vnf1-vnf-operator-0                |
|                        |                                      |                     |          |                   | . Cannot inject ssh-key because target   |
|                        |                                      |                     |          |                   | VM is in error state. Deploying at VIM:  |
|                        |                                      |                     |          |                   | Error at create vdu: unknown. Error at   |
|                        |                                      |                     |          |                   | create vdu: unknown                      |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${vnf_1_ip_addr}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${vnf_1_ip_addr}' not found.
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | FAIL |
11 tests, 5 passed, 6 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | FAIL |
'+---------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name                | id                                   | date                | ns state | current operation | error details                            |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| k8s_06-nopasswd_k8s_proxy_charm | e962ae49-d197-48ce-abce-61bff1be6049 | 2024-02-24T02:54:44 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.6ed34dec-132d-  |
|                                 |                                      |                     |          |                   | 450d-abe5-8ab441f89137, Stage 2/5:       |
|                                 |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                                 |                                      |                     |          |                   | environments.            ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | wkc30DGu1TYfNOpsjqz/cB6FP93h00KyD1SY3QtB |
|                                 |                                      |                     |          |                   | KKyZ0HgCRxZi83z764Wd5w== root@simple-    |
|                                 |                                      |                     |          |                   | ee-z0-vnf1-vnf-operator-0                |
|                                 |                                      |                     |          |                   | . Cannot inject ssh-key because target   |
|                                 |                                      |                     |          |                   | VNF is in error state                    |
+---------------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.248.107
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
The ns-action with id eb0ead9a-7cfa-4d63-9286-95cc4f40246e was not completed
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | FAIL |
12 tests, 7 passed, 5 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Create Dummy VIM                                                      | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete VIM                                                            | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor                                | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor                                 | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | PASS |
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | PASS |
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | PASS |
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | PASS |
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | PASS |
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor                                      | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor                                          | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages                                                | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | FAIL |
'+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name       | id                                   | date                | ns state | current operation | error details                            |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| k8s_10-k8s_proxy_charm | 1e8fbcc5-6785-4b12-9ab7-60a9882777ef | 2024-02-24T03:14:11 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.88313687-4642-  |
|                        |                                      |                     |          |                   | 43fe-a0ad-7b2604d85134, Stage 2/5:       |
|                        |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                        |                                      |                     |          |                   | environments.                     ...
    [ Message content over the limit has been removed. ]
...                 |                                      |                     |          |                   | W8+qyPGQLP3KYmuUzT3jPW0s8sB3gaApOHEQ5s3f |
|                        |                                      |                     |          |                   | Q6ue3+dWOlhkCrYaTkjaxQ== root@simple-    |
|                        |                                      |                     |          |                   | ee-z0-vnf1-vnf-operator-0                |
|                        |                                      |                     |          |                   | . Cannot inject ssh-key because target   |
|                        |                                      |                     |          |                   | VNF is in error state                    |
+------------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | FAIL |
Variable '${ns_id}' not found.
------------------------------------------------------------------------------
Test SSH Access                                                       | FAIL |
msg=IP address of the management VNF 'vnf1' is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | FAIL |
Variable '${vnf_1_ip_addr}' not found.
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | FAIL |
Variable '${vnf_1_ip_addr}' not found.
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | FAIL |
11 tests, 5 passed, 6 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation                                             | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation                                | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation                                            | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation                               | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | PASS |
15 tests, 15 passed, 0 failed
==============================================================================
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforcement.       
==============================================================================
Create First Project With Quotas                                      | PASS |
------------------------------------------------------------------------------
Create Second Project With Quotas                                     | PASS |
------------------------------------------------------------------------------
Create User In Projects                                               | PASS |
------------------------------------------------------------------------------
Change First Project Name to Third Project Name                       | PASS |
------------------------------------------------------------------------------
Create VNFDs On Third Project Until Exceed Quota                      | PASS |
------------------------------------------------------------------------------
Increase Third Project Quotas                                         | PASS |
------------------------------------------------------------------------------
Create More VNFDs On Third Project Until Exceed Quota                 | PASS |
------------------------------------------------------------------------------
Create VNFDs On Second Project Until Exceed Quota                     | PASS |
------------------------------------------------------------------------------
Check Project Scopes                                                  | PASS |
------------------------------------------------------------------------------
Delete Second Project VNFD                                            | PASS |
------------------------------------------------------------------------------
Delete Third Project VNFDs                                            | PASS |
------------------------------------------------------------------------------
Delete Second Project After Removing User From It                     | PASS |
------------------------------------------------------------------------------
Delete Projects User                                                  | PASS |
------------------------------------------------------------------------------
Delete Third Project                                                  | PASS |
------------------------------------------------------------------------------
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforce... | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based metrics.   
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metrics                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF                                               | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF Id                                                            | PASS |
------------------------------------------------------------------------------
Get VNF IP Address                                                    | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling                          | PASS |
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling                       | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold                             | PASS |
------------------------------------------------------------------------------
Wait Threshold Time                                                   | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time         | PASS |
------------------------------------------------------------------------------
Get VDUs After Auto-scaling                                           | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | PASS |
15 tests, 15 passed, 0 failed
==============================================================================
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or alarms com...
==============================================================================
Create Webhook Service VNF Descriptor                                 | PASS |
------------------------------------------------------------------------------
Create Webhook Service NS Descriptor                                  | PASS |
------------------------------------------------------------------------------
Instantiate Webhook Service Network Service                           | PASS |
------------------------------------------------------------------------------
Get Webhook Service VNF IP Address                                    | PASS |
------------------------------------------------------------------------------
Start Webhook Service                                                 | PASS |
------------------------------------------------------------------------------
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Alarm Metric                                                      | PASS |
------------------------------------------------------------------------------
Check Alarms Were Received                                            | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Instance                                    | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Descriptor                                  | PASS |
------------------------------------------------------------------------------
Delete Webhook Service VNF Descriptor                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or a... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with VNF-based ...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name                        | id                                   | date                | ns state | current operation                                    | error details |
+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| sa_08-vnf_with_vnf_indicators_snmp_test | 36f4427f-139e-44cd-ac62-d2aa2f7c0c9b | 2024-02-24T04:07:42 | BUILDING | INSTANTIATING (cb507cbf-3ea1-4c60-b4db-69ad0a5d0d28) | N/A           |
+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get VNF SNMP Metrics                                                  | FAIL |
Keyword 'Get Metric' failed after retrying 10 times. The last error was: Metric ifInOctets not found
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with V... | FAIL |
7 tests, 5 passed, 2 failed
==============================================================================
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.             
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Template :: Onboards the Network Slice Template: nst ... | PASS |
------------------------------------------------------------------------------
Network Slice Instance Test :: Instantiates the NST recently onboa... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| slicebasic             | ff1e32dc-f586-44b9-b763-7018b5526b83 | failed             | configured    | ERROR instantiating: NS 709cb6a1-86f2-404b-83ee-ce1ef427a521 FAILED: Deploying at VIM: Error at create vdu: unknown; NS a1399f79-e8ae-4657-87fc-b895d881c5c7 FAILED: Deploying at VIM: Error at create vdu: unknown; NS 452d6134-6655-42fd-b430-65909264e763 FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get Slice Vnf Ip Addresses :: Obtains the list of IPs addresses in... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Test Slice Connectivity :: SSH access to the slice middle vnf (mgm... | FAIL |
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.248.160
------------------------------------------------------------------------------
Delete Slice Instance :: Stops the slice instance (slice_name)        | PASS |
------------------------------------------------------------------------------
Delete Slice Template :: Deletes the NST (nst_name) from OSM          | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.     | FAIL |
13 tests, 9 passed, 4 failed
==============================================================================
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Network Slic...
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Templates :: Onboards the Network Slice Templates: ns... | PASS |
------------------------------------------------------------------------------
Network Slice First Instance :: Instantiates the First NST recentl... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| slicebasic             | 1dad2d44-8c22-4f30-8012-d666c583ff1e | failed             | configured    | ERROR instantiating: NS 77a4b4a4-14e9-4f25-89f5-c44f9c03b361 FAILED: Deploying at VIM: Error at create vdu: unknown; NS fa01dc3a-190a-4f0b-9bc6-cd6c368be033 FAILED: Deploying at VIM: Error at create vdu: unknown; NS 43e76ba4-1d29-43e0-aaf3-31048787651f FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
Network Slice Second Instance :: Instantiates the Second NST recen... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| sliceshared            | 52b2d915-dc1a-4a13-8e6c-68e9cb3880e8 | failed             | configured    | ERROR instantiating: NS fa01dc3a-190a-4f0b-9bc6-cd6c368be033 FAILED: Deploying at VIM: Error at create vdu: unknown; NS 0a3e8207-42e0-4a5e-bc54-7921f08f94d9 FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
First Network Slice Ns Count :: Counts the NS in both slice instan... | PASS |
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get First Slice Vnf IPs :: Obtains the list of IPs addresses in th... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Test First Slice Connectivity :: SSH access to the slice middle vn... | FAIL |
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.249.37
------------------------------------------------------------------------------
Delete Slice One Instance :: Stops the slice instance (slice_name)    | PASS |
------------------------------------------------------------------------------
Second Network Slice Ns Count :: Counts the NS in both slice insta... | PASS |
------------------------------------------------------------------------------
Get Second Slice Vnf IPs :: Obtains the list of IPs addresses in t... | PASS |
------------------------------------------------------------------------------
Test Second Slice Connectivity :: SSH access to the slice middle v... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Delete Slice Two Instance :: Stops the slice instance (slice2_name)   | PASS |
------------------------------------------------------------------------------
Delete Slice One Template :: Deletes the NST (nst_name) from OSM      | PASS |
------------------------------------------------------------------------------
Delete Slice Two Template :: Deletes the NST (nst2_name) from OSM     | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Net... | FAIL |
20 tests, 14 passed, 6 failed
==============================================================================
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003 Api testing
==============================================================================
Create VNF package from JSON file descriptor :: Test case to creat... | PASS |
------------------------------------------------------------------------------
Instantiate VNF :: Test case to Instantiate a VNF                     | PASS |
------------------------------------------------------------------------------
Query VNF Instances :: Test case to query VNF Instance                | PASS |
------------------------------------------------------------------------------
Query VNF Instance ID :: Test case to query Vnf instance ID           | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops :: Test case to Query VNF LCM operation             | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops ID                                                  | PASS |
------------------------------------------------------------------------------
Scale VNF :: Test case to   Scale out VNF                             | PASS |
------------------------------------------------------------------------------
Terminate VNF :: Test case to terminate the VNF                       | PASS |
------------------------------------------------------------------------------
Delete VNF :: Test case to delete VNF                                 | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite                                                             | FAIL |
603 tests, 491 passed, 112 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html