SuccessConsole Output

[osm-devops] Running shell script
+ docker run --env OSM_HOSTNAME=172.21.249.226 --env PROMETHEUS_HOSTNAME=172.21.249.226 --env PROMETHEUS_PORT=9091 --env JUJU_PASSWORD=a001df778938dde61670fbdfae265cc1 --env-file /home/jenkins/hive/robot-systest.cfg --env OCI_REGISTRY_URL=oci://osm.etsi.org:5050/devops/test --env OCI_REGISTRY_USER=**** --env OCI_REGISTRY_PASSWORD=**** -v /home/jenkins/hive/clouds.yaml:/etc/openstack/clouds.yaml -v /home/jenkins/hive/cicd_rsa:/root/osm_id_rsa -v /home/jenkins/hive/kubeconfig.yaml:/root/.kube/config -v /tmp/tmp.nYAof5tU56:/robot-systest/reports -v /home/jenkins/hive/port-mapping-etsi-vim.yaml:/root/port-mapping.yaml opensourcemano/tests:osm-master-merge-2899 -c -t daily

2024-02-19_02:34:21 Creating VIM osm
85764c05-53df-46c7-a9c8-e9e51d2283b7
VIM status: | osm | 85764c05-53df-46c7-a9c8-e9e51d2283b7 | admin | ENABLED | N/A |

2024-02-19_02:34:32 Creating K8s Cluster
b9ca8c4f-2e8e-4a1d-b2f3-3cc251bb39e7
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 01-Crud Operations On Vim Targets :: [BASIC-01] CRUD operat...
==============================================================================
Create VIM Target Basic :: Create a VIM Target only with the manda... | PASS |
Not applicable for openstack VIM
------------------------------------------------------------------------------
Delete VIM Target By Name :: Delete the VIM Target created in prev... | PASS |
Not applicable for openstack VIM
------------------------------------------------------------------------------
Create VIM Target With Extra Config :: Create a VIM Target using t... | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 01-Crud Operations On Vim Targets :: [BASIC-01] CR... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor :: Upload VNF package for the test... | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Retrieve VNF mgmt IP address from OSM. | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 08-Disable Port Security Network Level :: [BASIC-08] Disabl...
==============================================================================
Create VIM With Port Security Disabled :: Register an Opentack VIM... | PASS |
------------------------------------------------------------------------------
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+---------------------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name                                  | id                                   | date                | ns state | current operation                                    | error details |
+---------------------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| basic_08_disable_port_security_network_level_test | de0adcc3-f127-4a49-a706-8808f3a659c1 | 2024-02-19T02:38:41 | BUILDING | INSTANTIATING (6838c2c0-1174-4419-9f7d-1d9af41e11fc) | N/A           |
+---------------------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Check Port Security Is Disabled :: Check that there are ports/inte... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Delete VIM :: Delete VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 08-Disable Port Security Network Level :: [BASIC-0... | FAIL |
9 tests, 8 passed, 1 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Check the number of VDUs instances be... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User :: Create a user in OSM.                     | PASS |
------------------------------------------------------------------------------
Assign Role To User :: Assign a user to a project with a role         | PASS |
------------------------------------------------------------------------------
Run Action As User :: Update the password of the user.                | PASS |
------------------------------------------------------------------------------
Create And Update Project :: Create a project and update its name.    | PASS |
------------------------------------------------------------------------------
Create And Validate Role :: Create a role and check that exists in... | PASS |
------------------------------------------------------------------------------
Update Role Information :: Update a role with a capability.           | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources :: Delete user, project and role.          | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor :: Upload VNF package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor :: Upload NS package for the testsuite.  | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service :: Instantiate NS for the test... | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out :: Perform a manual scale-out operati... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one extra VDU... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In :: Perform a manual scale-in operation... | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS intance.                              | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package from OSM.                      | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package from OSM.                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with a virtual...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | PASS |
------------------------------------------------------------------------------
Get Vnfs Info :: Get information from the two VNF of the Ns, speci... | PASS |
------------------------------------------------------------------------------
Check Vnf1 IPs :: Check whether IP addresses of the first VNF in t... | PASS |
------------------------------------------------------------------------------
Check Vnf2 IPs :: Check whether IP addresses of the second VNF in ... | PASS |
------------------------------------------------------------------------------
Verify Vnf1 Interfaces :: Check whether IP addresses of the first ... | PASS |
------------------------------------------------------------------------------
Verify Vnf2 Interfaces :: Check whether IP addresses of the second... | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2 :: Check connectivity from the first VNF to... | PASS |
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1 :: Check connectivity from the second VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with ... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single VNF and tw...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | PASS |
------------------------------------------------------------------------------
Get Vnf Info :: Get VNF information, specifically the VNF instance... | PASS |
------------------------------------------------------------------------------
Check Vnf IPs :: Check whether IP addresses are syntactically valid.  | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single V... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only one VDU an...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get NS Id :: Get NS identifier and stores as suite variable to be ... | PASS |
------------------------------------------------------------------------------
Get Volumes From VNFD :: Get from VNF descriptor the expected numb... | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF.             | PASS |
------------------------------------------------------------------------------
Check VDU disks :: Check that the number of volumes is the expecte... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only o... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package :: Assert that the VNF package cannot be... | PASS |
------------------------------------------------------------------------------
Delete NS Package :: Delete NS package.                               | PASS |
------------------------------------------------------------------------------
Delete VNF Package :: Delete VNF package.                             | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs belongin...
==============================================================================
Create VNF Package :: Upload VNF package for the testsuite.           | PASS |
------------------------------------------------------------------------------
Create NS Package :: Upload NS package for the testsuite.             | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Check Vnf Affinity Groups :: Check that all VDUs of the VNF belong... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASIC-27] Upd...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | PASS |
------------------------------------------------------------------------------
Set NS Update Config :: Prepare NS update config dictionary to upd... | PASS |
------------------------------------------------------------------------------
Get Management Ip Address :: Get VNF mgmt IP address from the NS.     | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Test SSH access to the VNF mgmt IP address.        | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operation :: The VNF has a Da... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation :: Performs one Day 2 operation on the VNF... | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 2 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Update VNFD Package :: Updates the VNFD by using new VNFD package ... | PASS |
------------------------------------------------------------------------------
Update Running VNF Instance :: Updates the running VNF instance by... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation on Upgraded Helm EE :: Performs one Day 2 ... | PASS |
------------------------------------------------------------------------------
Check Remote Folder Created Via Day 2 Operation :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASI... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with one VDU wh...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Check Persistent Volume Counts :: Check that the number of persist... | PASS |
------------------------------------------------------------------------------
Set Persistent Volume Ids :: Get the identifiers of the persistent... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Check Persistent Root Volume in VIM after NS Deleted :: Check that... | PASS |
------------------------------------------------------------------------------
Check Persistent Ordinary Volume in VIM after NS Deleted :: Check ... | PASS |
------------------------------------------------------------------------------
Prepare Ns Config With Volume Id :: Generate NS instantiation para... | PASS |
------------------------------------------------------------------------------
Network Service Instance With Existing Volumes Test :: Instantiate... | PASS |
------------------------------------------------------------------------------
Verify the Attachment Of Existing Persistent Volumes :: Get the id... | PASS |
------------------------------------------------------------------------------
Delete NS Instance With Existing Volumes Test :: Delete NS instance.  | PASS |
------------------------------------------------------------------------------
Check Existence of Persistent Volumes :: Check that the persistent... | PASS |
------------------------------------------------------------------------------
Delete Persistent Volumes :: Delete persistent volumes.               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with o... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single VNF and ...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| basic_29         | 413dfac2-cff0-421d-a853-a27b4fba3cfa | 2024-02-19T03:10:14 | BUILDING | INSTANTIATING (5ca760a1-bf8d-467f-a33d-1da623d08fdf) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Info :: Get VNF information, specifically VNF instance id ... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vnf IPs :: Check whether IP addresses are syntactically valid.  | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check That Ipv6 Address_mode And Ra_mode Are Set :: Check that IPv... | FAIL |
Variable '${VNF_ID}' not found. Did you mean:
    ${VNFD_PKG}
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single VNF and t...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| basic_30         | 875a25c9-043e-460f-870b-f7e70fdf77a0 | 2024-02-19T03:16:36 | BUILDING | INSTANTIATING (0d3006b6-70ed-452e-b953-32af8e50edae) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnfs Info :: Get information from the two VNF of the NS, speci... | FAIL |
msg=Network service instance is not available
------------------------------------------------------------------------------
Check Vnf1 IPs :: Check whether IP addresses of the first VNF in t... | FAIL |
msg=VNF1 is not available
------------------------------------------------------------------------------
Check Vnf2 IPs :: Check whether IP addresses of the second VNF in ... | FAIL |
msg=VNF2 is not available
------------------------------------------------------------------------------
Verify Vnf1 Interfaces :: Check whether IP addresses of the first ... | FAIL |
msg=IP address of the data VNF 'vnf1' is not available
------------------------------------------------------------------------------
Verify Vnf2 Interfaces :: Check whether IP addresses of the second... | FAIL |
msg=IP address of the data VNF 'vnf2' is not available
------------------------------------------------------------------------------
Check that ipv6 address_mode and ra_mode are set :: Check that IPv... | FAIL |
Variable '${VNF_ID1}' not found.
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single ... | FAIL |
12 tests, 5 passed, 7 failed
==============================================================================
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic NS with ...
==============================================================================
Create Multiattach VNF Descriptor :: Upload VNF package for the te... | PASS |
------------------------------------------------------------------------------
Create Multiattach NS Descriptor :: Upload NS package for the test... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf ID :: Get the VNF instance id from OSM.                       | PASS |
------------------------------------------------------------------------------
Get Vnf Management Ip Addresses :: Get the IP addresses of the two... | PASS |
------------------------------------------------------------------------------
Ensure that VDUs can share data :: Connect via SSH to the two VDUs... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.            
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name      | id                                   | date                | ns state | current operation                                    | error details |
+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| epa_01-epa_sriov_test | 17e9bed9-91ae-4b91-b6a5-460c0b2eb021 | 2024-02-19T03:27:08 | BUILDING | INSTANTIATING (c26aab68-c8cc-4ecf-ab82-baf3f49da173) | N/A           |
+-----------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF of the NS.   | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Check SR-IOV Interface :: Connect via SSH to the mgmt IP address o... | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.    | FAIL |
8 tests, 5 passed, 3 failed
==============================================================================
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for additional...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Server ID :: Get the id of the VM at the VIM and store in ... | PASS |
------------------------------------------------------------------------------
Get Server Flavor Properties :: Get from the VIM the flavor proper... | PASS |
------------------------------------------------------------------------------
Check Flavor Quota Properties :: Assert that the flavor properties... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for a... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operations on SDN...
==============================================================================
Create Basic SDNC :: Register SDN controller in OSM.                  | PASS |
------------------------------------------------------------------------------
Check SDNC Status Is Healthy :: Check in Prometheus that the SDN c... | PASS |
------------------------------------------------------------------------------
Delete Basic SDNC :: Delete SDN controller from OSM.                  | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operatio... | PASS |
3 tests, 3 passed, 0 failed
==============================================================================
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.          
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses :: Get the mgmt IP addresses of both V... | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2 :: Check connectivity from the first VNF to... | PASS |
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1 :: Check connectivity from the second VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.  | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF with 2 V...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Cannot Instantiate Network Service :: Assert failure when trying t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance And Check VIM :: Delete NS instance and check t... | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF... | PASS |
6 tests, 6 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor :: Upload VNF package for the... | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor :: Upload NS package for the t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | PASS |
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | PASS |
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor :: Upload VNF package for... | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor :: Upload NS package for t... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| hfcloudinit      | 85336811-93ce-44d1-a670-208ed3af8453 | 2024-02-19T03:46:46 | BUILDING | INSTANTIATING (a16a179f-3f42-49b4-a90d-05842c4a2cfe) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init :: Check that the day-0 ... | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor :: Upload VNF package for ... | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor :: Upload NS package for th... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name | id                                   | date                | ns state | current operation                                    | error details |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| hfmultivdu       | 230de32e-0485-46a5-ac64-cc4a8bdf21e2 | 2024-02-19T03:53:38 | BUILDING | INSTANTIATING (972965e0-7603-474f-9d7c-4902705efc64) | N/A           |
+------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get Vnf Ip Address :: Get the mgmt IP address of the VNF of the NS.   | FAIL |
'' should not be empty.
------------------------------------------------------------------------------
Test Ping :: Test that the mgmt IP address of the VNF is reachable... | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test SSH Access :: Check that the VNF is accessible via SSH in its... | FAIL |
gaierror: [Errno -2] Name or service not known
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package.                       | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package.                     | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | FAIL |
9 tests, 5 passed, 4 failed
==============================================================================
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a multi-volume...
==============================================================================
Create VNF Descriptors :: Upload VNF packages for the testsuite.      | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                            |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
| heal_01          | 9ce7f084-13c8-4e61-afdd-287cb2f838f2 | 2024-02-19T04:00:33 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.b50d7bf8-10da-  |
|                  |                                      |                     |          |                   | 4b40-a01d-720fb3b67d19, Stage 2/5:       |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution    |
|                  |                                      |                     |          |                   | environments.                            |
|                  |                                      |                     |          |                   | Detail: Deploying at VIM: Error at       |
|                  |                                      |                     |          |                   | create vdu: 'NoneType' object does not   |
|                  |                                      |                     |          |                   | support item assignment. Error at create |
|                  |                                      |                     |          |                   | vdu: unknown                             |
+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get NS Id :: Get NS identifier.                                       | FAIL |
Invalid IF condition: Evaluating expression 'not "${ns_id}" in "{'${/}': '/', '${:}': ':', '${\\n}': '\n', '${DEBUG_FILE}': 'NONE', '${EXECDIR}': '/robot-systest', '${FAILURE_RETURN_CODE}': '1', '${False}': False, '${HEALING_POL_TIME}': '15sec', '${LOG_FILE}': '/robot-systest/reports/log.html', '${LOG_LEVEL}': 'INFO', '${None}': None, '${NS_ACTION_MAX_WAIT_TIME}': '1min', '${NS_ACTION_POL_TIME}': '15sec', '${NS_CONFIG}': '{vld: [ {name: mgmtnet, vim-network-name: osm-ext} ] }', '${NSD_DELETE_MAX_WAIT_TIME}': '1min', '${NSD_DELETE_POL_TIME}': '15sec', '${NS_DELETE_POL_TIME}': '15sec', '${NSD_NAME}': 'volumes_healing-ns', '${NSD_PKG}': 'volumes_healing_ns', '${NS_LAUNCH_POL_TIME}': '30sec', '${NS_NAME}': 'heal_01', '${NS_TIMEOUT}': '6min', '${null}': None, '${OUTPUT_DIR}': '/robot-systest/reports', '${OUTPUT_FILE}': '/robot-systest/reports/output.xml', '${PASSWORD}': '', '${PREV_TEST_MESSAGE}': '\'+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+\n| ns instance name | id                                   | date                | ns state | current operation | error details                            |\n+------------------+--------------------------------------+---------------------+----------+-------------------+------------------------------------------+\n| heal_01          | 9ce7f084-13c8-4e61-afdd-287cb2f838f2 | 2024-02-19T04:00:33 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.b50d7bf8-10da-  |\n|                  |...
    [ Message content over the limit has been removed. ]
...ORT_FILE}': '/robot-systest/reports/report.html', '${SPACE}': ' ', '${SUCCESS_RETURN_CODE}': '0', '${SUITE_DOCUMENTATION}': '[HEAL-01] Healing of a multi-volume VDU', '${SUITE_NAME}': 'Testsuite.Heal 01-Volume Vdu Healing', '${SUITE_SOURCE}': '/robot-systest/testsuite/heal_01-volume_vdu_healing.robot', '${TEMPDIR}': '/tmp', '${TEST_DOCUMENTATION}': 'Get NS identifier.', '${TEST_NAME}': 'Get NS Id', '${True}': True, '${USERNAME}': 'ubuntu', '${VDU_VOLUMES_NAME}': 'several_volumes-VM', '${VIM_TIMEOUT_MULTIPLIER}': '1.0', '${VNFD_DELETE_MAX_WAIT_TIME}': '1min', '${VNFD_DELETE_POL_TIME}': '15sec', '${VNFD_MANUALSCALE_NAME}': 'manual_scale-vnf', '${VNFD_MANUALSCALE_PKG}': 'manual_scale_vnf', '${VNFD_VOLUMES_NAME}': 'several_volumes-vnf', '${VNFD_VOLUMES_PKG}': 'several_volumes_vnf', '${VNF_SCALE_POL_TIME}': '15sec', '${VNF_SEVERAL_INDEX}': 'several_volumes_vnf', '&{OPTIONS}': {'include': ['daily'], 'exclude': [], 'skip': [], 'skip_on_failure': []}, '&{SUITE_METADATA}': Metadata(), '@{TEST_TAGS}': ['cleanup', 'cluster_heal', 'daily', 'heal_01', 'regression'], '@{VIM_VDUS}': [], '@{VIM_VOLUMES}': []}"' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression 'not "\${ns_id}" in "${variables}"' were resolved before the expression was evaluated. Try using 'not "\${ns_id}" in "$variables"' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Get VIM Objects :: Retrieve all VMs and volumes from the NS and st... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Volume VNF Info :: Get VDU ID, IP addresses and volumes of the... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Volumes Info :: Get number of volumes from the VNF descriptor ... | FAIL |
Variable '${VDU_VOLUMES_ID}' not found.
------------------------------------------------------------------------------
Check VDU Disks :: Check that the number of disks in the VDU meets... | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Delete Persistent Volume VDU :: Manually delete the VM in Openstack.  | FAIL |
msg=VDU is not available
------------------------------------------------------------------------------
Heal Persistent Volume VDU :: Manually heal the VNF in order to re... | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check VNF After Healing :: Check that the IDs of the VM and volume... | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Update VIM Objects :: Retrieve all VMs and volumes from the NS and... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF packages from OSM.               | PASS |
------------------------------------------------------------------------------
Delete Remaining Objects in VIM :: Delete any remaining objects (v... | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a mul... | FAIL |
16 tests, 6 passed, 10 failed
==============================================================================
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled VDUs       
==============================================================================
Create VNF Descriptors :: Upload VNF packages for the testsuite.      | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Create Test Flavor :: Create a flavor that will be used at NS inst... | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite ... | FAIL |
'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| ns instance name | id                                   | date                | ns state | current operation | error details                           |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
| heal_02          | 76cc9674-25e1-48aa-aa90-73399b0e9284 | 2024-02-19T04:08:02 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.ef23b8f5-d42e- |
|                  |                                      |                     |          |                   | 40d5-84e8-f3ee7cca0044, Stage 2/5:      |
|                  |                                      |                     |          |                   | deployment of KDUs, VMs and execution   |
|                  |                                      |                     |          |                   | environments.                           |
|                  |                                      |                     |          |                   | Detail: Deploying at VIM: Error at      |
|                  |                                      |                     |          |                   | create vdu: unknown                     |
+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' contains 'BROKEN'
------------------------------------------------------------------------------
Get NS Id :: Get NS identifier.                                       | FAIL |
Invalid IF condition: Evaluating expression 'not "${ns_id}" in "{'${/}': '/', '${:}': ':', '${\\n}': '\n', '${DEBUG_FILE}': 'NONE', '${EXECDIR}': '/robot-systest', '${FAILURE_RETURN_CODE}': '1', '${False}': False, '${FLAVOR_ID}': 'fe12a210-6fa7-4868-9845-89c27cb3fbb1', '${FLAVOR_NAME_PREFIX}': 'osm.heal02', '${HEALING_POL_TIME}': '15sec', '${LOG_FILE}': '/robot-systest/reports/log.html', '${LOG_LEVEL}': 'INFO', '${None}': None, '${NS_ACTION_MAX_WAIT_TIME}': '1min', '${NS_ACTION_POL_TIME}': '15sec', '${NSD_DELETE_MAX_WAIT_TIME}': '1min', '${NSD_DELETE_POL_TIME}': '15sec', '${NS_DELETE_POL_TIME}': '15sec', '${NSD_NAME}': 'volumes_healing-ns', '${NSD_PKG}': 'volumes_healing_ns', '${NS_LAUNCH_POL_TIME}': '30sec', '${NS_NAME}': 'heal_02', '${NS_TIMEOUT}': '6min', '${null}': None, '${OUTPUT_DIR}': '/robot-systest/reports', '${OUTPUT_FILE}': '/robot-systest/reports/output.xml', '${PASSWORD}': '', '${PREV_TEST_MESSAGE}': '\'+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| ns instance name | id                                   | date                | ns state | current operation | error details                           |\n+------------------+--------------------------------------+---------------------+----------+-------------------+-----------------------------------------+\n| heal_02          | 76cc9674-25e1-48aa-aa90-73399b0e9284 | 2024-02-19T04:08:02 | BROKEN   | IDLE (None)       | Operation: INSTANTIATING.ef23b8f5-d42e- |\n|  ...
    [ Message content over the limit has been removed. ]
...te/heal_02-scale_vdu_healing.robot', '${TEMPDIR}': '/tmp', '${TEST_DOCUMENTATION}': 'Get NS identifier.', '${TEST_NAME}': 'Get NS Id', '${True}': True, '${USERNAME}': 'ubuntu', '${VDU_MANUALSCALE_NAME}': 'mgmtVM', '${VDU_VOLUMES_NAME}': 'several_volumes-VM', '${VIM_TIMEOUT_MULTIPLIER}': '1.0', '${VNFD_DELETE_MAX_WAIT_TIME}': '1min', '${VNFD_DELETE_POL_TIME}': '15sec', '${VNFD_MANUALSCALE_NAME}': 'manual_scale-vnf', '${VNFD_MANUALSCALE_PKG}': 'manual_scale_vnf', '${VNFD_VOLUMES_NAME}': 'several_volumes-vnf', '${VNFD_VOLUMES_PKG}': 'several_volumes_vnf', '${VNF_MANUALSCALE_CLOUDINIT_FILE}': '/root/helloworld.txt', '${VNF_MANUALSCALE_DAY1_FILE}': '/home/ubuntu/first-touch', '${VNF_MANUALSCALE_INDEX}': 'manual_scale_vnf', '${VNF_MANUALSCALE_SCALING_GROUP}': 'manual-scaling_mgmtVM', '${VNF_SCALE_POL_TIME}': '15sec', '${VNF_SEVERAL_INDEX}': 'several_volumes_vnf', '&{OPTIONS}': {'include': ['daily'], 'exclude': [], 'skip': [], 'skip_on_failure': []}, '&{SUITE_METADATA}': Metadata(), '@{TEST_TAGS}': ['cleanup', 'cluster_heal', 'daily', 'heal_02', 'regression'], '@{VIM_VDUS}': [], '@{VIM_VOLUMES}': []}"' failed: SyntaxError: invalid syntax (<string>, line 1)

Variables in the original expression 'not "\${ns_id}" in "${variables}"' were resolved before the expression was evaluated. Try using 'not "\${ns_id}" in "$variables"' syntax to avoid that. See Evaluating Expressions appendix in Robot Framework User Guide for more details.
------------------------------------------------------------------------------
Scale Out Manual Scale VNF :: Perform a manual scale-out operation... | FAIL |
Variable '${NS_ID}' not found.
------------------------------------------------------------------------------
Get VIM Objects :: Retrieve all VMs and volumes from the NS and st... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Get Manual Scale VNF Info :: Get VDU ID and IP addresses of the ma... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Halt Manual Scale VDU :: Halt one of the VM of the Manual Scale VNF.  | FAIL |
msg=VDU is not available
------------------------------------------------------------------------------
Heal Manual Scale VDU :: Heal manually via OSM commands all stoppe... | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Check VNF After Healing :: Check that the IDs of the VM and volume... | FAIL |
msg=VNF is not available
------------------------------------------------------------------------------
Update VIM Objects :: Retrieve all VMs and volumes from the NS and... | FAIL |
msg=NS is not available
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF packages from OSM.               | PASS |
------------------------------------------------------------------------------
Delete Remaining Objects In VIM :: Delete any remaining objects (v... | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled... | FAIL |
16 tests, 7 passed, 9 failed
==============================================================================
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multiple VDUs      
==============================================================================
Create VNF Descriptors :: Upload VNF packages for the testsuite.      | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get NS Id :: Get NS identifier and stores as suite variable to be ... | PASS |
------------------------------------------------------------------------------
Scale Out Manual Scale VNF :: Perform a manual scale-out operation... | PASS |
------------------------------------------------------------------------------
Get VIM Objects :: Retrieve all VMs and volumes from the NS and st... | PASS |
------------------------------------------------------------------------------
Get Manual Scale VNF Info :: Get VDU ID and IP addresses of the ma... | PASS |
------------------------------------------------------------------------------
Get Volume VNF Info :: Get info about volumes and VM of the VNF wi... | PASS |
------------------------------------------------------------------------------
Stop VDUs :: Stop all VMs.                                            | PASS |
------------------------------------------------------------------------------
Heal VDUs :: Heal manually via OSM commands all stopped VMs . They... | PASS |
------------------------------------------------------------------------------
Check VNFs After Healing :: Check that the IDs of the VM and volum... | FAIL |
2 != 0
------------------------------------------------------------------------------
Update VIM Objects :: Retrieve all VMs and volumes from the NS and... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF packages from OSM.               | PASS |
------------------------------------------------------------------------------
Delete Objects In VIM :: Delete any remaining objects (volumes, VM... | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multipl... | FAIL |
16 tests, 15 passed, 1 failed
==============================================================================
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS                  
==============================================================================
Create VNF Descriptors :: Upload VNF package for the testsuite.       | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Network Service Instance Test :: Instantiate NS for the testsuite.    | PASS |
------------------------------------------------------------------------------
Get NS Id :: Get NS identifier and stores as suite variable to be ... | PASS |
------------------------------------------------------------------------------
Get VIM Objects :: Retrieve all VMs and volumes from the NS and st... | PASS |
------------------------------------------------------------------------------
Get VNF Info :: Get VDU ID and IP addresses of the VNF and stores ... | PASS |
------------------------------------------------------------------------------
Stop Autoheal VDU :: Stop one VM of the VNF.                          | PASS |
------------------------------------------------------------------------------
Wait For Autohealing To Be Completed :: Wait for auto-healing to b... | PASS |
------------------------------------------------------------------------------
Check VNF After Healing :: Check that the ID of the VM and the IP ... | PASS |
------------------------------------------------------------------------------
Update VIM Objects :: Retrieve all VMs from the NS and stores them... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Delete VNF package from OSM.                | PASS |
------------------------------------------------------------------------------
Delete Objects In VIM :: Delete any remaining objects (volumes, VM... | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS          | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Creates a VIM for the K8s cluster to be ... | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Delete K8s cluster.                    | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Retrieve NS instance id to be used later on.             | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Retrieve NF instance id to be used later on.            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation :: Perform OSM action to upgrade the num... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation :: Check that the number of... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation :: Perform OSM action to rollback the p... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation :: Check that the number o... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF :: Upload NF package for the tests... | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS :: Upload NS package for the testsu... | PASS |
------------------------------------------------------------------------------
Create Dummy VIM :: Register a VIM of type dummy in OSM.              | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM :: Register a K8s cluster associated to the... | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Instantiate NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete NS instance.                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM :: Remove K8s cluster from OSM.           | PASS |
------------------------------------------------------------------------------
Delete VIM :: Remove VIM from OSM.                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS package from OSM.              | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete NF package from OSM.             | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU stored in publ...
==============================================================================
Create Package For CNF :: Create Package For CNF                      | PASS |
------------------------------------------------------------------------------
Create Package For NS :: Create Package For NS                        | PASS |
------------------------------------------------------------------------------
Create Helm OCI Repo :: Create Helm OCI Repo for openldap kdu         | PASS |
------------------------------------------------------------------------------
Create Network Service Instance :: Create Network Service Instance    | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Get ID of NS instance                                    | PASS |
------------------------------------------------------------------------------
Get Vnf Id :: Get ID of VNF                                           | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over first KDU :: Execute Upgrade Operat... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over first KDU :: Check Rep... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation over first KDU :: Execute Rollback Oper... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over first KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation over second KDU :: Execute Upgrade Opera... | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation over second KDU :: Check Re... | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation over second KDU :: Execute Rollback Ope... | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation over second KDU :: Check R... | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance :: Delete Network Service Instance    | PASS |
------------------------------------------------------------------------------
Delete Helm OCI Repo :: Delete Helm OCI Repo                          | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete NS Descriptor Test                | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF Descriptor Test              | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 13-Two Helm Kdu :: [K8s-13] Two Helm-based KDU store... | PASS |
18 tests, 18 passed, 0 failed
==============================================================================
Testsuite.Lcmop 01-Cancel Operation Basic :: [LCMOP_01] Cancel an ongoing N...
==============================================================================
Create VNF Descriptor :: Create the VNF descriptor                    | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Create the NS descriptor                      | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the Network service        | PASS |
------------------------------------------------------------------------------
Get Operation ID :: Obtain the operation ID of the NS instantiation   | PASS |
------------------------------------------------------------------------------
Cancel Operation :: Cancel the ongoing NS instantiation               | PASS |
------------------------------------------------------------------------------
Check That Operation Is Cancelled :: Check that the operation is s... | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test :: Delete the cancelled NS instance           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test :: Delete the NS descriptor                 | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete the VNF descriptor               | PASS |
------------------------------------------------------------------------------
Testsuite.Lcmop 01-Cancel Operation Basic :: [LCMOP_01] Cancel an ... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforcement.       
==============================================================================
Create First Project With Quotas :: Create a first project with qu... | PASS |
------------------------------------------------------------------------------
Create Second Project With Quotas :: Create a second project with ... | PASS |
------------------------------------------------------------------------------
Create User In Projects :: Create a user with role project_admin i... | PASS |
------------------------------------------------------------------------------
Change First Project Name to Third Project Name :: Rename first pr... | PASS |
------------------------------------------------------------------------------
Create VNFDs On Third Project Until Exceed Quota :: Upload VNF pac... | PASS |
------------------------------------------------------------------------------
Increase Third Project Quotas :: Update the quotas of the third pr... | PASS |
------------------------------------------------------------------------------
Create More VNFDs On Third Project Until Exceed Quota :: Upload VN... | PASS |
------------------------------------------------------------------------------
Create VNFDs On Second Project Until Exceed Quota :: Upload VNF pa... | PASS |
------------------------------------------------------------------------------
Check Project Scopes :: Check that the user can see a VNF package ... | PASS |
------------------------------------------------------------------------------
Delete Second Project VNFD :: Delete VNF packages from second proj... | PASS |
------------------------------------------------------------------------------
Delete Third Project VNFDs :: Delete VNF packages from third project. | PASS |
------------------------------------------------------------------------------
Delete Second Project After Removing User From It :: Delete user f... | PASS |
------------------------------------------------------------------------------
Delete Projects User :: Delete user.                                  | PASS |
------------------------------------------------------------------------------
Delete Third Project :: Delete third project.                         | PASS |
------------------------------------------------------------------------------
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforce... | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based metrics.   
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate NS for the testsuite.      | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metrics :: Check that the expected metrics are p... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package.                            | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package.                          | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF :: Read metric threshold and threshold tim... | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | PASS |
------------------------------------------------------------------------------
Get VNF Id :: Retrieve VNF instance id to be used later on.           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address :: Get the mgmt IP address of the VNF to be use... | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling :: Get from Prometheu... | PASS |
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling :: Connect to the ... | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold :: Wait until the VIM me... | PASS |
------------------------------------------------------------------------------
Wait Threshold Time :: Wait until the VIM metric has exceeded thre... | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time :: C... | PASS |
------------------------------------------------------------------------------
Get VDUs After Auto-scaling :: Check that the VNF has scaled up an... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | PASS |
15 tests, 15 passed, 0 failed
==============================================================================
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or alarms com...
==============================================================================
Create Webhook Service VNF Descriptor :: Upload VNF package with a... | PASS |
------------------------------------------------------------------------------
Create Webhook Service NS Descriptor :: Upload NS package with a w... | PASS |
------------------------------------------------------------------------------
Instantiate Webhook Service Network Service :: Instantiate NS with... | PASS |
------------------------------------------------------------------------------
Get Webhook Service VNF IP Address :: Get the mgmt IP address of t... | PASS |
------------------------------------------------------------------------------
Start Webhook Service :: Launch simple command in webhook VNF to l... | PASS |
------------------------------------------------------------------------------
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the main NS for the tes... | PASS |
------------------------------------------------------------------------------
Get Alarm Metric :: Check that the expected metric is present in P... | PASS |
------------------------------------------------------------------------------
Check Alarms Were Received :: Check in the webhook VNF that the no... | PASS |
------------------------------------------------------------------------------
Delete NS Instance :: Delete main NS instance.                        | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete main NS package.                       | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete main VNF package.                     | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Instance :: Delete NS instance for the w... | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Descriptor :: Delete NS package for the ... | PASS |
------------------------------------------------------------------------------
Delete Webhook Service VNF Descriptor :: Delete VNF package for th... | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or a... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with VNF-based ...
==============================================================================
Create VNF Descriptor :: Upload VNF package for the testsuite.        | PASS |
------------------------------------------------------------------------------
Create NS Descriptor :: Upload NS package for the testsuite.          | PASS |
------------------------------------------------------------------------------
Instantiate Network Service :: Instantiate the NS for the testsuite.  | FAIL |
Keyword 'Check For NS Instance To Configured' failed after retrying for 5 minutes. The last error was: '+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| ns instance name                        | id                                   | date                | ns state | current operation                                    | error details |
+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
| sa_08-vnf_with_vnf_indicators_snmp_test | fe640e04-5afd-4d7b-8863-0e9e4ce8fffc | 2024-02-19T05:17:51 | BUILDING | INSTANTIATING (7f4ee6e0-79f8-42d1-9fa3-7cfa03756b3b) | N/A           |
+-----------------------------------------+--------------------------------------+---------------------+----------+------------------------------------------------------+---------------+
To get the history of all operations over a NS, run "osm ns-op-list NS_ID"
For more details on the current operation, run "osm ns-op-show OPERATION_ID"' does not contain any of 'READY' or 'BROKEN'
------------------------------------------------------------------------------
Get VNF SNMP Metrics :: Check that SNMP metrics from the VNF are s... | FAIL |
Keyword 'Get Metric' failed after retrying 10 times. The last error was: Metric ifInOctets not found
------------------------------------------------------------------------------
Delete NS Instance :: Delete NS instance.                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor :: Delete NS package from OSM.                   | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor :: Delete VNF package from OSM.                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with V... | FAIL |
7 tests, 5 passed, 2 failed
==============================================================================
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.             
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Template :: Onboards the Network Slice Template: nst ... | PASS |
------------------------------------------------------------------------------
Network Slice Instance Test :: Instantiates the NST recently onboa... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| slicebasic             | ae3d0da8-d390-40f6-87d1-39f910b299e7 | failed             | configured    | ERROR instantiating: NS 68097fde-9e82-4033-92b5-2d2fe4f24e79 FAILED: Deploying at VIM: Error at create vdu: unknown; NS 24b1bfe1-dc6b-4fbc-9e55-8c9fa87e224c FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get Slice Vnf Ip Addresses :: Obtains the list of IPs addresses in... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Test Slice Connectivity :: SSH access to the slice middle vnf (mgm... | FAIL |
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.248.67
------------------------------------------------------------------------------
Delete Slice Instance :: Stops the slice instance (slice_name)        | PASS |
------------------------------------------------------------------------------
Delete Slice Template :: Deletes the NST (nst_name) from OSM          | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.     | FAIL |
13 tests, 9 passed, 4 failed
==============================================================================
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Network Slic...
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Templates :: Onboards the Network Slice Templates: ns... | PASS |
------------------------------------------------------------------------------
Network Slice First Instance :: Instantiates the First NST recentl... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| slicebasic             | e78de7b8-97ec-4fd0-bffd-c0ba7a4125eb | failed             | configured    | ERROR instantiating: NS 8a05419a-1103-40ea-9037-f7079f4fa2e9 FAILED: Deploying at VIM: Error at create vdu: unknown; NS f77a9dda-f78a-4d98-9ff0-20af95daa709 FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
Network Slice Second Instance :: Instantiates the Second NST recen... | FAIL |
'+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| netslice instance name | id                                   | operational status | config status | detailed status                                                                                                                                                                                                     |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| sliceshared            | 72c96953-f696-4de1-8c6b-a364b4a7385b | failed             | configured    | ERROR instantiating: NS 8a05419a-1103-40ea-9037-f7079f4fa2e9 FAILED: Deploying at VIM: Error at create vdu: unknown; NS c8acdafc-d48d-4635-82dd-e93a624ad3fc FAILED: Deploying at VIM: Error at create vdu: unknown |
+------------------------+--------------------------------------+--------------------+---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+' contains 'failed'
------------------------------------------------------------------------------
First Network Slice Ns Count :: Counts the NS in both slice instan... | PASS |
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get First Slice Vnf IPs :: Obtains the list of IPs addresses in th... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | FAIL |
Keyword 'Test Ping Host' failed after retrying for 30 seconds. The last error was: 1 != 0
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Test First Slice Connectivity :: SSH access to the slice middle vn... | FAIL |
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.248.55
------------------------------------------------------------------------------
Delete Slice One Instance :: Stops the slice instance (slice_name)    | PASS |
------------------------------------------------------------------------------
Second Network Slice Ns Count :: Counts the NS in both slice insta... | PASS |
------------------------------------------------------------------------------
Get Second Slice Vnf IPs :: Obtains the list of IPs addresses in t... | PASS |
------------------------------------------------------------------------------
Test Second Slice Connectivity :: SSH access to the slice middle v... | FAIL |
TimeoutError: timed out
------------------------------------------------------------------------------
Delete Slice Two Instance :: Stops the slice instance (slice2_name)   | PASS |
------------------------------------------------------------------------------
Delete Slice One Template :: Deletes the NST (nst_name) from OSM      | PASS |
------------------------------------------------------------------------------
Delete Slice Two Template :: Deletes the NST (nst2_name) from OSM     | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Net... | FAIL |
20 tests, 14 passed, 6 failed
==============================================================================
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003 Api testing
==============================================================================
Create VNF Package From JSON File :: Create a VNF package and upda... | PASS |
------------------------------------------------------------------------------
Instantiate VNF :: Test case to Instantiate a VNF                     | PASS |
------------------------------------------------------------------------------
Query VNF Instances :: Test case to query VNF Instance                | PASS |
------------------------------------------------------------------------------
Query VNF Instance ID :: Test case to query Vnf instance ID           | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops :: Test case to Query VNF LCM operation             | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops ID :: Check if the operation has completed.         | PASS |
------------------------------------------------------------------------------
Scale VNF :: Scale out VNF                                            | PASS |
------------------------------------------------------------------------------
Terminate VNF :: Test case to terminate the VNF                       | PASS |
------------------------------------------------------------------------------
Delete VNF :: Delete VNF instance.                                    | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Delete VNF package from OSM.            | PASS |
------------------------------------------------------------------------------
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Sol003 02-Dualstack Ip Vnfm :: [Sol003-02] Sol003 Dual Stack IP i...
==============================================================================
Create VNFD Descriptor :: Test case to create a VNF Identifier        | PASS |
------------------------------------------------------------------------------
Instantiate VNF :: Test case to Instantiate a VNF                     | PASS |
------------------------------------------------------------------------------
Get Ns Id :: Get the NS instance id                                   | PASS |
------------------------------------------------------------------------------
Get Ip From The NSD :: Get the IP address from the NSD                | PASS |
------------------------------------------------------------------------------
Get Dual Ip :: Get the IP address from the NS                         | PASS |
------------------------------------------------------------------------------
Verify Dual Ip :: Test case to validate the IP address.               | PASS |
------------------------------------------------------------------------------
Terminate VNF :: Test case to terminate the VNF                       | PASS |
------------------------------------------------------------------------------
Delete VNF :: Test case to delete VNF                                 | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test :: Test case to delete the VNF descriptor. | PASS |
------------------------------------------------------------------------------
Testsuite.Sol003 02-Dualstack Ip Vnfm :: [Sol003-02] Sol003 Dual S... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite                                                             | FAIL |
451 tests, 396 passed, 55 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html