SuccessConsole Output

[osm-devops] Running shell script
+ docker run --env OSM_HOSTNAME=172.21.249.237 --env PROMETHEUS_HOSTNAME=172.21.249.237 --env PROMETHEUS_PORT=9091 --env JUJU_PASSWORD=2f78b6493c8cc70813b959ca065669a6 --env-file /home/jenkins/hive/robot-systest.cfg -v /home/jenkins/hive/clouds.yaml:/etc/openstack/clouds.yaml -v /home/jenkins/hive/cicd_rsa:/root/osm_id_rsa -v /home/jenkins/hive/kubeconfig.yaml:/root/.kube/config -v /tmp/tmp.9gPBurTvNO:/robot-systest/reports -v /home/jenkins/hive/port-mapping-etsi-vim.yaml:/root/port-mapping.yaml opensourcemano/tests:osm-v140-merge-316 -c -t daily

2024-05-03_22:36:16 Creating VIM osm
ff449c82-828e-462c-a21f-a03bb1058a24
VIM status: | osm | ff449c82-828e-462c-a21f-a03bb1058a24 | admin | ENABLED | N/A |
1e09b0ce-9848-4a2f-940c-ed1b2ae80e51
Checking status of SDNC sdnc-osm to see if it is enabled
SDNC enabled
Checking status of VIM osm to see if there is port-mapping
|                 |   "sdn-port-mapping": [                                     |
Port-mapping correctly added

2024-05-03_22:36:34 Creating K8s Cluster
8725303a-47ae-46aa-bca3-0113535f0333
K8s cluster stuck for more than 50 seconds:
+----------------+------------------------------------------------------------------------------------------------------+
| key            | attribute                                                                                            |
+----------------+------------------------------------------------------------------------------------------------------+
| _id            | "8725303a-47ae-46aa-bca3-0113535f0333"                                                               |
| name           | "osm"                                                                                                |
| credentials    | {                                                                                                    |
|                |   "apiVersion": "v1",                                                                                |
|                |   "clusters": [                                                                                      |
|                |     {                                                                                                |
|                |       "cluster": {                                                                                   |
|                |         "certificate-authority-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ |
|                | 0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EY3dOekl5TlRrM |
|                | U9Gb1hEVE15TURjd05ESXlOVGsxT0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BU |
|                | UVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTFVDCjdXUkFZTU90SmJ1U1loQ2FrVDZ3VUdKZEtZdUdRb29xd3F5WStnRW8yU1RnZEhPZ |
|                | EdpZzVJMjF3cG9tdFV1V2sKREhmZUJHMHIvRGkvUHdML3VEb0tqUFVvdU5JdTBYc1FTYXIrOGNMTkdWSDczSnBJcWRaZDVEREthd |
|                | WFacU9ONQovdlJjdVBiWHdLNldkRmdldDB3RWQycVlKQytmNk9Dcm5oUnlSOGJvWVdxZ2kvNzhNSHFwMERNQ0I4TDFHRHVmCjdJV |
|                | EFodUtBaUM1a2llQ1NzY1cwT0NVdTZPazdCVTZVc3dhd2phRVlWbUVkS0Flb0o2UWNGTHBnWkFvdDA2aFIKYlRqTmNkLzdLRDNCZ |
|                | VJWc3QycGZqL2lQdlVXaDBiR1VWREZDRXV1UC9VTUNRdHZ6SWVIUEhZamtjNkZYSldWSwpyZGk5bGNuV1FRSlVJVENLcFlzQ0F3R |
|                | UFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQMGRZVzdhV |
|                | VlMZ0dpNk53aW1iV3llUWh0bjZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnR |
|                | UJBQVBoNGhOUGlPUlZVZXQzRXgwTgpHekNUM1Q1OUtzMHFaa0JUMnpkM29qc0tsUS9LTS85TzJEa2YzdElnbkV6ZWlIdlMzUExTa |
|                | TZkaDhISzE3MlNQCnMyUy95bW5nTWZMMlkyYU85ZTA2L3B1NEFvUG56c2ZSOFhzNnVXc2N5UkdVbXNMcjR5eVBFaythL0F4OXcxS |
|                | 2MKeHFQZDB2bXo4OVZMVHFHb2hjZVJKcmVkMU1RcnNnMnMzR1pzRDU4MVRpVlI0bGQ3VlpNSnpGM01Wa3hOazNnagp6dm5SQU01M |
|                | HhPdmx1ek9ZVHo5aEthRjk0QTVta2pzck02ZStmdHN0dEpzQWduWnpIVHlaUFFkYW9TTE9YeWx6CnY2VGhrYjZvLzFXWjVTQjMrc |
|                | CttRlJYYmN4UC9tS04zNktiem5UOWJpVlJTRkVXcWswTmdHdUZiNDBvNkJLM3gKckFRPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tL |
|                | S0tCg==",                                                                                            |
|                |         "server": "https://172.21.248.125:6443"                                                      |
|                |       },                                                                                             |
|                |       "name": "cluster.local"                                                                        |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "contexts": [                                                                                      |
|                |     {                                                                                                |
|                |       "context": {                                                                                   |
|                |         "cluster": "cluster.local",                                                                  |
|                |         "user": "kubernetes-admin"                                                                   |
|                |       },                                                                                             |
|                |       "name": "kubernetes-admin@cluster.local"                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current-context": "kubernetes-admin@cluster.local",                                               |
|                |   "kind": "Config",                                                                                  |
|                |   "preferences": {},                                                                                 |
|                |   "users": [                                                                                         |
|                |     {                                                                                                |
|                |       "name": "kubernetes-admin",                                                                    |
|                |       "user": {                                                                                      |
|                |         "client-certificate-data": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURJVENDQWdtZ0F3SUJBZ0lJ |
|                | Vm02SVliZ0c2M1l3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TWpBM01E |
|                | Y3lNalU1TlRoYUZ3MHlOVEEwTURFd016QXdNREZhTURReApGekFWQmdOVkJBb1REbk41YzNSbGJUcHRZWE4wWlhKek1Sa3dGd1lE |
|                | VlFRREV4QnJkV0psY201bGRHVnpMV0ZrCmJXbHVNSUlCSWpBTkJna3Foa2lHOXcwQkFRRUZBQU9DQVE4QU1JSUJDZ0tDQVFFQXR5 |
|                | UDZiMmordHVINCtJTCsKRkt4YW5yMWNZUEJLdHp0UDIxSTVaNkhHWHBOdWJCS1lHTU52U0crVkd4REVYa3VSQk54ZFp2M1RteGpa |
|                | MWJDNQpyZTU5Z0duR2hPK1dKY0FrZDNudE9lMWpBSmNsM3Y0NmRxSisxVmJ2UDVSS09hQ2c1dzVmSFlxS25YSXpZTG80Cm9BRC9t |
|                | Vmh4WXplZzlJM2hWeUNhUFUrM3VkQ25NaXVsZnROd0VIWDEwaHFtb1R6eDJqSWdqVnB6eGl3WllRc08KVUpmRWdNV3gydkw5T0hG |
|                | TUwvWFIrb2VIc2RSWVpBZUkyRnF4VHJCcU45R2xLQ3h5S1ZPSkhEdFRPT1IzbDJKRgphRFlRbnlUYVVMNk9nRlBJQ1VTVitWUHdO |
|                | WG96UlN6Nkp2Tm5NWmpkTG41NjNXY3M1cEZwNjBETTlUMUMveE5pClFaUkRCUUlEQVFBQm8xWXdWREFPQmdOVkhROEJBZjhFQkFN |
|                | Q0JhQXdFd1lEVlIwbEJBd3dDZ1lJS3dZQkJRVUgKQXdJd0RBWURWUjBUQVFIL0JBSXdBREFmQmdOVkhTTUVHREFXZ0JUOUhXRnUy |
|                | bEdDNEJvdWpjSXBtMXNua0liWgorakFOQmdrcWhraUc5dzBCQVFzRkFBT0NBUUVBSml0dEhjODRjVmJnanJSOEt1dUh0K01Qd2s5 |
|                | eTdWTG5MQ1BsCmM3ckV6eHg5RDEzS0QyeTN6NzlrRDNSOXNmMHVicWczUjI2cFdJNCtObkc4b0VsK2FmelovcTRHb0laRW0zWEIK |
|                | ZE1hRlJRcVk2U1JXWERUVHVjZEFxVmt4VG4rTVFSSUZrZXUycUxMU3RMeFk2V0dtMXEvTUFxQ3o0WkNFejBHOApXSXFnTlNpUzJY |
|                | SytjQkN4cUlDbnQ1ODFGYXRLaHZnRk5rTjhFTlJlQ2VVQUw1N2pOaGZQVS9MOVY2RTllMENYCldkTUFkSithYyt6UGJuUU1GcktJ |
|                | NkdoOEsxNHdIS2FTTDNjV29sQUxLcUVTc0JLU2hsV0J0MWMxcTROSzNCOWMKRWsyNURLYU53SUxHZkx6dU0wY2dsNVdZQ3lsTmFS |
|                | M2FpQmVtbGx4aUUrR1hxckd1c0E9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",                               |
|                |         "client-key-data": "LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcFFJQkFBS0NBUUVBdHlQNmIy |
|                | ait0dUg0K0lMK0ZLeGFucjFjWVBCS3R6dFAyMUk1WjZIR1hwTnViQktZCkdNTnZTRytWR3hERVhrdVJCTnhkWnYzVG14aloxYkM1 |
|                | cmU1OWdHbkdoTytXSmNBa2QzbnRPZTFqQUpjbDN2NDYKZHFKKzFWYnZQNVJLT2FDZzV3NWZIWXFLblhJellMbzRvQUQvbVZoeFl6 |
|                | ZWc5STNoVnlDYVBVKzN1ZENuTWl1bApmdE53RUhYMTBocW1vVHp4MmpJZ2pWcHp4aXdaWVFzT1VKZkVnTVd4MnZMOU9IRk1ML1hS |
|                | K29lSHNkUllaQWVJCjJGcXhUckJxTjlHbEtDeHlLVk9KSER0VE9PUjNsMkpGYURZUW55VGFVTDZPZ0ZQSUNVU1YrVlB3TlhvelJT |
|                | ejYKSnZObk1aamRMbjU2M1djczVwRnA2MERNOVQxQy94TmlRWlJEQlFJREFRQUJBb0lCQVFDTjlXVjZWbmlhYWk4Qwo4d2JnSDNs |
|                | ZThvbFkydW9QZmZvNGwxUEg4SzVEUVNTbXdRTUVydmpqdlJwbkVHZ21iNHpKcDhiK3ZtSDRKeHN6CmVQbDB5UmlmSVY2d1RNYW1I |
|                | SG9uNG1yd0xBSkJ3dWVvSW9oT3pVWmpPQy9icUthZ1pOSlVSOStTbG9FNzZmbkoKVUkvejl0SXBtMVRKQTZYUDZ1cHhEdVNBQWZy |
|                | NEhHU01CMllKSWN1MW9WQWN3azY2YVlFa2c0NElnSnVWTGo1Swp6Nnh2ZUNlU3libWkyUkZ0dXFpNVFMRGl0a2Zsdk9Wa3BGUVQ5 |
|                | a0FDeTRSZTJ6Q2pzTVFyVFljQzNzdnhqaDlHClJ2QjZYczdWSTE2ZFhTMytZKzE2aW5yT1kzT1BUU1BySG5RcFJwRWZXL2Q1VS9S |
|                | ZzZqR2M0ZUMxa1o3YzNtQk4KMk5zVWNRRkJBb0dCQU5BZmRSdEh4aHVjM1o1TmcvTXRwbDk2NGpRMDZnd3dZYVVNYTFlOXZKZjYy |
|                | RjFiMThMTwpZUUltRmxQYUlJaFFCTU10elNIa1ZHL0JYbEd3WjgyNFdvUnd6MXBCU2lvNkJhTW9pT2hrcmRvK1FicW5vZlZCCkZ0 |
|                | dE9OcU1TK0hyVlNNdTY1QWJnbllscDZ0RDZsQ0lkaU1saWJ2ak5FUTJrdWQyanJyZGhvMUh2QW9HQkFPRkYKU2RjaUlTUDBuakxy |
|                | OGF5ZFVCK2xXeDR4MHY2VFp5NTFuSnpiWm1Ma3FTS2FsbWkrQk9OTDNJbjJSd1BCa3pjdwppUGp1cHB2a2dSRWpyU3VLR1NwMGRN |
|                | VmpxVDZGb2dmYVRDVjBBN0RxZ3VuTHpjUVZka1grNTU5bk5uQ0dLb2poCkhJYmVncm1NRytsc3M3RHZJQUk5cFhwRnJ2V0JZNCsw |
|                | N1VwTE10NUxBb0dCQUpPekgzckN6eGRkbGZINGRRSXAKalg4SlNHdGdlaEU0YkxPalFySzhGcEdORmV2N2QvM3FWUElmY1kwRXFq |
|                | M1MrKzVBSE9wR2pwM1pEMFROK24wRwpya1o3Z013K3RaR09KOTRJc0ZDczBxeWxyaVAzUDNzOFBDcGJNVzg5MFZYcTg0U1NGNjNC |
|                | emt0cy9aWmRucTh2CllwbjQzMlIycy9tSXc5ZEZpSUxnS2ZYRkFvR0FBYVNkdTBIMmQrcXExTGcvMVFCNHV5SmJuY2JEUVRRV0Jw |
|                | SzUKQjdQWjlWS3hvUno3aDl3SzhSVjJrRk1KaFk5OTRXTXJQSldSQllZUEl1N2Rybm1kWVYva0VpUjk4WVRMLzc2cAoyNFFUR3RF |
|                | N0R6VjdWTGpMV2d0WDZTTzVrK3lHbHVUOWJrWmxNYkZCNnR2dUc1WkM1NEZIbWJLMGFmbjluZWkxCjZsck9EaTBDZ1lFQXhXdEhi |
|                | S0kzSURvbkw2ejZzajJPOUo2RXpwaDVaM3B6OXd0L1VYU1hQV3kwUzcxZ3BKWFUKVlp6cEtURzZVZ3RtMWhIUUtlVXN0WVBzdU9E |
|                | Rmx0YXl0eFBrYTY2ZG5yby8wTHFwOFBSRlNOMkhTdEk2YUROcAo2T3ltQzlDYUhSU3JNYjF0cnNvUmlOSjlPTUd4YW8zTmlmSk1C |
|                | K0tjcWh4VUJ0c0FiWmVqWUQwPQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo="                                |
|                |       }                                                                                              |
|                |     }                                                                                                |
|                |   ]                                                                                                  |
|                | }                                                                                                    |
| k8s_version    | "v1"                                                                                                 |
| vim_account    | "ff449c82-828e-462c-a21f-a03bb1058a24"                                                               |
| nets           | {                                                                                                    |
|                |   "net1": "osm-ext"                                                                                  |
|                | }                                                                                                    |
| description    | "Robot cluster"                                                                                      |
| namespace      | "kube-system"                                                                                        |
| _admin         | {                                                                                                    |
|                |   "created": 1714775795.649102,                                                                      |
|                |   "modified": 1714775839.5646684,                                                                    |
|                |   "projects_read": [                                                                                 |
|                |     "63962e14-f9a2-4062-a5ac-8466ba671490"                                                           |
|                |   ],                                                                                                 |
|                |   "projects_write": [                                                                                |
|                |     "63962e14-f9a2-4062-a5ac-8466ba671490"                                                           |
|                |   ],                                                                                                 |
|                |   "operationalState": "PROCESSING",                                                                  |
|                |   "operations": [                                                                                    |
|                |     {                                                                                                |
|                |       "lcmOperationType": "create",                                                                  |
|                |       "operationState": "PROCESSING",                                                                |
|                |       "startTime": 1714775795.649133,                                                                |
|                |       "statusEnteredTime": 1714775795.649133,                                                        |
|                |       "detailed-status": "In progress",                                                              |
|                |       "operationParams": null,                                                                       |
|                |       "worker": "db29ad32492e"                                                                       |
|                |     }                                                                                                |
|                |   ],                                                                                                 |
|                |   "current_operation": 0,                                                                            |
|                |   "helm_chart_repos": [],                                                                            |
|                |   "juju_bundle_repos": [],                                                                           |
|                |   "juju-bundle": {                                                                                   |
|                |     "created": true,                                                                                 |
|                |     "error_msg": null,                                                                               |
|                |     "id": "8725303a-47ae-46aa-bca3-0113535f0333",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   },                                                                                                 |
|                |   "helm-chart": {                                                                                    |
|                |     "created": false,                                                                                |
|                |     "error_msg": null,                                                                               |
|                |     "id": "8725303a-47ae-46aa-bca3-0113535f0333",                                                    |
|                |     "operationalState": "ENABLED"                                                                    |
|                |   }                                                                                                  |
|                | }                                                                                                    |
| schema_version | "1.11"                                                                                               |
+----------------+------------------------------------------------------------------------------------------------------+
Deletion in progress

2024-05-03_22:37:26 Creating K8s Cluster
c8047d25-0c82-4a55-b0b2-62abcfa95bc2
==============================================================================
Testsuite                                                                     
==============================================================================
Testsuite.Basic 01-Crud Operations On Vim Targets :: [BASIC-01] CRUD operat...
==============================================================================
Create VIM Target Basic :: Create a VIM Target only with the manda... | PASS |
------------------------------------------------------------------------------
Delete VIM Target By Name :: Delete the VIM Target created in prev... | PASS |
------------------------------------------------------------------------------
Create VIM Target With Extra Config :: Create a VIM Target using t... | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 01-Crud Operations On Vim Targets :: [BASIC-01] CR... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASIC-05] Ins...
==============================================================================
Create Cloudinit VNF Descriptor                                       | PASS |
------------------------------------------------------------------------------
Create Cloudinit NS Descriptor                                        | PASS |
------------------------------------------------------------------------------
Instantiate Cloudinit Network Service Using Instantiation Paramete... | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access With The New Password :: Test SSH access with the ... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 05-Instantiation Parameters In Cloud Init :: [BASI... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.               
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Check VNF Charm Application Name                                      | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 06-Vnf With Charm :: [BASIC-06] VNF with Charm.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key management. 
==============================================================================
Create Nopasswd Charm VNF Descriptor                                  | PASS |
------------------------------------------------------------------------------
Create Nopasswd Charm NS Descriptor                                   | PASS |
------------------------------------------------------------------------------
Instantiate Nopasswd Charm Network Service                            | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Nopasswd VN... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation that crea... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 07-Secure Key Management :: [BASIC-07] Secure key ... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 08-Disable Port Security Network Level :: [BASIC-08] Disabl...
==============================================================================
Create VIM With Port Security Disabled                                | PASS |
------------------------------------------------------------------------------
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Check Port Security Is Disabled                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Delete VIM                                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 08-Disable Port Security Network Level :: [BASIC-0... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU Scaling.   
==============================================================================
Create Scaling VNF Descriptor                                         | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor                                          | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service                                   | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out                                          | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In                                           | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 09-Manual Vdu Scaling :: [BASIC-09] Manual VNF/VDU... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms                  
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 11-Native Charms :: [BASIC-11] Native Charms          | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives                  
==============================================================================
Change Juju Password :: NS package needs to be updated with the Ju... | PASS |
------------------------------------------------------------------------------
Upload Vnfds                                                          | PASS |
------------------------------------------------------------------------------
Upload Nsd                                                            | PASS |
------------------------------------------------------------------------------
Instantiate NS                                                        | PASS |
------------------------------------------------------------------------------
Check NS Charm Application Name                                       | PASS |
------------------------------------------------------------------------------
Check VDU Charm Application Name                                      | PASS |
------------------------------------------------------------------------------
Delete NS                                                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 12-Ns Primitives :: [BASIC-12] NS Primitives          | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations                    
==============================================================================
Create Charm VNF Descriptor Provides                                  | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor Requires                                  | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Provides                                        | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Requires                                        | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 13-Ns Relations :: [BASIC-13] NS Relations            | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations                  
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Provides                                        | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 14-Vnf Relations :: [BASIC-14] VNF Relations          | PASS |
6 tests, 6 passed, 0 failed
==============================================================================
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configurations.     
==============================================================================
Create And Validate User                                              | PASS |
------------------------------------------------------------------------------
Assign Role To User                                                   | PASS |
------------------------------------------------------------------------------
Run Action As User                                                    | PASS |
------------------------------------------------------------------------------
Create And Update Project                                             | PASS |
------------------------------------------------------------------------------
Create And Validate Role                                              | PASS |
------------------------------------------------------------------------------
Update Role Information                                               | PASS |
------------------------------------------------------------------------------
Delete Allocated Resources                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 15-Rbac Configurations :: [BASIC-15] RBAC Configur... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] Advanced o...
==============================================================================
Create Scaling VNF Descriptor                                         | PASS |
------------------------------------------------------------------------------
Create Scaling NS Descriptor                                          | PASS |
------------------------------------------------------------------------------
Instantiate Scaling Network Service                                   | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Check Vdus Before Scale Out :: Check the number of VDUs instances ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out                                          | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In                                           | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 16-Advanced Onboarding And Scaling :: [BASIC-16] A... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Package Befo...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package                                             | PASS |
------------------------------------------------------------------------------
Delete NS Package                                                     | PASS |
------------------------------------------------------------------------------
Delete VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 17-Delete Vnf Package :: [BASIC-17] Delete VNF Pac... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with a virtual...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnfs Info                                                         | PASS |
------------------------------------------------------------------------------
Check Vnf1 IPs                                                        | PASS |
------------------------------------------------------------------------------
Check Vnf2 IPs                                                        | PASS |
------------------------------------------------------------------------------
Verify Vnf1 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Verify Vnf2 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2                                                | PASS |
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1                                                | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 18-Ns Ip Profile :: [BASIC-18] NS with a VLD with ... | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single VNF and tw...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnf Info                                                          | PASS |
------------------------------------------------------------------------------
Check Vnf IPs                                                         | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 19-Vnf Ip Profile :: [BASIC-19] NS with a single V... | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] Manual VDU...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Get Vdus Before Scale Out :: Get the number of VDU records before ... | PASS |
------------------------------------------------------------------------------
Get Application Name Before Scale Out :: Get the application names.   | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name Before Scale Out :: Ch... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale Out                                          | PASS |
------------------------------------------------------------------------------
Check Vdus After Scale Out :: Check whether there is one more VDU ... | PASS |
------------------------------------------------------------------------------
Get Application Name After Scale Out :: Get the application names.    | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale Out :: Che... | PASS |
------------------------------------------------------------------------------
Perform Manual Vdu Scale In                                           | PASS |
------------------------------------------------------------------------------
Check Vdus After Scaling In :: Check whether there is one less VDU... | PASS |
------------------------------------------------------------------------------
Get Application Name After Scale In :: Get the application names.     | PASS |
------------------------------------------------------------------------------
Check Number of Duplicated Application Name After Scale In :: Chec... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 20-Manual Native Charm Vdu Scaling :: [BASIC-20] M... | PASS |
18 tests, 18 passed, 0 failed
==============================================================================
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only one VDU an...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Get Volumes From VNFD                                                 | PASS |
------------------------------------------------------------------------------
Get VNF IP Address                                                    | PASS |
------------------------------------------------------------------------------
Check VDU disks                                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 21-Support Of Volumes :: [BASIC-21] NS with only o... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Basic 22-Cross Model Relations :: [BASIC-22] Cross-model relations  
==============================================================================
Create Charm VNF Descriptor 1                                         | PASS |
------------------------------------------------------------------------------
Create Charm VNF Descriptor 2                                         | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor 1                                               | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor 2                                               | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 22-Cross Model Relations :: [BASIC-22] Cross-model... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation and deleti...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Cannot Delete VNF Package                                             | PASS |
------------------------------------------------------------------------------
Delete NS Package                                                     | PASS |
------------------------------------------------------------------------------
Delete VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 23-Sol004 Sol007 Packages :: [BASIC-23] Creation a... | PASS |
5 tests, 5 passed, 0 failed
==============================================================================
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs belongin...
==============================================================================
Create VNF Package                                                    | PASS |
------------------------------------------------------------------------------
Create NS Package                                                     | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Check Vnf Affinity Groups                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 24-Affinity Groups :: [BASIC-24] VNF with two VDUs... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Basic 25-Update Charm In Running Vnf Instance :: [BASIC-25] Updat...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Set NS Update Config                                                  | PASS |
------------------------------------------------------------------------------
Get Management Ip Address                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operation :: The Charm VNF ha... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation :: Performs one Day 2 operation on the VNF... | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 2 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Update VNFD Package :: Updates the VNFD by using new VNFD package ... | PASS |
------------------------------------------------------------------------------
Update Running VNF Instance :: Updates the running VNF instance by... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation on Upgraded Charm :: Performs one Day 2 op... | PASS |
------------------------------------------------------------------------------
Check Remote Folder Created Via Day 2 Operation :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 25-Update Charm In Running Vnf Instance :: [BASIC-... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 26-Secure Helm Execution Environment :: [BASIC-26] Secure c...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Management Ip Address                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 1 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Get data from EE pod                                                  | PASS |
------------------------------------------------------------------------------
Fail when trying to access gRPC server without TLS                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 26-Secure Helm Execution Environment :: [BASIC-26]... | PASS |
11 tests, 11 passed, 0 failed
==============================================================================
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASIC-27] Upd...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Set NS Update Config                                                  | PASS |
------------------------------------------------------------------------------
Get Management Ip Address                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operation :: The VNF has a Da... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation :: Performs one Day 2 operation on the VNF... | PASS |
------------------------------------------------------------------------------
Check Remote File Created Via Day 2 Operation :: Check whether the... | PASS |
------------------------------------------------------------------------------
Update VNFD Package :: Updates the VNFD by using new VNFD package ... | PASS |
------------------------------------------------------------------------------
Update Running VNF Instance :: Updates the running VNF instance by... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operation on Upgraded Helm EE :: Performs one Day 2 ... | PASS |
------------------------------------------------------------------------------
Check Remote Folder Created Via Day 2 Operation :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance :: [BASI... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with one VDU wh...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Check Persistent Volume Counts                                        | PASS |
------------------------------------------------------------------------------
Set Persistent Volume Ids                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Check Persistent Root Volume in VIM after NS Deleted                  | PASS |
------------------------------------------------------------------------------
Check Persistent Ordinary Volume in VIM after NS Deleted              | PASS |
------------------------------------------------------------------------------
Prepare Ns Config With Volume Id                                      | PASS |
------------------------------------------------------------------------------
Network Service Instance With Existing Volumes Test                   | PASS |
------------------------------------------------------------------------------
Verify the Attachment Of Existing Persistent Volumes                  | PASS |
------------------------------------------------------------------------------
Delete NS Instance With Existing Volumes Test                         | PASS |
------------------------------------------------------------------------------
Check Existence of Persistent Volumes                                 | PASS |
------------------------------------------------------------------------------
Delete Persistent Volumes                                             | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 28-Keep Persistent Volumes :: [BASIC-28] NS with o... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single VNF and ...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnf Info                                                          | PASS |
------------------------------------------------------------------------------
Check Vnf IPs                                                         | PASS |
------------------------------------------------------------------------------
Check that ipv6 address_mode and ra_mode are set                      | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 29-Vnf Ipv6 Profile :: [BASIC-29] NS with a single... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single VNF and t...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Vnfs Info                                                         | PASS |
------------------------------------------------------------------------------
Check Vnf1 IPs                                                        | PASS |
------------------------------------------------------------------------------
Check Vnf2 IPs                                                        | PASS |
------------------------------------------------------------------------------
Verify Vnf1 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Verify Vnf2 Interfaces                                                | PASS |
------------------------------------------------------------------------------
Check that ipv6 address_mode and ra_mode are set                      | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 30-Ns Ipv6 Profile :: [BASIC-30] NS with a single ... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic NS with ...
==============================================================================
Create Multiattach VNF Descriptor                                     | PASS |
------------------------------------------------------------------------------
Create Multiattach NS Descriptor                                      | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf ID                                                            | PASS |
------------------------------------------------------------------------------
Get Vnf Management Ip Addresses                                       | PASS |
------------------------------------------------------------------------------
Ensure that VDUs can share data                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Basic 31-Multivdu Volume Multiattach :: [BASIC-31] Basic... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.            
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF IP Address                                                    | PASS |
------------------------------------------------------------------------------
Check SR-IOV Interface                                                | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 01-Epa Sriov :: [EPA-01] EPA+SRIOV without underlay.    | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for additional...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF Server ID                                                     | PASS |
------------------------------------------------------------------------------
Get Server Flavor Properties                                          | PASS |
------------------------------------------------------------------------------
Check Flavor Quota Properties                                         | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 02-Additional Capabilities :: [EPA-02] Support for a... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operations on SDN...
==============================================================================
Create Basic SDNC                                                     | PASS |
------------------------------------------------------------------------------
Check SDNC Status Is Healthy                                          | PASS |
------------------------------------------------------------------------------
Delete Basic SDNC                                                     | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 03-Crud Operations On Sdnc :: [EPA-03] CRUD operatio... | PASS |
3 tests, 3 passed, 0 failed
==============================================================================
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.          
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Ping from Vnf1 to Vnf2                                                | PASS |
------------------------------------------------------------------------------
Ping from Vnf2 to Vnf1                                                | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Epa 04-Epa Underlay Sriov :: [EPA-04] EPA underlay SR-IOV.  | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF with 2 V...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Cannot Instantiate Network Service                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance And Check VIM                                      | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Fail 01-Insufficient Resources :: [FAIL-01] A single VNF... | PASS |
6 tests, 6 passed, 0 failed
==============================================================================
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a single-VDU VNF   
==============================================================================
Create Hackfest Basic VNF Descriptor                                  | PASS |
------------------------------------------------------------------------------
Create Hackfest Basic NS Descriptor                                   | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | PASS |
------------------------------------------------------------------------------
Test Ping                                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Basic :: [HACKFEST-BASIC] Basic NS with a singl... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with two mult...
==============================================================================
Create Hackfest Cloudinit VNF Descriptor                              | PASS |
------------------------------------------------------------------------------
Create Hackfest Cloudinit NS Descriptor                               | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote File Injected Via Cloud-init                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Cloudinit :: [HACKFEST-CLOUDINIT] Basic NS with... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with two multi-...
==============================================================================
Create Hackfest multivdu VNF Descriptor                               | PASS |
------------------------------------------------------------------------------
Create Hackfest Multivdu NS Descriptor                                | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get Vnf Ip Address                                                    | PASS |
------------------------------------------------------------------------------
Test Ping                                                             | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Delete NS Instance Test                                               | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Hackfest Multivdu :: [HACKFEST-MULTIVDU] Basic NS with t... | PASS |
9 tests, 9 passed, 0 failed
==============================================================================
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a multi-volume...
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Get VIM Objects                                                       | PASS |
------------------------------------------------------------------------------
Get Volume VNF Info                                                   | PASS |
------------------------------------------------------------------------------
Get Volumes Info                                                      | PASS |
------------------------------------------------------------------------------
Check VDU Disks                                                       | PASS |
------------------------------------------------------------------------------
Delete Persistent Volume VDU                                          | PASS |
------------------------------------------------------------------------------
Heal Persistent Volume VDU                                            | PASS |
------------------------------------------------------------------------------
Check VNF After Healing                                               | PASS |
------------------------------------------------------------------------------
Update VIM Objects                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 01-Volume Vdu Healing :: [HEAL-01] Healing of a mul... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled charm VDUs 
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Create Test Flavor                                                    | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Scale Out Charm VNF                                                   | PASS |
------------------------------------------------------------------------------
Get VIM Objects                                                       | PASS |
------------------------------------------------------------------------------
Get Charm VNF Info                                                    | PASS |
------------------------------------------------------------------------------
Halt Charm VDU                                                        | PASS |
------------------------------------------------------------------------------
Heal Charm VDU                                                        | PASS |
------------------------------------------------------------------------------
Check VNF After Healing                                               | PASS |
------------------------------------------------------------------------------
Update VIM Objects                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 02-Scale Vdu Healing :: [HEAL-02] Healing of scaled... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multiple VDUs      
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Scale Out Charm VNF                                                   | PASS |
------------------------------------------------------------------------------
Get VIM Objects                                                       | PASS |
------------------------------------------------------------------------------
Get Charm VNF Info                                                    | PASS |
------------------------------------------------------------------------------
Get Volume VNF Info                                                   | PASS |
------------------------------------------------------------------------------
Stop VDUs                                                             | PASS |
------------------------------------------------------------------------------
Heal VDUs                                                             | PASS |
------------------------------------------------------------------------------
Check VNFs After Healing                                              | PASS |
------------------------------------------------------------------------------
Update VIM Objects                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 03-Multiple Healing :: [HEAL-03] Healing of multipl... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS                  
==============================================================================
Create VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Network Service Instance Test                                         | PASS |
------------------------------------------------------------------------------
Get NS Id                                                             | PASS |
------------------------------------------------------------------------------
Get VIM Objects                                                       | PASS |
------------------------------------------------------------------------------
Get VNF Info                                                          | PASS |
------------------------------------------------------------------------------
Stop Autoheal VDU                                                     | PASS |
------------------------------------------------------------------------------
Wait For Autohealing To Be Completed                                  | PASS |
------------------------------------------------------------------------------
Check VNF After Healing                                               | PASS |
------------------------------------------------------------------------------
Update VIM Objects                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors                                                | PASS |
------------------------------------------------------------------------------
Delete Objects in VIM                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Heal 04-Autohealing :: [HEAL-04] Autohealing of NS          | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addition.        
==============================================================================
Create VIM Target Basic :: Creates a VIM for the K8s cluster to be... | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete VIM Target By ID :: Delete the VIM Target created in previo... | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 02-K8Scluster Creation :: [K8s-02] K8s cluster addit... | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                           
==============================================================================
Create Simple K8s VNF Descriptor                                      | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor                                          | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages                                                | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 03-Simple K8S :: [K8s-03] Simple K8s.                   | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.               
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation                                             | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation                                | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation                                            | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation                               | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 04-Openldap Helm :: [K8s-04] Openldap Helm chart.       | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.                
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 05-K8S Proxy Charms :: [K8s-05] K8s Proxy Charm.        | PASS |
11 tests, 11 passed, 0 failed
==============================================================================
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure Key Manag...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 06-K8S Secure Key Management :: [K8s-06] K8s Secure ... | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated cluster w...
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Create Dummy VIM                                                      | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete VIM                                                            | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 07-Dummy Helm :: [K8s-07] Openldap Helm in isolated ... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.             
==============================================================================
Create Simple K8s Scale VNF Descriptor                                | PASS |
------------------------------------------------------------------------------
Create Simple K8s Scale NS Descriptor                                 | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Get KDU Model Name :: Get the model name of the network service k8... | PASS |
------------------------------------------------------------------------------
Get Scale Count Before Scale Out :: Get the scale count of the app... | PASS |
------------------------------------------------------------------------------
Perform Manual KDU Scale Out :: Scale out the application of netwo... | PASS |
------------------------------------------------------------------------------
Check Scale Count After Scale Out :: Check whether the scale count... | PASS |
------------------------------------------------------------------------------
Perform Manual KDU Scale In :: Scale in the application of network... | PASS |
------------------------------------------------------------------------------
Check Scale Count After Scale In :: Check whether the scale count ... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 08-Simple K8S Scaling :: [K8s-08] Simple K8s Scale.     | PASS |
12 tests, 12 passed, 0 failed
==============================================================================
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.                   
==============================================================================
Create Simple K8s VNF Descriptor                                      | PASS |
------------------------------------------------------------------------------
Create Simple K8s Descriptor                                          | PASS |
------------------------------------------------------------------------------
Network Service K8s Instance Test                                     | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Delete NS K8s Instance Test                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Delete VNF NS Packages                                                | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 09-Pebble Charm K8S :: [K8s-09] Pebble Charm.           | PASS |
8 tests, 8 passed, 0 failed
==============================================================================
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K8s Proxy ...
==============================================================================
Create Charm VNF Descriptor                                           | PASS |
------------------------------------------------------------------------------
Create Charm NS Descriptor                                            | PASS |
------------------------------------------------------------------------------
Instantiate Charm Network Service                                     | PASS |
------------------------------------------------------------------------------
Get Management Ip Addresses                                           | PASS |
------------------------------------------------------------------------------
Test SSH Access                                                       | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 1 Operations :: The Charm VNF h... | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation per VNF t... | PASS |
------------------------------------------------------------------------------
Check Remote Files Created Via Day 2 Operations :: Check whether t... | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms :: [K8s-10] K... | PASS |
11 tests, 11 passed, 0 failed
==============================================================================
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart.         
==============================================================================
Create Package For OpenLDAP CNF                                       | PASS |
------------------------------------------------------------------------------
Create Package For OpenLDAP NS                                        | PASS |
------------------------------------------------------------------------------
Add K8s Cluster To OSM                                                | PASS |
------------------------------------------------------------------------------
Create Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Get Ns Id                                                             | PASS |
------------------------------------------------------------------------------
Get Vnf Id                                                            | PASS |
------------------------------------------------------------------------------
Execute Day 2 Operations :: Performs one Day 2 operation.             | PASS |
------------------------------------------------------------------------------
Execute Upgrade Operation                                             | PASS |
------------------------------------------------------------------------------
Check Replicas After Upgrade Operation                                | PASS |
------------------------------------------------------------------------------
Execute Rollback Operation                                            | PASS |
------------------------------------------------------------------------------
Check Replicas After Rollback Operation                               | PASS |
------------------------------------------------------------------------------
Delete Network Service Instance                                       | PASS |
------------------------------------------------------------------------------
Remove K8s Cluster from OSM                                           | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor Test                                             | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.K8S 12-Openldap Helm Day-2 :: [K8s-12] Openldap Helm chart. | PASS |
15 tests, 15 passed, 0 failed
==============================================================================
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforcement.       
==============================================================================
Create First Project With Quotas                                      | PASS |
------------------------------------------------------------------------------
Create Second Project With Quotas                                     | PASS |
------------------------------------------------------------------------------
Create User In Projects                                               | PASS |
------------------------------------------------------------------------------
Change First Project Name to Third Project Name                       | PASS |
------------------------------------------------------------------------------
Create VNFDs On Third Project Until Exceed Quota                      | PASS |
------------------------------------------------------------------------------
Increase Third Project Quotas                                         | PASS |
------------------------------------------------------------------------------
Create More VNFDs On Third Project Until Exceed Quota                 | PASS |
------------------------------------------------------------------------------
Create VNFDs On Second Project Until Exceed Quota                     | PASS |
------------------------------------------------------------------------------
Check Project Scopes                                                  | PASS |
------------------------------------------------------------------------------
Delete Second Project VNFD                                            | PASS |
------------------------------------------------------------------------------
Delete Third Project VNFDs                                            | PASS |
------------------------------------------------------------------------------
Delete Second Project After Removing User From It                     | PASS |
------------------------------------------------------------------------------
Delete Projects User                                                  | PASS |
------------------------------------------------------------------------------
Delete Third Project                                                  | PASS |
------------------------------------------------------------------------------
Testsuite.Quotas 01-Quota Enforcement :: [QUOTAS-01] Quota enforce... | PASS |
14 tests, 14 passed, 0 failed
==============================================================================
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based metrics.   
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metrics                                             | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 01-Vnf With Vim Metrics :: [SA-01] VNF with VIM-based... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VNF with VI...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Get Thresholds From VNF                                               | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF Id                                                            | PASS |
------------------------------------------------------------------------------
Get VNF IP Address                                                    | PASS |
------------------------------------------------------------------------------
Get VNF VIM-based Metric Before Auto-scaling                          | PASS |
------------------------------------------------------------------------------
Increase VIM-based Metric To Force Auto-scaling                       | PASS |
------------------------------------------------------------------------------
Wait VIM-based Metric To Exceed Threshold                             | PASS |
------------------------------------------------------------------------------
Wait Threshold Time                                                   | PASS |
------------------------------------------------------------------------------
Check VIM-based Metric Exceeds Threshold After Threshold-time         | PASS |
------------------------------------------------------------------------------
Get VDUs After Auto-scaling                                           | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling :: [SA-02] VN... | PASS |
15 tests, 15 passed, 0 failed
==============================================================================
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or alarms com...
==============================================================================
Create Webhook Service VNF Descriptor                                 | PASS |
------------------------------------------------------------------------------
Create Webhook Service NS Descriptor                                  | PASS |
------------------------------------------------------------------------------
Instantiate Webhook Service Network Service                           | PASS |
------------------------------------------------------------------------------
Get Webhook Service VNF IP Address                                    | PASS |
------------------------------------------------------------------------------
Start Webhook Service                                                 | PASS |
------------------------------------------------------------------------------
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get Alarm Metric                                                      | PASS |
------------------------------------------------------------------------------
Check Alarms Were Received                                            | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Instance                                    | PASS |
------------------------------------------------------------------------------
Delete Webhook Service NS Descriptor                                  | PASS |
------------------------------------------------------------------------------
Delete Webhook Service VNF Descriptor                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 07-Alarms From Sa-Related Vnfs :: [SA-07] Events or a... | PASS |
16 tests, 16 passed, 0 failed
==============================================================================
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with VNF-based ...
==============================================================================
Create VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Create NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Instantiate Network Service                                           | PASS |
------------------------------------------------------------------------------
Get VNF SNMP Metrics                                                  | PASS |
------------------------------------------------------------------------------
Delete NS Instance                                                    | PASS |
------------------------------------------------------------------------------
Delete NS Descriptor                                                  | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor                                                 | PASS |
------------------------------------------------------------------------------
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp :: [SA-08] VNF with V... | PASS |
7 tests, 7 passed, 0 failed
==============================================================================
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.             
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Template :: Onboards the Network Slice Template: nst ... | PASS |
------------------------------------------------------------------------------
Network Slice Instance Test :: Instantiates the NST recently onboa... | PASS |
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get Slice Vnf Ip Addresses :: Obtains the list of IPs addresses in... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | PASS |
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | PASS |
------------------------------------------------------------------------------
Test Slice Connectivity :: SSH access to the slice middle vnf (mgm... | PASS |
------------------------------------------------------------------------------
Delete Slice Instance :: Stops the slice instance (slice_name)        | PASS |
------------------------------------------------------------------------------
Delete Slice Template :: Deletes the NST (nst_name) from OSM          | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 01-Network Slicing :: [SLICE-01] Network Slicing.     | PASS |
13 tests, 13 passed, 0 failed
==============================================================================
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Network Slic...
==============================================================================
Create Slice VNF Descriptors :: Onboards all the VNFDs required fo... | PASS |
------------------------------------------------------------------------------
Create Slice NS Descriptors :: Onboards all the NSDs required for ... | PASS |
------------------------------------------------------------------------------
Create Slice Templates :: Onboards the Network Slice Templates: ns... | PASS |
------------------------------------------------------------------------------
Network Slice First Instance :: Instantiates the First NST recentl... | PASS |
------------------------------------------------------------------------------
Network Slice Second Instance :: Instantiates the Second NST recen... | PASS |
------------------------------------------------------------------------------
First Network Slice Ns Count :: Counts the NS in both slice instan... | PASS |
------------------------------------------------------------------------------
Get Middle Vnf Management Ip :: Obtains the management IP of the s... | PASS |
------------------------------------------------------------------------------
Get First Slice Vnf IPs :: Obtains the list of IPs addresses in th... | PASS |
------------------------------------------------------------------------------
Test Middle Ns Ping :: Pings the slice middle vnf (mgmt_vnf_ip)       | PASS |
------------------------------------------------------------------------------
Test Middle Vnf SSH Access :: SSH access to the slice middle vnf (... | PASS |
------------------------------------------------------------------------------
Test First Slice Connectivity :: SSH access to the slice middle vn... | PASS |
------------------------------------------------------------------------------
Delete Slice One Instance :: Stops the slice instance (slice_name)    | PASS |
------------------------------------------------------------------------------
Second Network Slice Ns Count :: Counts the NS in both slice insta... | PASS |
------------------------------------------------------------------------------
Get Second Slice Vnf IPs :: Obtains the list of IPs addresses in t... | PASS |
------------------------------------------------------------------------------
Test Second Slice Connectivity :: SSH access to the slice middle v... | PASS |
------------------------------------------------------------------------------
Delete Slice Two Instance :: Stops the slice instance (slice2_name)   | PASS |
------------------------------------------------------------------------------
Delete Slice One Template :: Deletes the NST (nst_name) from OSM      | PASS |
------------------------------------------------------------------------------
Delete Slice Two Template :: Deletes the NST (nst2_name) from OSM     | PASS |
------------------------------------------------------------------------------
Delete NS Descriptors :: Deletes all the NSDs created for the test... | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptors :: Deletes all the VNFDs created for the te... | PASS |
------------------------------------------------------------------------------
Testsuite.Slice 02-Shared Network Slicing :: [SLICE-02] Shared Net... | PASS |
20 tests, 20 passed, 0 failed
==============================================================================
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003 Api testing
==============================================================================
Create VNF package from JSON file descriptor :: Test case to creat... | PASS |
------------------------------------------------------------------------------
Instantiate VNF :: Test case to Instantiate a VNF                     | PASS |
------------------------------------------------------------------------------
Query VNF Instances :: Test case to query VNF Instance                | PASS |
------------------------------------------------------------------------------
Query VNF Instance ID :: Test case to query Vnf instance ID           | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops :: Test case to Query VNF LCM operation             | PASS |
------------------------------------------------------------------------------
Query VNF LCM Ops ID                                                  | PASS |
------------------------------------------------------------------------------
Scale VNF :: Test case to   Scale out VNF                             | PASS |
------------------------------------------------------------------------------
Terminate VNF :: Test case to terminate the VNF                       | PASS |
------------------------------------------------------------------------------
Delete VNF :: Test case to delete VNF                                 | PASS |
------------------------------------------------------------------------------
Delete VNF Descriptor Test                                            | PASS |
------------------------------------------------------------------------------
Testsuite.Sol003 01-Vnf-Lifecycle-Management :: [SOL003-01] Sol003... | PASS |
10 tests, 10 passed, 0 failed
==============================================================================
Testsuite                                                             | PASS |
603 tests, 603 passed, 0 failed
==============================================================================
Output:  /robot-systest/reports/output.xml
Log:     /robot-systest/reports/log.html
Report:  /robot-systest/reports/report.html