...
...
...
...
TMF661 Trouble Ticket API Conformance Profile R16.5.0
- TMF660 Product Catalog API Conformance Profile R16.5.0
- TMF659 Customer Management API Conformance Profile R16.5.0
- TMF637 Product Inventory Management API Conformance Profile R16.5
- TMF645 Service Qualification API Conformance Profile R16.5
...
...
...
...
...
Trouble Ticket CTK (API REST Specification TMF661 - R16.5.0)
Product Catalog Management CTK (API REST Specification TMF660 - R16.5.0)
Customer Management CTK (API REST Specification TMF659 - R16.5.0)
...
Currently available conformance profiles and CTKs can be found in our TM Forum Open API portal.
Appears in the following playbooks
...
The following instructions describe how to install
...
and run an Open API CTK
...
:
...
Newman (needed for CTK test execution), this is the command line version of 'Postman'; installation instructions available at: https://www.getpostman.com/docs/newman_intro
...
Node.js offers a server-side environment, which allows the use of JavaScript language to generate web pages. Basically, it replaces server languages such as PHP, Java EE, etc. Once Node.js is installed, Newman is just a command away:
npm install -g newman
This installs Newman from npm globally on your system allowing you to run it from anywhere.
(This example is covering Product Offering Qualification for the 18.0 Release, but the steps to run a CTK are similar, unless stated on the readme.md that comes with the CTK).
1.
Installing and Running Conformance Test Kit
The CTK is dependent on the installation of node.js and npm to work.
Node.js and NPM can be downloaded and installed from
...
Once Node.js and
...
npm are installed
...
1 Import CTK from TM Forum
- Download and unzip postman collection file for selected API from the corresponding page (see CTK links provided above)
- Store downloaded file into the folder in your system where Newman runs
2 Configure environment
- Download environment file (TMFENV) from the following link: TMFENV File
- Modify environment file to refer to the endpoint where the implementation to be certified is running (see step 3 below)
- Store modified file into the folder in your system where Newman runs
3 You need to create your testing environment. The environment is a text file without extension written in JSON. It has the following format:
You can use this as a template. Create a file with this format, replace the values for the name, the host and your API addresses and put it in the same folder as the postman collections.
4 Now create the right script or batch file for your platform (either Windows or Linux/Mac), put it in the same folder and run script execution command. For example, you can use a batch file (runtest.bat) which would look like the following example:
set http_proxy=http://proxyinternet.tesa:8080
newman -c DSTestedAPITestCollection.postman_collection -e TMFENV -H DSTestedAPICTKResult.html -o DSTestedAPICTKResult.json
pause >nul
5 A folder name results will be created and filled with the output of the tests. You should see something like the following:
If they are no failures, then you have passed the CTK and your API is conformant with all the Mandatory features.
The results of the CTK are in the DSTestedAPICTKResult.html and DSTestedAPICTKResult.json files and should look like the following (example with Customer Management API):
All the information related to the execution of the CTK will be contained in the DSTestedAPICTKResult.json file.
The following is a complete example for the Trouble Ticket API:
Newman test report
Requests:
Individual tests:
...
Individual tests:
...
Individual tests:
| Test name | Pass count | Fail count |
|---|---|---|
| Content-Type is present text/plain | 1 | 0 |
| Status code is an error | 1 | 0 |
Individual tests:
...
Individual tests:
...
Individual tests:
...
Individual tests:
...
Individual tests:
...
Individual tests:
...
Individual tests:
...
Individual tests:
...
download and unzip the TMF679-ProductOfferingQualification ZIP file within your test directory.
You should see the following files between many others :
Windows-RUNCTK.ps1
Linux-RUNCTK.sh
2.
For Windows:
Right click Windows-RUNCTK.ps1 and select run with PowerShell, press Y and Enter, wait for the dependencies to be installed go to Step 2.
For Linux and Mac:
You need to give executable permission for the Linux-RUNCTK.sh file, you can do that by opening a terminal and typing:
bash Linux-RUNCTK.sh
Wait for NPM to install the dependencies and go to step 2.
3.
Enter the URL for the base of your API, for example, if you can get a resource on:
You should input:
https://tm-forum-open-api-reference-implementation.mybluemix.net/tmf-api/productOfferingQualificationManagement/v1
The script will now run for a few minutes and when it ends, you will have a resultsHTML.html file inside the folder, this is the file you need to forward to TMForum to get your certification if your API passed every test, the file should look like this:
If there are no failures then you have passed the CTK and your API is conformant with all
the Mandatory features.
Individual tests:
...
Individual tests:
| Test name | Pass count | Fail count |
|---|---|---|
| Content-Type is present application/json | 1 | 0 |
| Status code is 200 | 1 | 0 |
| Element contained equals previous creation | 1 | 0 |
Individual tests:
...
Individual tests:
...
...
The following link points to the TM Forum Open API Self Certification Web Page in which conformance results are published: TM Forum Open API Self Certification Web Page
You can also submit a link to your webpage along with your test results .