Create a specific work item (Bug) for each failed test case in Azure DevOps pipelines

Question

I'm using VS Test task for automated testing as part of my release pipeline in Azure DevOps. In build pipeline, there is option to create a bug if whole build fails as part of definition. I do not see that in release definition.

But i'm curious to find, if i have 10 test cases in a test suite and 2 test cases got failed and 8 test cases got passed. So is there any way to create a work item (bug) for only each of the failed test cases as part of release pipeline.

Please suggest me if that option is available, even with the powershell/REST API calls to get the failed test cases and create bugs for each case.

Mar Tin Mar Tin · Accepted Answer · 2019-08-01T07:46:35

Step: Read out the runs of your buildpipeline to get the run id - link

Url:

GET http://{instance}/{collection}/{project}/_apis/test/runs?api-version=5.0

Step: Read out the results of a specific run - link

Url:

GET https://{instance}/{collection}/{project}/_apis/test/Runs/{runId}/results/{testCaseResultId}?api-version=5.0

Step: analyse the response

from step 2 you will get a Json respone with the struct:

  "startedDate": "2019-07-26T04:42:59.097Z",
  "completedDate": "2019-07-26T04:42:59.107Z",
  "durationInMs": 10,
  "outcome": "Passed",
  "revision": 1,
  "state": "Completed",
  "testCase": {
    "name": "TestConstructorDescriptor"
  },
  "startedDate": "2019-07-31T09:07:51.153Z",
  "completedDate": "2019-07-31T09:07:51.153Z",
  "outcome": "Failed",
  "revision": 1,
  "state": "Completed",
  "testCase": {
    "name": "TestCreateTelegrams"
  },

Step: Filter tests with Failed outcome and store the meta information in an array
Step: Create your Workitem - link

Payload:

[
  {
    "op": "add",
    "path": "/fields/System.Title",
    "from": null,
    "value": "Sample task"
  }
]

Url:

POST https://{instance}/{collection}/{project}/_apis/wit/workitems/${type}?api-version=5.0

Wrap all these steps in a script (PowerShell) and added to your buildpipeline after VsTest Task. These snippets may help:

Authorization headers: (Personal Access Token needed)

#AUTHORIZATION HEADERS
$headers = @{
    "Authorization" = ('Basic {0}' -f [System.Convert]::ToBase64String([System.Text.Encoding]::ASCII.GetBytes(":$($PAT)")))
    "If-Match"      = ""
}

REST API Invoke-RestMethod: (Edit -Method GET or POST)

$url = "<Enter url from steps 1, 2 or 5>"
$projs = Invoke-RestMethod -Uri $url -Method GET -ContentType "application/json" -Headers $headers -Verbose

Create Payload:

$json = @{ "op" = "add"; "path" = "$path"; ... } | ConvertTo-Json

Get ETag: (may needed for PUT or POST methods, execute before Invoke-RestMethod)

$request = Invoke-WebRequest -Uri $url -Method GET -ContentType "application/json" -Headers $headers -Verbose
$headers.'If-Match' = $request.Headers.ETag

Hope this helps.

Create a specific work item (Bug) for each failed test case in Azure DevOps pipelines

2 Answers