TFS 2017 build of ordered CodedUI unit tests doesn't give detailed results - Consider all tests as one test

2
votes

I'm using tfs 2017 to run CodedUI ordered unit tests. These are my build steps: enter image description here These are my "Run Functional Tests" configurations: enter image description here And these are the "Publish Test Results" (I'm not sure they are correct): enter image description here

The TestAgent is deployed and the tests are running fine, The problem is that the test results appear as only one result and I can't see detailed result for each test. This is how my tests results looks like (The attachments are screen shots I take for each test): enter image description here

1
unit-testingtfsbuildcoded-ui-testsordered-test

1 Answers

1
votes

I can reproduce your situation and TFS will treat the tests as one in the log:

DistributedTests: Total Tests : 1, Passed Tests : 0

It's a know issue, please refer below link:

How to display test results of individual test in the ordered test suite in TFS Web

This is a limitation of the run functional test task. You can publish the .trx file using the "publish test results" task and it will show you all the tests but you wont know which ".orderedtest" they were associated with etc.

You need either open *.trx file in Visual Studio or use Publish Test Results task(need to check continue on error).

enter image description here

Besides also change the outcome from failed to all in the test result page.