TFS 2015 vNext - selectively execute automated tests - need MTM?

Question

I'm building new automation infrastructure and have the privilege to use TFS 2015 vNext from the very first beginning. And so I did and defined my vNext build as part of my CI.

I just cannot find a way that a QA person or Dev person can selectively choose which automated test to run (what ever may be the reason for doing that) on any of the machines in the machines group. I would expect to have such functionality under the TEST hub but there isn't.

Am I missing something? Do I still have to use MTM for that and define XAML build, controller etc? Any way to combine the two? I understood that Microsoft is about to abandon Lab Center (and the entire MTM) so what is the other option?

(I'm familiar with "Executing Automated tests in Build vNext using Test Plan, Test Suites" but would like to give the freedom to select tests).

Lab Management Evolution

Thanks!

Did you mean you just want to customize the running order of the automated tests or random select even only run some of the automates tests like the manually test? — PatrickLu-MSFT
select manually which automated tests to run on one of the target (testing) machines. The idea is to let QA or Dev to run sub-set of the automation, on demand, whenever they want. — ClimbingLung

Eddie Chen - MSFT Eddie Chen - MSFT · Accepted Answer · 2016-09-07T06:23:32

There isn't any way to select tests from Run Functional Tests steps, I have help you submit a feature request on VSTS/TFS User Voice, you can vote it here: Allow to select test case in "Run Functional Tests" step.

The work around for now would be create one suite for each test so that you can choose in the build definition.

Or you can also use test filter criteria to run selective test, refer to this link for details: Running selective unit tests in VS 2012 using TestCaseFilter.

TFS 2015 vNext - selectively execute automated tests - need MTM?

1 Answers