Vnext Test results console is not updating pass test case counts during test case execution ?

Question

Hello ,

We are using Vnext build for running  automation test cases.(We are using VS Coded UI 2015)

We have a pool of 100 test cases which takes around 5 hours.

When the test runs , console of Vnext build automation is not updating passed or failed test cases .

It keeps on showing that passed test case count is 0 , till all test cases are executed (Refer below screenshot).

Please suggest how to solve the issue ?

---

Abhisek Biswal

Answer 1

Hi,

What’s the version of your TFS? What’re tasks of your build definition? Is there Advanced execution options of test task and how do you specify the batch size? Can you share the detail log on the OneDrive (set system.debug to true, then queue build)?

It should update the result for a batch execution. The default bucket size is 100, if you have less than 100 tests in a test run, this is considered a partial bucket and it value is 10.

Based on your description, you have 100 tests and it seems uses a batch.

---

MSDN Community Support
Please remember to click "Mark as Answer" the responses that resolved your issue, and to click "Unmark as Answer" if not. This can be beneficial to other community members reading this thread. If you have any compliments or complaints to MSDN Support, feel free to contact [e-mail].

Answer 2

Hi,

Please find the logs from the below links

https://1drv.ms/u/s!AhWi1D03iH7_axbetJtRfsStLno

Answers to your other questions:

------------------------------

Q]What’s the version of your TFS : 

Ans:VS2015 Enterprise with Update3

Q]Is there Advanced execution options of test task and how do you specify the batch size? :

Ans:No there is no advanced execution options of test task. We use test filter criteria to filter test using their test category name  like  TestCategory=QA_Smoke_Suite2 

Q]What’re tasks of your build definition?

Ans: Refer screen shot .

---

Abhisek Biswal

Answer 3

Hi,

Are these tests in a assembly? It dispatch the tests per to the assemblies, so it

statistics the result per to the assemblies. You also can specify multiple test machines and check Distribute tests by number of machines options, then it dispatch the tests per to the machines.

---

MSDN Community Support
Please remember to click "Mark as Answer" the responses that resolved your issue, and to click "Unmark as Answer" if not. This can be beneficial to other community members reading this thread. If you have any compliments or complaints to MSDN Support, feel free to contact [e-mail].

Answer 4

Hi ,

Please elaborate your answer. Are you suggesting me to distribute the tests in multiple machine to get results of every test case in the console window ? Isnt there any option to get the test results of each test cases once is executed .Currently we have to wait till the tests end ?

---

Abhisek Biswal