locked
Test Case to Test Result Mapping and Report RRS feed

  • Question

  • We are trying to find a way to reliably report out test pass results for our whole project. Here is the scenario:

    We are testing a project that gets built using MsBuild. Separate from the project build, there is also a test build that can be generated to compile the test code. The test build number does not always match the project build number. Once the project build is completed, it gets deployed manually into a variety of environments (say Env-A, Env-B, Env-C, etc). After the project deployment, the test build gets manually copied to a test client and run against one or many of the environments. Each run generates a TRX file.

    Also, we are using TFS 2010 to store our test cases using the Test Case work item template. In our test case source code we use the [WorkItem] attribute to map the test code directly to the matching test case in TFS.

    What we want to be able to do is to upload the TRX files to TFS and then generate a report that gives the following data columns (preferably in a nicely formatted Excell sheet):

    • Area Path (from the Test Case work item)
    • Iteration Path (from the Test Case work item)
    • Total Count of Active Test Cases in that Iteration Path - (Total Tests)
    • Total Count of Automated Test Cases - (Automated Tests)
    • Total Count of Manual Tests - (Total Tests - Automated Tests)
    • Total Count of Automated Tests that Passed in the current Project Build on the current Environment
    • Total Count of Automated Tests that Failed in the current Project Build on the current Environment
    • Total Count of Automated Tests that were Inconclusive (or some other test result) in the current Project Build on the current Environment
    • Total Count of Automated Tests that have not been executed in the current Project Build on the current Environment

    Given those columns we would then like to auto-calculate some other statistics (like % Passing, % Executed, and the overall totals). We need to provide this report on a per Build per Environment basis.

    Is there an easy way to generate these reports? Right now we don't seem to have a way to generate this easily.

     

    Wednesday, June 30, 2010 7:06 AM

All replies

  • Hey, Were you able to find a way to do this. If so could you please share it with me. I am also going to do the same thing and could not find a way to do this yet.

     

    Thank you.

    Dilan

    Saturday, May 14, 2011 6:45 PM