none
Ordered Tests RRS feed

  • Question

  • I have 2 questions about OrderedTests.

    1. Test run timeout :

    My Orderedtests all fail with an error Test Run Timeout.
    The OrderedList contains 19 testsmethods and it is normal that it takes quite some time.
    But, every test runs perfectly on his own. Only in the OrderedTest it gives a time out error.
    If I look at the Start and End Time it took approx. 30 minutes.


    2. Test result details :

    My test run details are incorrect when I look at the results.
    I now have this structure in the Results page Additional Information :

    TestContext.Writeline()_1 =>OK
    TestContext.Writeline()_2 =>OK
    TestContext.Writeline()_3 =>OK (writeline from Test CleanUp script)
    TestContext.Writeline()_1 =>NOK
    TestContext.Writeline()_2 =>NOK
    TestContext.Writeline()_1 =>NOK

    This way it is impossible to see what went wrong.
    I also have larger log file and they should contain about 10 lines, but when executing via OrderedTest they contain about 50 lines.
    Shouldn't this be the same, results from a single run and results from a OrderedTest run?

    3. Test Results :

    I also noticed that my numbers are irrelative and completely wrong.
    I have an orderedtest with 19 tests.
    If I run it I get numbers like 22 / 20 passed. (19 (+ 1 for the compleet set OK) => but 22 ??)
    When it is finished I get Results like 28 / 37 passed (there are only 19 test ???)

    Regards,
    Leslie

    • Edited by Leslie Clynckemaillie Wednesday, June 2, 2010 9:26 AM added another question
    • Moved by Mathew Aniyan MSFT Tuesday, June 8, 2010 4:18 AM Question on Ordered Tests (From:Visual Studio UI Automation Testing (includes CodedUI))
    Wednesday, June 2, 2010 7:16 AM

Answers

  • Ordered test duplicate logging issue was a bug that we are addressing in VS 2010 Sp1 release. A workaround is to use Console.WriteLine () for logging.
    Saturday, October 30, 2010 3:11 AM

All replies

  • i am concerned about the timeout problem as well in ordered test... whenever timeout error happens, it stop the order test run and leave th rest test method not run. It's bad thing as I cannot finish running all of the test methods.
    totta wang
    Thursday, October 21, 2010 5:53 AM
  • Ordered test duplicate logging issue was a bug that we are addressing in VS 2010 Sp1 release. A workaround is to use Console.WriteLine () for logging.
    Saturday, October 30, 2010 3:11 AM