locked
MTM wont stop Automated Test Run. RRS feed

  • Question

  • Hi All

    I am using Ranorex to create automated tests. I have the Ranorex project in TFS the required Ranorex DLL's are referenced in Vistual Studio. The Ranorex project runs without fault in Ranorex and Visual Studio.

    I have the test agent and test controller configured. I have have the test from Visual Studio linked to a test that is in MTM.

    The automated test will run in MTM and the actual test will complete however in MTM I need to push the STOP Test button to get MTM to stop. I have left the test for upto 10 minutes but it just will not stop.

    The Test Agent reports that the test is finished.

    The log from MTM reports no errors. Has anyone else had an issue like this?   

    Wednesday, October 17, 2012 4:48 AM

All replies

  • Hi Mowog,

    Thank you for your post.

    Would you please show us a screenshot of the issue?

    Regards,


    Lily Wu [MSFT]
    MSDN Community Support | Feedback to us

    Thursday, October 18, 2012 1:56 AM
  • First image shows no active tests.

    Second images shows MTM still waiting for test controller?

    Thursday, October 18, 2012 2:54 AM
  • Hi Mowog,

    Thank you for your post.

    I am trying to involve someone to further look at this issue. There might be some time delay. Appreciate your patience.

    Thank you for your understanding and support.

    Regards,


    Lily Wu [MSFT]
    MSDN Community Support | Feedback to us

    Friday, October 19, 2012 2:49 AM
  • Thanks for the response.

    I can work around the issue for the moment but it would be good to see it fixed.

    Ian

    Friday, October 19, 2012 3:07 AM
  • Hi lan

    What 's the log like? Can you share the log with us? http://skydrive.com is ideal for sharing.

    Refer to: http://blogs.msdn.com/b/aseemb/archive/2010/03/07/how-to-enable-test-agent-logs.aspx


    Forrest Guo | MSDN Community Support | Feedback to manager

    Friday, October 19, 2012 1:06 PM
  • Hi lan

    What 's the log like? Can you share the log with us? http://skydrive.com is ideal for sharing.

    Refer to: http://blogs.msdn.com/b/aseemb/archive/2010/03/07/how-to-enable-test-agent-logs.aspx


    Forrest Guo | MSDN Community Support | Feedback to manager

    I have put a zip file in the public section of my skydrive.

    Ian

    Sunday, October 21, 2012 9:54 PM
  • The folder or zip URL is required as I don't have your Windows account.

    thanks.


    Forrest Guo | MSDN Community Support | Feedback to manager

    Monday, October 22, 2012 1:23 AM
    • Edited by Mowog Monday, October 22, 2012 2:41 AM
    Monday, October 22, 2012 2:41 AM
  • Were able to get the files?
    Wednesday, October 24, 2012 5:27 AM
  • Sorry, I'm unable to download the log. Can you send to my email instead: forrestg@microsoft ?

    Forrest Guo | MSDN Community Support | Feedback to manager


    • Edited by Forrest Guo Wednesday, October 24, 2012 6:33 AM fix typo in email address
    Wednesday, October 24, 2012 6:32 AM
  • Sorry, I'm unable to download the log. Can you send to my email instead: forrestg@microsoft ?

    Forrest Guo | MSDN Community Support | Feedback to manager


    Email sent

    Friday, October 26, 2012 1:26 AM
  • VSTTAgentProcess.log mentions:

    "ResolutionAppDomainHelper.Unload: An error occurred while attempting to unload the tests AppDomain.  The AppDomain may still have foreground threads executing."

    Can you double-check the tests code and see if there's such AppDomain?


    Forrest Guo | MSDN Community Support | Feedback to manager

    Saturday, October 27, 2012 3:40 PM
  • Please refer to below instruction to extend timeout of test execution:

    How to: Specify Timeout Periods for Test Controllers and Test Agents


    Forrest Guo | MSDN Community Support | Feedback to manager

    Saturday, October 27, 2012 3:56 PM
  • I have played with these timeout values to no effect?

    What do you suggest I set the values to?


    • Edited by Mowog Monday, October 29, 2012 1:08 AM
    Monday, October 29, 2012 1:08 AM
  • Test execution time + buffer time if test agent has low performance.

    How about it?


    Forrest Guo | MSDN Community Support | Feedback to manager

    Monday, October 29, 2012 1:00 PM
  • Test execution time + buffer time if test agent has low performance.

    How about it?


    Forrest Guo | MSDN Community Support | Feedback to manager

    I have absolutly no idea what you are talking about..?

    I have tried a few diffrent settings in the XML files nothing has worked. Can yo provide you suggested settings for the XML files?

    Monday, October 29, 2012 8:40 PM
  • I meant the value <add key="AgentSyncTimeoutInSeconds" value="300"/> test execution time is an estimated time.

    I'll ask someone else to help with this thread, please wait some time.


    Forrest Guo | MSDN Community Support | Feedback to manager

    Tuesday, October 30, 2012 2:05 PM
  • What is the version of the Visual Studio Agent Software you have?

    If the version is: 10.0.3xxxx.x please install Microsoft Visual Studio 2010 Service Pack 1 and test again.

    http://www.microsoft.com/en-us/download/details.aspx?id=23691

    Are you running Coded UI tests?

    Thank you

    VS Agent About box
    Tuesday, October 30, 2012 10:38 PM
  • What is the version of the Visual Studio Agent Software you have?

    If the version is: 10.0.3xxxx.x please install Microsoft Visual Studio 2010 Service Pack 1 and test again.

    http://www.microsoft.com/en-us/download/details.aspx?id=23691

    Are you running Coded UI tests?

    Thank you

    Tuesday, October 30, 2012 10:44 PM
  • My Test agents match what you have in the image.

    I am using Ranorex to create the automated tests because of the Poor Silverlight support in CodedUI and because CoddedUI is rubbish.

    The Ranorex project is in TFS.

    I have a CodeUI Place holder that calls the Ranorex Automated tests.  I have followed this guide http://www.ranorex.com/blog/running-ranorex-automated-tests-using-microsoft-test-manager to set up the Ranorex/TFS/MTM connections. I setup the Test Agents and Test Controllers to Microsoft setup instructions. The tests run and report results. The one issue is I have to force a stop of the tests.    

    Tuesday, October 30, 2012 10:55 PM
  • Can you replicate the problem without the integrated Ranorex automation?

     

    Thank you

    Teddy

    Wednesday, October 31, 2012 12:18 AM
  • Can you replicate the problem without the integrated Ranorex automation?

    Thank you

    Teddy

    Good attempt to flick pass the issue on another tool. In this case that flick pass would be a fail. I created a simple Google search link click CodedUI Test. This test was then setup to run via MTM, and as I write this I am still waiting for MTM to stop the test. All up it has been around 5 minutes and MTM is still waiting for the Test Controller...? Pause....

    Another 2 Minutes no Stop....

    Wednesday, October 31, 2012 2:09 AM
  • In order to see the current status of the running tests you will have to click on the Refresh icon on the upper right corner of MTM.

    The behavior is by design.

    Thank you

     


    Wednesday, October 31, 2012 3:20 AM
  • In order to see the current status of the running tests you will have to click on the Refresh icon on the upper right corner of MTM.

    The behavior is by design.

    Thank you


    In this case it is poor design... Or is this the Microsoft way of say we just don't know why thats happening?

    I may sound negative and thats because I am.... It took this long for someone to blame poor software design for this issue...

    Our only hope is Microsoft gets better at this software testing thing.  


    • Edited by Mowog Wednesday, October 31, 2012 4:01 AM
    Wednesday, October 31, 2012 4:00 AM
  • Please provide your feedback here:

    https://connect.microsoft.com/VisualStudio

    Our development Team is reviewing these feedbacks and considering them.

     

    Thank you

     

     

     

    • Marked as answer by Mowog Wednesday, October 31, 2012 11:12 PM
    • Unmarked as answer by Mowog Wednesday, October 31, 2012 11:12 PM
    • Marked as answer by Teodora Stanev - MSFTMicrosoft employee Friday, November 16, 2012 10:52 PM
    • Unmarked as answer by Mowog Sunday, November 18, 2012 8:57 PM
    Wednesday, October 31, 2012 4:06 AM
  • You guys need to stop marking this as answered.

    Poor software design is not an answer.

    Sunday, November 18, 2012 8:58 PM
  • Hi,

    We understand that you do not like the current design of the product.

    Unfortunately, we do not have a better answer for you now.

    Please provide your feedback here:

    https://connect.microsoft.com/VisualStudio

    Our development Team is reviewing these feedbacks and considering them.

    Marking a thread as answered simply closes it and indicates to other users that no further action is required.

    Thank you

    Monday, November 19, 2012 5:12 PM
  • The thing is it is not answered.

    Leaving it unanswered highlights a flaw in design.

    Monday, November 19, 2012 11:40 PM
  • Hi Mowong,

    Appologies for the pain which got caused due to this long pending issue. This is a long thread but still there are few things which were not clear after reading it completely. (The log file link did not work for me as well, so I have not looked at them.) Here are my questions : -

    1. What is the state of the environment once the test run is shown complete on the test agent? Is it ready or "running test"?
    2. I know that on completion of the test run on all agents, test controller uploads all the attachments which got produced in the test run. During this time, even though agents are idle/online but still some background activity is going on for the test run. Does your test run produces lot of run/result level attachments?
    3. Can you please paste the contents of the "Test run log" for your test run? (MTM -> Analyze Test Runs -> Open the run which got completed -> Click on the "View" link next to "Test run log")

    Regards

    Aseem Bansal

    Wednesday, November 21, 2012 9:26 AM