Cannot get Test Impact working in MTM (Test Manager)

Question

I try to get the Recommended Tests feature working in MTM. I tried for several days but I cannot get it working on my local machine.

I do not want to test remotely, I want to test a application running on my own IIS.

What I did:

• I installed VS Ultimate
• I created a Test plan with settings
• The Test settings are. Test Impact (with IIS on advanced tab enabled), ASP.NET Client Proxy and action recording
• A web site runs on my local IIS uynder a framework 4.0 app pool
• I created a build with Test Impact enabled
• A assigned a build to my testplan and ran my manual tests
• I changed code and reran my build
• I attached a new build and nothing shows up under Impacted Tests
• While running I get a TestCaseCollectorErrorWarning.xml with the following messages

<DataCollectorMessage level="Warning" agentName="DNLT28" dataCollectorFriendlyName="Test Impact" dataCollectorUri="datacollector://microsoft/TestImpact/1.0" timestamp="2011-08-11T15:42:42.9969984+02:00"> <Text>No Microsoft .NET applications were launched during the test run. Launch applications from Explorer or a new command prompt after a test case has started. If no .NET application is being tested, disable the Test Impact and IntelliTrace diagnostic data adapters.</Text> </DataCollectorMessage>

<DataCollectorMessage level="Warning" agentName="DNLT28" dataCollectorFriendlyName="Test Impact" dataCollectorUri="datacollector://microsoft/TestImpact/1.0" timestamp="2011-08-11T15:42:42.9969984+02:00"> <Text>IntelliTrace is configured to collect data from IIS, but no Web request was intercepted during the test. Verify that the "ASP.NET Client Proxy for IntelliTrace and Test Impact" is selected in the diagnostics and data page of your test settings, and that "localhost" or "127.0.0.1" is not being used to contact the server. You can safely ignore this warning if you are not testing a web application or web service on the IIS server.</Text> </DataCollectorMessage> </DataCollectorMessages>

I do not know how to fix this. I am pretty sure I don't have run a Test Controller or Agent while testing locally but nothing works regarding Test Impact.

Please help!

BTW: The suggestions mentioned here http://social.msdn.microsoft.com/Forums/en-US/vsmantest/thread/1ac45931-5e5b-4a26-9a6b-22eb5c60d3a7 

and

http://social.msdn.microsoft.com/Forums/en-US/vsmantest/thread/6f4a489a-514d-40da-a6c9-3ef508a16a18

 

does not work ..... :(

 

---

René van Osnabrugge
W: www.delta-n.nl
B: osnabrugge.wordpress.com
T: @renevo

Answer 1

Hello renevo,

I am moving your issue to the Testing with Visual Studio Test Manager (MTM) forum so that you can get better support there.

Thanks.

---

Vicky Song [MSFT]
MSDN Community Support | Feedback to us
Get or Request Code Sample from Microsoft
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 2

Hi. I'll work with you to figure this out. Essentially the steps you took are correct so let me get some more detailed information.

I am going to assume that all of the manual tests had an action recording with them and passed.

1. Did you use http://localhost/ when accessing your web pages?
2. Were you running MTM as an admin (i.e. right-click, run as administrator) or you are an administrator on your local box and UAC is turned off?

If the answer to the first question is yes, that you did use localhost then that's probably the reason. In order to work, IIS inserts a proxy behind the scenes to capture all data. Using localhost as the address bypasses any proxy because IIS is smart enough to figure out that it shouldn't use a proxy for localhost. This bypasses MTM's mechanism for collecting data.

For the second question, in order to implement any process in IIS, you are required to run as an admin with elevated privileges. This could also be a cause.

If I had to guess though, I would check the first item. If that wasn't it, let me know and we'll go through some other things.

 

 

---

Jeff Levinson | ALM MVP
Author, "Software Testing with Visual Studio 2010"

Answer 3

Hi Jeff,

Thanks for your reply. I have read your book ! That's how I came across this issue.

Unfortunately I already tried your answers. And this did not help.

Do I need a Test agent for my local tests ?

Hope to hear from you!

---

René van Osnabrugge
W: www.delta-n.nl
B: osnabrugge.wordpress.com
T: @renevo

Answer 4

Thanks.

No, you shouldn't need a local test agent for the manual runs, it siimply runs under your account.

Okay, just to be on the safe side, could you enter the contents of the action recording so i can take a look? Could you also provide a screenshot somewhere of the Properties page of the Plan tab so I can see the build and environment settings?

Thanks! We'll get through this :)

 

---

Jeff Levinson | ALM MVP
Author, "Software Testing with Visual Studio 2010"

Answer 5

Hi,

Sorry Pressed the wrong button. Tried to click Reply, but accidentally pressed mark as answer

This is my action recording:

------------------------------------

Start testing
Go to web page 'http://www.google.nl/' using new browser instance
Parent window changed to 'Google - Windows Internet Explorer'
Type 'http://' in 'Address and search using Google' text box
Go to web page 'http://mymachinename/BlogEngineWeb'
Click 'Log in' link
Type 'Admin' in 'User Name:' text box
Type '********' in 'Password:' text box
Click 'Log In' button
Step Completed : Open Browser and login as Administrator
Parent window changed to 'Name of the blog | Short description of the blog -...'
Click 'Close' button
End testing

-----------------------------------------------

And a screendump of my plan

 

 

 

 

---

René van Osnabrugge
W: www.delta-n.nl
B: osnabrugge.wordpress.com
T: @renevo

Answer 6

Okay. Everything looks good here. Next thing - the build. The screenshots didn't list the build but I'll ask a few questions about that next:

1. Is the build the same definition from prior to running the tests to after re-running them?
2. Could you provide a copy of the summary screen from the build output? The build output should also list the impacted tests - if it doesn't work there it won't work in MTM either.

If it isn't there either (it probably won't be based on the test collector warnings you showed earlier) then we have to track down why it isn't noting anything regarding .NET.

Could you turn on tracing and re-run your tests again? The link for turning on tracing is here: http://blogs.msdn.com/b/gautamg/archive/2009/11/29/how-to-enable-tracing-for-ui-test-components.aspx.

If you would like, you can send them directly to my e-mail address as they may contain sensitive information or you can obfuscate the log before posting it here. If I can't figure out anything from this, I'll ask someone from the team to jump on and help you. My e-mail address is jeff at jtlevinson period com.

 

---

Jeff Levinson | ALM MVP
Author, "Software Testing with Visual Studio 2010"

Answer 7

I suspect there was not a changeset associated to the code or you have not assigned a new build to the test plan.

Answer 8

Hi All,

I been trying all the steps and I too could not get the test impact to work on my local IIS website.  I have changed it to use ipaddress and it doesn't seems to work.. However, I was able to get it to work very good with windows form application in both MTM and VS2010, but been trying so many many days and couldn't get it to work both from MTM and VS2010. I keep getting there's no instrument ....If  anyone can use the TIA with web based application, can you please add it to this forum. It has been driving me insane trying to figured it out.  I would really appreciate it. 

Thanks,

Angel