How to run coded UI test VS2012 on tfs 2010 test agent

Question

Hi,

I have a VS2012 coded UI project, targeted framework .Net 4.0 and try to integrate this solution with our TFS and Test Manager. TFS server is 2010 version, I do have configured Test Controller and Test Agent 2010. TFS build was configured to build coded UI project and release was associated with a test suite.
When test case runs from TestManager, it fails with error:

System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.VisualStudio.QualityTools.CodedUITestFramework, Version=11.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified.

I tried to install VS2012 on agent machine, but it didn't help. Coded UI assemblies are not installed into GAC, they are stored in Visual Studio PrivateAssemblies and PublicAssemblies folders.

Does anybody have this kind of configuration working Coded UI VS2012 with TFS 2010?

Is there ability to configure TestAgent 2010 to use a new version of Coded UI to run tests?

---

Best Regards, Sergey.

Answer 1

Hello Sergey,

Thank you for your post.

Do you want to run coded UI test using TFS build? Or using MTM?

Hope you can provide us detailed  information so that we can further look at this issue.

Best regards,

---

Amanda Zhu [MSFT]
MSDN Community Support | Feedback to us
Develop and promote your apps in Windows Store
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 2

Hi Amanda,

Thanks for a reply, I want to use coded UI tests through MTM and have configured Test Controller with Test Agent 2010. Please let me know what kind of details could help to assist in this issue.

---

Best Regards, Sergey.

Answer 3

Hello Sergey,

We have a forum Testing with Visual Studio Test Manager (MTM) for this issue. In order to provide better support, I moved this thread.

Best regards,

---

Amanda Zhu [MSFT]
MSDN Community Support | Feedback to us
Develop and promote your apps in Windows Store
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 4

Hi Sergey,

Thank you for your post.

Use MTM run automated test, you need set up test environment, test setting in MTM Lab center. Associate test case with test method in VS, associate test plan with correct team build, test setting.  Test controller specified during create test environment.

1. About test case with test method in VS, you can refer to How to: Associate an Automated Test with a Test Case.

2. MTM use test plan to run automated test. Test plan contains test case which associate with test method. Test setting and environment is create for test plan. Correct build is select for test plan. For detail information, you can refer to How to: Run Automated Tests from a Test Plan Using Microsoft Test Manager.

3. You should set up lab to hold test environment and test settings. This test environment is need to run automated test in MTM. For detail information, you can refer to Using a Virtual Lab for Your Application Lifecycle.

4. You need use TFS build to build the test application, then choose the correct build for test plan. For detail information, you can refer to Create a Basic Build Definition.

Regards,

---

Lily Wu
MSDN Community Support | Feedback to us
Develop and promote your apps in Windows Store
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 5

Hi Lily,

Thank you for reply and clarifications. Probably my first post wasn't too clear. I do have successfully complete all steps you specified.

1. There is association between test methods and test cases

2. There is a test plan with associated build

3. There is defined a test lab with physical environment

4. There is TFS build to build test cases and it was selected for a test plan

All these steps were complete. Problem is Test Agent 2010 fails to run Coded UI tests implemented with VS2012. Please, see my first post for an error message.

---

Best Regards, Sergey.

Answer 6

Hi Sergey,

Please check the test agent is configured run as Interactive process.

Can you show us the test controller status?

Regards,

---

Lily Wu
MSDN Community Support | Feedback to us
Develop and promote your apps in Windows Store
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 7

Hi Lily,

Thank you for a reply.

Test Agent is configured as interactive process. I'm not sure where test controller status could be seen. Here is test agent status: 

And here is test controller configuration:

Let me know if you need some additional details.

---

Best Regards, Sergey.

Answer 8

Hi Sergey,

I am trying to involve someone to further look at this issue. There might be some time delay. Appreciate your patience.

Thank you for your understanding and support.

Regards,

---

Lily Wu
MSDN Community Support | Feedback to us
Develop and promote your apps in Windows Store
Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Answer 9

I am not sure if this supported scenario.

As you can use:

 

VS 2010  

http://msdn.microsoft.com/en-us/library/dd380742(v=vs.100).aspx

and  VS 2012

http://msdn.microsoft.com/en-us/library/dd380742(v=vs.110).aspx

 support different Configurations and Platforms for Coded UI Tests and Action Recordings

 

Maybe you can try installing .NET Framework 4.5 on TFS 2010 and the Agent.

 

Please see the following

http://msdn.microsoft.com/en-us/library/hh506981.aspx

 

If you create Coded UI Tests using the new UI Testing API in Visual Studio 2012, these projects cannot be opened in Visual Studio 2010.

 

Based on the above I think it is safe to say this is not supported.

Thank you