locked
Need advice working with Test Controller and Test Agents

    Question

  • IF I have five workstations and one server as below:

    WS1: VS2010 ULTIMALTE and Test Agent

    WS2: VS2010 Test Controller

    WS3: VS2010 ULTIMALTE and Test Agent

    WS4: VS2010 ULTIMALTE and Test Agent

    WS5: VS2010 ULTIMALTE and Test Agent

    Serv:  SQL2008 (LoadTest210) for LoadTestResult

    For each Test Agent, I configured to the Test controller on WS2. 

    1) If I run a load test on WS1 with 1000 virtual users, will the test controller (each VS2010 ULTIMATE comes with 250 Vu)  uses all test agents on all four workstations?

    2) If I run a load test on WS1 with 500 virtual users, will the test controller (each VS2010 ULTIMATE comes with 250 Vu) select agents to manage? How do I know which agents are used?

    3) If I want to check performance of a application server, do I have to have Test Agent installed on the application server?  How?

    Tuesday, August 10, 2010 5:57 PM

Answers

  • Hi,

    You can always run 5 different load test against same web server but this won't be useful as you will get 5 different results so analysis won't make sense. I'll recommend you using Virtual User Pack to use Load Test capabilities effectively. Please note that you need not necessary to have test controller and test agent. You can run 1000 users on VS Ultimate box itself once you've Virtual User Pack. Please check here: http://msdn.microsoft.com/en-us/library/ff426121(v=VS.100).aspx

    But recommended way is to use Test Controller and multiple test agents in case you want to simulate large number of users.

    Thanks, Rubel


    http://blogs.msdn.com/rubel/
    Wednesday, August 11, 2010 12:42 PM
  • Hello,

    As Rubel mentioned above, running with controller and agents would be a better choice, one more thing, to simulate 1000 virtual users, usually it will only take 1-2 agents for it. You could check that for the cpu and memory utilization on agents, if both are lower than 80%-85% when getting the load, then the number of agents is capable for generating this load.

    You can refer to this article about detailed information about controller and agents: http://msdn.microsoft.com/en-us/library/ms243155.aspx

    About the virtual user pack, here is an article offer detailed information about this common questions: http://msdn.microsoft.com/en-us/vstudio/ff520697.aspx

    Thanks.


    Please remember to mark the replies as answers if they help and unmark them if they provide no help
    Thursday, August 12, 2010 5:39 AM

All replies

  • Hi,

    #1->No, You can't do remote runs i.e. run using test agents without virtual user pack. So you won't be able to use WS2, WS3, WS4 and WS5 while doing a load test run on WS1. You'll be able to do just a local run on WS1 / any other box having VS2010 ultimate and it will be limited to 250 users. Please check here for more details: http://msdn.microsoft.com/en-us/library/ee850544.aspx

    #2-> You won't be able to use controller / agents as I mentioned above. Meanwhile, you can specify which test agents to use for a run in test setting. Please check here for more details: http://msdn.microsoft.com/en-us/library/ff426235.aspx. Specially check on Agent Selection Rule.

    #3-> Yes, you'll have to install test agent on server as well. It will be similar to like you've installed test agents on rest boxes. But in test setting you'll specify your agent selection rules such that tests are not executed on test agent installed on web server.

    Thanks, Rubel


    http://blogs.msdn.com/rubel/
    Wednesday, August 11, 2010 9:01 AM
  • Thanks for your response, Rubel.

    As mentioned above, I would like to run a load test to measure an application server with approx. atleast 1000 users. 

    Can I use all fives workstations - each run a load test on the same application server? Hmmm! this doesn't seem to make sense.

    Or I must user Test Agents and Test Controller which requires Pack Virtual User License?

    What would you recommend the effective/correct for test setup for my requirement?

     

     

    Wednesday, August 11, 2010 12:35 PM
  • Hi,

    You can always run 5 different load test against same web server but this won't be useful as you will get 5 different results so analysis won't make sense. I'll recommend you using Virtual User Pack to use Load Test capabilities effectively. Please note that you need not necessary to have test controller and test agent. You can run 1000 users on VS Ultimate box itself once you've Virtual User Pack. Please check here: http://msdn.microsoft.com/en-us/library/ff426121(v=VS.100).aspx

    But recommended way is to use Test Controller and multiple test agents in case you want to simulate large number of users.

    Thanks, Rubel


    http://blogs.msdn.com/rubel/
    Wednesday, August 11, 2010 12:42 PM
  • Hello,

    As Rubel mentioned above, running with controller and agents would be a better choice, one more thing, to simulate 1000 virtual users, usually it will only take 1-2 agents for it. You could check that for the cpu and memory utilization on agents, if both are lower than 80%-85% when getting the load, then the number of agents is capable for generating this load.

    You can refer to this article about detailed information about controller and agents: http://msdn.microsoft.com/en-us/library/ms243155.aspx

    About the virtual user pack, here is an article offer detailed information about this common questions: http://msdn.microsoft.com/en-us/vstudio/ff520697.aspx

    Thanks.


    Please remember to mark the replies as answers if they help and unmark them if they provide no help
    Thursday, August 12, 2010 5:39 AM