VS2008 Load Testing - Maximum page counters = 50?

Question

We have just discovered that Visual Studio 2008 load testing appears to count and report on only the first 50 unique pages used in a given load test. This is obviously fairly useless for load tests that hit more than 50 different pages on a web server.

Is this a hard restriction or is this perhaps configurable somewhere in the registry?

Does anyone know if the same limitation exists in Visual Studio 2010?

Answer 1

Someone mentioned elsewhere to check the "Maximum Request URLs Reported" propery of the load test but it is set to 1000.  I'm not sure why this setting is not being respected.  Is there something else that overrides this setting?

Here is what our load test "run settings" looks like:

Answer 2

Hi wilsonjeff72,

Thank you for posting in the MSDN forum.

Could you share us the detailed steps?  So we can try to repro this issue and check it.

Do you mean that: you create a web test with more than 50 request URLs, add this web test to the load test, then run the load test, it only get 50 request URLs Reported? Can you share us a screen shot about this result?

I can create a web test with more requests URLs with VS2010, but I’m not very sure which result I should check it. So if possible, you could share us a screen shot.

If you got error messages, please also show the whole error messages in your post.

Best Regards,

---

Jack Zhai [MSFT]
MSDN Community Support | Feedback to us

Answer 3

Thanks for trying to help on this one. Here’s a little more info for clarity.

To prove this apparent 50 unique request limitation behavior I created 80 pages containing nothing but "hello world" (page01.html through page80.html) and added their calls to a web test in that order with a think time of 1 second on each request. I then included that web test (100%) in a new load test that ran for 2 minute at 1 constant user.

The load test “run settings” looks like this:

After the load test completes, in the “Graphs” panel, I see the “Page Response Time” section fill up with  page1.html through page50.html only, nothing more.

If I then look at the “Detailed Results” I see all 80 pages show up under “Page Results”, each with a count of 1 (correct), so it looks like all pages were captured.

However, if I go back to the “Graphs” panel and select the “Page Response Time” graph and click “Export to Excel”:

…what I end up with is an Excel sheet that stops at column AY which is the page50.html request.

I get the same 50 request limitation if I export to CSV.

If I take a look directly at the LoadTest database I can see all 80 unique requests in the WebLoadTestRequestMap table for the load test in question.  So the data appears to be in the LoadTest database but shouldn’t the Visual Studio interface allow me access to it on an export? 

I have been told that this issue no longer exists in VS 2010 but unfortunately we do not yet have access to that version.  I am hoping there is some kind of tweak or workaround I can implement to properly export the response time numbers.

Hopefully this has clarified my exact question for you.  I appreciate your time.  If anything needs further clarification please let me know.

 

Answer 4

Hi wilsonjeff72,

Glad to receive your reply.

To resolve this issue quickly, would you mind sharing this project to us, please attach your Visual Studio project, you can upload it to the sky driver, and then share the download link in your post. I will try to check it with VS2010, so we can resolve this issue as soon as possible.

As my understanding, it will work normally with VS2010, since some feedbacks have been updated when we create tests.

Best Regards,

---

Jack Zhai [MSFT]
MSDN Community Support | Feedback to us

Answer 5

Hi Jack,

Thanks for looking at this. 

Here is a smaple project including web content (80 html pages) which is causing the issue described above.  You will have to change settings where applicable of course (web server, load test repository, etc).

https://skydrive.live.com/embed?cid=43C1F8FBA618BECF&resid=43C1F8FBA618BECF%21136&authkey=AIiPPAM0DQvpFbI

Jeff

Answer 6

Hi wilsonjeff72,

Based on your pages, I record a web test with 55 pages, and add it to the load test, with the similar settings in the VS2010. I can get the result like the following screen shot, so I think it works in VS2010.

I also try to run it with VS2008, as you said that I just get 50 pages, so if possible, use the VS2010.J

You can submit this feedback to Microsoft Connect feedback portal: http://connect.microsoft.com, Microsoft engineers will evaluate them seriously. Thanks for your understanding.

Best Regards,

---

Jack Zhai [MSFT]
MSDN Community Support | Feedback to us

Answer 7

Hi, thanks for verifying this.  It sounds like our only option is to upgrade.  I highly doubt MS will be interested in resolving an issue in a 4-5 year old product.

Answer 8

Hi wilsonjeff72,

My personal suggestion is that you could use the VS2010, since you will get more new features and technologies about Testing.J

Have a nice day,

---

Jack Zhai [MSFT]
MSDN Community Support | Feedback to us

Answer 9

Hi wilsonjeff72,

Sorry for my misunderstanding.

I try to check the result, and it seems that it has the same issue. It still has the 50 pages limit.

See: http://social.msdn.microsoft.com/Forums/en-US/vstswebtest/thread/6c01308e-42fa-4c61-8544-7877f67d907b.

Best Regards,

---

Jack Zhai [MSFT]
MSDN Community Support | Feedback to us