VSTS - Problems with Looping and Transactions in a LoadTest.

Question

Hi All,

Hope one of you experts can clear up some confusion i have.

I have a single coded web test that has a loop in it and a transaction.
The coded webtest is a vanilla conversion from a webtest with the addition of a loop.
i.e

for (int i = 1; i <= 50; i++)
{
this.BeginTransaction("DataCommited");
//request code......
this.EndTransaction("DataCommited");
}

When i run this with the settings (1 Iteration, 2 Users) , i don't see the page response times and more importantly the Transactions displayed during the test run. However, i do see them after the test run is complete.
Question1: Is there a way to view these transactions during the test?

Also, When i run the same test but with the settings (Run duration of 1 Minute, 2 two users constant load) i also don't see the page response times or the Transactions displayed during the test run. The additional problem here is that the results are NOT displayed after the run either!!! The tables are blank.
Question2a: Is there a way to view these transactions during the test/after the test run?
Question2b: Why does the outcome differ depending on the run setting?

Thanks in anticipation.
Richard.

Answer 1

I think i understand why this is happening.

It appears that the "Page Response Times" and "Transaction Reponse Times" are not updated until the webtest has completed.
This is a bit of a problem in my scenerio as the webtest doesn't complete until my loop within the webtest is completed, thus you don't get the data displayed until the run has finished.

This also explains why the "Page Response Times" and "Transaction Reponse Times" are NOT displayed after the test run when the "duration" run setting are used as my duration is completed before the loop finished.

This is going to be a bit problematic for me:((
  

Answer 2

Richard,
 You are orrect with how this works.  We are looking at making this change for VS 2010.

---

Blog - http://blogs.msdn.com/slumley/default.aspx

Answer 3

Ok thanks Slumley.

I have just downloded 2010 B2 ultimate. I'll see how it behaves in that version.

Thanks
Richard 

Answer 4

FYI...

I have installed VS2010 Beta2, removed the coded loop and used the new GUI loop instead but the problem remains.
Do you know if this will be fixed in the final 2010 release as this is a show stopper for me?

Thanks
Richard.

Answer 5

Hi Slumey,

Is there a way that i can raise a defect to try and ensure that this is fixed in the 2010 RTM?

Thanks
Richard.

Answer 6

Hello again..

Can you verify if this is likely to be fixed in the final 2010 Build?
If i need to raise this issue myself, what is the process?

Thanks in anticipation.
Richard.

Answer 7

Can anybody verify the current situation for this issue in final 2010 release.

To reiterate the problem noted in a loadtest:
a) Page & Transaction response times are not reported until the webtest completes. Major problem when you have a loop in the webtest.
b) The bigger problem is that only the last page and transaction times are reported when the webtest completes. All the other response times from the loop appear to be discarded! If this is the case, what is the point is providing looping functionality (GUI or Coded) if the response times are not saved?

The above are problems in 2010 Beta2.

Answer 8

Hi Richard, I just verified this has been addressed post beta 2.

Ed.

---

Ed Glas [MSFT]

Answer 9

Hi Ed,

Magic. Thanks for the reply.

Richard.