locked
Unclear request response times RRS feed

  • Question

  • Hi

    I have some concerns regarding request response times in the load test result. The table below is the page results from a load test scenario.

     

    Page Scenario Test Network Total Ave Min Median 90% 95% 99% Max Std Dev Goal % Meeting Goal
    Create cart LT1 T1 LAN 3 0,014 0,011 0,015 0,015 0,015 0,015 0,015 0,0019 0 100
    Delete cart LT1 T1 LAN 2 0,69 0,48 0,89 0,89 0,89 0,89 0,89 0,20 0 100
    Enter cart name LT1 T1 LAN 3 0,57 0,50 0,51 0,69 0,69 0,69 0,69 0,088 0 100
    Enter my carts LT1 T1 LAN 9 0,058 0,015 0,023 0,35 0,35 0,35 0,35 0,10 0 100
    Enter product details LT1 T1 LAN 3 0,91 0,78 0,82 1,11 1,11 1,11 1,11 0,15 0 100
    Enter start page LT1 T1 LAN 3 0,77 0,031 1,04 1,23 1,23 1,23 1,23 0,53 0 100

     For the same scenario I get following request results:

    Request Scenario Test Total Failed Response Time Content Length
    Delete cart LT1 T1 2,00 0 0,67 0
    Enter cart name LT1 T1 3,00 0 0,54 0
    Enter my carts LT1 T1 9,00 0 0,058 14 455
    Enter product details LT1 T1 3,00 0 0,58 694 528
    Enter start page LT1 T1 3,00 0 0,74 5 393

     

    My questions are:

    1. How is "Response Time" for requests calculated when "Total" is more then 1?
    2. Why is not the same results calculated for response times for requests as for pages (i.e. "Ave", "90%", "95%" etc.)?
    3. I have tried to find the request response times in the report DB but the only response times i can find is for pages (select PageId, ResponseTime from LoadTestPageDetail where LoadTestRunId = 10). Where can I find the request response times?
    Thursday, December 22, 2011 4:18 PM

Answers

All replies

  • Hi Stefan,

    Thank you for posting in the MSDN forum.

     

    1.      Request results:

     

    Total: The total number of this Web performance test request issued during the load test run.

     

    Response Time: The average time to receive the entire response to a request, measured from the time the request was sent to the Web server. It is the average time of this request when it runs for the total number.

    For more information, see Reference1.

    2.      Page results:

     

    90%: The 90th percentile for the response time. This indicates that 90% of the pages responded faster than this number, and 10% of the pages responded more slowly.

     

    The same page has the different response time when it is executed for many times in load test. Like the number of the virtual users, the network and others, they can impact the page response time. The 90% means that it just collect the pages which is faster than the number.

    About the Ave, 95% and others, see the Reference2.

     

    3.      If you want to get a request response time, you could get it from the web test, see this article: http://msdn.microsoft.com/en-us/library/dd997556.aspx.

    Note:

    The Total Time is different from the Request Time.

     

    Reference1: http://msdn.microsoft.com/en-us/library/ms404656.aspx#TheRequestsTable.

     

    Reference2: http://msdn.microsoft.com/en-us/library/ms404705(v=VS.100).aspx.

     

    Hope this can help you,


    Jack Zhai [MSFT]
    MSDN Community Support | Feedback to us


    Monday, December 26, 2011 5:53 AM
    Moderator
  • The Request results as presented in VS2010 Load test are not sufficient in our understanding. The average value is usually misleading. It's actually too bad that VS2010 Load test does NOT save the same type of time statistics for Web request as for Web pages.

    Why it's not possible to get the 90th, 95th and 99th percentile time statistics for Web requests?

    (Note that we understand that Web page time delay already includes timing for dependent requests. We know also that it's possible to parallelize dependent requests in a load test.)

    Regards

    Tuesday, December 27, 2011 10:54 AM
  • Hi Piotr,

     

    Thank you for posting in the MSDN forum.

     

    The latest version is not able to get the 90th, 95th and 99th percentile time statistics for Web requests. Maybe the next version can achieve it. You could submit the suggestions and ideas: http://visualstudio.uservoice.com/forums/121579-visual-studio.

     

    Best Regards,


    Jack Zhai [MSFT]
    MSDN Community Support | Feedback to us

    Wednesday, December 28, 2011 6:59 AM
    Moderator
  • I have posted the suggestion "More relevant metrics for request results" Thanks for helping out!
    • Marked as answer by Stefan Stoffe Wednesday, December 28, 2011 2:44 PM
    • Unmarked as answer by Stefan Stoffe Wednesday, December 28, 2011 2:45 PM
    Wednesday, December 28, 2011 7:57 AM