Software Quality

October 24, 2012

Examining Web Performance Test Results Using the Web Performance Test Results Viewer

Filed under: Testing, Visual Studio 2012 — Tags: , , — David Allen @ 4:21 am

I really like the Web performance testing tools built into Visual Studio 2012 Ultimate. These are tools you can use to create and execute automated tests of web applications for the purpose of measuring performance and load. These latest versions are much more polished, feature-rich, and easy to use than the versions that came in previous versions of Visual Studio. One of my favorite features is the ability to export load test results into an Excel workbook.

When you generate the Excel load test reports,  there are two different formats available. One is a side-by-side comparison of two different load test runs. The other is a trend analysis that can compare two or more test runs and show a graph of the trends of various performance measures.  When you press the button to export the test results, it does not merely dump the raw data into an Excel workbook, it uses Excel automation to generate a bunch of graphs that show the comparisons or trends in the various performance measures. It is the same kind of work that we used to have to do by hand. Only now, thanks to automation, we can see the results in a visual fashion much more quickly.The sample image shown above shows a trend report I ran.

I was testing the performance of a web application with various web garden settings. The first two runs, 44 and 45, were run with the worker process equal to one. Run 47 performs the load test with two worker processes, and run 48 is the performance of the web garden with four worker processes. From my experiment, I concluded that my current configuration would be able to deliver far more results with four worker processes. As an interesting side note, the IIS server that was hosting my web application had four CPUs.  So this is a reasonable result to expect. But there is something very satisfying about having actual performance tests data to verify your hypothesis.

If you are interested in learning more, this MSDN article is a good entry point Examining Web Performance Test Results Using the Web Performance Test Results Viewer.

2 Comments »

  1. This is such a critical step when involving your infrastructure team. There never seems to be a person that is responsible for running load testing during design so these measurements never really feel solid. It is great you have access to more of these tools. Hopefully they will help developers confidently quantify realistic requirements when they are ready to request resources. Cool stuff, thanks for sharing.

    Comment by Cory — October 24, 2012 @ 7:54 am

    • I agree. These non-functional requirements are often overlooked and hard to specify.

      Comment by David Allen — October 24, 2012 @ 7:53 pm


RSS feed for comments on this post. TrackBack URI

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Blog at WordPress.com.

%d bloggers like this: