Load test, performance test, stress test, soak test…there are numerous of terms to describe these efforts and even within the testing community there is not unanimous agreement. These definitions line up well with the most common usages:
Performance Testing – Any testing that is focused on measuring the performance of a system. This is in contrast to functional testing, which is primarily focused on measuring the correctness of the system. When you use a stopwatch to measure page load times in your browser, you are performance testing.
Load Testing – Performance testing with the goal of measuring the performance of a system … Continue reading »
So you’ve got a shiny new site designed and ready for testing. You may get some questions like: who are your users, and what will they do while on your site? Sometimes questions like these can be answered with analytics, sometimes with educated guessing. However, for those who can’t answer these simple questions, some options still remain. Among those, one option may soon be a reality: monkeys – lots of monkeys.
In the past, deploying monkeys has been somewhat problematic, as it required extensive training to keep them stationary while using a keyboard & mouse while using computer. This limitation may … Continue reading »
This tutorial will show you how you can use performance goals to customize the reports to give you information that is relevant to the individual performance requirements of your system. The goal is to help you learn to draw better conclusions from the data and get more accurate results. You’ll also spend less time poring through the data.
We get this question a lot. I would really like to give an easy answer to that question. But since the answer depends heavily on the nature of your organization and the testing demands, I’m instead going to list some of the issues that we consider when helping our customers make these decisions.
Schedule – are you in a hurry? If you have an impending deadline and the performance testing needs to be completed immediately, then outsourcing may be the best choice. With an experienced partner, the first load test can be completed in less than a week. If the schedule … Continue reading »
Reaping performance benefits from using persistent connections on your HTTP web server is nothing new. In a recent test of a SSL site, one of our clients enabled persistent connections on their servers as part of a new deployment. The results were quite impressive: for a single user & negligible server utilization, page durations dropped from 12 seconds to only 3.5 seconds. Persistent connections can contribute to much of this duration difference by reducing the amount of time needed establish new connections. The use of SSL makes this feature even more important, as the SSL layer requires additional session negotiation. … Continue reading »
For Lenox, makers of fine china and crystal, e-commerce has been an important aspect of the business for over ten years. When Lynch needed to test the Lenox website user capacity on short notice, Load Tester was the right tool for the job. It offered the features and flexibility to build complex, realistic test cases and identify performance bottlenecks. Read more about their experience.
ProtoTest, provider of consulting services in specialized software quality and test projects, uses Load Tester to help their clients determine how many users their websites can handle. I spoke with Lawrence Nuanez, Senior Consultant, to find out more.
Last time, I talked about why it is ok to start testing early in the development process. I’m going to continue that thought process to discuss load testing without complete performance requirements. This Load Testing 101 article says “If the real end user is going to do work with your application in a totally different way than you test you are as good as with no testing at all.” While there is a nugget of truth hidden in there, it is easy to take away the wrong understanding.
One interpretation of that statement would be that “you must have … Continue reading »
During testing of some sites, we found an strange case where pages seem to download themselves. What does this look like?
Note that the page gets requested, and seems to request itself while it is rendering. This has an obvious problem: the dynamic content is being requested twice as many times as necessary, causing the server to have to render it twice as often as necessary. If users turn off Load Tester’s “streaming” feature while recording, this looks a little different: the 2nd instance of the request is still made, but instead we get an error message: “Connection to server abandoned … Continue reading »
Jason Tower, in his Web Performance-sponsored BMW Spec E30, took second place last weekend at his most recent road race. He had never driven the Atlanta course before – nice job, Jason! Watch his in-car video (wow, that looks fast!) and hear more about the race on his blog.