Load Testing Blog
AIX Monitoring Support on the Horizon
We’ve got a lot of new exciting progress making it’s way into Load Tester 4.2. Among these features, Load Tester 4.2 will be introducing an Advanced Server Analysis™ module designed for AIX servers. Like our other Advanced Server Analysis™ agents, the AIX module is capable of running offline, and will continue to collect data about your server even when normal connectivity to the server has been overloaded (unlike some of our competitors solutions). The monitoring agent can collect vital information from your server, including:
CPU
Memory
Disk activity (reads / writes / % utilization)
Network activity (bandwidth in & … Continue reading »
Load Testing Anti-Patterns: Building the Perfect Test
We run into a wide variety of customers who need load testing software and/or services. While many are working their way through the process on-the-fly, others have toiled long and hard to develop a thorough testing plan, complete with detailed descriptions of exactly how the load test should be performed. On occasion, this testing plan is incredibly specific – detailing exactly how many users should be doing this or doing that, exactly how many users should click a button at the same time, exactly which search result the user should follow, etc.
While I applaud the amount of effort put into … Continue reading »
Fixing: Unable to Establish Connection to the server
In this example case, we ran into a situation where a load engine could not resolve the hostname of the server being tested, even though Load Tester was able to record & replay against the server without any difficulty. This problem appears immediately, but only when running a Load Test with the troubled load engine. By using the Engines View in Load Tester, we were able to select and use each Load Engine separately in a Load Test, until the faulty engine had been isolated (this sort of problem will show errors coming back from the engine within seconds, and … Continue reading »
How-To: Recording Local Host Server
Recently we have been getting a lot of questions regarding how to use Load Tester to record against local host. While it is possible to record a local server, and may be useful for testcase development, it is however not recommended to run a load test on the same machines as the local server. Running a load test on the server can produce confusing and misleading results as well as cause resource issues. In order to get useful results, Load Tester and the web server need to be on separate machines.
In order to record against the local host; use the … Continue reading »
Knowing your Security with Stress Testing
In the past, we’ve had plenty of discussion on how performance effects user experience, and how that relates to conversions. But, can a server’s performance effect it’s security?
During a previous test, we had a customer whose site included a contact form. The user would complete the contact form in their browser, and the application server would convert this response into an e-mail and send it through a mail server. The contact form, coupled with the use of a CAPTCHA, helps to cut back on undesirable messages. During our testing, we discovered that the mail server was becoming overloaded (at only … Continue reading »
Choosing the scenarios for a load test
What to test?
Occasionally, we encounter customers who have only a single scenario to test. For example, one client developed an application in which the only scenario of interest involved a user registering him/herself with the system and scheduling an appointment. When this happens, the tester may devote their efforts to the accurate simulation, testing and analysis of this single scenario. You are unlikely to be so lucky.
In any moderately complex system, there are dozens or even hundreds of scenarios that are candidates for load testing. You are not likely to have the time or resources to test them all. As … Continue reading »
The Purpose of Load Testing
Why am I doing this?
Even a well-executed Load Testing effort may fail if it does not answer the right questions…or answer them in the right way. The “right questions” might appear obvious, such as “How many hits/sec can the server handle?” Such questions, while well-intentioned, may not be the questions that really need to be answered. They may simply be the easiest questions to ask…and answer.
From a higher-level strategic level, the real questions sound something like:
1. Is this system ready to deploy?
2. Can we make this system available to another 350 users?
3. We deployed the system and the performance is … Continue reading »
Testing tip: Make it Fail
We recently had a case of debugging a testcase where Load Tester reported an error with a page that looked and appeared just as it should, except it was missing a link the user needed to move forward. Debugging this case was easy: examine the replay two pages prior to the error, and the server had added a red error message to the page indicating the selected criteria was not valid.
So why didn’t Load Tester flag this error from the server? Beneath the error message, the page was exactly identical to the expect page: form fields were present and filled … Continue reading »
How to Develop a Robust Load Testing Plan
When I first started writing test cases with Load Tester, I found it easy to fall into the psychological trap of writing functional test cases. But load testing requires a different approach, and inadequate tests can cost you time and money.
Functional test cases (such as the unit tests popularized by JUnit) confirm the correctness of a system. These tests should be highly specific and have excellent code coverage. A good engineer approaches functional testing as though she were designing a jet engine: if any screw, flange, or circuit fails then the entire system is completely … Continue reading »
Load Testing Back to Basics: Missing User Variables Errors
There are a few errors that are frequently reported by customers. One of them being the missing user variables error. A missing user variables error basically means that a variable that was suppose to be extracted on an earlier page was not extracted, and the user is now trying to use that variable. The error can be caused by a number of things, the most common are server connectivity issues and improper configuration of a dynamic value.
If the missing user variable error was caused by server connectivity issues, there tends to be a server error before … Continue reading »