Next Generation Testing: no test plan required
So you’ve got a shiny new site designed and ready for testing. You may get some questions like: who are your users, and what will they do while on your site? Sometimes questions like these can be answered with analytics, sometimes with educated guessing. However, for those who can’t answer these simple questions, some options still remain. Among those, one option may soon be a reality: monkeys – lots of monkeys.
In the past, deploying monkeys has been somewhat problematic, as it required extensive training to keep them stationary while using a keyboard & mouse while using computer. This limitation may soon be behind us, made possible by the Apple iPad. This new approach to testing, which we refer to as Fast Origination for Offsite Load may revolutionize the testing industry, by eliminating the need for test planning or scripting. Using our own monitoring software on the iPad, next generation Website Load Testing can offer two innovative new metrics for site performance, which are easily understood by both developers and management alike:
- Shakings: a measurement of user frustration. When users are beginning to become agitated, they may shake the iPad rigorously (usually above their head).
- Stompings: and indication of a lost user. The measurement tool can now gather when the user has thrown their iPad to the ground, and stomped on it before walking off to bother neighboring users. Stompings usually occur when the system is no longer responsive, or is generating error messages preventing the user from proceeding.
This experimental new methodology uses a reserved off-site facility, where the test subjects have access to internet and bananas 24 hours a day. It is recommended that testing be kept and conducted off-site, as the risk of many upset subjects wandering around during an on-site test has been shown to have detrimental effects to the health of the test servers.
We’re excited by this new methodology, and hope that you’ll go bananas for the chance to test without planning too!
Frank is an engineer for Web Performance. He is also an advocate for correct fire safety procedures whenever applying massive load to production test rigs.