This Firefox extension is a plugin for SeleniumIDE that makes it easy to collect performance measurements during a test. Installing this extension will add new commands for starting and stopping timers and provides a UI for viewing and downloading the collected measurements.
ChrisWhen his dad brought home a Commodore PET computer, Chris was drawn into computers. 7 years later, after finishing his degree in Computer and Electrical Engineering at Purdue University, he found himself writing software for industrial control systems. His first foray into testing software resulted in an innovative control system for testing lubricants in automotive … Continue reading »
The problem
Here is the situation: We are running a load test for a customer. The web servers are showing low to moderate CPU utilization and low disk activity. They have plenty of memory available. The middle-tier servers are reporting similar measurements. So is the database. Everything looks good in the load test.
ChrisWhen his dad brought home a Commodore PET computer, Chris was drawn into computers. 7 years later, after finishing his degree in Computer and Electrical Engineering at Purdue University, he found himself writing software for industrial control systems. His first foray into testing software resulted … Continue reading »
InfluxData offers a set of tools that are well-purposed for load testing:
InfluxDB is a time series database that is very good for storing measurements generated during load testing
Telegraf is a client that can report performance-related OS measurements to InfluxDB (CPU%, Memory%, bandwidth, network and disk I/O, etc). Useful for monitoring both the load generators and the servers.
Chronograf is a visualization tool for time-series databases – very handy for visualizing and analyzing load test measurements.
ChrisWhen his dad brought home a Commodore PET computer, Chris was drawn into computers. 7 years later, after finishing … Continue reading »
The 0.3 release adds some new plugins and enhancements applicable to performance and load testing:
New Test Plugins
The new Test Duration Plugin creates measurements of individual tests (# running, duration, etc.).
The new Step Summary Measurements plugin creates sampled measurements on steps such as success, failure and error counts, running count, running duration.
Enhancements to existing plugins
The Periodic Measurement Collector plugin can now tag measurements with the source hostname
The Step Duration Producer plugin has 3 new features for improving test analysis
The Save Measurements to CSV plugin now writes a footer line at the end of the file. The footer line … Continue reading »
To complement our Measurements and Parallel extensions, the Graphite extension sends measurements to a Graphite-compatible listener (Carbon, InfluxDB, etc). This allows, for example, viewing load test measurements live in a compatible UI, such as Graphite, Grafana or Chronograf.
After installing the extension (via the Extensions… button), it must be configured with the hostname and port that Graphite will be listening to.
You will also need a Periodic Measurement Collector plugin running, which was added in the Measurement extension 0.2 release. The periodic collector gathers the measurements and sends them to the Graphite plugin. It has a … Continue reading »
Executing a load test implies running many tests at the same time…making this ability a crucial part of my work to add load testing capabilities to the Muse Test Framework and MuseIDE. This extension provides just that feature – running multiple tests in a test suite in parallel. After all, a load test is really just a test suite executed with a high level of parallelism and additional (performance) goals.
The Measurements extension adds performance measurement features to tests developed with the MuseIDE. The 0.2 release adds several new plugins that are crucial to our goal of using Muse for load testing: Periodic Measurement Collector, Store Measurements to Local Filesystem, Store Measurements to CSV and the Step Measurements Producer.
Even though interoperability has been conquered, browsers still want to compete on performance, so picking the fastest one is a reasonable question. But what does browser performance mean in a world in which many people now have 1 Gb/s network connections in their home, and a 4G LTE phone connection can go up to 173Mb/s?
The Measurements extension is a free (and open-source) project extension for MuseIDE and the Muse Test Framework that adds evaluation of performance criteria to a test. This initial release adds two new capabilities:
Collect and store the durations of steps in the test, for later analysis.
Compare the duration of steps to performance goals and record a test failure when the goal is exceeded.
The extension is available for installation directly within the MuseIDE: after opening your project, go to Extensions and switch to the Available tab. The Measurement extension can be installed into your project with the click of a button:
Each … Continue reading »