Menu

Load Testing Blog

Measurements extension 0.3 now available

The 0.3 release adds some new plugins and enhancements applicable to performance and load testing:
New Test Plugins

The new Test Duration Plugin creates measurements of individual tests (# running, duration, etc.).
The new Step Summary Measurements plugin creates sampled measurements on steps such as success, failure and error counts, running count, running duration.

Enhancements to existing plugins

The Periodic Measurement Collector plugin can now tag measurements with the source hostname
The Step Duration Producer plugin has 3 new features for improving test analysis
The Save Measurements to CSV plugin now writes a footer line at the end of the file. The footer line … Continue reading »

Improved analysis with the Step Duration Producer plugin

Find failing steps
The Step Duration Producer plugin is part of the Measurements extension for MuseIDE. Its primary function is to report the duration of each completed step. Starting with the 0.3 release, it can add status metadata to each measurement indicating the completion status of the step – success, failure or error.
To enable, turn on the Add Step Status parameter in the plugin configuration.
With the status available, analysis or visualization tools such as Chronograf can identify which steps are failing in your test. This chart shows that a verify step failed 5 times:

Which steps are running?
Want to know which tests … Continue reading »

Test Duration Producer plugin

This plugin is part of the Measurements extension for MuseIDE version 0.3. It is a test-suite plugin that provides measurements to illustrate how many of each test are running, how long have they been running and how long did they take to complete. It is intended to be helpful for load testing.
Each time a test within a suite completes, a measurement is produced containing the duration of the test. If the running tests parameter is true, then each time measurements are collected by the Periodic Measurement Collector, two additional measurements are produced for each test. The first, running, is … Continue reading »

Analyze measurements by hostname

The Periodic Measurement Collector plugin, part of the Measurements extension for MuseIDE, now has the ability to add the hostname to each measurement it collects. This will allow analysis tools to analyze performance based on the source of the measurement. In the context of load testing, this would allow identification of regions that are experiencing slower page load times.
Here is an example of the durations of a homepage under load, identified by source hostname:

To enable this feature, turn on the Add source hostname parameter in the plugin configuration. Note that it applies to all measurements collected by the plugin.
This … Continue reading »

Announcing the Graphite extension for MuseIDE

To complement our Measurements and Parallel extensions, the Graphite extension sends measurements to a Graphite-compatible listener (Carbon, InfluxDB, etc). This allows, for example, viewing load test measurements live in a compatible UI, such as Graphite, Grafana or Chronograf.

After installing the extension (via the Extensions… button), it must be configured with the hostname and port that Graphite will be listening to.

You will also need a Periodic Measurement Collector plugin running, which was added in the Measurement extension 0.2 release. The periodic collector gathers the measurements and sends them to the Graphite plugin. It has a … Continue reading »

Introducing the OkHttp extension for MuseIDE

The Muse Test Framework is designed around extensibility – and specifically around the ease of adding new types of steps and value sources. The intent was to make it easy for 3rd parties to add new abilities to the framework and have those abilities seamlessly integrated into the MuseIDE without much effort. This made it a natural choice for us when looking to develop new load testing capabilities beyond our current tools such as Load Tester.
This first version of the OkHttp extension is very simple – almost embarassingly so. It provides just a handful of new capabilties:

Create … Continue reading »

Introducing the Parallel extension for MuseIDE

Executing a load test implies running many tests at the same time…making this ability a crucial part of my work to add load testing capabilities to the Muse Test Framework and MuseIDE. This extension provides just that feature – running multiple tests in a test suite in parallel. After all, a load test is really just a test suite executed with a high level of parallelism and additional (performance) goals.

Measurements extension 0.2 released

The Measurements extension adds performance measurement features to tests developed with the MuseIDE. The 0.2 release adds several new plugins that are crucial to our goal of using Muse for load testing: Periodic Measurement Collector, Store Measurements to Local Filesystem, Store Measurements to CSV and the Step Measurements Producer.

Introducing the Measurements extension for MuseIDE

The Measurements extension is a free (and open-source) project extension for MuseIDE and the Muse Test Framework that adds evaluation of performance criteria to a test.  This initial release adds two new capabilities:

Collect and store the durations of steps in the test, for later analysis.
Compare the duration of steps to performance goals and record a test failure when the goal is exceeded.

The extension is available for installation directly within the MuseIDE: after opening your project, go to Extensions and switch to the Available tab. The Measurement extension can be installed into your project with the click of a button:

Each … Continue reading »

Resources

Copyright © 2018 Web Performance, Inc.

A Durham web design company

×

(1) 919-845-7601 9AM-5PM EST

Just complete this form and we will get back to you as soon as possible with a quote. Please note: Technical support questions should be posted to our online support system.

About You
What you Need