In our latest CloudTest release (SOASTA 54.21), we here at SOASTA are unveiling an exciting new feature, Performance Analysis Dashboard with Baseline Comparison. Here’s what we did, why we did it, and how it works.
You asked, we answered
As a highly requested feature, many of our customers wanted the ability to do baseline comparisons between tests and different releases from test-to-test within CloudTest, all the while displayed on an easy-to-view dashboard.
(Baseline comparisons have been available in the past, but not to the extent that they were provided on the same dashboard as they are now. Core to CloudTest and not available in other competitive testing tools, you can view the current test run in real-time against a previous baseline comparisons—LIVE!)
Well, here it is!
How the Performance Analysis Dashboard works
This capability allows you to pick a previous release version to compare against a current release version, complete with performance test results and metrics.
Step 1: Set a baseline result
The first step is to right-click on any of the reports, or even a previous report, and choose “set” as a baseline result, as shown here:
Step 2: Choose a baseline comparison dashboard
The next step is to open another report and choose baseline comparison dashboard, as shown here:
Step 3: Compare metrics at will
In the next step, you’ll just edit the bottom portion and do all metrics comparisons you want to look at, as shown here:
But wait, there’s more!
You can also perform baseline performance comparisons against their defined Service Level Agreements (SLAs), as defined by the business. Just as importantly, you’re able to ensure that the current release adheres to these SLAs and enables the IT operations team to drill down into performance test results to compare actual results of the current release against any previously tested baseline. This helps you ensure that performance has either improved, stayed within required SLAs, or if degraded, be able to make a determination of next steps, fixes, or help provide data for failover planning.
For more details about this new feature and other enhancements and updates, please view the release notes in your CloudLink account.
If you’d like to see it for yourself, or if you have any questions, just reach out to me @DanBoutinGNV.
About the Author
Dan is the Vice President of Digital Strategy for SOASTA. In this role, Dan is responsible taking the world's first Digital Performance Management (DPM) solution to market as a trusted advisor for SOASTA's strategic customers, and changing the way ecommerce organizations approach the marketplace.