75% of All Web & Mobile Apps Go Live Without Ever Being Scale Tested
So why is it that so many web and mobile apps experience some form of performance issues (#FAIL) despite having access and availability to seemingly unlimited amounts of affordable compute power? Well…it’s complicated. First of all, very few of these performance issues are based on a lack of capacity, but rather on configuration, setup, design, or implementation issues. All of which could easily have been discovered through testing.
Which brings us to the app market’s “dirty little secret”…that at least 75% of all web and mobile apps GO LIVE without ever being load (scale) tested, despite the potential volatility and volume of today’s web traffic. Having run one of the largest financial services SaaS sites in the early 2000s, I can tell you this: all of us building and deploying these apps want them to be fully scale tested. Especially in light of recent surveys, which indicate that even the most minor app performance issues (500ms) can lead to a significant amount of lost revenue (1% of sales). So why don’t we scale test these sites?
While the answers may vary slightly, it is almost always that the traditional enterprise-class test solutions are way too expensive and take way too long to set up and analyze results. The only alternative to these expensive test solutions like HP LoadRunner and MicroFocus Silk, has been the recent emergence of a number of easy-to-use and low cost test tools such as jMeter and Grinder. Unfortunately these tools lack many of the most basic components of load testing, such as integrated analytics and automation of test deployment, leaving the need for additional products to fill in. The options of choosing between expensive & slow vs. cheap & lacking features most often leads to the decision of not testing at all.
It has been our vision here at SOASTA to change app testing forever. First, we changed testing by introducing “Cloud Computing” as the new platform to test from back in 2007. Then (in April) by introducing the first load and performance test platform specifically for Mobile applications. And now today (once again) we are changing testing by announcing the First FREE (Enterprise Class) test solution built specifically for web and mobile testing. The name of our new edition is CloudTest Lite, (beta available today).
CloudTest Lite is the same award winning enterprise class test solution that is currently being used by many of the leading consumer facing and enterprise companies such as Mattel, Gilt Groupe, Hallmark, Intuit, Verizon and Netflix. It includes SOASTA’s award winning (patented) technology with its extremely easy-to-use test creation and deployment processes, as well as SOASTA’s advanced and integrated real-time analytics engine. The only limitation to CloudTest Lite versus our other CloudTest editions is in the size of the test that can be performed…it is set at a maximum of 100 concurrent users per test. For perspective, an “average” app on a normal day of usage will experience between 50-250 concurrent users. To test 100 users just a few years ago using a sophisticated test solution would have cost around $100,000; with CloudTest Lite, now it is FREE and could and should lead to regular scale testing of applications.
It is our sincere hope, that this announcement of CloudTest Lite will once again transform the app development world by introducing a test platform for daily scale testing of web and mobile applications.
About the Author
As CEO of SOASTA, Tom brings more than 30 years of experience building early stage software companies, leading two companies to successful IPOs. Tom is a regular speaker at both cloud and testing events, and has become a leading advocate in using the cloud to empower individuals and accelerate changes in how applications are built, tested and deployed. Most recently, Tom served as President and CEO of Kenamea. Prior to Kenamea, he was CEO of Dorado Corp., a financial services software provider. Previous to Dorado, he was EVP of Sagent Technology through its 1999 IPO, entrepreneur-in-residence at Crosspoint Venture Partners, and held executive positions at Digitalk Corp., Knowledgeware (KWI) and Encore Financial Services. Tom also serves on several boards in the Silicon Valley.