Archive | Load and Performance

Why Performance Testing your application is Required for Efficient UP and OUT Scalability

The cloud tries to meet applications’ scalability needs by using the UP and OUT approach – more powerful VM’s and redundancy. This on demand elasticity masks root causes which limit scalability while at the same time increasing your OPEX and adding more points of failure to your deployment.Cloud Deployments-

Let’s think through the elasticity approach a little deeper…

The cloud is configured to automatically react to surges in load and allocate more resources such as CPU, RAM, etc. The key concept here is react AFTER the detection of a increased workload. Does this guarantee the users’s experience who were logged at the beginning of this perceived higher workload?

Why the Cloud can’t Overcome Configuration Issues which limit Scalability

All software servers (OS’s, web servers, application servers, messaging servers, database servers) come with tunable configurations which can either throttle or flood the throughput of your application. These configurations have a profound effect on usage of hardware resources. Limit the threads and the CPU will never be busy processing requests. Allocate only a certain amount of heap and the rest of the RAM is rendered untouchable by an application. Inversely, open the gates, and easily overwhelm the resources. What to do?

Performance test your application in the cloud in order to efficiently scale UP and OUT!

Engage performance engineers to design a performance test harness and execute a realistic load. Use performance testing to Expose configuration limitations. Test with the upper limit of anticipated peak load and add headroom. Let hardware resources be the real limiting scalability factor so that you can take advantage of the elasticity of the cloud.

Continue Reading

Performance Engineers: Stay Curious!

So, what really drives web application performance engineers? Curiosity. We possess the skills to build a rock solid performance test harness that becomes a magic time machine. Leveraging this harness, we can predict the future. Rev up the number of users and what will curioushappen? We are dying to know. We need to know. We won’t stop until we know. At what load does the application fall over, crash to it’s death? When will it be brought to it’s knees with ridiculously high response times? We can emulate a realistic load and answer these important questions…but the fun part is being the maverick detective.

Through performance testing, we become intimate with the application and understand it’s behavior under high workloads. We get to kick all the tires of a deployment. Resource usage patterns become predictable. Studying the results is like a treasure map of data leading to bottlenecks.

This is the fun part…a wildly exciting adventure. Based on data, we morph into scientists, proving and disproving hypothesis. When we double the capacity of an application with a configuration tuning tweak – that’s a great day! The bigger the challenge, the more exhilarating the reward. The reward is always a higher scaling application.

The best performance engineers are the most curious. You want the most curious engineers testing your most critical applications. You see, without the expertise of a performance engineer – designing, executing and analyzing the results, no one can possibly know how the application will perform once it is released to production. Making an application screaming fast is our goal – and we love the ride!

Are you a curious tester? If so express your interest in joining our performance team! If you liked this article and want to read another by our performance lead Becky Clinard check out her recent post on her vision for Performance Testing with uTest.


Continue Reading

My Vision for the uTest Performance Testing Community

What will differentiate uTest’s performance testing services and make us the “Go To” community for customers’ load testing projects? The value we deliver in the analysis of the test results.

As we grow the team by on-boarding new performance engineers and by training existing testers who want to further their career in this exciting industry, we will place an emphasis on performance testing geared towards providing Actionable value to the customer.

What will differentiate uTest’s performance

To understand the difference between “Front End Testing” and “Performance Engineering” I’ll describe how typical “front end” load testing is executed. First, the customer provides a URL or downloadable application as well as user activity workflows. They supply the target workload expected in production (some will have lofty goals of a million users logging into their website all at once, but we aim to please..). Then automated scripts are created to simulate real users and the harness is configured to reach that expected workload. The start button is pressed (I’m over simplifying here…) and the test is executed. More often than not, the load test falls over before the expected workload is reached. The results are analyzed and a report is delivered. This process is repeated for the time duration or until the number of sold tests cycles have been completed. This type of validation testing definitely meets the sold criteria to customer but let’s taking it a step deeper…and give them more value and insight.  Continue Reading →

Continue Reading

Meet Becky Clinard our New Performance Lead

As you may have seen in our forums post we are looking for testers interested in Load & Performance so that we can build our Performance Team. For those interested there will be resources to help build or improve your experience. We will be doing this by providing  blog posts, valuable course tracks, skill tests and more.

That is why I am excited to introduce our new Performance Lead Becky Clinard! circle becky

I met with Becky last week and we have a lot of great ideas for increasing the number of performance projects for uTest. Even better she has a lot to share and teach on how to become a performance expert.

You will soon be seeing content by Becky so read more for an intro to Becky and to find out more about her past experiences and how she plans to get involved in the community!

Continue Reading →

Continue Reading

Video: uTest Partner BlazeMeter Talks Performance Testing with JMeter

Our friends at BlazeMeter last week hosted a live session giving testers and developers everything they need to run performance testing with the popular open source load performance testing tool JMeter. And we’re happy to share the session here on the uTest Blog.

The hour-long session starts with an overview of performance testing, then moves onto how to run performance testing with JMeter, why it’s worth using BlazeMeter with JMeter, and concludes with a Q&A hosted by BlazeMeter’s Ophir Prusak.

BlazeMeter is a proud uTest partner and provides next-generation, cloud based performance testing solutions that are 100% Apache JMeter™ compatible, and was founded with the goal of making it easy for everyone to run sophisticated, large-scale performance and load tests quickly, easily and affordably.

After viewing, you can also check out our Load and Performance Testing course track at uTest University for even more in-depth learning.


Continue Reading

uTest Partner BlazeMeter Hosts Performance Testing with JMeter Webinar

JMeter is the leading open source load performance testing tool, and cloud-based performance testing provider BlazeMeter will be hosting a live1_blazemeterbanner webinar next week giving testers and developers everything they need to run performance testing with the popular tool.

In this webinar on Wednesday, November 19, at 1pm Eastern Time, BlazeMeter’s Ophir Prusak will cover all of the vast capabilities and lesser known limitations of the popular open source load tool. The session will consist of three parts:

  • How to run performance testing with JMeter. Learn best practices, tips, and what you can and can’t do with JMeter.
  • Why it’s worth using BlazeMeter with JMeter. Learn the benefits and additional features you can get by running performance tests through BlazeMeter.
  • Live Q&A. Ask Ophir your questions about JMeter or BlazeMeter.

Continue Reading →

Continue Reading

Preparing for a Load Test With JMeter: The Vital Point You Might Be Overlooking

This piece was originally published by our good friends at BlazeMeter – the Load Testing Cloud. Don’t forget to also check out all of the lbz_bl_0001.24.13f_1oad testing tool options out there — and other testing tools — along with user-submitted reviews at our Tool Reviews section of the site.

If you often run load tests, you probably have a mental checklist of questions that run through your mind, including:

  • How many threads per JMeter engine should I use?
  • Can my engine handle 10% more threads?
  • Should I start with the maximum number of threads, or add as I go?

All of these questions are important and should be carefully considered – but what about the load test itself? Have you considered how the actual procedure will be managed?

Continue Reading →

Continue Reading

Open Source Load Testing Tools Comparison: Which One Should You Use?

This piece was originally published by our good friends at BlazeMeter – the Load Testing Cloud. Don’t forget to also check out all of the load testing tool options out there — and other testing tools — along with user-submitted reviews at our Tool Reviews section of the site.

Is your application, server or service is fast enough? How do you know? Can you be 100% sure that your latest feature hasn’t triggered a performance degradation or memory JMeter-Response-Times-vs-Threadsleak?

The only way to be sure is by regularly checking the performance of your web or app. But which tool should you use for this?

In this article, I’m going to review the pros and cons of the most popular open source solutions for load and performance testing.

Chances are that most of you have already seen this page. It’s a great list of 53 of the most commonly used open source performance testing tools.  However, some of these tools are limited to only HTTP protocol, some haven’t been updated for years and most aren’t flexible enough to provide parametrization, correlation, assertions and distributed testing capabilities.

Continue Reading →

Continue Reading

Load Testing Not Performed in Most Organizations: Should it be an Optional Affair?

We’ve all seen the disastrous results of not properly load testing and sites not being able to shoulder the traffic — the site crashing in the United States is one load-testingexample where people’s livelihoods were actually put at risk (e.g. this wasn’t someone being inconvenienced today while pre-ordering the iPhone 6).

So you’d think that more organizations would be taking load testing seriously as part of the software development process, given the bottom-line risks to the business. However, according to a Software Testing Magazine report citing a survey from the Methods & Tools software development magazine, only 24% of organizations load test all of their projects, and even as high as 34% don’t perform any load or performance testing.

I’d be interested to dig deeper into this report, because it isn’t clear if this is a widespread issue in software development, or just in certain sectors. For example, organizations that make up this survey respondent pool may want to re-think their load testing strategies if they’re in industries with a low tolerance for crashes or slow site performance — i.e. retail. Nonetheless, this is still a surprising number.

Is load testing just an optional step for software development organizations? Or have they still not learned with the number of high-profile site crashes as of late? We’d be interested to hear from you in the comments below.

Continue Reading

Load Testing Tool LoadStorm Introduces LITE Version

Untitled5Creator of cloud testing tool LoadStorm, CustomerCentrix, today announced that it has released a LITE version of its cloud load testing tool.

This version is designed to be a cost-effective, easy-to-use complement to its enterprise level tool, LoadStorm PRO. According to the company, LoadStorm allows users to set up tests in the web application and run them from the cloud with no hardware to purchase and no software to install. Users will be able to try LITE for free from their site.

Don’t forget to leave a review of LoadStorm if you’ve used the cloud load testing tool in the past, and be sure to check out the complete library of testing Tool Reviews to check out comparable load testing tools and see which is best for your testing team’s needs.

Continue Reading

Load Testing with uTest & BlazeMeter

BlazeMeter LogoWhen it comes to building high quality apps, ensuring that they can handle even the toughest loads is one of the most important steps in software testing. But despite its importance, companies often see load testing as too difficult, too expensive, and too distracting from the goal of simply shipping the app. For many companies, their first load test comes in the “real world,” in the hands of their devoted users. And for all too many of them, the results are disastrous.

Our customers have been asking us for more and more help with load testing, and earlier this year we started seeking a partner who could help us execute high volume load tests. When we met the team at BlazeMeter, we immediately knew we had made the right connection. When it comes to modern load testing, these guys get it. They’ve built an outstanding cloud platform to run load tests using JMeter, a hugely popular load testing tool, with the ability to quickly scale from a few thousand to hundreds of thousands of virtual users.

Load ChartToday we’re pleased to announce a new partnership with BlazeMeter, and we think that by working together we will make it substantially easier for companies to load test their web and mobile apps quickly and affordably.

BlazeMeter has built their load testing technology on JMeter – an open source platform with thousands of man hours of active development – for companies like Nike, Adobe, MIT and others. By creating a cloud platform for JMeter scripts, BlazeMeter has made it easy to deliver load tests on any scale without their customers having to manage expensive infrastructure.

BlazeMeter waterfall chartuTest brings to the table our team of performance experts to help create JMeter scripts and interpret the results. With our community of load testing professionals, we have some of the smartest JMeter experts in the world who know how to build testing scripts, execute them, and then interpret the results. Companies can work with us to have their web and mobile apps load tested using industry-leading tools, even if they have have no prior background in running a load test.

And because JMeter is an open platform, companies are not locked into an expensive tool with recurring licensing fees. Customers can reuse their JMeter scripts however they like, including on their own systems.

Are you launching a new app soon? Getting ready for the upcoming big holidays? Planning for an ad blitz around some upcoming sporting events? You have absolutely no excuse to think load testing is too complicated or expensive. Using uTest, we can help you plan, execute, and interpret a full suite of load tests very affordably for your web or mobile app. Learn more on our load testing overview page or contact us for pricing.

Continue Reading

Quell the Queue with Load Testing

App QueueThere is a recent trend in releasing hot new apps to create a queue for your users before you can fully support them (see Mailbox and Tempo). The implementation of these queues is great from a usability perspective. They create both excitement and exclusivity for an app while you can sort out scalability issues. But as entertaining as they can be in the first week of usage (“yay, my numbers going down and look how many people are behind me,” you may think), having users wait to get your app while you sort out issues is a dangerous tight rope to walk, especially when a user’s switching costs are so low. An impatient user may decide to delete your app and move on to the next one, never getting to appreciate your app’s greatness.

So how do you minimize this risk? Enter Load Testing. Before releasing your app, get the confidence you need to know that all of your systems integrate properly and can handle the weight of your user base. uTest offers a combination of live and simulated load options to allow you to understand your app’s performance under peak loads. Finding your bottlenecks before launching your app means that no users, not even those early in the queue, should have to face performance issues. Avoid low app store star ratings and reviews and delight your users by letting your app shine through.

Do you know if your app has what it takes to meet its post-launch demand? Find out today.

Continue Reading