Testing the Limits With Ben Simo – Part II

In part II of our Testing the Limits interview with Ben Simo, we’ll discuss whether you should trust automated testing tools; the proliferation of testers on Twitter; the true meaning of “QA”; how testing evolves differently in each company; the long lost Bach brothers and much more. You can catch up on the conversation by reading part I. We’ll wrap things up tomorrow with part III.

********

uTest: Jon Bach mentioned that changing the meaning of “QA” to Quality Assistance would help outsiders (engineers, executives, et al) better understand the role of this discipline.  Agree or disagree?

Simo: I believe I first heard  “Quality Assistance”  from Cem Kaner.  I agree with Jon. When testers bear the title Quality Assurance, it often implies that they actually assure the quality of other people’s work. Testers are in a position to help assist quality; not assure it. Let’s not assist the setting of unrealistic expectations with inappropriate titles.

uTest: While we’re on the subject, are you anyway related to James and Jon Bach? The resemblance is uncanny.
Simo: I don’t think so. I’m available for adoption if the Bach family is interested. ;)

uTest: You’ve said that you frequently use automated tools, but that you don’t trust them entirely (back to that whole defensive pessimist thing again). What advice do you have for testers and managers wanting to strike a healthy balance? And what’s currently in your arsenal of automated tools?

Simo: My mistrust in tools is based on the fact that tools can’t think for me. Automated checking can only process whatever decision rules someone thought to program when the checks were created. Automation will consistently do what it is programmed to do and consistently not do what it is not explicitly programmed to do. I find test automation to be useful. In fact, there are some things I’d not want to even try to do manually. I do, however, distrust the green bar. When automated checking passes, I ask myself what the automation does not tell me. I also try to keep aware that people who don’t understand what the automation does are likely to assume that it does more than it does.

Tools are much more than test automation. Tools are essential for testing. I don’t want to test without tools. I have some old programming books that promote testing in which a programmer manually executes code, step-by-step, with pencil and paper in order verify that the code works as expected. This is manual testing. This is a testing practice that came from a time when computer time was rare and cost more than people. We’d now laugh at someone proposing testing in this manner.

Read more…

The Coming Shortage of Software Testers

Imagine a world where software testers are courted and wooed like LeBron James; where online job boards are littered with “Testers Wanted” posts and where everyone can finally spell “QA” correctly. In other words, imagine a world with a shortage of software testers…

“Nonsense!” you say. “There’s plenty of software testers to go around.” Not for long, says SiliconIndia, who posits that a shortage of skilled software testers is only a matter of time. Citing various facts, figures and estimates from a recent Gartner study, the author examines the reasons behind this coming tester drought.

Pradeep Chennavajhula explains:

This shortage is now a major concern for the IT service organizations, considering that the academia is not geared up to support the program, and many of the training organizations are not geared up to meet the demand of the industry. In this scenario, the question still remains as to how is the industry planning to tackle the shortage of software testers?

Good question. Of course, we’ve dealt with these issues many times before on The uTest Blog. Here are a few posts with some answers:

Read more…

Testing Fireworks (and other weekend readings)

“They want to know if the 91-shot Saturn Missile Battery really fires 91 shots,” writes Cory Matteson of the Lincoln Journal Star. “And, they want to know if 96,000 firecrackers in a pile the size of a bean bag chair will leave the lawn looking like burnt toast if they’re set off all at once.”

Much like software users, fireworks enthusiasts (like the guy in the picture) want a product that functions as expected; that works safely and without any unnecessary complications, regardless of the environment it is being used in. In short, they want a product that has been tested extensively before it was launched released.

So, seeing that it’s Forth of July weekend here in The States, I thought I would direct your attention to some testing fireworks – literally, in the form of this manual from the Consumer Product Safety Commission, and figuratively, in form of these recent (and provocative) software testing blog posts. Enjoy.

How Challenging Each Other Helps the Craft – James Bach
“Regular readers know that I’m dissatisfied with the state of the testing industry. It’s a shambles, and will continue to be as long as middle managers in big companies continue to be fat juicy targets for scam-artists (large tool vendors, consulting firms, and certain “professional” organizations) and well-meaning cargo cultists (such as those who think learning testing is the same as memorizing definitions of words and filling in templates).

What I can do about it is to develop my personal excellence, and associate myself with others who wish to do likewise. Someday, perhaps we will attain a critical mass. Perhaps the studious will inherit the Earth.”

The Heart of a Tester – Pradeep Soundararajan
“In 1954, when software testing was just about taking birth, there were two groups that started to form. I was as curious as you are right now, to know what those two groups stood for. One of the groups christened as, “Kuzusu”, had a thought that good testing would reduce the number of billable hours to deliver a good enough product and hence had to be avoided. The other group christened, “Shidachi”, stood for good testing that can save a lot of stakeholders time and money to deliver a good enough product. Things started getting hostile. People from the two groups tried killing each other.”

Read more…

Top 20 Software Testing Tweeps

According to Twitter co-founder Biz Stone, Twitter now has 105,779,710 registered users—and is adding 300,000 new users a day. Attempting to weed through all of the fluff can be daunting! So, if you’re interested in jumping into the Twittersphere or are just looking to follow the leading journalists and thinkers in software testing today, check out our “Top 20 Software Testing Tweeps” list below (in no particular order)!

  1. James Bach – @jamesmarcusbach
  2. Michael Bolton – @michaelbolton
  3. Testing At The Edge Of Chaos (Matt Heusser) — @mheusser
  4. Tester Tested! (Pradeep Soundararajan) – @testertested
  5. StickyMinds.com (Better Software Mag) — @StickyMinds
  6. SearchSoftwareQuality.com (Yvette Francino) — @yvettef or @SoftwareTestTT
  7. Google Testing Blog (Copeland/Whittaker) – @copelandpatrick or @googletesting
  8. Testy Redhead (Lanette  Creamer) – @lanettecream
  9. Test Obsessed (Elizabeth Hendrickson) — @testobsessed
  10. SD Times — @sdtimes
  11. Jon Bach – @jbtestpilot
  12. Software Test & Performance Mag –- @STPCollab
  13. Software Testing Club (Rosie Sherry) — @rosiesherry or @testingclub
  14. Lisa Crispin — @lisacrispin
  15. Fred Beringer — @fredberinger
  16. uTest (shameless plug! ;-) ) — @uTest
  17. Weekend Testing (Santhosh/Parimala/Ajay) – @weekendtesting or
  18. Santhosh Tuppad — @santhoshst
  19. Ajay Balamurugadas — @ajay184f
  20. Parimala Shankariah — @curioustester

Update! Thanks for everyone’s recommendations. Here are a few we missed: @sbarber, @QualityFrog, @dailytestingtip, @sdelesie, @Rob_Lambert, @chris_mcmahon, @hexawise, @marlenac, @shrinik, @sbharath1012, @sellib, @TestingNews.

Please feel free to add any active Tweeps you think we may have missed in the comments! We welcome your recommendations.

Testing the Limits With Scott Barber – Part II

In part II of our interview with Scott Barber, we tackle the so-called “consensus” among the Context-Driven School; his start as a software tester; why software problems are mostly people problems; reporting out-scope-bugs and much more.

We will post the final installment tomorrow. By the way, did you miss Part I?

uTest: There’s a lot of consensus among the Context-Driven School of Software Testing, but are there any fundamental differences? You can’t agree with guys like Michael Bolton and James Bach on everything, can you? Speak freely, your secrets are safe with us!

SB: I don’t know that there *is* a lot of consensus. I know that I am very much Context-Driven. In fact, my license plate says “CONTEXT”. That said, the buzz and counter-buzz surrounding the Context-Driven School of Software Testing is still causing as much harm as good.

I think the underlying problem is that the creation of software is widely treated as a software development activity, which may or may not benefit from related activities like testing. I find this thought process just plain silly. Software development, in my experience, is done for one of four reasons; altruism (minimal), education (some), research and development (slightly more than some), and/or financial/business advantage reasons (most). I think the fact that software is created for different reasons and purposes makes software development at least context-dependent by definition. The difference between being context-dependent and being context-driven is fundamentally the difference between being reactive vs. being proactive.

I think there never would have been a need to call out or name the Context-Driven School of Software Testing if testing hadn’t been so undervalued, misunderstood, and too often ignored entirely for so long that some entrepreneurial folks decided to step up and start talking about “the right way” to test software. While I’ll be one of the first to admit that many of these folks published “right ways” that were far superior to the state of the practice of the time, none of these “right ways” were right for everyone or every situation.

Read more…

Journey Of A Passionate Tester

To say that uTester Ajay Balamurugadas has an impressive software testing resume would be an obvious understatement. Coached by Pradeep Soundararajan, he has been awarded a scholarship from the Software Testing Club; is a proud student of  the Miagi-Do School run by Matt Heusser, and co-founded “Weekend Testing.” Oh yeah, and he’s also the latest contributor to our guest blogger series. For more of his work, be sure to check out his blog or follow him on Twitter.

In this post, Ajay takes a stroll down memory lane…

This is an article on my experiences with software testing, the traps I fell into, and the lessons I learned in the process. Before I share my story, let me make one thing clear: I’m no software testing expert. I make mistakes, learn, practice and apply my learning to improve my skills as a tester. To illustrate, I’ve split the journey into five simple stages.

Stage 1: Testing = Find Bugs

I am hired as an Associate QA Engineer at my first job. I was called upon to help remove all bugs in the product before it reached the customer – simple enough. As an obedient student, I did what was expected of me. The execution percentage never reached 100%. I could not complete a cycle of execution in the stipulated time. I did not know that I was checking and not testing. Whenever I tested, I could not achieve 100% execution. Some of the bugs I logged were termed as ‘Deferred – Will not be fixed’. I was bombarded with questions like: “Which user would do that? Good bug, but why did you find it now? Why did you miss it? ”

I did not have an answer for the questions. I myself had more questions than answers.

Read more…

uTest Blog Abuzz With Hive Award Win @ SXSW

Last week, we found out that our humble little Software Testing Blog won the Hive Award at SXSW as the top business software blog (here’s the slideshow and the PDF report). We’re honored to make this prestigious list, along with brands we love such as HowStuffWorks, Nokia, Nike, HBO and About.com.

Part of the reason this blog has been so successful in the past year is how infrequently we talk about ourselves (ugh, boring). Well, I’m allowing myself to break that rule briefly so I can thank the people who have made our blog what it is today.

  • Our in-house team (Stanton, Mike, Jenny and Peter) for their tireless efforts and talented writing about everything from mobile apps to social media to software testing to crowdsourcing trends.
  • Our guest bloggers from the uTest community who have written passionately about everything from mobile testing to QA in agile environments to the evolving roles of testers.
  • Our Testing The Limits guests (including James Whittaker, Matt Heusser, James Bach, Michael Bolton and Jon Bach) who have not only tolerated our wide range of questions — from the insightful to the inane — but joined in with good humor, wit, eloquence and intellect.

I’ll end this little Oscar speech before the orchestra starts playing me off stage. Suffice it to say, we love writing for you; we’ll keep scouring every corner of the world (virtual and physical) for fresh topics and angles about anything related to software; and we’ll keep reminding ourselves why we’ve had this success: we write stuff that you seem to enjoy reading. We now return you to your regularly scheduled programming.

Testing the Limits With Jon Bach – Part II

In part II of our interview with Jon Bach, we get his thoughts on testing metrics; common tester stereotypes; the merit of certifications; the testing blogosphere; inventing Twitter in 1986, as well some rapid fire Q&A. We think you’ll like it. By the way, did you miss part I of the interview?

uTest: You have some great tips on how to handle bloated testing numbers and statistics: “Any number, any statistic is like software. It can be tested.” What other tips can you give testers when it comes to having the courage, diplomacy and patience to slow things down and get to the truth?

JB:  For me, the magic words that often make me feel more courageous, diplomatic and patient are: “I have been fooled before.”

No one will argue with that because it’s true.  Scammers often confess that the hardest person to fool is somebody who says “I can be fooled.”  So many times I’ve been so sure I was right just to meet someone who convinced me differently, sometimes in a matter of seconds.  So now say “I could be wrong”, and use other safety language like: “it could be”, “it seems like”, “it looks as if” and “maybe…”  That way, I don’t feel stupid when I’m shown refuting evidence to my claim.  If you practice that, chances are good that you will appear to be a kung fu master who, after having floored your 50th assailant with your skills, slowly backs out of the room on guard for the 51st.

Remember that testing is a craft.  It involves thinking about how things might be different.  Remembering to say “I have been fooled before” is consistent with that spirit.

uTest:  Testing certs: worthwhile or window dressing?

JB:  The only thing worthwhile about them is the debate they provoke.  Window dressing is an apt metaphor because it’s only meant to enhance a window’s *appearance*.  When there’s a flood or a storm or some other strong test of the window, the dressing often gets destroyed. Outside of the flood, people may prefer the look of the dressing; I just want to be a stronger window.  Passing multiple choice tests about so-called “best practices” don’t do that for me.

Read more…

On Tour With Michael Bolton

When we published our Michael Bolton interviews earlier this week, we forgot to mention that he’ll be speaking at a bunch of  testing events/seminars in the months ahead. So if you’re in these areas and want to see Michael speak in person (as opposed to Youtube) you owe it yourself to attend.

That said, here are a few upcoming testing events:

  • “Why is Testing Taking So Long?” – Michael will be giving an interactive talk on this topic at the Markham meeting for TASSQ, the Toronto Association of System and Software Quality, on Wednesday, February 10, 2010.
  • The Conference on Free Testing Tools: Michael will be giving a three-day public offering of his Rapid Software Testing course, and will deliver the keynote talk. The event will be sponsored by the Norwegian Computer Society, and will be held in Trondheim, Norway, March 22-26, 2010.

Read more…

A Dissenting Opinion On Testing’s “To Cert Or Not To Cert” Debate

Earlier this week, we published our three-part interview with Michael Bolton.  This was the latest installment in our monthly Testing The Limits series, in which we sit down with luminaries from the worlds of testing, development, crowdsourcing or startup life.  As part of this discussion, we asked Michael for his take on the issue of testing certifications (as we’ve done with Matt Heusser and James Bach in previous months).

In response to what she felt was “cert-bashing,” Charity Stoner of ProtoTest has written a post defending test certifications.  Since we always encourage civil discourse and open-minded debate — and since the purpose of  the Testing The Limits series is to offer up different perspectives from around the world of software — I wanted to shine a light on this post.

What do you think about test certifications?  Do they provide testers with a toolkit that complements their experience and adds real value?  Are they a marketing mechanism that limits what it means to be a professional software tester?  Or is it somewhere in the middle?  I’d love to hear your thoughts.

    • Page 1 of 2
    • 1
    • 2
    • >