Book review: How we test software at Microsoft

By David M Williams
Monday, 11 May 2009 04:48

Entertainment

How many testers work at Microsoft? About half! Ok, joking aside, the real answer is surprisingly similar, according to this engrossing tome "How we test software at Microsoft" from Microsoft Press.

Microsoft hires a vast amount of programmers, known by the title SDE – or Software Development Engineer. You’d expect this, they’re a vast software empire.

Yet, what may not be so well known is that the company also hires about an equal number of SDET’s – or, Software Development Engineer in Test, now numbering at 9,000 people.

These SDETs have a specific “tester DNA” that the company looks for. They come with the same experience and education in computer science but are wired differently; they are motivated to use their skills to find and quash bugs, to put software through its paces and to help ensure a better product over all.

This book is all about how they go about it and the methods used to rig up realistic testing scenarios. There are techniques you’d expect, like boundary value analysis but also a remarkable amount of scientific and statistical experiments with terms like Halstead metrics and Bayesian graphical modelling.

The chapters are broadly divided into four categories. One is about Microsoft and the history of the test engineers, one about testing in general, and one about solving tomorrow’s problems today and how Microsoft aim to take testing into the future. Approximately one half the book is devoted to the final category, test tools and systems.

It is here that the real meat about just “how” Microsoft test software is shown, covering bugs and test cases, automation, non-functional testing, customer feedback and other tools. An interesting chapter also goes into detail about the different challenges of testing services, as the Software as a Service (SaaS) paradigm takes greater hold.

All in all, this is an impressive work with a great deal of wisdom and principles – underpinned by sound theory – that would be of interest to any company that produces software of reasonable complexity.

The ISBN number is 0-7356-2425-9, with a recommended retail price of $USD 44.99 or $AUD 85.00. You can find it at Microsoft Press (with an Amazon.com price match guarantee.)