Practical Usability: Beyond User Testing

What did you want to be when you grew up? Astronaut? Teacher?Football star? Diva on Top of the Pops?

Me – I wanted to be Alfred, the butler from Batman (but Isuppose that’s mainly something between me and a futurepsychiatrist). No matter, the point here is that you could ask athousand kids, and I bet not one would say they wanted to be a‘usability professional’. Most probably, they wouldn’t know whatone is. In fact, most of my friends and family don’t know what Ido, even after a dozen painful explanations.

Those of you reading this article on NMK at least are likely toknow what usability is, and since you had the good sense to openthis article, you may even have secret aspirations to make yourproducts easier to use.
But even a knowledgeable audience may not know that there is alot more to usability than user testing. That’s what thisarticle is about. It will tell you about a variety of ways youcan ask your own users to help improve your products, whilestill respecting the judgement of your design team.

User testing is a great place to start

Let’s start with the technique you probably already know. Auser test is a brilliant research technique to evaluatewhat users like about your product, and what drives them mad. Itcan be run in a number of ways, but most often involves bringingfive to twelve typical users into a lab with recording andone-way glass facilities. The user conducts normal tasks whilethinking aloud, and the observers behind the one-way glass seefor themselves the effects of using 9-point pink text on a redbackground.

Typically it takes a day or two to plan, and another day or twoto run. You can hire professionals like us to run it for you, orif cash is tight, you can do it yourself. (We offer superbcourses to teach the skills you’ll need, or you can learn aboutit from books.)

What makes the technique so effective is that even though thenumber of users you see is small, you will have a strong senseof the main issues even after the first two or three users, andby the tenth user you may actually start getting bored. It’sgood value for money.

Academics say that usability testing is all about uncoveringusability problems, and it is very good at that indeed. But wethink it is about much more. After working with dozens of thebiggest names in the industry, I have seen that user tests havea number of surprising beneficial side effects:

  • They bring teams together. Even the most argumentative teams are likely to develop a common vision after seeing a dozen users stumble over the same bits.
  • They energise projects. There’s nothing like seeing real users getting excited about a new product to let a team know they are working on a winner.
  • They teach you about your users’ desires and needs. It can be liberating to know what it is your users actually want, so you can focus efforts on meeting real needs rather than wasting time.
  • They answer specific design questions. In the office, a design team can end up in bitter disagreements about whether a button should be black or green, or text should be 10-point or 11-point. Usability tests allow you to make decisions based on real data, not just on guesswork.
  • They help you understand local audiences. If you are localising a product, user testing allows you to see that it works with different kinds of users.
  • They help teams meet early milestones. A user test requires all the components of a project to work together well enough (even if not perfectly) so a user can work through them. The user test will focus the team so all the components are ready by a specified date.

…but there are many more choices

So that’s usability tests. What other options are there? Forthat matter, why do there need to be other usability researchtechniques.

Here’s the thing. User tests give brilliant data, but they oftencome too late to address big problems. By the time you have aprototype complete enough to include in a user test, you willhave spent tens of thousands of pounds on development costs,your marketing team will have a launch date and a sales approachalready in mind, and everyone will have become so invested intheir ideas that they may find it difficult to let themgo.

Over the years, good researchers have developed quick andaffordable techniques that work at various times throughout thedevelopment cycle, usually to validate and inform decisions justbefore the cost and risk levels are ready to go up.

Some examples:

  • As soon as the idea surfaces. Most projects start with a Big Idea. You can use quick field-based techniques to validate your vision before a single hour of design work is wasted. Once, when working for a major publisher who was developing software for farmers, we determined that their target market was less interested in tracking livestock than in tracking subsidies. Big change, big savings.
  • Once the first messy drawings are available. If you already have your Big Idea in hand and you’re starting to work on the overall architecture of your system’s interface, you can validate and refine your ideas with nothing more than rough drawings using a technique called group collaborative design. In a day or two you can iterate the design half a dozen times, and you’ll then have a validated design you can hand to your designers and coders, secure in the knowledge that the fundamental design is sound.
  • When you get worried about your competitor. If you work in a competitive marketplace, you may be familiar with the sinking sensation you have whenever your competitor issues a new release and you get your first look to see they’ve just added the feature you’ve been thinking about for ages but had been told was too difficult to implement. Competitive user testing helps you evaluate your competitors’ specific features or general approach so you can determine which features are genuinely appreciated by users, and where their weak points are.

There are plenty of other techniques too – ways of getting usersto develop or validate complex information architecture, ways tocombine the strengths of a focus group with the insight of auser test, ways to gather feedback over the web or the phone,and ways to assess a system even when there are no users yet.

Three rules

As you think about ways to make your products more usable,consider these three rules:

  • Qualitative and cheap is usually better than quantitative and expensive. There may be a temptation to involve 50 or 100 or 150 users in and run a study like a first-year Psychology experiment, and it’s great if you have the time and budget to do that. But you can often get data just as useful – sometimes even more so – from a small group if you use the right techniques. Quantitative techniques are slow and expensive, and often only tell you that a phenomenon exists; in contrast, qualitative techniques like the ones discussed above are often quick and cheap, and tell you why the phenomenon exists.
  • Early is better than late. The earlier you can get user feedback, the more cost effective it will be. If you can learn about a major problem before coding begins, you’ll save more money than if you discover the same problem just before you ship.
  • Something is better than nothing. The most important lesson is that it’s always better to get some user feedback than none at all. If you’re not doing anything user-centred at all yet, don’t be intimidated into thinking you need a large, complex project run by professionals. You can learn to do many of these techniques on your own. You’ll be amazed at how large an effect you can have on your organisation with even a one-day study run in your own conference rooms.

About the author. Andrew is a PrincipalConsultant at Serco Usability Services, running commercialresearch projects and overseeing relations with governmentclients. He has a particular interest in the effects of hightechnology on society and democracy. In addition, Andrew managesthe group’s commercial research and development activities.Andrew serves as a key instructor for usability and designcourses offered by Serco, and information on his next course canbe found here.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s