Menu

Research

The biggest mistake teams make when running user interviews

The biggest mistake in user interviews is not asking the wrong question. It's accepting the first answer and moving on.

Why interviews often stay too close to the surface, and why the real insight usually appears only when you stay with an answer for longer than planned.

20 January 20254 min read

In short

Why interviews often stay too close to the surface, and why the real insight usually appears only when you stay with an answer for longer than planned.

Why the first answer is rarely the real answer

The biggest mistake teams make in isn't asking the wrong questions. It's accepting the first answer they get. Most users will give you an answer quickly. They'll tell you what they think, what they expect, what they usually do. It often sounds reasonable enough to move on. The keeps flowing, the script keeps moving, and you cover everything you planned to cover. It feels productive. But the first answer is rarely where the is.

There is a social reason for it as well as a procedural one. Participants want to be helpful and are aware they are taking up your time, so they produce a tidy answer quickly. Sitting in the pause after it, without filling the silence, is what gives them room to produce a truer one.

Every question can be answered and you can still fail to understand what is actually going on.

What happens when you stay with the response

I remember a where a user was going through a fairly standard journey and described part of it as fine. No hesitation, no visible frustration, nothing that would flag it as an issue if you were taking the answer at face value. It would have been very easy to move on. But we didn't. We stayed there a bit longer. Asked them to walk through what they were thinking, why they chose that option, what they expected to happen next. What came out wasn't fine at all. They didn't fully understand what they were doing. They weren't confident in the decision they'd just made. They were moving forward because it seemed like the only available option, not because it felt right. That's a completely different picture. And it only surfaced because we didn't accept the first answer.

Fine is worth treating as a rather than a verdict. So are it's alright, it makes sense, and I suppose so. All of them are answers people give when nothing is obviously wrong and something has still not landed, and each is an invitation to ask what they were expecting instead.

Key takeaway

The first answer is often the cleanest answer, not the most revealing one.

How this shows up in complex systems

Working across NHS journeys, users would often describe experiences in very general terms: it's a bit confusing, there's a lot going on, it's not very clear. Useful , but not particularly actionable on their own. If you stop there, you end up with vague problems and equally vague solutions. But when you start digging (asking them to show you where the confusion comes from, what they expected instead, what they were trying to achieve in that moment), things start to sharpen. You move from this is confusing to this specific part breaks because the structure doesn't match how users think. That's where decisions can actually be made.

The move that unlocks it is usually asking somebody to show rather than tell. General descriptions stay general no matter how many follow-ups you ask. Watching the same person attempt the thing they just called confusing puts the problem in a specific place, on a specific screen, at a specific moment.

Why interview guides work against depth

Most interview guides are designed to cover ground. There's a natural pressure to keep moving, to get through everything, to make the most of the time you have. And that pressure works against depth. In my experience, the most valuable interviews are rarely the ones where you cover everything. They're the ones where you follow something unexpected and stay with it longer than planned. Where you notice a small hesitation and choose to explore it. Where an answer doesn't quite add up and you gently push on it. That's where the real tends to sit: when the person running the is comfortable going off-script and sitting in the uncomfortable space of not immediately knowing where a conversation will . Because that's where users stop giving rehearsed answers and start revealing how they actually think.

The practical fix is to plan for fewer questions than the time allows. A guide with six areas and forty minutes creates room to follow something; the same forty minutes with twelve areas guarantees that anything unexpected gets cut short in order to finish.

It helps to agree in advance that finishing the guide is not the objective. Without that, a moderator who abandons half the script to pursue something interesting looks like they lost control of the , rather than like they did the job properly.

Written by Andy Scott

Strategic design, UX and digital transformation thinking from real projects.

LET'S WORK TOGETHER

Ready to improve your product?

UX, research and product leadership for teams tackling complex digital services.

Previous feedback

I had a fantastic experience working with Andy. One of his most impressive achievements during our time at NHS HEE was masterminding a deeply complex information architecture for a new platform that brought together a large number of legacy websites.

Will Parkhouse

Senior Content Designer