Accessibility

Accessibility testing without real users is not enough

Accessibility testing only tells part of the story when it stops at tools and audits. The real gaps appear when people try to use the product in practice.

Why automated checks and formal validation are useful but incomplete, and why real user testing is what shows whether an accessible product is actually usable.

15 November 20236 min read

In short

Why automated checks and formal validation are useful but incomplete, and why real user testing is what shows whether an accessible product is actually usable.

Why formal testing can create false confidence

Testing tools can only tell you what is detectable. What they can't reveal is whether an experience that technically works is actually easy to use. And that's where the gap sits.

Automated testing can confirm that something works. It cannot tell you whether it is easy to use.

Why technically sound products can still create friction

You can have a product that performs well in automated tests and still creates significant for real users. Journeys can technically work but require unnecessary effort. Content can be accessible but difficult to understand in . can be valid but unintuitive when used differently than originally intended. Nothing is technically wrong, but something is clearly not working. That only becomes visible when real people start using it.

Key takeaway

Automated and audit-based testing is essential for baseline quality, but it cannot reveal how effort, confusion, or hesitation show up in real use.

Why real usage reveals what testing tools cannot

Users who rely on assistive technology don't interact with products the same way as those designing or building them. users navigate differently. Keyboard-only users move through content in a different rhythm. Voice control introduces another layer of entirely. These aren't . They're real usage patterns. And they expose issues that tools cannot.

A might be able to access every element on a page, but the order in which those elements are read can make the journey confusing. A form might be fully operable via keyboard but require too many steps to complete efficiently. might technically work but lack the needed to make decisions quickly. From a compliance perspective, everything passes. From a user perspective, the experience breaks down.

Why accessibility testing needs to happen earlier

Teams often underestimate how early this kind of testing should happen. It's frequently left until later stages — once the product is more complete — under the assumption that it's something to validate rather than something to shape the design. By then, become harder to act on. Changes require more effort, timelines are tighter, and there's less flexibility to rethink core decisions.

When real user testing is brought in earlier, it becomes part of how decisions are made, not just how they are checked. Assumptions are challenged sooner. are refined before they are scaled. Journeys are shaped based on actual rather than being adjusted after the fact.

Automated tools and audits still have a place. They provide , speed, and coverage that would be difficult to achieve otherwise. But they shouldn't be the only source of truth. Without real user input, you're only seeing part of the picture. isn't proven by passing tests. It's proven by people being able to use the product without unnecessary effort.

Written by Andy Scott

Strategic design, UX and digital transformation thinking from real projects.

LET'S WORK TOGETHER

Ready to improve your product?

UX, research and product leadership for teams tackling complex digital services. The work usually starts where things have become harder than they need to be: unclear journeys, inconsistent products, competing priorities, or teams trying to move forward without a clear direction. I help simplify the problem, shape the right next step, and turn complexity into something people can actually use.

Previous feedback

Will Parkhouse

Senior Content Designer

01/20