Your customers are lying to you (and they don't even know it)
Jacob Dutton
1 May 2025

The Customer Reality Test is a powerful way to uncover what customers actually do, not what they say they do.
The idea is simple: what people tell you in interviews and surveys often bears little resemblance to how they behave in real life.
What's a Customer Reality test?
It's systematic observation of real customers in their natural environment as they interact with products and services in their daily lives.
No artificial settings. No hypothetical questions. Just quiet, methodical observation of actual behaviour in the real world.
Most teams rely on what customers tell them. But watching what they actually do reveals an entirely different story.
How a retailer completely reframed their omnichannel strategy
A major UK retailer we work with was planning to invest £25M in their omnichannel shopping experience. Based on extensive customer surveys and focus groups, they'd developed a strategy centered around a "seamless shopping journey" that would let customers start purchases on one device and finish on another, with features like cross-device baskets and sophisticated recommendation engines.
Before committing, they conducted a Customer Reality Test with our guidance. The team:
Shadowed 24 customers during actual shopping trips, both in-store and at home
Observed their complete shopping journey from initial interest to purchase
Documented how they used the website, app, and physical stores
Captured real-world contextual factors that influenced their shopping decisions
The reality didn't match what customers had told them at all:
Only 8% of customers actually shopped in the sequential, cross-device way their strategy assumed
Instead, 63% followed a "research online, then start fresh in-store" pattern, deliberately keeping digital and physical shopping separate
Customers weren't using their phones in-store to continue digital journeys; they were using them to consult with friends and family via messaging apps and photos
The highest friction point wasn't moving between channels. it was confirming whether specific products were actually available in their local store
The company completely reoriented their strategy around these insights:
They scrapped the expensive cross-device basket synchronisation system
Instead, they created a simplified "check local stock" feature prominent on every product page
They built new in-store displays designed to address the specific questions customers typically researched online
They developed a "share with friends" feature that worked with popular messaging platforms
The revised approach cost £9M instead of £25M and delivered a 34% improvement in conversion rate between online research and in-store purchases. Most importantly, it solved problems customers actually had rather than problems the company thought they had.
Without watching real shopping behaviour, they would have invested millions in solving a problem that barely existed while missing the actual friction points in their customer experience.
How to run a Customer Reality Test
To run this test, you'll need:
Access to real customers in their natural environment
Permission to observe them (obviously important!)
A structured observation framework
Team members trained to observe without interfering
1. Define what you're looking for
Be clear about what you want to learn. Are you observing how customers:
Complete specific tasks?
Interact with existing products?
Handle particular situations or problems?
Make decisions in certain contexts?
2. Recruit the right participants
Find customers who represent your segment and who are willing to be observed naturally. Be transparent about your purpose, but avoid explaining exactly what you're looking for.
3. Create an observation protocol
Develop a consistent structure for notes that captures:
Context (time, location, situation)
Activities (what they're doing)
Pain points (frustrations, workarounds, inefficiencies)
Unmet needs (what they want but can't currently do)
4. Observe without interfering
The key to a good Customer Reality Test is becoming invisible. Don't ask questions during observation. Don't suggest solutions. Just watch and document.
5. Look for patterns across observations
The most valuable insights come from seeing recurring behaviours across multiple customers:
Common workarounds
Shared frustrations
Unexpected use cases
Environmental factors you hadn't considered
Common mistakes to avoid:
Asking questions during observation (this changes behaviour)
Only observing for short periods (you'll miss important context)
Jumping to solutions instead of deeply understanding problems
Focusing only on your product (observe the entire customer experience)
Try this next week
Identify a key customer segment for your product or service. Recruit 3-5 customers willing to be observed for several hours. Create a simple observation sheet to document what you see. Look for patterns that contradict what customers have told you in the past.
You'll likely discover your customers have been unintentionally misleading you about how they actually use your product.
More articles
Explore more insights from our team to deepen your understanding of digital strategy and web development best practices.