Episode Details

What’s up everyone, today we have the pleasure of sitting down with Dr. John Whalen, Cognitive Scientist, Author, and Founder at Brilliant Experience.

shTNmWsiInndTRwsf735

Summary: John has spent his career studying how people actually think, and his conclusion is uncomfortable for anyone who believes their marketing decisions are more rational than they are. In this episode, John explores how synthetic users built from cognitive science principles can fill the massive research gap that most teams quietly ignore, and why removing the human interviewer from the room might be the fastest way to finally hear the truth.

In this Episode…

• (00:00) - Intro
• (01:13) - In This Episode
• (04:31) - What Are Synthetic Users and Why Do They Matter?
• (10:00) - How Synthetic Users Make Stakeholders Hungry for Real Human Research
• (15:56) - Pre-Testing on Synthetic Users: Shortcut or Smart Step?
• (18:53) - How to Actually Build a Synthetic User: Tools, Layers, and Agentic Systems
• (40:51) - Is the Average Persona Dead? Scale, Diversity, and the World Model
• (43:01) - Asking the Uncomfortable Questions: What AI Agents Reveal That Humans Won't
• (49:30) - Ending the Quant vs. Qual Debate with Statistically Relevant Qualitative Data
• (56:37) - Mining the 'Why' Behind Silent Behavioral Data with Synthetic Users
• (01:02:31) - Designing for Agent Users: The Coming Shift to Human-and-Machine-Centered Design
• (01:05:28) - The Happiness Question: Dogs, Nature, and Staying Analog

About John
Dr. John Whalen is a Cognitive Scientist, Author, and Founder of Brilliant Experience, where he applies cognitive science principles to help organizations design products and experiences that align with how people actually think and make decisions. He’s also an educator, teaching two AI customer research courses on Maven.

His work explores the intersection of human psychology and marketing, including the emerging practice of pre-testing ideas on synthetic users to give brands a faster and more informed competitive edge. He is also the author of a book on the science of designing for the human mind, bringing academic rigor to practical business challenges.

How Synthetic User Research Works and When to Trust It
Synthetic user research sounds like something creepy out of a dystopian science fiction film, and John is the first to admit the terminology does nobody any favors. When asked about what synthetic users actually are and what they mean for research, he admited: if he had been on the branding team, he would have pushed hard for something like “dynamic personas” instead. The name creates unnecessary friction before the conversation even starts. And that friction matters when you’re trying to get skeptical executives or methiculous researchers to take the whole thing seriously.

Under the hood, specialized AI tools simulate how a defined audience segment would respond to a question, concept, or stimulus, without recruiting, scheduling, incentivizing, or waiting on real human participants. John runs a class where he collects genuine human data first, then feeds comparable inputs into these tools to benchmark accuracy head-to-head. The results are pretty wild. AI-generated responses align with real human findings somewhere between 85% and 100% of the time on major topics and consumer needs. That is not a peer-reviewed clinical trial, and John is not pretending otherwise. But 85% alignment is enough signal to stop reflexively dismissing the method and start asking harder, more specific questions about exactly where it fits into a research stack.

So what does this mean for you and your company though? Think all the decisions that currently live in a black hole of zero structured input. How many product calls, campaign concepts, and messaging pivots ha