Episode Details

Would you like access to our advanced agency training for FREE? https://www.agencymastery360.com/training

Are you feeding your data into AI and assuming the insights it gives you are accurate? What if those confident-sounding answers are quietly steering you in the wrong direction?

More agency owners are turning to AI to analyze and interpret performance data, and for good reason. Used correctly, it can save massive amounts of time and move teams beyond using AI to crank out blog posts, ads, or emails faster. But when it comes to attribution, performance analysis, and real decision-making, AI has a dangerous flaw: it's often wrong with absolute confidence.

Today's featured guest understands where most agencies go wrong with AI-driven data analysis. He'll break down why large language models frequently misinterpret marketing data, how flawed inputs and assumptions lead to misleading insights, and what it actually takes to get reliable answers from AI without burning budget or making bad strategic calls.

Scott Desgrosseilliers is the founder and CEO of Wicked Reports, a marketing attribution platform built specifically for e-commerce brands doing between $5M and $50M in annual revenue. Scott has spent years deep in attribution, analytics, and now AI, figuring out how to separate real signal from noise in an ecosystem where every platform claims the win.

He'll talk about how most platforms may be misleading you and the framework he uses to bring sanity back to attribution for serious e-commerce brands.

In this episode, we'll discuss:

• Why AI is sounds smart but gets marketing attribution wrong.

• Injecting intention into AI.

• The Five Forces framework to improve your AI data.

Apple | Spotify | iHeart Radio

E2M Solutions: Today's episode of the Smart Agency Masterclass is sponsored by E2M Solutions, a web design, and development agency that has provided white-label services for the past 10 years to agencies all over the world. Check out e2msolutions.com/smartagency and get 10% off for the first three months of service.

One of the biggest myths around AI is that it's inherently "smart." Scott shared that it took eight months for Wicked Reports to release their AI analyst, not because the tech wasn't powerful, but because it was too confident while being wrong.

AI models are designed to sound affirmative. Ask them a bad question, and they'll still give you a polished answer. If you ask ChatGPT if you should jump off a bridge, it'll say, "Yes, that's a great idea," unless you explicitly train it to be critical. That's a massive problem when you're dealing with revenue attribution and ad spend decisions.

Another major issue is that AI lacks native understanding of time, which is foundational to attribution. Clicks, impressions, tags, and conversions happen in sequence over days or weeks. Without heavy rules, coaching, and sanity checks layered in, AI can't natu