Episode Details

Send us Fan Mail

📬 You like this podcast? You’ll love the newsletter.
Join the weekly The Visibility Report: subscribe

In this Found in AI news update, Cassie Clark breaks down Peec AI’s research into OpenAI’s Labrador retrieval index, including the separate indexes identified for web content, news, shopping, YouTube, PDFs, and more.

Then, we look at Common Crawl’s analysis of more than 584,000 llms.txt files and what it tells us about the confusion surrounding llms.txt, robots.txt, and AI crawler access.

Finally, Microsoft is preparing businesses for a future where AI agents don’t just help consumers discover products — they help choose and buy them. Microsoft’s latest agentic commerce guidance shows why structured, accurate, and current product data could become critical as AI moves from answering questions to taking action.

In this episode:

• What Peec AI discovered about ChatGPT’s Labrador search index
• Why ranking in Bing isn’t a proxy for ChatGPT visibility
• How freshness appears within ChatGPT’s retrieval infrastructure
• OpenAI’s experiments with its own shopping index
• What Common Crawl learned from 584,107 llms.txt files
• The difference between llms.txt and robots.txt
• Why llms.txt does not control AI crawler access
• Microsoft’s recommendations for preparing for agentic commerce
• Why structured product data matters when AI agents are shopping
• The difference between AI visibility and agent readiness
• Why businesses should prepare for AI discovery even while the technology continues to change

Sources

• Peec AI: “ChatGPT Built Its Own Search Index”
• Search Engine Journal: “Common Crawl Finds Widespread Confusion Around llms.txt & robots.txt”
• Microsoft Advertising: “How Businesses Win When AI Does the Shopping”

--

Cassie Clark is an AI search visibility consultant and a fractional content strategist for startups and enterprise brands. If that sounds like the kind of help you're looking for, email me at cassie@cassieclarkmarketing.com. 

Or request your AI Search Visibility Audit: https://cassieclarkmarketing.com/ai-search-visibility-audit/

Join Cassie Clark for a free live training, How to Build an AI Search Visibility Strategy, on November 5, 2026, at 1 PM ET.

Learn how to identify relevant AI search opportunities, diagnose visibility gaps, establish a measurement baseline, and prioritize your next steps. Includes live Q&A.

Register for free: https://cassieclarkmarketing.com/ai-search-training/