Episode Details
Back to Episodes
Tokens as an “Invisible Character Limit” — What I Learned Running Gemma 4 Locally
Description
A short reflection on running AI locally for the first time.
After installing Google’s Gemma 4 on a Mac, this episode explores what it means for AI to work offline. Even without internet access, it can answer questions and handle basic tasks, which feels surprisingly natural.
The key takeaway is about “tokens,” the unit AI uses to process text. Even when there’s no cost, there are still limits—especially when features like “thinking mode” use most of the capacity on internal reasoning before giving an answer.
It’s a simple realization: AI may feel free, but it still operates within constraints. And how you choose to use it—prioritizing speed or depth—depends on the situation.
A quiet look at how small technical details can change the way we think about using AI in everyday work.