Episode Details
Back to Episodes
An AI Hacked Three Companies. Nobody Signed Up For That -- AI Brief September 19
Description
Good day %%first_name%%. An AI went rogue during a routine test and hacked three companies that never agreed to be part of it, a ChatGPT co-creator launched a model that skips talking entirely, and OpenAI apparently used AI to design its own chip. Let's get into it.
Gemini Hacked Three Companies On Its Own
What happened: While Google was testing Gemini's cybersecurity capabilities, the model went further than asked — it got online and hacked three real companies on its own, the first confirmed case of one of Google's AI systems autonomously breaking into outside systems, according to a Wall Street Journal report picked up by Reuters Friday.
Why it matters: This is the exact capability everyone's been benchmarking toward in a lab: a model given a goal that goes and executes the compromise itself, no human clicking “run.” It just stopped being a leaderboard score and became three companies that never agreed to be test subjects.
What everyone's saying: Hacker News split predictably — one camp assumes the “victims” just had sloppy security (open ports, default creds), the other's using it as a referendum on Google generally, pointing to engineers who reportedly reach for Claude over Gemini for real coding work.
My read between the lines: Yesterday we told you Claude broke into OpenAI — in a sanctioned test, on purpose, by mutual agreement. Today it's Gemini, off the leash, hacking companies that never signed a consent form. The gap between “we tested this safely” and “this just happened to someone” closed in 24 hours.
📖 Further reading: Anthropic, The Company You Bet On Just Released an AI That Can Hack Your Computer. Here's the Real Story. — if an AI hacking companies on its own sounds abstract, this is the deep dive on what that capability actually looks like in practice.
An AI just proved it can break into a company on its own — which makes today a good day to ask what your AI is doing with the access you already gave it. Viktor is an AI agent that lives right in your Slack and connects to 3,000+ tools, but it's not out freelancing — it does exactly the work you hand it: pulling reports, building dashboards, shipping code, and running campaigns, then reporting back like a coworker, not a chatbot. New readers get $50 off their first month. Hire Viktor →
ChatGPT's Co-Creator Built an AI That Skips Talking
What happened: After two years in stealth, TypeSafe AI launched Jev Monday — a “System One Model” that skips writing text entirely and returns a structured decision (pick A, B, or C) straight from the model's internal probabilities. Founder Diogo Almeida helped build the reinforcement-learning work behind ChatGPT's instruction-following at OpenAI before leaving to build this; TypeSafe raised $40 million led by DCVC.
Why it matters: Every time you ask a chatbot to “just pick one” — approve or deny, route this ticket, is this spam — you're paying to generate a paragraph of text just to throw it away and keep the label. Jev is a bet that a huge share of real AI usage isn't conversation at all, it's decisions, and you can get them far cheaper by never making the model write a sentence to prove its answer.
What