Episode Details

Microsoft Research’s Jennifer Neville discusses real-workflow AI evaluation; AWS brings SageMaker HyperPod Spaces into SageMaker Studio; and SpaceX is reportedly seeking financing for Nvidia chips in a round led by Apollo Global Management. Also covered: ScienceClaw-Eval, Anthropic’s Claude access for cyberdefenders, OpenAI and Ironclad’s contracting-workflow collaboration, Musubi’s PolicyLM-1.7B, and Common Sense Media’s assessment of ChatGPT for Teens.

• Jennifer Neville on evaluating AI across multi-turn, collaborative, and longer real-world tasks.
• AWS adds a SageMaker Studio interface for managing HyperPod Spaces.
• SpaceX reportedly seeks to raise $40 billion to buy Nvidia chips; the financing is not complete.
• ScienceClaw-Eval proposes tests for lasting improvements in scientific-agent workflows.
• Anthropic expands defensive access to advanced Claude models.
• OpenAI and Ironclad train and evaluate agents on contracting workflows.
• Musubi releases an open-weight model intended for real-time moderation.
• Common Sense Media criticizes ChatGPT for Teens’ protections.

Sources:
- Microsoft Research: https://www.microsoft.com/en-us/research/podcast/what-ai-gets-wrong-and-what-failure-teaches-us/
- AWS: https://aws.amazon.com/blogs/machine-learning/manage-amazon-sagemaker-hyperpod-spaces-directly-from-sagemaker-studio/
- The Information, citing the Financial Times: https://www.theinformation.com/briefings/spacex-seeks-raise-40-billion-apollo-buy-nvidia-chips
- ScienceClaw paper: https://arxiv.org/abs/2610.08691v1
- The Information on Anthropic: https://www.theinformation.com/briefings/anthropic-expands-cyberdefenders-access-top-models
- OpenAI: https://openai.com/index/advancing-computer-use-with-ironclad
- TechCrunch on Musubi: https://techcrunch.com/2026/10/06/how-ai-decision-models-could-change-content-moderation/
- The Verge on ChatGPT for Teens: https://www.theverge.com/ai-artificial-intelligence/1006355/openai-chatgpt-for-teens-common-sense-media