Podcast Episodes
Back to SearchEP480: Durable Agent Workflows - Orchestrate Long-Running AI Actions Safely
Design durable agent workflows and saga-style orchestration: persist plans and evidence, coordinate long-running steps, fence stale workers, reconcil…
3 weeks, 3 days ago
EP150: AI API Prompt Optimization — Reduce Tokens Without Losing Quality
A practical guide to optimizing AI API prompts: remove waste, preserve critical instructions, control context growth, measure quality, and reduce tok…
3 weeks, 3 days ago
EP479: Safe Tool Execution at the AI Gateway - Turn Model Plans into Controlled Actions
Design safe tool execution at the AI gateway: declare versioned capabilities, validate and normalize arguments, recheck authorization, require precis…
3 weeks, 3 days ago
EP478: Streaming as a First-Class AI Gateway Protocol - Make Every Event Count
Design streaming as a first-class AI gateway protocol: define typed events, enforce ordering, manage backpressure, reconcile usage, propagate cancell…
3 weeks, 4 days ago
EP477: Deadline-Aware Admission Control - Keeping AI Gateways Reliable Under Load
Design deadline-aware admission control for AI gateways: reserve multidimensional capacity, protect in-flight work, queue fairly, shed load early, pr…
3 weeks, 4 days ago
EP476: Provider Contracts and Capability Negotiation - Route by What Endpoints Can Actually Do
Design machine-checkable provider contracts for AI gateways: version capabilities, calculate real request envelopes, negotiate tools and streaming, d…
3 weeks, 4 days ago
EP475: Policy Distribution and Regional Consistency - Keep Every Gateway on the Same Rules
Design policy distribution for multi-region AI gateways: publish signed immutable bundles, control activation and staleness, prevent split-brain deci…
3 weeks, 4 days ago
EP474: Multi-Region and Data-Residency-Aware Routing - Place Every Decision Carefully
Design multi-region and data-residency-aware routing for AI gateways: place inference, quotas, telemetry, failover, tools, and reconciliation across …
3 weeks, 4 days ago
EP473: Privacy-Aware Observability for AI API Gateways - Measure Without Exposing
Design privacy-aware observability for AI gateways: measure latency, quality, cost, fairness, and policy outcomes while minimizing prompt exposure an…
3 weeks, 4 days ago
EP472: AI API Gateway Operation Lifecycles - From Intent to Reconciliation
Design an end-to-end AI gateway operation ledger that preserves idempotency, reservations, routing decisions, provider attempts, streaming state, too…
3 weeks, 4 days ago