Episode Details

What happens when the Oxide API is slow? A podcast episode! More specifically, one about how the team employed all manner of debugging techniques to track it down to one obscure and configurable async runtime feature! Bryan and Adam were joined by members of the team to talk about that journey and the tools we used (and made!) along the way.

In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Dave Pacheco, Eliza Weisman, and Augustus Mayo.

Previous episodes mentioned:

• Oxide and the Chamber of Mysteries
• The Saga of Sagas
• DTrace at 20
• Cultural Idiosyncrasies
• Mr. Nagle’s Wild Ride
• A Debugging Odyssey
• RTO or GTFO

Some of the topics we hit on, in the order that we hit them:

• Falling in Love with Rust
• Tokio Runtime Builder – disable_lifo_slot
• magic‑trace (GitHub)
• Magic Trace podcast episode from Jane Street
• diesel‑dtrace (GitHub)
• omicron issue comment
• qorb
• statemap
• tokio‑dtrace
• tokio issue #7411
• Visualizing Systems with Statemaps
• PostgreSQL WAL INIT ZERO
• Statemaps: Visualizing System Behavior (YouTube)

The statemaps that we referred to:

• Nexus by thread, discussed starting at 55:29. (This statemap has some states coalesced; the full version is also available.)
• Nexus by Tokio task, tagged by thread, discussed starting at 1:15:33

The D scripts that we referred to:

• nexus-statemap.d used to generate the initial statemap
• nexus-profile.d to understand what