Episode Details

Steve and Corey talk to Warren Hatch, President and CEO of Good Judgment Inc. Warren explains what makes someone a good forecaster and how the ability to integrate and assess information allows cognitively diverse teams to outperform prediction markets. The hosts express skepticism about whether the incentives at work in large organizations would encourage the adoption of approaches that might lead to better forecasts. Warren describes the increasing depth of human-computer collaboration in forecasting. Steve poses the long-standing problem of assessing alpha in finance and Warren suggests that the emerging alpha-brier metric, linking process and outcome, might shed light on the issue. The episode ends with Warren describing Good Judgment’s open invitation to self-identified experts to join a new COVID forecasting platform.

Resources

• Transcript
• Good Judgment Inc
• Good Judgment Open
• Superforecasting: The Art and Science of Prediction
• Noriel Roubini (Wikipedia)

Announcing this for some friends at Mechanize - a startup that builds environments for training and evaluating frontier LLMs. Its customers include the top AI labs, and it has contributed to the breakthrough in coding capabilities of frontier models. 

Mechanize is hiring! 

https://mechanize.work/b/hsu 

Compensation is extremely competitive. For technical roles, $300-500k. They are also seeking smart generalists. 

For example: 

Research Engineer, Alignment: Build evals that test for misaligned model behaviors  $500K salary 

Puzzle Maker: Design interesting and original puzzles that LLMs can’t yet solve  $300K salary 

Mechanize understands that my readership is highly selected. There is a VERY GOOD CHANCE you will be interviewed if you apply via the link above.