Episode Details

If an agent can solve your interview puzzle in seconds, what are you actually measuring?

This week an Anthropic engineering manager, Felix Rieseberg, wrote that he stopped using coding interviews for his team. Claude does them better than the candidates. He also says he has no replacement for the coding interviews yet.

It is one manager, not the whole company. But I'm sure we will see more and more cases.

The same problem is already on our desks. Agents write a growing share of our code. Tests, reviews and merged code show what shipped. They show much less about who understood it.

So here are three things I would want to see in a candidate:

• Can they explain a change they did not write?
• Can they spot the part of the output that is wrong?
• Can they say what they would check before merging?

Is that really feasible in a real interview? Maybe they are the wrong three. Which one would you find hardest to judge?

I go deeper on this in this week's episode of The Human in the Loop.

#TheHumanInTheLoop #TechHiring #CodingAgents