How to Do AI Evals Step-by-Step with Real Production Data | Tutorial by Hamel Husain and Shreya Shankar

How to Do AI Evals Step-by-Step with Real Production Data | Tutorial by Hamel Husain and Shreya Shankar

Published: January 15, 2026

Duration: 1:05:44

Today’s Episode

Everyone’s demoing AI features. Few are shipping them to production reliably.

The gap? Evals.

Not the theoretical kind. The real-world kind that catches bugs before users do.

Hamel Husain and Shreya Shankar train people at OpenAI, Anthropic, Google, and Meta on how to build AI products that actually work. Their Maven course is the top-grossing course on the platform.

Today, they’re walking you through their complete eval process.

----

Brought to you by:

* The AI Evals Course for PMs...