This is a great FAQ focussed on the rapidly evolving field of LLM/Agent Evals. The content is curated from questions Hamel Husain and Shreya Shankar have received running their course, “AI Evals for Engineers & PMs”. Their next live cohort starts on July 21st.

I continue to believe that a robust and deliberate foundation for Evals is the single most important component of a production-ready AI Agentic workflow.

Frequently Asked Questions (And Answers) About AI Evals