Stella and Amy
AI Evals and Analytics Podcast
Build trustworthy AI products through evaluation-driven development. Each episode covers practical evaluation strategies, industry trends, and best practices for building safe, reliable AI systems. From dataset generation and evals metrics design to cross-functional collaboration and post-launch analytics, we talk about how to build trustworthy and lasting AI products with a good AI evals and analytics framework. Subscribe for practical techniques, industry insights, and guest interviews on AI evaluation and analytics. More about AI Evals and Analytics -- https://ai-evals.org/ We (Stella & Amy...
N'hésitez pas à visiter le site du podcast et à soutenir son créateur : open.firstory.me
Où écouter ?
Les podcasts dans l'appli Replaio Radio Bientôt disponibleLes podcasts arrivent très bientôt dans l'appli. Installe-la dès maintenant et découvre en avant-première une toute nouvelle façon de vivre les podcasts
Installe-la gratuitement
Android près de 10 M de téléchargements · note de 4,8
iOS bientôt
Épisodes
From AI Evals to Business Impact 10.03.2026 9:20
Why do most AI teams only ask "is this actually working for the business?" after it's too late? When should you start connecting evals to business impact and how do you actually do it? Using the same medical insurance chatbot from the last episode, we show how to bridge the gap between model metrics and the outcomes your leadership actually cares about. We introduce the Eval-to-Impact Stack: a thr...
Build AI Evals from Scratch: When and How? 07.02.2026 17:48
What is Evaluation-driven development? When should you start building evals for your product? How to build it from scrach? Using a real-world example of a customer chatbot for a medical insurance company, we walk through the process of setting up evals from scratch: translating product requirements into quantifiable metrics, curating quality test datasets (hint: you need fewer examples than you th...
AI Evals Skills: Why Data Scientists Have a Natural Advantage 26.01.2026 22:10
What are the skills required for AI evals? Why data scientists have a natural advantage in AI evals? Evaluating AI isn’t just about "vibe coding" with an AI assistant. It actually requires a solid foundation in statistics for picking sample sizes and coding to build your own testing frameworks. Data scientists have a huge head start here because they are already pros at designing metrics and...
Podcasts similaires
Écoute le podcast AI Evals and Analytics Podcast sur Replaio
La radio et les podcasts dans une seule appli - gratuite, sans inscription. Installe-la dès aujourd'hui et ne rate pas le lancement
Replaio n'est pas éditeur de podcasts ; les noms des émissions, les visuels et l'audio appartiennent à leurs auteurs et sont diffusés via des flux RSS publics
