Snorkel AI
Benchtalks
Benchtalks is Snorkel AI's podcast series at the intersection of AI evaluation, data quality, and real-world impact. Hosted by the Snorkel team, each episode brings together researchers, practitioners, and leaders to dig into the questions that matter most as AI benchmarks grow more sophisticated, dynamic, and reflective of the complexity found in real-world deployments. We explore the full stack of what it takes to build AI that actually works — from the design of rigorous, open benchmarks that close the gap between what we measure and what we encounter in production, to the expert-in-the-loo...
Určitě navštivte web podcastu a podpořte jeho tvůrce: www.buzzsprout.com
Kde poslouchat?
Podcasty v aplikaci Replaio Radio Už brzyPodcasty míří do aplikace už brzy. Nainstaluj si ji teď a jako první uvidíš úplně nový pohled na podcasty
Nainstaluj zdarma
Android téměř 10 mil. stažení · hodnocení 4,8
iOS už brzy
Epizody
Benchtalks #3: Parth Asawa (Continual Learning Bench) - We Taught AI Everything Except How to Learn 25.06.2026 50:35
For our third Benchtalks, the series dedicated to the researchers building the measurement toolkits that frontier labs hill-climb on, Snorkel AI co-founder Vincent Sunn Chen sat down with Parth Asawa , a UC Berkeley PhD student advised by Matei Zaharia and Joey Gonzalez , and the creator of Continual Learning Bench , the first standardized benchmark for measuring whether AI systems actually learn...
Benchtalks #2: John Yang (SWE-bench, ProgramBench) - The future of coding benchmarks 03.06.2026 54:13
For our second Benchtalks , the series dedicated to the researchers building the measurement toolkits that frontier labs hill-climb on, Snorkel AI co-founder Vincent Sunn Chen sat down with John Yang , a Stanford PhD student and creator of the SWE-bench franchise, SWE-smith, CodeClash, and most recently ProgramBench . This interview covers: Why every frontier model scored 0% at launch — until GPT...
Benchtalks #1: Alex Shaw (Terminal-Bench, Harbor) - Building the benchmark factory 31.03.2026 22:17
In this inaugural episode of Benchtalks, Snorkel AI co-founder Vincent Chen sits down with Alex Shaw, MTS at Laude Institute and co-creator of Terminal-Bench, to unpack what the rapid hill-climbing on TB2 reveals about the state of AI agent evaluation — and where the field needs to go. This interview covers: Why TB2 went from 20–30% during development to 75–80% at the frontier today The bet on th...
Podobné podcasty
Poslouchej podcast Benchtalks v Replaio
Rádio a podcasty v jedné aplikaci - zdarma a bez registrace. Nainstaluj si ji ještě dnes a nepropásni premiéru
Replaio není vydavatelem podcastů; názvy pořadů, obálky a audio patří jejich autorům a šíří se přes veřejné RSS kanály
