Outperform

Why does one of the world’s leading business podcasts (and media companies) employ a full-time Head of Experimentation and Failure? Ask Grace Miller, who holds the title at FLIGHTSTORY, the company behind The Diary of a CEO. On today’s episode, Grace shares how her team built an experimentation engine to drive growth across podcasts, product, paid media, and marketing. Grace shares how her work sp...

What’s next for experimentation in 2025? We’re breaking down insights from the biggest names in tech—Netflix, Amazon, Meta, and more. Fresh from top experimentation conferences, we’ve identified three major trends set to shape the future of experimentation.  In this Episode: Shifting toward self-serve capabilities for less-technical end users The rise of automated "set it and forget it" experiment...

Eppo Head of Product Eric Metelka took to the stage in San Francisco at the 2024 Lenny & Friends Summit to share some big insights on where product teams are making mistakes in their experimentation programs. Drawing on case studies from industry leaders like Netflix, MSN and Booking.com, Eric explores how to rebuild trust in your data, accelerate experiment velocity, and foster a culture that...

Data-driven is the buzzword of the day—but what are the strategies that separate top-tier, data-driven companies from the rest? From chaotic, one-off tests to fully automated systems, we share the four stages that drive scalable growth, speed up learning, and make decision-making a breeze. In this episode, Lukas Goetz-Weiss, joins Ryan Lucht to explore each maturity stage, the common roadblocks, a...

"When in doubt, test it out!" In today's episode of Outperform, we uncover why the best teams thrive on a culture of testing everything— powerful metrics like segment-level differences and the dynamic balance between best practices and bold experiments, showcasing why both small tweaks and big swings matter. Plus, how a well-balanced experiment portfolio and savvy management can supercharge your p...

The power of experimentation is never clearer than when small changes spark massive breakthroughs. But how do you get your teams convinced to start testing many small changes in the first place?  We explore some common roadblocks that stand in the way of world-class cultures of experimentation. Ryan, Che, and Sven share insider insights from companies like Airbnb and Stitch Fix to give you actiona...

AI is evolving at lightning speed - the shift from custom-built models to pre-trained large language models (LLMs) is driving rapid adoption from businesses. But how do we know if all these models are actually driving positive business outcomes? As the New York Times put it, “AI has a measurement problem”.  In this Episode: Why most current AI model evaluation methods fall short How to truly measu...

Imagine a world where your AB tests run themselves—faster, smarter, and more dynamic than a simple 50/50 split that takes weeks to measure.  Today’s episode breaks down how multi-armed bandit algorithms could change when and where you use AB testing. But don’t be fooled—there are no free lunches and no cure-alls.. We’ll show you why understanding your use case, keeping the stakes low, and having h...