Experiment Nation: The Podcast

Simar, CEO and Founder of OptiPhoenix, shared invaluable insights on A/B testing and CRO at Experiment Nation. Here are 5 key takeaways: Don’t rely solely on macro goals: Micro goals reveal user behavior, driving better testing strategies and informing future hypotheses. Iterative testing trumps scrapping: Learn from failed tests by adjusting hypotheses and running new experiments, boosting your w...

Avishek Basu Mallick, a Senior PM at CheapOair, talks about: - Experimentation at scale: Even with high traffic, rigorous experimentation is crucial. - Idea generation: User research, NPS surveys, and internal stakeholders are valuable sources of experiment ideas. - Communicating progress: Regular updates with leadership build trust and ensure alignment. - Personalization is nuanced: Distinguish b...

Michael St Laurent, a seasoned CRO expert, shared his insights on large-scale testing Here are 5 key takeaways for marketers: Prioritization is key: Large-scale testing requires prioritizing tests based on potential impact and aligning with overall business goals. AI is the future, but humans guide it: Mike emphasizes the power of AI in automating processes and analyzing data, but highlights the i...

Ellie Hughes, a top CRO expert and Experimentor of the Year, shared some incredible insights in her recent Experiment Nation interview. Here are 5 takeaways to boost your experimentation game: - Start Small and Stay Curious: Ellie emphasizes that experimentation is a journey, not a destination. Start small, stay curious, and never stop learning! - Prioritize Value, Not Tasks: Focus your time on ac...

Join us for a deep dive into conversion rate optimization on low-traffic sites with these actionable insights Chris Mercer Measure before optimizing: Understand the current user journey and behaviors to identify areas for improvement. Test sequentially: Iterate faster on low-traffic websites by testing changes sequentially instead of using AB tests. Focus on the right metrics: Prioritize actions t...

Discover the power of experimenting to learn and win! 💪 Nick Murphy shares his expertise on building learning libraries. Here are 5 key takeaways: - Learning libraries capture the “why” behind successful and unsuccessful tests. - Organize your learning library with consistent and digestible fields. - Use “broad” and “specific” learning columns for a layered understanding. - Encourage cross-team c...

In this episode, senior customer experience leader, Courtney LeBlanc, reveals the ideal partnership between CX and experimenters and shares invaluable insights on: Forging powerful partnerships between CX and experimenters Navigating the daily demands of a CX leader Simplifying CX workflows with customer insights ... and so much more! Don't miss out on this enlightening conversation from an ex...

How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways: 1- Leadership advocacy is critical for embedding experimentation practices in a highly matrixed organization. 2 - Prioritize education and internal PR to influence and persuade teams to...

In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.subst...

Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial specially to them. We explored the...

Jyoti Malik, the founder of Blue Bagels, built a successful CRO agency by only working with ethical brands. In this chat with Tracy Laranjo, she shares: How to run CRO programs with purpose instead of random guesses - Her favourite underrated user research methods - Tips for creating a CRO strategy that succeeds in the long-term ... And much more. Contact Jyoti: Website: https://www.bluebagels.com...

Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation cultur, the struggles and benefits of adopting a culture of experimentation, and the need for leadership and reinvestment in the experimentation industry. Connect with Nima here:...

CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn Solomon's email: solomon.kahn@gmail.com Original YouTube Video: https://...

It's that time of year again! It's time for Experiment Nation's 2024 CRO Salary Report. In this episode, we explore some of the report's highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly. Find the CRO Salary report here: https://experimentnation.com/experiment-nations-2024-cro-salary-report/ Tracy's LinkedIn: htt...

Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers...

Shiva Manjanath, discusses with Ana Kerkovic the significance of collaboration with stakeholders and stakeholder management, optimizing CRO processes, transitioning from testing to experimentation, the impact of copy testing, and the need for research-backed strategies in CRO. Chapters ----- 00:00 Unlocking Business Growth with Data00:24 Introducing Experiment Nation and Guest Shiva Manjunath00:45...

Media. Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover: Why would CROs need mentorship? How do you find one? When are you ready to be a mentor and how do you get that word out? Would Tracy be a mentor for our listeners? GrowthMentor: https://app.growthmentor.com/mentees/sign_up?ref=970f4f6f79 Contact Tracy: LinkedIn: https://www.li...

🔥 Check out this insightful interview with Bryce York, Director of Product Management at Tatari, on Experiment Nation’s Conference! Here are 5 key takeaways from the interview: The similarities and differences between CRO and product management. The importance of overlapping skills and work in both areas, especially in smaller companies. Bryce’s background and journey from entrepreneurship to pro...

Documentation. The unsung, yet incredibly important part of any experimentation program. Great documentation allows you to look back at past experiments and find patterns of what were the most effective levers to inform your testing roadmap and levers you probably can deprioritize. In today's episode of  Experiment Nation , our own  Charlotte April Bomford  recently spoke to  Edmund Beggs  abo...

🚀 Exciting Insights from Simon Girardin about learning from failure!🚀 📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates: 1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders who may not be as versed in the technical aspects. 2️⃣ Learning from Tests: Emphasize the importance of...

Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences,...

In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of exp...

In this episode, Mike Green discusses the use of diary studies in UX research, particularly in the context of public sector user research. Mike Green, a freelance user research lead based in the UK, shares his experiences using Google Forms, structuring incentives, and addressing challenges in recruitment for diary studies. The discussion emphasizes the longitudinal nature of diary studies, contra...