Experiment Nation: The Podcast

Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, inclu...

Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will's approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, chall...

You need to invest in ad optimization. Effective performance marketing / advertising optimization relies on continuous experimentation, data-driven decision-making, audience insight, and refined targeting. It's not just about numbers; creativity, a deep understanding of advertising channels, and ethical targeting are crucial. Brand trust and performance marketing are interconnected, with custo...

Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements a...

Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assump...

Personalization timing matters Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveragi...

We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the compan...

Heatmaps to the rescue! Creating an impactful website hero section above the fold is vital for user engagement. Clear value propositions and compelling calls to action are essential, as users often don't scroll past this section. Heat mapping, combined with other techniques like exit polls and A/B testing, provides a comprehensive understanding of user behavior. While urgency and scarcity tact...

Experimentation Culture for Startups is so important. In the realm of Conversion Rate Optimization (CRO), engaging all stakeholders, from executives to product managers and customer service, is pivotal for success. This inclusive approach fosters collaboration, early alignment on technical aspects, and efficient experimentation. It stands in stark contrast to tactical CRO, which tends to focus on...

Having an experimentation roadmap is crucial for conversion rate optimization and Hypotheses Testing because it provides a structured and strategic approach to improving conversion rates on a website or marketing campaign. Here are a few key reasons why it is important: Systematic Testing: An experimentation roadmap helps in organizing and prioritizing the different experiments that need to be con...

Landing pages are, generally speaking, a page that users “land on” after clicking on a link in an email or an ad. What we’re talking about today, however, are standalone pages that are specifically designed to motivate, build trust, create urgency, and ultimately convert visitors. They matter because, when used correctly, they can significantly improve the effectiveness of ad campaigns and maximiz...

Don't test everything. Experimentation isn't about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experime...

In this podcast episode, Mark Eltsefon, a senior data scientist and experimentation evangelist, discusses building an experimentation culture in different companies. He shares his journey from starting as a software developer to becoming passionate about data science and experimentation. He contrasts the experimentation culture at TikTok, where data-driven decisions were central and democratizatio...

Juliana Amorim emphasizes that personalization is not a silver bullet and recommends its use when aligned with strong hypotheses and business goals. She co-founded Croct, a personalization experimentation platform, focusing on adapting user journeys to context. Examples include tailoring websites for diverse buyer personas within B2B companies and customizing content for users at different stages,...

Building a personal brand as a conversion rate optimizer is crucial in today's competitive digital landscape. Your personal brand serves as a powerful tool to establish credibility, showcase expertise, and attract new opportunities. By cultivating a strong brand identity, you position yourself as an authority in the field, gaining trust from potential clients or employers. A well-developed per...

Ideation strategies are essential to building an experimentation culture. Companies should encourage employees to generate new ideas and provide a platform for sharing them. This can be done through brainstorming sessions, hackathons, or online idea-sharing platforms. It's important to involve stakeholders from different departments and levels of the organization to ensure diverse perspectives...

Eddie Aguilar, a developer and CRO specialist, shares his experience with experimentation and optimization. He discusses how he started as a developer at a young age and eventually shifted to optimization. He recounts a specific incident while working with Envision App, where he made a global change to the website that caused a significant error, resulting in a spike in error logs. Eddie emphasize...

David Mannheim, author and expert on personalization, discusses the importance of personalization in marketing. He emphasizes the need for brands to focus on building relationships with customers based on trust and care. Mannheim distinguishes personalization from segmentation, highlighting personalization as a communication principle rather than just a marketing tactic. He also mentions the chall...

In this video, Riccardo Vandra discusses the importance of asking powerful questions for conversion rate optimization (CRO). He emphasizes that the quality of our questions determines the quality of our insights and ultimately our success. Riccardo proposes a three-step questioning framework for building effective questions. This is a public episode. If you would like to discuss this with other su...

We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy. Th...

Mixing quantitative and qualitative research methods is essential for understanding human motivation. While quantitative methods provide statistical data and measurable insights, qualitative methods capture nuanced experiences and emotions. By combining both approaches, researchers gain a comprehensive understanding of the complex interplay between factors such as social, psychological, and cultur...

The best Product Managers and Experimenters possess a unique skill: they know how to tell good stories that capture the hearts and minds of stakeholders and gain buy-in. Through powerful storytelling, they paint a vivid picture of the product's vision, value, and potential impact. They tap into emotions, using anecdotes and examples to create relatable narratives that resonate with their audie...

Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue. Nicoleta walks...

Learn A/B Testing Statistics, how to use Overall Evaluation Criterion, Twyman's law, how much traffic do you need to run A/B tests, and other statistical concepts all Experimenters must know. Watch the video version here: https://www.youtube.com/watch?v=tH4tjpbziCo #statistics #abtesting #cro This is a public episode. If you would like to discuss this with other subscribers or get access to bo...

Are you looking to replace Google Optimize? On Experiment Nation's recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it's worth building your own Experimentation Platform (spoiler alert: the answer is usually no). #googleoptimize #vendor #experimentation This is a public episode. If you would like to di...