Experiment Nation: The Podcast

Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX desi...

Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about: - What you should expect your win rate to be - The benefits of sequential testing - Why you should report on confidence intervals This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Many businesses approach conversion optimisation by hiring a single in-house practitioner and believing that they can run all aspects of the discipline. But what you also need is Executive buy-in Most CROs are generally very multiskilled because that have had to learn to be so, however this approach typically leaves them frustrated because they lack the buy-in from an executive, support of special...

Experimenters obsess about many A/B Testing Statistics concepts - but not all of them are worth worrying about. Statsig's Timothy Chan shares his thoughts about test isolation, interaction effects and confidence levels - some of his thoughts may surprise you. #experimentation #product #statistics This is a public episode. If you would like to discuss this with other subscribers or get access t...

Client Relationship Tips and secrets behind a thriving relationship between a CRO agency and the client - anybody can learn how to get started in CRO but it takes years of experience to know how to run a CRO agency and how to scale while keeping the same standards of quality. In my presentation, I will walk you through what you need to know to build a strong, successful relationship with your clie...

10 lessons that helped John Ekman in Launching a CRO agency. John learned many lessons when launching his agency - he wants to share them with you. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc. In my session, I will share the insights that I got during my 12 years journey, transitioning from CRO - website optimization to increase the conversion...

Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them. This process involves identifying the unique needs and prefer...

A/B testing plays a critical role in decision-making - but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to co...

Add Exploration and Validation phases to your testing program - because most of your wins are fake. #experimentation #statistics #testing This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Being an Experimentation leader requires a different set of skills. Vistaprint's Cristina Pujol walks through the lessons she's learned. 0:00 - Introduction 1:03 - How Vistaprint organizes for Experimentation 2:22 - The Ambassador role 4:19 - Experimentation process for domains 8:18 - Let’s take a real example 11:36 - Ideas to share learnings and celebrate success #leadership #program #exp...

Does exactly what it says on the tin. #research #conversion #optimization This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Our industry can be damning of those doing things ""imperfectly"" - but it seems not to draw the distinction between those doing things imperfectly through ignorance (who can be educated) and those doing things imperfectly through lack of a better option (who need to be helped to show the value to decision-makers).   This attitude has a negative impact on new entrants to the industry and sets comp...

How to be a good test coder with Jeroen Wiersma This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

In this session, I want to cover the most strategic actions that a new Experimentation Strategist (or Program Manager) can execute during their first three months in the role to increase trust among the stakeholders and clients.  I will share this based on my experience working with clients such as Miro, Procore, The Bouqs, and Gympass, among others.  About the speaker Carlos has over nine years o...

You don't have to A/B test everything. Be smart by having guiding principles.  #conversionrateoptimization #experimentation #ecommerce This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Many optimizers are good at using data to craft hypotheses. Great optimizers, however, build data-driven segments, analyze by business goals (not just test KPIs), and importantly, propose how to take action on campaign results.  About the speaker Alexandra leads Product Marketing at Kameleoon. She loves storytelling as a way of demonstrating a product’s values and benefits to customers.  Chapters...

Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini  #experimentation #conversionrateoptimization #growth This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life. This is a public episode. If you would like to discuss this with other subscribers or get access t...

Creating a customer journey map can help stakeholders better understand the customer’s experience, and helps ensure that all stakeholders are working towards the same goal. It can also help identify potential areas of improvement, and provide insights into how customers interact with your product, service, or organization. This is a public episode. If you would like to discuss this with other subs...

When looking for a job, it’s important to have a clear idea of what you’re looking for in terms of type of work, salary, benefits, and work culture. You should also have a general understanding of your skills and experience, and be able to articulate to potential employers why you’d be a good fit for the job. Tracy Laranjo walks you through the things you need to know to land that dream job and ge...

Form optimization is the process of improving the structure and design of a web form to make it more user-friendly and efficient. This includes streamlining the form’s layout, making it easier to understand and fill out, and adding features such as auto-fill, pre-filled fields, and error handling. Alun Lukas shares how optimizing forms helps to reduce user frustration and abandonment, increase con...

Teams are horrible at this! They have no idea it should happen, and if they do, they're usually lost and the approach is terrible. When you break it down, it's really not difficult. This shouldn't be a black box anymore.   I will cover the following: (1) What each of the test planning aspects are and how to do them including MDE and duration estimates, (2) CXL's pre-test calculator unless our new...

Skeptical first-time buyers need to be given the utmost priority in order to make them feel comfortable and secure with their purchase. This may include providing detailed product or service information, offering multiple payment options, providing customer service support, and offering warranties or guarantees for their purchase. Rishi shares his thoughts on how to win over this critical customer...