Experiment Nation: The Podcast

Stop testing randomly. Have a plan. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

CRO is a process of optimizing a website or landing page to maximize the percentage of visitors to convert into paying customers. It involves testing different elements of the website to determine what works best for increasing conversions. As long as businesses value increasing their conversion rate, CRO will remain an important part of online marketing and web design - but it may not exist as a...

There’s a lot of talk about how to find things to test, how to analyze tests and the importance of iterating on tests. This week, I was thinking about how I could add something a little different to the conversation and decided to share my thoughts about when to run a test - particularly when building products. This is a public episode. If you would like to discuss this with other subscribers or g...

Curiosity needs to be a driver in every experimenter’s toolkit. What is going on in the head of my customer? What is really their job-to-be-done? When buying flowers, we typically think of the standard occasions: Mother’s Day, Valentine’s Day, new baby & sympathy. But if we were to structure our ecommerce website on those occasions alone, we may be addressing the majority, but we’d be missing...

Even if you are the best Experimenter at your company, unless you are able to nurture a culture of Experimentation - you’ll end up constantly fighting uphill battles. Here are a few quick pointers on how to be a better Experimentation leader. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Pineapple on pizza. If you ever want to have a heated debate with a group of people, ask them if pineapple belongs on pizza. Now let’s replace pizza with CRO and pineapple with “best practices” (or whatever topic CROs are angry about on LinkedIn these days). This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.su...

Watch this session on Youtube: https://youtu.be/JqT95k7eG_8 This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Based on a brand new obsession (thanks to the pandemic) for homemade pizza, I would like to talk about how optimisation is just like cooking that perfect pie.  You can have all of the tools in the world, but do you have the experienced chef and the right ingredients. Sure, you can cook up a quick Margherita in under an hour, but does it taste good. But, what if you left the dough to rise for a few...

About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It's the book he wished he had when he started in analytics. In this episode, he shares: Plus other statistical concepts explained in a way even a five-year-old could understand. Why intuition can actually be a good thing in data analytics If you need to know R or Python t...

About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

A/B Testing can be intimidating to the uninitiated, but it doesn’t have to be! I want to introduce testing concepts via a real-world scenario that we can all relate to: Dessert. I’ll cover what an MVT is, hypotheses, independent variables, dependent variables, results (of course), and design flaws. And if you need any more convincing, I have four words for you: Monte Cristo Bread Pudding. This is...

Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there. Whether you're in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more. **This episode, nor those of Product for Product, are endorsements of any of the discussed tools.** Listen to Product for Product: spreaker...

You can do better than testing button colors, but how do you decide what to test when, and what type of test to run? Roadmapping. This session teaches you to be the GPS navigator, helping your team optimize experimentation routes.  On this journey, you will identify how each path can drive desired impacts by turning a formidable trek into a series of attainable milestones.    Presented by  Kenya D...

Experiment Nation: The Podcast is a show on which we share Interviews with Experimenters from around the world, opinion pieces, and recent presentations with you - the experimentation community. We hope you enjoy the show, let’s get to it. If you enjoy our content, consider signing up for Experiment Nation's bi-weekly newsletter here:  https://buff.ly/31qO0AQ This is a public episode. If you would...

Tracy is a Toronto-based growth marketer with a knack for conversion optimization. In a past life she’s QA tested “adult” eBooks and helped make it easier for Canadians to write their wills online. Tracy is also one of the co-hosts of the Experiment Nation podcast where she chats with optimizers at the top of their game. Beyond the 9-5, you can catch her knitting, crushing empires in Civ6, or napp...

About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions. Find Johann on Twitter: @amaclickclick Learn more about AWA Digital: awa-digital.com This is a public episode. If you would l...

Anil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and...

About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

When experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users. This is a public episode. If you would like to discuss this...

About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Although the two sample proportion test is well known within the marketing experimentation community, there are a host of categorical data analysis techniques that are amenable to the analysis of A\B test data. This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation. Specifically, we discuss how to 1) test a\b\n experiments...

Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO. Learn more about ConversionAdvocates: https://con...