The Experimentation Edge

AI is moving so fast that what “good” looked like a few months ago is already outdated.  So how do you measure value, ship safely, and scale what works? Marco Casalaina, VP of Products, Core AI and AI Futurist at Microsoft, joins to unpack how his team builds and evaluates next‑gen AI—at hyperspeed.  Marco leads the AI Futures team and previously led Azure OpenAI, Azure Cognitive Services, Respons...

Summary What do you test rigorously—and what do you ship fast and fix forward—when every change could impact millions?  Vinoj Kumar, Vice President of Engineering at Upwork, leads at the intersection of infrastructure and product, where feedback loops are longer and the blast radius is wider.  He shares a pragmatic framework for experimentation—blast radius x reversibility—that sets testing rigor,...

Think pest control isn’t a digital business? Think again.  Raj Mehta, Vice President of Product and Technology at Moxie Pest Control, outlines how he turned a spreadsheet-run operation into a data-driven engine across 9,000+ daily calls.  Raj shares how consolidating fragmented systems into a data lake unlocked automation—from shrinking lead routing from 20–25 minutes to under 30 seconds—to deploy...

If 80% of A/B tests fail, how do you de-risk decisions that touch pricing, product, and brand? Aleksandra (Aleks) Bass, Chief Product & Technology Officer at Typeform, shares how her team “earns the right to A/B test” with medical-grade rigor—moving from literature reviews and user tests to simulated trials before exposing changes to customers. She details Typeform’s repositioning from “forms”...