TMI - Testing and Management Insights

In this episode of TMI, Chip and Tess dive deep into the frustrating world of flaky tests . These are the tests that pass sometimes and fail at other times, even when the code hasn't changed. We discuss reference research from Trunk, who analyzed over 20 million CI jobs and found that flaky tests are a widespread problem, even among large tech companies like Meta, Google, and Uber. We examine stra...

Explore the three pillars of Agile estimating and planning: embracing change, prioritizing value, and effective communication—principles that resonate beyond software development. Learn why multitasking can hinder progress despite feeling productive. Understand the pitfalls of setting initial estimates in stone. Learn why providing estimation dates and team velocity as ranges -- rather than a defi...

In this episode, explore the Agile philosophy in software development. Learn about using story points and “Ideal Days” for estimation, and the importance of communication and trust in Agile teams. Discover how to choose optimal sprint durations, understand velocity, and use burn-down charts to spot risks. Dive into Scrum as a framework, including the role of the Scrum Master, sprint planning, dail...

In this episode, we dive into exploratory testing, a dynamic technique where tests are designed and executed simultaneously, using insights from previous experiments to guide future ones. We explore various exploratory testing tours , including: The Guide Book Tour : Following the user manual step by step. The Money Tour : Prioritizing features most essential to users. The Saboteur Tour : Intentio...

In this episode of the TMI Podcast, we dive into the intriguing world of Testing in Production and how it allows you to observe your software in real-world conditions. Join us as we discuss key techniques to minimize risks while testing in production: Feature Flags: Deploy code to production servers without immediate exposure to users. Feature flags allow you to unveil new features only when you’r...

Are you ready to navigate the AI revolution and elevate your career? Dive into our latest episode, where AI and testing experts share the must-have skills to thrive in the age of artificial intelligence. 🔍  Key Highlights: Essential AI Literacy:  Discover why understanding AI is vital for everyone in tech, no matter your role. Transforming Testing:  Learn how AI is reshaping the testing landscape...

In this episode, we explore the four essential metrics that define high-performing teams: Delivery Lead Time: The speed of transitioning code from a developer’s machine to production. Deployment Frequency: The regularity of deployments to production. Resilience: Mean time to restore service Change Fail Rate: The percentage of releases that encounter issues in production. We challenge the notion th...

In this episode, we dive into the Agile Manifesto , emphasizing individuals and interactions over processes and tools. We explain why quality isn't something you can tack on at the end. We discuss fostering a culture where everyone feels empowered to speak up. Explore iterative development and user stories, along with the agile testing quadrants . Learn about test-driven development (TDD), accepta...

In this episode, we dive deep into integrating testing throughout the entire development process. Discover the nuances of equivalence class testing and embark on exploratory testing tours like The Back Alley Tour and the Rained Out Tour. We discuss striking the right balance between manual and automated testing and explore how tech giants like Google categorize their test cases. Learn about the co...

Is AI about to revolutionize software testing? This episode dives deep into the future of QA, exploring how AI is changing the game. We tackle the big questions: Will robots take our jobs? How do we test AI? Can we trust AI systems? AI-first testing and what it means for efficiency. The rise of the "hybrid tester" and the evolving role of human expertise. Autonomous testing and the crucial role of...

Join us as we uncover the secrets to creating high-performing teams. Discover how to cultivate a culture where everyone feels empowered to share their ideas and take risks. 🌟  Key Insights: Leadership Essentials:  Learn about “The Law of the Tombstone,” reflecting on how you want to be remembered, and explore the balance between loyalty and constructive insubordination—knowing when to support you...

In this episode of the TMI Podcast, we delveinto the transformative impact of artificial intelligence on the testing landscape. As AI-generated code becomes more prevalent—already accounting for 25% at tech giants like Google—the pace of development is accelerating. Testersare now challenged to keep up. Discover how AI is revolutionizing bug detection, test plan creation, and even test automation,...

In this episode, we revisit “How Google Tests Software,” published in 2012, to evaluate its relevance today. We examine the roles of Software Engineers in Test (SETs) and Test Engineers (TEs), highlighting their responsibilities, tools, and the challenges they face. We explore the Test Certified system, a tiered framework that encourages developers to sharpen their testing skills. We also discuss...

In this episode, we review How Microsoft Tests Software , published in 2008. We explore which methodologies have stood the test of time and which haven’t. Discover Microsoft’s 1:1 developer-to-tester ratio (didn't) and their collaborative approach throughout the development cycle (did). Learn about the hidden costs of technical debt and the importance of Quality Milestones dedicated to addressing...

In this episode, we delve into the principles of Agile and lean software development , focusing on streamlining processes and eliminating bottlenecks to achieve faster delivery and improved stability. We explore Agile estimating and planning techniques, such as Planning Poker , and discuss how to foster a healthy team dynamic by embracing open disagreement. We also examine Google’s whole-team appr...

In this episode, we dive deeper into the Agile Testing Quadrants and the testing pyramid , exploring how these frameworks guide effective testing strategies. We’ll discuss the value of using real customer examples when designing tests and the importance of developing and testing “thin slices” or “steel threads” to ensure end-to-end functionality. We also cover the benefits of testing with mocks an...

In this episode, we explore the nuances of effective leadership and decision-making within the realm of software testing and management. We discuss the holistic approach to testing, emphasizing the importance of involving the entire team, including developers testing their own code, and adopting the shift-left philosophy to catch issues early. The episode delves into the complexities of project ti...

In this episode, we delve into structured and exploratory software testing techniques. Discover how equivalence class and pairwise testing can reduce test cases and save time. Learn about boundary value analysis for edge cases, decision table testing for input-output mapping, and state transition diagrams for planning. Explore domain analysis and use case testing from a user’s perspective. Underst...

In this episode, we explore the concept of the 10-Minute Test Plan and why “ failing fast ” is beneficial for agile development. We’ll discuss the ongoing importance of manual testers in the software development lifecycle and delve into the unique culture of “ Googliness ” at Google. We also discuss the benefits of Story Mapping . We’ll emphasize the importance of empowering your team to make deci...

In this episode, we delve into the principles of holistic testing and the whole-team approach, emphasizing the importance of creating an environment where every team member feels empowered and takes ownership of their work. We discuss strategies for accurately estimating project timelines and explore how Google employs “ dogfooding ” — testing products internally before releasing them to external...

In this episode, we delve into the world of Prompt Engineering, specifically tailored for software testers. Discover how to extract the most precise information from Large Language Models (LLMs) using three distinctive frameworks:  • RACE: Role, Action, Context, Expectation • COAST: Context, Objective, Actions, Scenario, Task • APE: Action, Purpose, Expectation Learn why it’s crucial to define the...

In this episode of Testing and Management Insights, we debunk two common myths of agile testing: the belief that agile means no documentation and that testers aren't needed. We explore the concept of shifting left and the importance of integrating quality into every step of development. We delve into the Agile Testing Quadrants and discuss the different types of tests that support the engineering...

In this episode, we delve into the essential strategies for cultivating an exceptional software team, emphasizing the importance of building trust and fostering a collaborative environment. We explore key motivators that drive team performance: mastery, autonomy, and purpose. The discussion highlights the shift in leadership from micromanaging to coaching, empowering team members to take ownership...

In this episode of TMI we dive deep into the findings of the 10th annual DORA 2024 Accelerate State of DevOps Report, which surveyed over 40,000 tech professionals. Join us as we explore the transformative impact of AI integration in the tech industry: Discover how 81% of organizations are prioritizing AI, with 76% of developers incorporating it into their daily workflows. Delve into the paradox o...

Explore the world of whole-team testing and discover how Test Driven Development (TDD) fosters smarter design and more testable code. Delve into the crucial role of the Product Owner as the customer’s advocate. Gain insights into Google’s powerful internal tools that execute millions of regression tests and learn why manual testing remains vital. Embark on exploratory testing tours like the “All N...