Full Day Class: Test Metrics & Measurement: What’s Working, What’s Not and Why

A concerning assumption is being made today by many software testing professionals. They are assuming that they understand how decisions are made about testing progress and quality. Peering into the minds of our stakeholders, we begin to understand the context that informs their decisions. This insight will challenge our assumptions about test reporting, and lead to shifts in our test management, leadership and reporting approaches.

In this class, join Lynn as we explore testing metrics to understand what’s working, what’s not and why. First, we will explore the concept of context and how it shapes our perceptions, expectations and decision making. From there we will look to understand measurement dysfunctions and the dangers they pose to our teams and stakeholder decision making. We will step into the shoes of our stakeholders to understand what really informs their decision making and how test reporting fits in. We will explore how best to meet stakeholder needs by evaluating different approaches including traditional metrics, dashboards and information radiators. We will wrap up by developing an action plan for your project and sharing important considerations when leading change.

Learning Objectives:

  • Understand how context shapes our perceptions, expectations and decision making
  • Review why we measure and common measurement dysfunctions
  • Explore the stakeholder decision making process
  • Review “traditional” metrics, dashboards and information radiators
  • Understand leading change and how to influence a shift on your projects
  • Explore scalability of approach from small projects to large scale programs
  • Develop an action plan for shifting metrics on your projects

Class Outline:

  • Play “How Context Matters” Game
    • Debrief how context shapes us and informs our expectations and decision making
    • Align this learning with testing metrics & measurement
  • Workshop/Breakout – Experience Sharing
    • Share our experiences and approaches to hear what’s working and what’s not
  • Measurement Dysfunctions
    • Why We Measure
    • The Measurement Problem
    • Measurement & Context
    • Qualitative vs. Quantitative Debate
    • Constructs, Abstraction & Aggregation
    • Measurement Side Effects
    • Delivering “Bad” News
    • Inquiry vs. Control
    • Product Quality vs. Value
  • Stakeholder Decision Making
    • Explore the context that influences and informs stakeholder decision making.
    • Getting to the bottom of what really matters
  • Traditional Metrics, Dashboards & Information Radiators
    • Recognizing our predispositions around “best practices” and shifting to the approach to meet the need
    • Emphasis on telling the testing story and driving stakeholder conversation
    • Shifting stakeholder expectations on testing metrics and measurement
    • Brief overview of leading change and how to influence a shift on your projects
  • Scalability of Measurement Approaches
    • Review of approaches and the feasibility of scaling up or down to fit a project
  • Workshop/Breakout – Understanding Why & What’s Next
    • Collaborative session, looking back on the morning, to identify the “why” behind what’s working and what’s not
    • Identify an action plan for your project including considerations around change management

Location: Pecan Date: May 21, 2018 Time: 8:30 am - 4:30 pm Lynn McKee