Gary Klein: Insights For Making Better Decisions

Episode Summary

Executive Summary: Gary Klein argues that expertise is not just years of experience but a richer mental model built from mistakes, reflection, stories, and curiosity about anomalies. He contrasts error reduction with insight generation, explaining how organizations often suppress both insight and candor. The conversation covers decision journals, pre-mortems, shadow boxing, cognitive flexibility, and why teams should surface unique perspectives before making decisions.

Main Topics: What makes someone an expert (Priority: 5/5): Klein distinguishes competence from expertise: experts know their mistakes, reflect on them, and continually refine their mental models; years alone are insufficient. Insights and how they emerge (Priority: 5/5): He identifies three insight pathways—connection, contradiction, and correction—and argues that curiosity toward anomalies is the key driver of insight. Why organizations block insight (Priority: 4/5): Organizations prefer predictability and error reduction, which makes them suppress disruptive ideas and novelty even when they claim to want innovation. Decision journals and decision scorecards (Priority: 4/5): Klein endorses capturing decisions as they are made—goals, information used, stakeholders, and assumptions—to enable fairer and more useful retrospectives. Mental models, stories, and learning (Priority: 5/5): A robust mental model includes how something works, its limits, workarounds, and likely points of confusion; stories help transmit these richer models better than abstract summaries. Pre-mortems, shadow boxing, and reducing errors (Priority: 5/5): He describes pre-mortems as a way to surface risks before action, and shadow boxing as scenario-based expert training that improves judgment through feedback and comparison. Teams, consensus, and voluntary compliance (Priority: 4/5): Klein argues that groups often make worse decisions than individuals; he favors a trusted single decision maker, anonymous input when needed, and environment design that encourages voluntary compliance.

Key Arguments: Expertise is better identified by how a person handles mistakes than by confidence, title, or years of experience. Insights come in three forms: connecting ideas, recognizing contradictions, or correcting flawed beliefs; curiosity is what turns anomalies into learning. Organizations unintentionally block insights because insight is disruptive, disorganizing, and harder to reward than error avoidance. Decision quality should be evaluated using the decision context and thinking process at the time, not just outcomes. A decision journal should record the decision, goals, key information, and affected people so later review can separate good/bad decisions from lucky/unlucky outcomes. Strong mental models include operational knowledge plus limits, workarounds, and foreseeable confusion points. Stories are powerful because they convey experience, surprise, and transformation, helping others see how an expert actually thinks. Pre-mortems improve team candor by asking people to imagine a future failure and generate reasons it happened before the project starts. Shadow boxing accelerates expertise by letting learners compare their reasoning against expert reasoning in realistic scenarios. Cognitive flexibility comes from exposing people to cases that break routines so they learn to adapt rather than merely repeat standard responses. Heuristics are mostly useful and necessary; biases often reflect heuristics failing in contrived tasks, not general flaws in human judgment. Teams should often gather input privately and then designate one accountable decision maker rather than relying on consensus. In high-stakes environments, structuring situations for voluntary compliance and trust is often better than relying on intimidation.

Data Points: Insight examples studied: 120 - Klein studied 120 examples of insights to identify common pathways. Insight pathways identified: 3 - He identified connection, contradiction, and correction pathways for insight. Correction-pathway cases found: 27 - He found 27 cases of insights that required correcting a flawed belief. Expertise criteria: 7 or 8 - Klein says he has about seven or eight criteria for identifying expertise. Shadow Box training improvement: 25% - He says a half-day of Shadow Box training can increase match to expert reasoning by about 25%. Decision review cadence example: Every 3 months - He gives quarterly project review meetings as an example of organizational follow-up. Pre-mortem time horizon: 6 months to 1 year - The exercise asks the team to imagine the project has failed after six months or a year. Pre-mortem generation time: 2 minutes - Participants spend two minutes writing down reasons the project failed in the imagined future. Project kickoff meeting length example: 1 to 1.5 hours - He describes spending about an hour to an hour and a half on project kickoff before doing a pre-mortem. Decision-making delay example: 45 minutes - From Damasio’s lesion work, emotionally impaired subjects took 45 minutes to choose a restaurant.

Pivotal Quotes: "tell me the last mistake you made" — Gary Klein: Used as a criterion for distinguishing true experts from merely competent people. "good ideas are fragile and precious and easily discarded" — Gary Klein: Explaining why organizations need mechanisms to protect ideas from premature rejection. "I want that person to trust me more at the end of the encounter than at the beginning" — Gary Klein: Describing the mindset of officers who successfully gain voluntary compliance instead of using intimidation.

Implications: For individuals and organizations, the message is to reward curiosity, document decisions, and create structures that surface expertise before errors become costly. The most effective teams learn from surprise, not just failure.