← Back to Knowledge Graph

When the Israeli Defense Forces asked Kahneman to improve their officer selection process, the interviewers revolted. His proposal felt mechanical, dehumanizing, and insulting to their professional judgment. It also doubled their prediction accuracy.

The Framework

Kahneman's structured interview protocol is a six-step procedure that defeats the halo effect, substitution heuristic, and intuitive confidence by forcing sequential, independent evaluation of separate dimensions before allowing a global impression:

  • Define 6 job-relevant traits before the interview (e.g., responsibility, sociability, intellectual capacity, energy, physical fitness, pride).
  • Create factual questions for each trait — questions about the candidate's actual past behavior, not hypothetical "what would you do?" scenarios.
  • Score each trait independently on a 1-5 scale during the interview, completing one trait before moving to the next.
  • Do not form a global impression until all six traits are scored.
  • "Close your eyes" — after all traits are scored, pause and let an overall intuitive impression form.
  • Record both the structured scores and the intuitive impression. Use both in the final evaluation.

    • The "close your eyes" step is the protocol's brilliant concession to the interviewers' rebellion: it preserves the role of intuition while ensuring it operates after structured evaluation rather than instead of it. The intuitive impression, informed by the structured data, turns out to be more accurate than either structured scores alone or intuition alone.

    Where It Comes From

    Kahneman describes the origin story in Chapter 21 of Thinking, Fast and Slow. Assigned to improve the IDF's officer selection, he faced interviewers who relied on unstructured conversations and holistic gut feelings — which produced confident but inaccurate predictions. His solution drew on Meehl's clinical vs. statistical prediction research: replace global judgment with dimension-by-dimension assessment. The interviewers hated it initially but warmed up when the "close your eyes" intuitive step was added — and the prediction accuracy dramatically improved.

    > "The recipe for a good structured interview is simple: independently score several dimensions, then combine them." — Thinking, Fast and Slow, Ch 21

    Cross-Library Connections

    Hughes's 6MX behavioral profiling system in Six-Minute X-Ray follows the same structural logic: observe specific behavioral markers (quadrant, needs hierarchy, speech patterns) sequentially before forming a global profile. The structure prevents the halo effect from contaminating cross-dimensional evaluation.

    Fisher's objective criteria principle in Getting to Yes parallels the structured interview: evaluate each dimension of a negotiation against external standards rather than relying on a holistic "feel" for the deal. Sequential evaluation of interests, options, and standards produces better agreements than intuitive "sense of the whole."

    The Implementation Playbook

    Hiring: Implement the protocol immediately for every role. Define 6 traits that predict success in the specific job. Design behavioral questions for each ("Tell me about a time you..."). Score each trait 1-5 during the interview before moving to the next. After all scores are recorded, form an overall impression. The combined score + impression outperforms unstructured interviews by a wide margin.

    Performance Reviews: Adapt the protocol for annual reviews. Define 6 performance dimensions relevant to the role. Score each independently using specific behavioral examples from the review period. Only after all dimensions are scored, write the overall assessment. This prevents the recency effect and halo effect from contaminating the review.

    Vendor Selection: When evaluating proposals from multiple vendors, define your evaluation criteria upfront. Score each vendor on each criterion independently before forming an overall impression. The structure prevents the most charismatic presenter from winning on all dimensions.

    Investment Due Diligence: Define 6-8 evaluation dimensions for your investment thesis (market size, team, unit economics, moat, etc.). Score each dimension independently for every opportunity. The equal-weighted composite score often outperforms holistic "this feels like a winner" judgments.

    College Admissions: Kahneman's protocol could transform admissions: score academic achievement, extracurricular depth, essay quality, recommendation strength, and diversity contribution independently before forming a holistic evaluation. The current process — reading an application and forming a "sense" — is the unstructured interview in academic clothing.

    Key Takeaway

    The structured interview protocol embodies Kahneman's deepest practical insight: the best decisions come from combining structured analysis with calibrated intuition — in that order. Structure first prevents the halo effect and substitution heuristic from contaminating the evaluation. Intuition last contributes pattern recognition that formal scores may miss. But the intuition must come last, after the structure has done its work. Reversing the order — intuiting first, then looking for supporting data — is how the halo effect wins.

    Continue Exploring

    [[Algorithms vs. Experts]] — The broader finding that structured methods outperform unstructured judgment

    [[Halo Effect]] — The bias the structured protocol is specifically designed to defeat

    [[Illusion of Validity]] — Why interviewers' holistic confidence is uncorrelated with accuracy

    📚 From Thinking, Fast and Slow by Daniel Kahneman — Get the book