Judgment Errors Specimen OB

Outcome Bias

You judge the quality of a decision by its result - even when luck, not process, wrote the ending.

Explained

Outcome Bias is the tendency to rate a decision as good or bad after you know how it turned out, even when the same choice would look different with a different roll of luck. Results rewrite the story of the reasoning.

People evaluate medical and monetary decisions more favorably when they learn the outcome was good, and more harshly when it was bad - even when the information available at decision time is held constant. A risky bet that pays off gets called genius. A careful plan that fails because of noise gets called foolish. Baron and Hershey's 1988 experiments made that swap measurable. The process visible at decision time gets replaced by the ending that arrived later.

It shows up wherever people review performance: business, sports, medicine, parenting, investing, and public debate. Hindsight makes the path feel obvious, so the quality of the original call gets judged by the scoreboard, not by what was knowable then. Praise-and-blame cultures amplify the bug. Leaders reward visible wins and punish visible losses, so teams learn to optimize for lucky outcomes instead of repeatable process.

Outcome bias is close to hindsight bias but not identical. Hindsight makes the past feel more predictable. Outcome bias uses the known result to grade whether the decision was competent. They often travel together: once the ending feels inevitable, the person who chose "wrong" looks careless.

Good outcomes can hide weak reasoning, and bad outcomes can hide strong reasoning. Results still matter for learning and accountability - the bug is using the result alone to judge whether the decision was sound when it was made, then scaling whatever luck just rewarded.

Examples

  • "It worked, so it was a brilliant call."
  • "It failed, so the plan was reckless."
  • "Fire them - look at the result."
  • "Promote them - the bet paid off."
  • "That surgeon is great; the patient lived."
  • "That surgeon is bad; the patient died."
  • "We should copy whatever the winning team did."
  • "I knew it was wrong the whole time - see how it ended?"

Real-world scenarios

Lucky launch review: a product ships with thin testing and happens to avoid outages. Leadership calls the process "lean and smart." The next launch with the same process burns. Outcome graded the first decision; Baron and Hershey's pattern shows up in the postmortem calendar.

Surgery scoreboard: two cases used the same evidence-based protocol. One patient recovers, one does not. Staff whisper that the second doctor's judgment was worse - even though the decision tree at the time looked identical.

Investment folklore: a concentrated bet doubles and becomes a "conviction" story. An equally reasoned bet that loses becomes proof of recklessness. Process never gets a separate grade.

Coach on the hot seat: a correct fourth-down call fails on a bounce. Fans demand firing. The same call that succeeds would have been "gutsy excellence." The ball, not the expected value, wrote the review.

Parent blame loop: a careful outdoor plan ends with a scraped knee. Relatives treat the parent as negligent. A careless plan that luckily ends fine gets no critique. Authorship of harm gets confused with authorship of risk.

Impact

Outcome bias teaches the wrong lessons. Teams copy lucky wins and abandon sound processes that hit bad variance.

Accountability becomes theater. People hide uncertainty, avoid reversible bets, and chase narratives that will look good if luck cooperates.

Talent systems mis-rank people. High performers in noisy domains get punished for noise; lucky ones get promoted for noise.

Public debate turns cruel and shallow. Complex policy gets graded by one vivid ending instead of decision quality under uncertainty.

Over time organizations become superstition machines: rituals from recent winners replace checklists that would survive a different roll.

Causes

Outcomes are vivid and easy to observe; decision quality is abstract and requires reconstructing what was known. The mind prefers the vivid grade.

Hindsight compresses uncertainty, so the "right" choice feels obvious after the fact. Moral emotions then attach to the result: praise for good endings, blame for bad ones.

Incentive systems reward scoreboards. When bonuses, status, and media stories track results more than process audits, outcome bias becomes institutional habit.

Research

Baron and Hershey's 1988 Journal of Personality and Social Psychology paper, Outcome Bias in Decision Evaluation, showed that identical decisions were rated differently once people learned good versus bad outcomes.

Participants still cared about process information when it was available, but outcome knowledge systematically shifted evaluations - evidence that results leak into judgments of decision quality even when they should be held constant.

The practical lesson is not to ignore results. It is to grade process with the information set that existed at decision time, then study outcomes as data about the world - including luck.

How to spot it in yourself

  • Your verdict on a decision flips after you learn the result.
  • You cannot state what was knowable at the time without using the ending.
  • You promote or blame people mainly by scoreboard, not by decision quality.
  • You scale a process because it "worked once."
  • Bad luck looks like incompetence; good luck looks like skill.
  • Postmortems skip expected value and jump to "what happened."

Prevention

Separate process review from outcome review on purpose.

  • Write the decision rationale before results arrive when stakes are high.
  • Ask what you would think of this choice if the outcome had flipped.
  • Grade decisions on information quality, alternatives considered, and risk sizing.
  • Track base rates and variance so one ending cannot rewrite a method.
  • Reward good process under uncertainty, not only lucky wins.
  • In postmortems, label luck explicitly before you change the playbook.

Questions & Answers

When should outcomes change how I judge a decision?

When they reveal information about process quality you can use next time - a near-miss exposing a missing check. The bug is calling a careful decision stupid solely because luck turned, or calling recklessness genius because it paid.

If I am unwilling to ignore a bad outcome, how do I review fairly?

Score the decision given what was known then, then score the update for next time. Two ledgers: quality of choice, and new information from the result.

Do markets and sports make outcome bias inevitable?

They reward scoreboards, so the bias is constant. Counter with process metrics, pre-registered strategies, and reviews that hide the final score until the process is graded.

Can celebrating wins without process review be harmless?

For party mood, sure. For learning systems, no - unexamined wins teach luck as skill. Save a short "what would we repeat?" even when champagne is open.

What if my organization only punishes failed attempts?

Then outcome bias is policy. Push for blameless process reviews on both hits and misses, or people will hide information and avoid smart risks.

Reframing

Against Outcome Bias, keep the result as data - then grade the decision with the clock rolled back to what was knowable.

Failed plan

Original thought

"It failed, so the plan was reckless."

Reframed thought

"The outcome hurt. I'll judge whether the call was reasonable with what we knew then, and only then decide what to change."

Lucky win

Original thought

"It worked, so it was a brilliant call."

Reframed thought

"We got a good result. I'll check whether the process was sound or we just got lucky before we scale it."

Sports call

Original thought

"That play failed - fire the coach."

Reframed thought

"One play can fail on a good decision. I'll ask about odds and alternatives at the time, not only the final score."

Practice this pattern in the Reframing App - capture the trigger, label it (like Outcome Bias), check evidence, and write a more balanced thought.

Sources

Link copied to clipboard!