Base Rate Fallacy
You combine prior odds and new evidence wrong - case detail hijacks the probability the math would give.
Explained
Base Rate Fallacy is a formal error in probabilistic reasoning. You have a prior (how common something is) and new evidence (a test, a witness, a profile match). The fallacy is answering as if the case detail alone set the odds, without properly updating from the starting rate.
People often neglect or misuse base rates once vivid case information is on the table. A rare disease plus a positive test does not equal "almost certainly diseased" unless you do the math with prevalence. A "looks like an engineer" story does not set the odds without the population mix. Representativeness makes the story feel like the probability. The fallacy is the broken update.
Base-rate neglect is the everyday habit of letting vivid cases crowd out frequency. The base-rate fallacy names the formal error when priors and evidence are combined incorrectly. Neglect of probability shrugs at odds more broadly. Availability supplies the vivid case that tempts the skip.
Case evidence can be powerful. The bug is treating it as a replacement for the denominator instead of as a likelihood to fold into the prior.
Write the base rate first. Then ask how strongly the evidence should move you. If you cannot say, you are guessing with a story.
Examples
- "The test is 99% accurate, so I'm 99% sure."
- "They match the profile - must be the one."
- "It looks like fraud, so it probably is."
- "False positives are rare, so ignore prevalence."
- "I've never seen that fail, so the base rate is near zero."
- "The witness is sure; prior odds don't matter."
- "This resume screams founder - hire probability is high."
- "Positive screen means we found it."
Real-world scenarios
Screening shock: a rare condition's test is highly accurate. A positive result still leaves most positives as false when prevalence is tiny. Bar-Hillel's fallacy - accuracy feelings replaced Bayes.
Security alert: an anomaly detector flags "suspicious" behavior common among innocents. Analysts treat the flag as near-proof without the base rate of benign anomalies.
Hiring stereotype: a candidate "fits the successful founder story." The room forgets how many non-founders fit the same story.
Fraud review: one vivid pattern match elevates a case while the frequency of that pattern among honest users stays unread.
Medical forum: a battery of specific symptoms from a blog post sets fear at 90% while population rates were never opened.
Impact
Base-rate fallacy drives false certainty after tests, flags, and profiles.
Medicine, security, and HR over-treat, over-punish, or over-invest on impressive case matches with tiny priors.
Public scare stories convert rare events into felt majorities.
Personal risk choices swing on anecdotes that never meet a denominator.
Over time you trust stories more than rates - and cannot notice when the math disagreed.
Causes
Case information is concrete and causal-feeling; base rates are abstract.
Representativeness equates "looks like" with "likely to be."
People confuse a test's accuracy with the posterior probability after a positive result.
Research
Bar-Hillel's 1980 Acta Psychologica paper, The Base-Rate Fallacy in Probability Judgments, analyzed how and when people fail to incorporate base-rate information into probability judgments.
The fallacy appears especially when individuating case detail is present and feels diagnostic - even when the prior remains crucial to a correct posterior.
The practical lesson is to state prevalence before you interpret the cue, and to translate "accurate test" into expected false positives in the population you actually have.
How to spot it in yourself
- You quote accuracy and skip prevalence.
- Profile resemblance sets your probability alone.
- You cannot name the base rate for the claim you're making.
- False-positive counts feel irrelevant once a flag appears.
- Stories beat denominators in your briefings.
- Surprise at Bayes results is routine.
Prevention
Do the update on purpose.
- Write base rate, hit rate, and false-positive rate before concluding.
- Translate to natural frequencies: "out of 10,000 people..."
- Ask how common the lookalike is among non-cases.
- Separate "evidence is strong" from "posterior is high."
- In reviews, require the prior on the slide.
- When accuracy is quoted, demand the population it applies to.
Reframing
Against Base Rate Fallacy, keep useful case clues - then fold them into the prior instead of replacing it.
99% accurate
"The test is 99% accurate, so I'm 99% sure."
"Accuracy isn't the posterior. I'll bring in prevalence before I set my odds."
Profile match
"They match the profile - must be the one."
"Match is evidence. I'll ask how many non-targets match too before I call it proof."
Looks like fraud
"It looks like fraud, so it probably is."
"Looks-like is representativeness. I'll check the base rate of this pattern among honest cases."
Practice this pattern in the Reframing App - capture the trigger, label it (like Base Rate Fallacy), check evidence, and write a more balanced thought.
Sources
- Bar-Hillel, M. (1980). The Base-Rate Fallacy in Probability Judgments. Acta Psychologica.