<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Psychology on kenji.blog</title><link>http://kenji.blog/en/categories/psychology/</link><description>Recent content in Psychology on kenji.blog</description><generator>Hugo -- gohugo.io</generator><language>en</language><copyright>kenjinote</copyright><lastBuildDate>Thu, 10 Sep 2026 21:00:00 +0900</lastBuildDate><atom:link href="http://kenji.blog/en/categories/psychology/index.xml" rel="self" type="application/rss+xml"/><item><title>Does 'Testing Positive' = 'Sick'? The Base Rate Fallacy</title><link>http://kenji.blog/en/p/base-rate-fallacy/</link><pubDate>Thu, 10 Sep 2026 21:00:00 +0900</pubDate><guid>http://kenji.blog/en/p/base-rate-fallacy/</guid><description>&lt;img src="http://kenji.blog/p/base-rate-fallacy/img/base_rate_fallacy.jpg" alt="Featured image of post Does 'Testing Positive' = 'Sick'? The Base Rate Fallacy" />&lt;p>Anyone would panic if they received a &amp;ldquo;positive (abnormal)&amp;rdquo; result on a health checkup or cancer screening.
However, with knowledge of statistics and probability, you might be able to take a deep breath and stay calm. This is because &lt;strong>&amp;ldquo;testing positive on a highly accurate test&amp;rdquo; does not necessarily mean &amp;ldquo;there is a high probability of actually having the disease.&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>This is a typical cognitive bias called the &lt;strong>&amp;ldquo;Base Rate Fallacy&amp;rdquo;&lt;/strong> or &amp;ldquo;Base Rate Neglect,&amp;rdquo; where human intuition significantly misjudges probability calculations.&lt;/p>
&lt;h2 id="the-terrifying-health-checkup-problem">The Terrifying Health Checkup Problem
&lt;/h2>&lt;p>Imagine the following situation.&lt;/p>
&lt;p>In a certain town, there is an unknown disease that infects 1 in 10,000 people (0.01%).
To detect this disease, an excellent test kit with &lt;strong>&amp;ldquo;99% accuracy&amp;rdquo;&lt;/strong> has been developed.
(* 99% accuracy means that if a sick person takes the test, there is a 99% chance it will correctly determine &amp;ldquo;positive,&amp;rdquo; and if a healthy person takes the test, there is a 99% chance it will correctly determine &amp;ldquo;negative.&amp;rdquo;)&lt;/p>
&lt;p>You happen to take this test, and the result is &lt;strong>&amp;ldquo;positive.&amp;rdquo;&lt;/strong>
Now, what is the &lt;strong>actual probability that you are infected with this disease&lt;/strong>?&lt;/p>
&lt;p>Many people intuitively answer, &amp;ldquo;Since the test accuracy is 99%, the probability that I am sick must also be 99%.&amp;rdquo;
However, the mathematically correct answer is &lt;strong>&amp;ldquo;about 0.98% (less than 1%).&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>Why on earth does the actual probability become less than 1% even with 99% accuracy?&lt;/p>
&lt;h2 id="bayes-theorem-and-visualizing-the-whole">Bayes&amp;rsquo; Theorem and Visualizing the Whole
&lt;/h2>&lt;p>The key to solving this problem lies in considering not only the accuracy of the test but also &lt;strong>&amp;ldquo;how rare the disease originally is (base rate / prior probability).&amp;rdquo;&lt;/strong>
Let&amp;rsquo;s visualize this counter-intuitive phenomenon using a large population of 1 million people.&lt;/p>
&lt;ul>
&lt;li>&lt;strong>Total Population&lt;/strong>: 1,000,000 people&lt;/li>
&lt;li>&lt;strong>Actually Sick People&lt;/strong> (1 in 10,000): 100 people&lt;/li>
&lt;li>&lt;strong>Healthy People&lt;/strong>: 999,900 people&lt;/li>
&lt;/ul>
&lt;p>We administer the &amp;ldquo;99% accurate&amp;rdquo; test to all 1 million of these people.&lt;/p>
&lt;h3 id="1-when-actually-sick-people-100-take-the-test">1. When Actually Sick People (100) Take the Test
&lt;/h3>&lt;p>Since the accuracy is 99%, those correctly determined as &amp;ldquo;positive&amp;rdquo; are:
100 people × 99% = &lt;strong>99 people&lt;/strong> (True Positives)&lt;/p>
&lt;h3 id="2-when-healthy-people-999900-take-the-test">2. When Healthy People (999,900) Take the Test
&lt;/h3>&lt;p>Since the accuracy is 99%, there are people who are incorrectly determined as &amp;ldquo;positive&amp;rdquo; with a 1% probability (false positives):
999,900 people × 1% = &lt;strong>9,999 people&lt;/strong> (False Positives)&lt;/p>
&lt;div class="mermaid">graph TD
A["Total Population (1,000,000 people)"] --> B["Sick People (100 people)"]
A --> C["Healthy People (999,900 people)"]
B -->|99% Correct| B1["True Positives (99 people)"]
B -->|1% Failure| B2["False Negatives (1 person)"]
C -->|99% Correct| C1["True Negatives (989,901 people)"]
C -->|1% Failure| C2["False Positives (9,999 people)"]
B1 -.-> D{"Total Number of People Told 'Positive': 10,098 people"}
C2 -.-> D
style A fill:#ECEFF1,stroke:#333
style B fill:#FFCDD2,stroke:#333
style C fill:#C8E6C9,stroke:#333
style B1 fill:#F44336,stroke:#333,color:#fff
style C2 fill:#FF9800,stroke:#333,color:#fff
style D fill:#FFF9C4,stroke:#333,stroke-width:2px&lt;/div>
&lt;h2 id="the-real-probability-that-you-are-sick">The Real Probability That You Are Sick
&lt;/h2>&lt;p>Now, you have been told by the doctor, &amp;ldquo;You are positive.&amp;rdquo;
This means that you have entered the group &amp;ldquo;Total Number of People Told &amp;lsquo;Positive&amp;rsquo; (10,098 people)&amp;rdquo; at the bottom right of the diagram.&lt;/p>
&lt;p>What is the proportion of &lt;strong>&amp;ldquo;people who are actually sick (True Positives)&amp;rdquo;&lt;/strong> within this group?&lt;/p>
$$ \text{Probability of actually being sick} = \frac{\text{True Positives}}{\text{Everyone told they are positive}} = \frac{99}{99 + 9,999} = \frac{99}{10,098} \approx 0.0098 $$
&lt;p>The calculated result is &lt;strong>about 0.98%&lt;/strong>.
Despite being told &amp;ldquo;positive,&amp;rdquo; the probability that you are healthy (False Positive) is overwhelmingly higher (about 99%).&lt;/p>
&lt;h2 id="why-does-intuition-make-mistakes">Why Does Intuition Make Mistakes?
&lt;/h2>&lt;p>This phenomenon is mathematically explained by &lt;strong>&amp;ldquo;Bayes&amp;rsquo; Theorem,&amp;rdquo;&lt;/strong> which calculates conditional probability, but the human brain is very poor at this calculation.&lt;/p>
&lt;p>The reason we make mistakes is that we are distracted by the specific, intense information provided right in front of us (&amp;ldquo;Your test result is positive! The accuracy is 99%!&amp;rdquo;), and we ignore the vast, boring statistical background data (&amp;ldquo;In the first place, only 1 in 10,000 people has this disease (base rate)&amp;rdquo;).&lt;/p>
&lt;p>&lt;strong>Because the &amp;ldquo;rarity of the disease (0.01%)&amp;rdquo; is much more extreme than the &amp;ldquo;inaccuracy of the test (1%),&amp;rdquo; the slight testing errors quickly swallow up the actual number of sick people.&lt;/strong>&lt;/p>
&lt;h2 id="the-base-rate-fallacy-hidden-in-society">The &amp;ldquo;Base Rate Fallacy&amp;rdquo; Hidden in Society
&lt;/h2>&lt;p>This illusion causes panic and incorrect judgments not only in medical care but in various situations.&lt;/p>
&lt;ul>
&lt;li>&lt;strong>Facial Recognition Systems and Terrorists&lt;/strong>:
Even if a facial recognition camera with 99.9% accuracy finds a &amp;ldquo;terrorist&amp;rdquo; at an airport, because the base probability of terrorists is extremely low, almost everyone caught will be innocent civilians with similar faces (False Positives).&lt;/li>
&lt;li>&lt;strong>Traffic Accidents and Elderly Drivers&lt;/strong>:
Even if you feel it&amp;rsquo;s dangerous seeing news that &amp;ldquo;XX% of cars that caused accidents were driven by elderly people,&amp;rdquo; unless you consider the &amp;ldquo;proportion of elderly people among all drivers on the road in the first place (base rate),&amp;rdquo; you cannot know if a specific age group is truly more prone to causing accidents.&lt;/li>
&lt;/ul>
&lt;p>The &amp;ldquo;Base Rate Fallacy&amp;rdquo; teaches us the importance of statistical thinking: especially when we see shocking numbers or individual cases, we should step back and consider &lt;strong>&amp;ldquo;how likely is that to happen within the whole in the first place (base rate).&amp;rdquo;&lt;/strong>&lt;/p></description></item></channel></rss>