<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Induction on kenji.blog</title><link>http://kenji.blog/en/tags/induction/</link><description>Recent content in Induction on kenji.blog</description><generator>Hugo -- gohugo.io</generator><language>en</language><copyright>kenjinote</copyright><lastBuildDate>Thu, 10 Sep 2026 21:00:00 +0900</lastBuildDate><atom:link href="http://kenji.blog/en/tags/induction/index.xml" rel="self" type="application/rss+xml"/><item><title>Are Emeralds Green or 'Grue'?: Goodman's New Riddle of Induction</title><link>http://kenji.blog/en/p/grue-paradox/</link><pubDate>Thu, 10 Sep 2026 21:00:00 +0900</pubDate><guid>http://kenji.blog/en/p/grue-paradox/</guid><description>&lt;img src="http://kenji.blog/p/grue-paradox/img/grue_paradox.jpg" alt="Featured image of post Are Emeralds Green or 'Grue'?: Goodman's New Riddle of Induction" />&lt;p>We predict the &amp;ldquo;future&amp;rdquo; from &amp;ldquo;past experiences&amp;rdquo;.
&amp;ldquo;The sun rose from the east yesterday, so it will rise from the east tomorrow as well.&amp;rdquo;
&amp;ldquo;All emeralds we have seen so far were green, so the next emerald unearthed will also be green.&amp;rdquo;&lt;/p>
&lt;p>Such reasoning is called &amp;ldquo;induction&amp;rdquo;, and it is the foundation of all science. However, in 1955, philosopher Nelson Goodman devised a bizarre concept of color to show that this induction has a fundamental flaw. That is the &lt;strong>&amp;ldquo;Grue&amp;rdquo; paradox&lt;/strong>.&lt;/p>
&lt;h2 id="definition-of-the-new-color-grue">Definition of the New Color &amp;ldquo;Grue&amp;rdquo;
&lt;/h2>&lt;p>Goodman defined a new property (color) called &amp;ldquo;Grue&amp;rdquo;, which is a synthesis of &amp;ldquo;Green&amp;rdquo; and &amp;ldquo;Blue&amp;rdquo;, as follows.&lt;/p>
&lt;blockquote>
&lt;p>&lt;strong>Definition of Grue:&lt;/strong>
An object is &amp;ldquo;grue&amp;rdquo; if it is observed before a specific time $t$ (e.g., January 1, 2030) and is &amp;ldquo;green&amp;rdquo;, and if it is observed at or after time $t$ and is &amp;ldquo;blue&amp;rdquo;.&lt;/p>
&lt;/blockquote>
$$
\text{Grue} =
\begin{cases}
\text{Green} &amp; (\text{Time} &lt; t) \\
\text{Blue} &amp; (\text{Time} \ge t)
\end{cases}
$$
&lt;p>According to this definition, the green emerald you hold in your hand right now (before time $t$) is simultaneously &amp;ldquo;green&amp;rdquo; and &amp;ldquo;grue&amp;rdquo;.&lt;/p>
&lt;h2 id="why-is-it-a-paradox">Why is it a Paradox?
&lt;/h2>&lt;p>The paradox occurs when we try to predict the future.
All emeralds humanity has observed so far have been &amp;ldquo;green&amp;rdquo;. Therefore, using induction, we predict the following:&lt;/p>
&lt;p>&lt;strong>Hypothesis A: &amp;ldquo;All emeralds are &amp;lsquo;green&amp;rsquo;&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>But wait a minute. Since all emeralds observed so far were from before time $t$, they must have also all been &amp;ldquo;grue&amp;rdquo;. Therefore, from exactly the same observational data, the following prediction also holds true.&lt;/p>
&lt;p>&lt;strong>Hypothesis B: &amp;ldquo;All emeralds are &amp;lsquo;grue&amp;rsquo;&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>If we follow the rules of induction, past observations support Hypothesis B with &amp;ldquo;exactly the same strength&amp;rdquo; as they support Hypothesis A.&lt;/p>
&lt;div class="mermaid">graph TD
A["Past observation: All emeralds were green"] -->|Simultaneously| B["Past observation: All emeralds were 'grue'"]
A --> C["Inductive prediction A: Future emeralds will also be 'green'"]
B --> D["Inductive prediction B: Future emeralds will also be 'grue'"]
C --> E["Remain green even after time t"]
D --> F["Turn 'blue' after time t!"]
style C fill:#4CAF50,stroke:#333,color:#fff
style D fill:#2196F3,stroke:#333,color:#fff
style F fill:#F44336,stroke:#333,color:#fff,stroke-width:2px&lt;/div>
&lt;h2 id="will-emeralds-turn-blue">Will Emeralds Turn Blue?
&lt;/h2>&lt;p>If Hypothesis B is correct, the moment time $t$ arrives, all emeralds in the world must simultaneously turn &amp;ldquo;blue&amp;rdquo; (from the definition of grue).&lt;/p>
&lt;p>Intuitively, we think, &amp;ldquo;That&amp;rsquo;s absurd. Hypothesis B is unnatural wordplay, and Hypothesis A (green) must be the correct one.&amp;rdquo;&lt;/p>
&lt;p>However, Goodman&amp;rsquo;s question lies much deeper.
&lt;strong>Even though both &amp;ldquo;green&amp;rdquo; and &amp;ldquo;grue&amp;rdquo; hypotheses perfectly match past data, why do we consider only the &amp;ldquo;green&amp;rdquo; prediction as valid and eliminate the &amp;ldquo;grue&amp;rdquo; prediction? What is the &amp;ldquo;logical basis&amp;rdquo; for that?&lt;/strong>&lt;/p>
&lt;h2 id="challenge-to-the-uniformity-of-nature">Challenge to the &amp;ldquo;Uniformity of Nature&amp;rdquo;
&lt;/h2>&lt;p>To avoid this problem, an objection comes to mind: &amp;ldquo;We should use simple concepts like &amp;lsquo;green&amp;rsquo; and not complex, time-dependent concepts like &amp;lsquo;grue&amp;rsquo;.&amp;rdquo;&lt;/p>
&lt;p>However, Goodman showed the opposite: if we define a color &amp;ldquo;Bleen&amp;rdquo; (blue until time $t$, green thereafter), the very concept of &amp;ldquo;green&amp;rdquo; becomes a complex, time-dependent concept (&amp;ldquo;grue&amp;rdquo; until time $t$, &amp;ldquo;bleen&amp;rdquo; thereafter).
In other words, which words we take as &amp;ldquo;fundamental&amp;rdquo; is merely a habit of our language.&lt;/p>
&lt;p>Goodman&amp;rsquo;s &amp;ldquo;Grue&amp;rdquo; paradox (the new riddle of induction) proved that scientific theories are not determined merely by objective data alone, but depend heavily on &amp;ldquo;what conceptual framework (language) we use to carve up the world&amp;rdquo;.&lt;/p>
&lt;p>Even in the context of AI and machine learning, this paradox continues to hold significant meaning today as the problem of &amp;ldquo;overfitting&amp;rdquo; and &amp;ldquo;bias&amp;rdquo;, where even with the same training data, predictions for the future can completely change depending on the &amp;ldquo;structure of the model (which features it focuses on)&amp;rdquo;.&lt;/p></description></item><item><title>Does seeing a blue apple prove 'ravens are black'? : Hempel's Ravens</title><link>http://kenji.blog/en/p/hempels-ravens/</link><pubDate>Thu, 10 Sep 2026 21:00:00 +0900</pubDate><guid>http://kenji.blog/en/p/hempels-ravens/</guid><description>&lt;img src="http://kenji.blog/p/hempels-ravens/img/hempels_ravens.jpg" alt="Featured image of post Does seeing a blue apple prove 'ravens are black'? : Hempel's Ravens" />&lt;p>How do scientists prove theories? Usually, they use &amp;ldquo;induction,&amp;rdquo; gathering data by observing the world.
For example, if you wanted to prove the hypothesis that &amp;ldquo;all ravens are black,&amp;rdquo; you would observe ravens around the world and confirm one by one that they are black.&lt;/p>
&lt;p>However, in the 1940s, logician Carl Hempel pointed out a strange logical loophole hidden in this commonplace scientific method.
This is the paradox of &lt;strong>Hempel&amp;rsquo;s Ravens&lt;/strong>, which states that &lt;strong>&amp;ldquo;simply seeing a blue apple or a red shoe serves as evidence that &amp;lsquo;ravens are black&amp;rsquo;.&amp;rdquo;&lt;/strong>&lt;/p>
&lt;h2 id="logical-substitution-the-magic-of-the-contrapositive">Logical Substitution: The Magic of the Contrapositive
&lt;/h2>&lt;p>To understand Hempel&amp;rsquo;s argument, we must recall the concept of the &lt;strong>&amp;ldquo;contrapositive&amp;rdquo;&lt;/strong> learned in high school mathematics.&lt;/p>
&lt;p>In logic, if a proposition &amp;ldquo;If A, then B&amp;rdquo; is true, its contrapositive &amp;ldquo;If not B, then not A&amp;rdquo; must also be true (this is called logical equivalence).&lt;/p>
&lt;p>Hypothesis $H_1$: &lt;strong>&amp;ldquo;All ravens are black (If it is a raven, then it is black)&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>Let&amp;rsquo;s take the contrapositive of this hypothesis $H_1$.
It becomes &amp;ldquo;If it is not black, then it is not a raven.&amp;rdquo;&lt;/p>
&lt;p>Hypothesis $H_2$: &lt;strong>&amp;ldquo;Everything that is not black is not a raven&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>According to the rules of logic, $H_1$ and $H_2$ have &lt;strong>exactly the same meaning (equivalence)&lt;/strong>. If one is proven, the other is automatically proven as well.&lt;/p>
&lt;h2 id="proving-ravens-without-seeing-ravens">Proving Ravens Without Seeing Ravens
&lt;/h2>&lt;p>Now, to confirm hypothesis $H_1$ (ravens are black), every time you find a black raven, the certainty (evidence) of the hypothesis gets a little stronger.
This is something everyone can agree on.&lt;/p>
&lt;p>However, since $H_1$ and $H_2$ mean the same thing, finding evidence for hypothesis $H_2$ (things that are not black are not ravens) should directly serve as evidence for hypothesis $H_1$.&lt;/p>
&lt;p>So, what constitutes evidence for $H_2$?
You just need to find something that is &amp;ldquo;not black and not a raven.&amp;rdquo;&lt;/p>
&lt;ul>
&lt;li>Suppose there is a &lt;strong>&amp;ldquo;blue apple&amp;rdquo;&lt;/strong> on the table. It is not black, and it is not a raven. Therefore, it is evidence supporting $H_2$.&lt;/li>
&lt;li>There are &lt;strong>&amp;ldquo;red shoes&amp;rdquo;&lt;/strong> in the closet. These are also not black and not ravens. They are evidence for $H_2$.&lt;/li>
&lt;li>A &lt;strong>&amp;ldquo;white cloud&amp;rdquo;&lt;/strong> is floating in the sky. This is also evidence for $H_2$.&lt;/li>
&lt;/ul>
&lt;p>Since evidence for $H_2$ holds the same value as evidence for $H_1$, the following bizarre conclusion is logically derived:&lt;/p>
&lt;p>&lt;strong>&amp;ldquo;The more you observe blue apples and red shoes in a room, the more the hypothesis &amp;lsquo;all ravens are black&amp;rsquo; is proven to be true.&amp;rdquo;&lt;/strong>&lt;/p>
&lt;div class="mermaid">graph TD
A["Proposition H1: All ravens are black"] &lt;-->|Logical equivalence (Contrapositive)| B["Proposition H2: What is not black is not a raven"]
C["Observation: Black raven"] -->|Serves as evidence for| A
D["Observation: Blue apple"] -->|Serves as evidence for| B
D -.->|Therefore, this should also be evidence for?| A
style A fill:#4CAF50,stroke:#333,stroke-width:2px,color:#fff
style B fill:#4CAF50,stroke:#333,stroke-width:2px,color:#fff
style C fill:#2196F3,stroke:#333,color:#fff
style D fill:#FF9800,stroke:#333,color:#fff&lt;/div>
&lt;h2 id="why-is-it-counterintuitive">Why Is It Counterintuitive?
&lt;/h2>&lt;p>No ornithologist anywhere in the world grows more convinced that &amp;ldquo;ravens are black&amp;rdquo; by looking at a blue apple. Although it should be perfectly correct logically, why does our common sense reject this?&lt;/p>
&lt;p>Several approaches have been proposed in the fields of philosophy and statistics to address this paradox.&lt;/p>
&lt;h3 id="1-the-bayesian-solution-difference-in-information-content">1. The Bayesian Solution (Difference in Information Content)
&lt;/h3>&lt;p>The most compelling counterargument from the perspective of modern statistics (Bayesian probability) focuses on the difference in the &amp;ldquo;strength of evidence (information content).&amp;rdquo;&lt;/p>
&lt;p>In the world, there are overwhelmingly more &amp;ldquo;things that are not black&amp;rdquo; than &amp;ldquo;black things,&amp;rdquo; and astronomically more &amp;ldquo;things that are not ravens&amp;rdquo; than &amp;ldquo;ravens.&amp;rdquo;&lt;/p>
&lt;p>When you see a blue apple, it certainly serves as evidence that &amp;ldquo;all ravens are black,&amp;rdquo; but &lt;strong>its value as evidence (the increase in probability) is infinitely close to zero&lt;/strong>.
Confirming just one of the countless &amp;ldquo;non-black things&amp;rdquo; in the vast universe raises the probability that &amp;ldquo;ravens are black&amp;rdquo; by an amount comparable to the effect of removing a single grain of sand from a desert. On the other hand, directly finding one black raven carries an overwhelmingly greater evidentiary value.&lt;/p>
&lt;p>In other words, the Bayesian solution is that logically &amp;ldquo;a blue apple is evidence,&amp;rdquo; but practically &amp;ldquo;its evidentiary value is equal to zero and can be ignored.&amp;rdquo;&lt;/p>
&lt;h3 id="2-the-limits-of-indoor-ornithology">2. The Limits of &amp;ldquo;Indoor Ornithology&amp;rdquo;
&lt;/h3>&lt;p>This paradox highlights how the foundation of science known as &amp;ldquo;induction (deriving general laws from observation)&amp;rdquo; rests on a fragile premise. Relying solely on logical equivalence would enable &amp;ldquo;indoor ornithology,&amp;rdquo; where one could verify any universal law (&amp;ldquo;all swans are white,&amp;rdquo; &amp;ldquo;no aliens are green,&amp;rdquo; etc.) simply by observing the junk in a room without ever going outside.&lt;/p>
&lt;p>Hempel&amp;rsquo;s Ravens is a fascinating paradox that shows that the words &amp;ldquo;evidence&amp;rdquo; and &amp;ldquo;proof&amp;rdquo; we unconsciously use cannot be fully captured by the rules of pure symbolic logic alone.&lt;/p></description></item></channel></rss>