Carathéodory Extension Theorem
From outer measure to Lebesgue measure: why not every set can be measured, with Cantor and Vitali sets as examples.
From Probability Measures to a Deeper Question
Suppose you already know what a probability measure is and why random variables must be measurable. A natural next question is:
How do we actually construct such a measure?
Can we assign a measure to any set?
The answer is subtle: not every set can be measured. Carathéodory’s method explains how to build a measure and which sets are allowed.
Step 1. Start with Simple Measures
Begin by assigning length to half‑open intervals:
- For , set .
This is finitely additive on the algebra generated by finite disjoint unions of such intervals.
Step 2. Outer Measure
To talk about arbitrary , define the outer measure
Because infima of nonempty subsets of always exist (possibly ), the outer measure is defined for every set.
Step 3. Carathéodory-Measurable Sets
A set is Carathéodory‑measurable if
Plainly put: splitting along does not break additivity of the outer measure. The collection of all such forms a ‑algebra.
Step 4. Lebesgue Measure
Restricting to Carathéodory‑measurable sets yields a ‑additive measure on that ‑algebra. This is called the Lebesgue measure.
Step 5. Measurable vs Non‑Measurable: Two Canonical Examples
Cantor Set (Measurable yet “weird”)
Construct the Cantor set by repeatedly removing middle thirds:
- Start with ; remove .
- From each remaining interval, remove its middle third; repeat ad infinitum.
Properties:
- (the removed lengths sum to ),
- yet is uncountable (continuum cardinality),
- closed and compact,
- and Lebesgue‑measurable (it satisfies Carathéodory’s condition).
Interactive demo (build the Cantor set visually):
The Cantor Set: Infinite Points, Zero Length
Start with [0,1]. Remove the middle third repeatedly. What remains?
Vitali Set (Non‑Measurable, explained carefully)
Define an equivalence relation on by . Using the axiom of choice, choose one representative from each equivalence class inside ; call the resulting set (a Vitali set).
Key facts behind non‑measurability (sketch):
- For each rational , consider the translate .
- These translates are pairwise disjoint: if with and , then ; by construction picked one representative per rational class, hence and .
- We have
- If were Lebesgue‑measurable with measure , then by translation invariance and countable additivity,
- If , the sum diverges to , contradicting .
- If , the sum is , contradicting that the union covers , which has measure .
Hence cannot be measurable: Lebesgue measure cannot be consistently assigned to it. The construction crucially uses the axiom of choice.
Summary
- Outer measure exists for every set (infimum always exists).
- Carathéodory‑measurable sets are exactly those for which splitting preserves additivity.
- Restricting to them gives the Lebesgue measure.
- Not every set is measurable:
- Cantor set: measurable, , uncountable.
- Vitali set: non‑measurable; measurability would contradict translation invariance + countable additivity.