Carathéodory Extension Theorem

From outer measure to Lebesgue measure: why not every set can be measured, with Cantor and Vitali sets as examples.

Measure TheoryProbability TheoryAdvancedCaratheodoryExtension

From Probability Measures to a Deeper Question

Suppose you already know what a probability measure is and why random variables must be measurable. A natural next question is:

How do we actually construct such a measure?
Can we assign a measure to any set?

The answer is subtle: not every set can be measured. Carathéodory’s method explains how to build a measure and which sets are allowed.

Step 1. Start with Simple Measures

Begin by assigning length to half‑open intervals:

  • For (a,b]R(a,b] \subset \mathbb{R}, set μ((a,b])=ba\mu((a,b]) = b-a.

This is finitely additive on the algebra generated by finite disjoint unions of such intervals.

Step 2. Outer Measure

To talk about arbitrary ERE \subset \mathbb{R}, define the outer measure

m(E)=inf ⁣{  i=1Ii  |  Ei=1Ii,  Ii intervals}.m^*(E) = \inf\!\left\{\;\sum_{i=1}^\infty |I_i|\;\middle|\; E \subset \bigcup_{i=1}^\infty I_i,\; I_i\text{ intervals}\right\}.

Because infima of nonempty subsets of [0,][0,\infty] always exist (possibly ==\infty), the outer measure is defined for every set.

Step 3. Carathéodory-Measurable Sets

A set ERE \subset \mathbb{R} is Carathéodory‑measurable if

m(A)=m ⁣(AE)+m ⁣(AEc)for all AR.m^*(A) = m^*\!\big(A \cap E\big) + m^*\!\big(A \cap E^{c}\big)\quad\text{for all }A \subset \mathbb{R}.

Plainly put: splitting along EE does not break additivity of the outer measure. The collection of all such EE forms a σ\sigma‑algebra.

Step 4. Lebesgue Measure

Restricting mm^* to Carathéodory‑measurable sets yields a σ\sigma‑additive measure on that σ\sigma‑algebra. This is called the Lebesgue measure.

Step 5. Measurable vs Non‑Measurable: Two Canonical Examples

Cantor Set (Measurable yet “weird”)

Construct the Cantor set C[0,1]C \subset [0,1] by repeatedly removing middle thirds:

  1. Start with [0,1][0,1]; remove (13,23)(\tfrac13,\tfrac23).
  2. From each remaining interval, remove its middle third; repeat ad infinitum.

Properties:

  • m(C)=0m(C)=0 (the removed lengths sum to 11),
  • yet CC is uncountable (continuum cardinality),
  • closed and compact,
  • and Lebesgue‑measurable (it satisfies Carathéodory’s condition).

Interactive demo (build the Cantor set visually):

The Cantor Set: Infinite Points, Zero Length

Start with [0,1]. Remove the middle third repeatedly. What remains?

Step 0: Remaining Length = 1.00000000
1
Number of Intervals
1.00000000
Total Length
1
Expected Intervals

Vitali Set (Non‑Measurable, explained carefully)

Define an equivalence relation on R\mathbb{R} by xy    xyQx \sim y \iff x-y \in \mathbb{Q}. Using the axiom of choice, choose one representative from each equivalence class inside [0,1][0,1]; call the resulting set VV (a Vitali set).

Key facts behind non‑measurability (sketch):

  1. For each rational rQ[1,1]r \in \mathbb{Q} \cap [-1,1], consider the translate V+r={v+r:vV}V+r=\{v+r:v\in V\}.
  2. These translates are pairwise disjoint: if (v1+r1)=(v2+r2)(v_1+r_1)=(v_2+r_2) with viVv_i\in V and riQr_i\in\mathbb{Q}, then v1v2=r2r1Qv_1-v_2=r_2-r_1\in\mathbb{Q}; by construction VV picked one representative per rational class, hence v1=v2v_1=v_2 and r1=r2r_1=r_2.
  3. We have
    [0,1]  rQ[1,1](V+r)  [1,2].[0,1]\ \subset\ \bigcup_{r\in\mathbb{Q}\cap[-1,1]} (V+r)\ \subset\ [-1,2].
  4. If VV were Lebesgue‑measurable with measure α=m(V)\alpha=m(V), then by translation invariance and countable additivity,
    rQ[1,1]m(V+r) = rα.\sum_{r\in\mathbb{Q}\cap[-1,1]} m(V+r)\ =\ \sum_{r} \alpha.
    • If α>0\alpha>0, the sum diverges to \infty, contradicting m([1,2])=3m([-1,2])=3.
    • If α=0\alpha=0, the sum is 00, contradicting that the union covers [0,1][0,1], which has measure 11.

Hence VV cannot be measurable: Lebesgue measure cannot be consistently assigned to it. The construction crucially uses the axiom of choice.

Summary

  • Outer measure mm^* exists for every set (infimum always exists).
  • Carathéodory‑measurable sets are exactly those for which splitting preserves additivity.
  • Restricting mm^* to them gives the Lebesgue measure.
  • Not every set is measurable:
    • Cantor set: measurable, m(C)=0m(C)=0, uncountable.
    • Vitali set: non‑measurable; measurability would contradict translation invariance + countable additivity.
← Back to Encyclopedia