What Is the Gamma Distribution?

The gamma distribution is a continuous probability distribution that models the total waiting time until a specific number of events occur.

It is one of the most versatile distributions in statistics and can describe a wide range of phenomena. In fact, both the exponential distribution and the chi-square distribution are special cases of the gamma distribution.

---

Applications in Medicine and Biostatistics

✅ Exponential distribution (Gamma with $\alpha = 1$)

• Radiation therapy: Time until the first cancer cell is destroyed by a dose.
• Emergency room arrivals: Time until the next patient arrives.

This models the time until the first event occurs.

✅ Gamma distribution (integer $\alpha = n$)

• Vaccine response time: Total time needed after multiple doses for the immune system to respond.
• Multistep treatment durations: Total time required for multiple phases of a treatment to complete.

This models the time until the $n$-th event occurs.

✅ Chi-square distribution (Gamma with $\alpha = k/2, \beta = 1/2$)

• Clinical trials: Statistical testing (e.g. $\chi^2$ test) for differences between treatment and control groups.
• Genetic association studies: Testing whether a gene is significantly associated with a disease.

This models the total squared variation in independent normal variables.

---

Probability Density Function

The gamma distribution is defined by the following probability density function:

• $\alpha > 0$: shape parameter
• $\beta > 0$: rate parameter
• $\Gamma(\alpha)$: gamma function, where $\Gamma(n) = (n-1)!$ if $n$ is an integer

This formula defines a family of curves depending on $\alpha$ and $\beta$.

---

Special Cases of the Gamma Distribution

Exponential distribution: $\alpha = 1$

Models the time until the first event.

Chi-square distribution: $\alpha = \frac{k}{2}, \beta = \frac{1}{2}$

The sum of $k$ squared standard normal variables.

---

Visualizing the Gamma Distribution

Interactive Gamma Distribution Explorer

Explore how shape (α) and rate (β) parameters affect the gamma distribution

Current Distribution: Gamma Distribution

Parameters

Shape (α): 2

Rate (β): 1

Statistics

Mean: 2.000

Variance: 2.000

Std Dev: 1.414

Quick Examples

Exponential (α=1)Chi-Square (df=4)Chi-Square (df=8)Gamma Example (α=3)

Distribution Visualization

Probability Density Function

f(x; α, β) = (β^α / Γ(α)) × x^α-1 × e^-βx

Mean

μ = α/β

Variance

σ² = α/β²

Current: f(x; 2, 1)

Use the interactive tool above to explore how the shape ($\alpha$) and rate ($\beta$) affect the distribution.

Quick buttons are also provided to show:

• Exponential distribution ($\alpha = 1$)
• Chi-square distribution ($\alpha = k/2$, $\beta = 1/2$)

---

Additive Property: The Key to Intuition

The shape parameter $\alpha$ represents how many events we’re waiting for.

Sum of exponentials → gamma distribution

If $X_i \sim \mathrm{Exp}(\beta)$ are independent, then:

This means: the time until the $n$-th event is gamma-distributed.

---

Proof via Moment Generating Function (MGF)

The MGF of $X \sim \mathrm{Exp}(\beta)$ is:

Then the MGF of the sum $S_n = \sum X_i$ is:

This matches the MGF of $\mathrm{Gamma}(n, \beta)$:

So, the sum of exponentials is gamma-distributed.

---

Mean, Variance, and Their Intuitive Meaning

Once we understand the gamma distribution as the sum of exponential waiting times, it’s natural to ask: how do the parameters $\alpha$ and $\beta$ affect the average and the spread?

📌 Mean and Variance

For $X \sim \mathrm{Gamma}(\alpha, \beta)$ (with rate parameter $\beta$), we have:

Let’s break this down:

• $\alpha$: the number of events we are waiting for
• $\beta$: the rate at which events occur per unit time

---

🔄 Scaling and the Role of $\beta$

We can derive the variance formula using a change of variables. Let $Y \sim \mathrm{Gamma}(\alpha, 1)$ and define:

This means we’re slowing down time by a factor of $\beta$.

Using the change of variables formula with the Jacobian:

Since:

we get:

which is exactly the density of $\mathrm{Gamma}(\alpha, \beta)$.

Now, from a standard rule in probability:

So:

---

🎯 Intuition: Why is the variance inversely proportional to $\beta^2$?

• Increasing $\alpha$ means waiting for more events → more total time and more variability
• Increasing $\beta$ means time moves faster (events occur more frequently)
  → waiting time becomes shorter and more consistent

But here’s the key:

• Mean is like a “length” → it scales linearly with time: $\mathbb{E}[X] = \frac{\alpha}{\beta}$
• Variance is like “spread in squared units” → it scales with the square of time

So doubling the speed ($\beta \to 2\beta$) makes the mean half as long, but the variance one-fourth as wide.

This is why:

and not just $\frac{\alpha}{\beta}$.

---

Understanding this scaling helps build strong intuition for how gamma models respond to changes in event frequency and cumulative wait time.

---

Summary

• The gamma distribution models total waiting time until a number of events occur.
• It generalizes both the exponential and chi-square distributions.
• It is widely used in medicine, from modeling treatment durations to statistical testing.
• The additive property reveals the intuitive meaning of the shape parameter: how many events you’re waiting for.
• The mean and variance depend on both $\alpha$ and $\beta$, with variance inversely proportional to $\beta^2$—capturing how faster event rates reduce uncertainty more rapidly.