Beta Distribution

Modeling probabilities, percentages, and proportions.

The "Probability of Probabilities" Distribution

The Beta distribution is a continuous probability distribution defined on the interval [0, 1]. This makes it perfectly suited for modeling random variables that represent probabilities or proportions.

In quantitative finance, it's a powerful tool in Bayesian inference and risk modeling. For example, a credit analyst might use it to model the recovery rate on a defaulted loan (which must be between 0% and 100%). A trading strategist could use it to represent the probability of a particular signal being profitable.

Interactive Beta Distribution
Adjust the shape parameters (α and β) to see how they influence the distribution. Note the wide variety of shapes the Beta distribution can take.
Mean (μ\mu): 0.29
Variance (σ2\sigma^2): 0.03

Core Concepts

Probability Density Function (PDF)
The PDF is defined by two positive shape parameters, α and β.
f(x;α,β)=xα1(1x)β1B(α,β)f(x; \alpha, \beta) = \frac{x^{\alpha-1} (1-x)^{\beta-1}}{B(\alpha, \beta)}
  • xx is the variable (a probability, between 0 and 1).
  • α\alpha and β\beta can be thought of as counts of "successes" and "failures".
  • B(α,β)B(\alpha, \beta) is the Beta function, which acts as a normalizing constant.
Cumulative Distribution Function (CDF)
The CDF is the regularized incomplete beta function.
F(x;α,β)=Ix(α,β)F(x; \alpha, \beta) = I_x(\alpha, \beta)

This function is computationally complex and is almost always calculated using statistical software.

Expected Value & Variance

Expected Value (Mean)

E[X]=αα+βE[X] = \frac{\alpha}{\alpha + \beta}

Variance

Var(X)=αβ(α+β)2(α+β+1)Var(X) = \frac{\alpha \beta}{(\alpha + \beta)^2 (\alpha + \beta + 1)}

Key Derivations

Deriving the Expected Value (Mean)
We derive the mean by calculating the integral of xf(x)x \cdot f(x) over its domain [0, 1].

Step 1: Set up the Integral for E[X]

The expected value is the integral of xx times the PDF.

E[X]=01xxα1(1x)β1B(α,β)dxE[X] = \int_{0}^{1} x \cdot \frac{x^{\alpha-1} (1-x)^{\beta-1}}{B(\alpha, \beta)} dx

Step 2: Simplify the Integral

Combine the xx terms and move the constant Beta function outside.

E[X]=1B(α,β)01xα(1x)β1dxE[X] = \frac{1}{B(\alpha, \beta)} \int_{0}^{1} x^{\alpha} (1-x)^{\beta-1} dx

Step 3: Recognize the New Integral

The new integral 01xα(1x)β1dx\int_{0}^{1} x^{\alpha} (1-x)^{\beta-1} dx looks very similar to the definition of a Beta function itself. It is exactly equal to B(α+1,β)B(\alpha+1, \beta).

E[X]=B(α+1,β)B(α,β)E[X] = \frac{B(\alpha+1, \beta)}{B(\alpha, \beta)}

Step 4: Expand Using the Gamma Function

Now, we use the definition of the Beta function in terms of the Gamma function: B(a,b)=Γ(a)Γ(b)Γ(a+b)B(a, b) = \frac{\Gamma(a)\Gamma(b)}{\Gamma(a+b)}.

E[X]=Γ(α+1)Γ(β)Γ(α+1+β)Γ(α)Γ(β)Γ(α+β)E[X] = \frac{\frac{\Gamma(\alpha+1)\Gamma(\beta)}{\Gamma(\alpha+1+\beta)}}{\frac{\Gamma(\alpha)\Gamma(\beta)}{\Gamma(\alpha+\beta)}}

This simplifies to:

E[X]=Γ(α+1)Γ(α)Γ(α+β)Γ(α+β+1)E[X] = \frac{\Gamma(\alpha+1)}{\Gamma(\alpha)} \cdot \frac{\Gamma(\alpha+\beta)}{\Gamma(\alpha+\beta+1)}

Step 5: Apply the Gamma Function Property

Using the property Γ(z+1)=zΓ(z)\Gamma(z+1) = z\Gamma(z), we have:

  • Γ(α+1)=αΓ(α)\Gamma(\alpha+1) = \alpha\Gamma(\alpha)
  • Γ(α+β+1)=(α+β)Γ(α+β)\Gamma(\alpha+\beta+1) = (\alpha+\beta)\Gamma(\alpha+\beta)

Substituting these in:

E[X]=αΓ(α)Γ(α)Γ(α+β)(α+β)Γ(α+β)E[X] = \frac{\alpha\Gamma(\alpha)}{\Gamma(\alpha)} \cdot \frac{\Gamma(\alpha+\beta)}{(\alpha+\beta)\Gamma(\alpha+\beta)}

After canceling terms, we get our final result.

Final Mean Formula
E[X]=αα+βE[X] = \frac{\alpha}{\alpha + \beta}