Lesson 2.3: The "Weird Algebra" of Infinitesimals (Our New Rules)

Welcome to Lesson 2.3. In our last two lessons, we made two critical discoveries.

  • Failure (Lesson 2.1): Summing the 1st power of random steps, ΔW\sum |\Delta W|, goes to infinity.
  • Success! (Lesson 2.2): Summing the 2nd power of random steps, (ΔW)2\sum (\Delta W)^2, converges to a finite, non-random number: TT (the total time).

This is our "Aha!" Moment. We now have a "Rosetta Stone" that lets us translate between the random world and the normal world.

In this lesson, we will convert that "big-picture" sum (a calculus concept) into a simple, powerful set of "multiplication rules" (an algebra concept). These rules are the "cheat sheet" we will use to build Itô's Lemma in the next module.

Part 1: Deriving the Master Rule: (dWt)² = dt

This is the most important rule in all of finance. Let's see exactly where it comes from.

What We Found (Lesson 2.2):

We proved that the sum of all the squared random steps is equal to the sum of all the tiny time steps.

limni=1n(ΔWi)2=T\lim_{n \to \infty} \sum_{i=1}^n (\Delta W_i)^2 = T

We also know, from Lesson 1.5, that:

limni=1nΔt=T\lim_{n \to \infty} \sum_{i=1}^n \Delta t = T

The Logical Leap:

If the total sum of all the (ΔWi)2(\Delta W_i)^2 pieces is equal to the total sum of all the Δt\Delta t pieces... then any one tiny piece from the first sum, (ΔWi)2(\Delta W_i)^2, must be "equal in weight" to its corresponding tiny piece from the second sum, Δt\Delta t.

The "Piles of Sand" Analogy

Imagine you have a pile of a million tiny, random pebbles (the (ΔWi)2\sum (\Delta W_i)^2 pile) and a pile of a million tiny, identical grains of sand (the Δt\sum \Delta t pile). From Lesson 2.2, you know the total weight of both piles is exactly the same (they both equal TT). Therefore, the "typical" weight of one random pebble, (ΔWi)2(\Delta W_i)^2, must be equal to the weight of one grain of sand, Δt\Delta t.

The Final Step: Δ → d (Infinitesimal Notation)

In calculus, we move from "delta" (Δ\Delta a tiny step) to "differential" (dd an infinitely small step) to make our rules exact.

Δt\Delta t becomes dtdt (an infinitely small step in time)

ΔWt\Delta W_t becomes dWtdW_t (an infinitely small random step)

By replacing the Δ\Delta with dd in our new rule, we get the Master Rule of Itô Calculus:

(dWt)2=dt(dW_t)^2 = dt

This rule is the "weird algebra" in its final form. It states that the "squared" infinitesimal random step is not zero, but instead becomes a "first-order" infinitesimal time step.

Part 2: Deriving the "Normal" Rules

Now that we have our "master" rule, we need to formalize the other rules for multiplication. These are the "normal" rules we learned in Lesson 0.8.

Rule #2: What is (dt)²?

Δt\Delta t is a small number (e.g., 0.01). (Δt)2(\Delta t)^2 is a much smaller number (e.g., 0.0001). In the limit as Δt0\Delta t \to 0, the (Δt)2(\Delta t)^2 term is "infinitely smaller" than Δt\Delta t and becomes zero. Rule #1: (Δt)² ≈ 0

(dt)2=0(dt)^2 = 0

Rule #3: What is dt ⋅ dWt?

We find its "order of magnitude" using our "typical size" logic from Lesson 1.3: The size of dtdt is of order 1. The "typical size" of dWtdW_t is dt\sqrt{dt}, which is order 0.5. So, the "typical size" of their product is: (dt)(dt)=(dt)1.5(dt) \cdot (\sqrt{dt}) = (dt)^{1.5}. If dt=0.01dt = 0.01, then (dt)1.50.001(dt)^{1.5} \approx 0.001. Just like (dt)2(dt)^2, this term is "infinitely smaller" than dtdt and goes to zero in the limit.

dtdWt=0dt \cdot dW_t = 0

Part 3: The "So What?" (Our New "Multiplication Table")

We have just built the complete "cheat sheet" for Itô calculus. This is the new "algebra" that all of our derivations will be based on. Anytime we are expanding a formula (like a Taylor series) and we see these terms, we can now simplify them.

Itô "Weird Algebra" Rules
×dtdWt
dt0\to 00\to 0
dWt0\to 0dt\to dt

In simple terms: Any term "squared" with a dtdt (like (dt)2(dt)^2) is 0. Any "mixed" term (dtdWtdt \cdot dW_t) is 0. The only second-order term that survives is (dWt)2(dW_t)^2, which magically becomes a first-order term: dtdt.

What's Next? (The 'Hook')

    You now have your "rules of engagement." This multiplication table is the only thing we need (in addition to our Taylor expansion from Module 0) to build the "master tool" of finance.

    In our next module, Module 3: Itô's Lemma, we will finally build the "chain rule" for stochastic calculus.

    We will start with our 2-variable Taylor expansion (from Lesson 1.7):

    ΔV+12(+22VtS(ΔtΔS)+2VS2(ΔS)2)\Delta V \approx \dots + \frac{1}{2}\left( \dots + 2\frac{\partial^2 V}{\partial t \partial S}(\Delta t \Delta S) + \frac{\partial^2 V}{\partial S^2}(\Delta S)^2 \right)

    We will plug in our stock SDE: ΔS=μStΔt+σStΔWt\Delta S = \mu S_t \Delta t + \sigma S_t \Delta W_t. When we do, we will get terms like (Δt)2(\Delta t)^2, ΔtΔWt\Delta t \Delta W_t, and (ΔWt)2(\Delta W_t)^2. And now, thanks to this lesson, we have the simple rules to know exactly which terms "die" (go to 0) and which "survive."

    The one term that survives, (ΔWt)2Δt(\Delta W_t)^2 \to \Delta t, will give us the famous "Itô correction term" that makes the Black-Scholes equation possible. You are now ready to derive.

Up Next: The Itô Integral