Skip to content
ISEGORIABenjamin Haire

ISEGORIA / MATH ENCYCLOPEDIA

Stochastic processes: Brownian motion and noise

Random walks rescaled into Brownian motion, quadratic variation, and densities that obey Fokker–Planck.

Before you begin: Probability, measure theory, and Markov chains

Predict, manipulate, then check your reasoning against the example and question. Graphs illustrate the mathematics; they do not replace a proof.

1. From random walk to Brownian motion

Take n coin-flip steps, shrink time by n and space by √n. As n grows, the paths stop looking like staircases and start looking like one universal random curve. Zoom in: a quarter of the time and half of the space looks statistically the same as the whole.

Worked example. At \(t=1\), the endpoint histogram approaches the standard normal density; the shaded bands are \(\pm\sqrt t\) and \(\pm2\sqrt t\).

Watch out. Donsker’s theorem is convergence in distribution of whole paths. Any single simulated path is still a staircase at fine enough scale.

Why scale space by √n rather than n?

The variance of n independent ±1 steps is n, so dividing by \(\sqrt n\) is the only choice that keeps the endpoint variance at 1.

Reference: Gregory F. Lawler · Stochastic Calculus: An Introduction with Applications

2. Quadratic variation

Cut [0, 1] into 2^m pieces and add up the increments of a Brownian path two ways. The sum of absolute increments grows without bound, so the path has infinite length. The sum of squared increments settles at exactly t. That single fact, dB² = dt, is why stochastic calculus needs an extra term.

Worked example. The left-point (Itô) sum of \(B\,\Delta B\) tends to \(\tfrac12(B_1^2-1)\); the midpoint (Stratonovich) sum tends to \(\tfrac12B_1^2\). The readout computes both.

Watch out. The path is sampled at \(2^{14}\) points, so level \(m=14\) is the finest partition the data can show; beyond that the path is a straight-line interpolation.

For a smooth curve, what happens to the sum of squares?

It tends to zero, because each squared increment is \(O(\Delta t^2)\) and there are only \(1/\Delta t\) of them.

Reference: Gregory F. Lawler · Stochastic Calculus: An Introduction with Applications

3. Paths and their density

An Ornstein–Uhlenbeck particle is pulled toward zero and kicked by noise. Watch individual paths wander while the density they build obeys a deterministic equation. Drag the time slice: the histogram of the simulated paths matches the exact Gaussian solution.

Worked example. Starting from \(x_0\), \(X_t\sim\mathcal N\!\bigl(x_0e^{-\theta t},\ \tfrac{\sigma^2}{2\theta}(1-e^{-2\theta t})\bigr)\). At \(\theta=0\) this is Brownian motion with variance \(\sigma^2t\).

Watch out. The paths use the exact Gaussian transition over each small step, so there is no discretisation bias, only sampling noise from 600 paths.

What is the long-run variance?

\(\sigma^2/(2\theta)\): the balance between noise pumping variance in and the drift pulling it out.

Reference: Gregory F. Lawler · Stochastic Calculus: An Introduction with Applications

Continue exploring

Linear algebra: the geometry of transformationsFourier analysis: functions made of wavesDynamical systems: stability and chaosOptimization: the geometry of the best choiceProbability: learning from uncertaintyGroup theory: symmetry as algebraAlgebraic topology: detecting holesNumerical analysis: when computation misleadsNumber theory: patterns in the integersGraph theory: routes, trees, and networksPartial differential equations: fields in motionInformation theory: uncertainty and codesCalculus of variations: paths and principlesClassical mechanics: motion and forcesElectromagnetism: fields and inductionOptics: rays, waves, and colourThermodynamics: energy, work, and entropyQuantum mechanics: amplitudes and spinComplex analysis: maps, residues, and harmonic fieldsFluid dynamics: flow, pressure, and vorticityStatistics and inference: signals in dataSpecial relativity: space, time, and lightDifferential geometry: curvature and shapeStatistical mechanics: microstates and temperatureMeasure theory: size, approximation, and convergenceMarkov chains: transition, stationarity, and absorptionDifferential forms: circulation, curl, and pullbacksGeneral relativity: curvature, clocks, and lightFunctional analysis: norms, projections, and operatorsPlasma physics: screening, orbits, and wavesLie groups and Lie algebras: continuous symmetryHamiltonian mechanics: phase space and its geometrySolid-state physics: waves in a crystalControl theory: feedback, poles, and stabilityLogic and computability: what can be computedHyperbolic geometry: where parallels multiplyRigid-body dynamics: spinning, tumbling, precessingElliptic curves: geometry that addsAtomic physics: orbitals and spectraQuaternions: rotation as multiplicationPush-forward and pullback: integrating through a mapKnot theory: telling tangles apartFractal geometry: dimension between the integersQuantum information: entanglement and its limitsCosmology: the expanding universeCellular automata: computation from local rulesComplex systems: order from many simple partsGalois theory: the symmetry of equationsMagnetism and the Ising model: order from alignmentOscillators and escapements: how a watch keeps timeGears and mechanisms: transmitting motion exactlyQuartz resonators: a crystal that keeps timeLoudspeakers: the moving-coil driverFilters and crossovers: splitting sound between driversRoom acoustics: the room is part of the speakerWavelets: zooming in on a signalLaser physics: light that copies itselfRepresentation theory: groups acting as matricesSemiconductor physics: bands, doping, junctions

Back to the math encyclopedia