Maxwell's theorem

See Maxwell's theorem (geometry) for the result on triangles.

In probability theory, Maxwell's theorem (known also as Herschel-Maxwell's theorem and Herschel-Maxwell's derivation) states that if the probability distribution of a random vector in $\mathbb {R} ^{n}$ is unchanged by rotations, and if the components are independent, then the components are identically distributed and normally distributed.

Equivalent statements

If the probability distribution of a vector-valued random variable X = ( X₁, ..., X_n )^T is the same as the distribution of GX for every n×n orthogonal matrix G and the components are independent, then the components X₁, ..., X_n are normally distributed with expected value 0 and all have the same variance. This theorem is one of many characterizations of the normal distribution.

The only rotationally invariant probability distributions on Rⁿ that have independent components are multivariate normal distributions with expected value 0 and variance σ²I_n, (where I_n = the n×n identity matrix), for some positive number σ².

History

John Herschel proved the theorem in 1850. Ten years later, James Clerk Maxwell proved the theorem in Proposition IV of his 1860 paper.

Proof

We only need to prove the theorem for the 2-dimensional case, since we can then generalize it to n-dimensions by applying the theorem sequentially to each pair of coordinates.

Since rotating by 90 degrees preserves the joint distribution, $X_{1}$ and $X_{2}$ have the same probability measure: let it be $\mu$. If $\mu$ is a Dirac delta distribution at zero, then it is in particular a degenerate gaussian distribution. Let us now assume that it is not a Dirac delta distribution at zero.

By the Lebesgue's decomposition theorem, we decompose $\mu$ to a sum of regular measure and an atomic measure: $\mu =\mu _{r}+\mu _{s}$. We need to show that $\mu _{s}=0$; we proceed by contradiction. Suppose $\mu _{s}$ contains an atomic part, then there exists some $x\in \mathbb {R}$ such that $\mu _{s}(\{x\})>0$. By independence of $X_{1},X_{2}$, the conditional variable $X_{2}|\{X_{1}=x\}$ is distributed the same way as $X_{2}$. Suppose $x=0$, then since we assumed $\mu$ is not concentrated at zero, $Pr(X_{2}\neq 0)>0$, and so the double ray $\{(x_{1},x_{2}):x_{1}=0,x_{2}\neq 0\}$ has nonzero probability. Now, by rotational symmetry of $\mu \times \mu$, any rotation of the double ray also has the same nonzero probability, and since any two rotations are disjoint, their union has infinite probability; thus arriving at a contradiction.

Let $\mu$ have probability density function $\rho$; the problem reduces to solving the functional equation

$$\rho (x)\rho (y)=\rho (x\cos \theta +y\sin \theta )\rho (x\sin \theta -y\cos \theta ).$$

Sources

• Feller, William (1966). An Introduction to Probability Theory and its Applications. Vol. II (1st ed.). Wiley. p. 187.
• Maxwell, James Clerk (1860). "Illustrations of the dynamical theory of gases". Philosophical Magazine. 4th Series. 19: 390–393.

External links

• Maxwell's theorem in a video by 3blue1brown