Proof that Variance is Non-Negative


\[\textbf{Var}(x) = \mathbb{E}[ (X - \mathbb{E}(X) )^2 ] = \mathbb{E}(X^2) - \mathbb{E}(X)^2\]

Show that variance is never negative.

There’s 2 ways to do this: the right way and overkill.

The Right Way

Notice that you’re taking the mean of a real-valued function squared, which is never negative. Therefore, the mean can’t be negative.

The Way That It Actually Went Down

Jensen’s Inequality.

The square function is convex. Therefore, by Jensen’s inequality, the positive term in the last expression dominates the negative one, proving the statement.

This is way overkill for something that can be figured out without even writing something down.

Hindsight is rather insulting.

Related Posts

Transverse versus parallel crossings

Opera night in the tenderloin

Did you ever love her?

what's the ideal analogy

officer grade pemmican

Sammy Cottrell

Jump or die, dumbass

beats you

kairos

Mechanistic Interpretability and Lean 4