Proof of the Gauss-Markov Theorem

Let P be any projector onto a subspace containing so that PX=X and Py is a linear unbiased estimator of . Let denote the orthogonal projector onto so that is the OLS estimator of . Note that because ,

Using this fact,

and, for any ,