OUTLINE OF A PROOF OF FISHER'S THEOREM
The p linear forms Yi ( i = 1, ..., p) generate a p-dimensional hyperplane spanned by p orthogonal axes Y1, ..., Yp. The supplementary subspace Y is (n - p)-dimensional, and is easily fitted with (n - p ) additional orthogonal axes Yp+1, ..., Yn, each axis being also orthogonal to each of the Yi ( i = 1, ..., p).
Each of the Yi (i = p+1, ..., n) carries a variable Yi that is ~N(0, 1) (owing to the spherical symmetry of the joint distribution of the Xi), and these Yi are independent (owing to the orthogonality of the Yi).
In the lower image:
* p = 1, and Y1 is the axis defined by the linear form Y1.
* The supplementary space is the red plane spanned by Y2 and Y3.
* XP is the projection of X on this plane.
___________
Let's now get back to the interpretation of Q:
Q(X1,
X2 ,
..., Xn)
= (
iXi
²) - Y1² - Y2² -...-
Yp² p
< n
This
interpretation has first a geometric part, then a probabilistic part.
Geometry
1)
iXi
² is just the square of the distance of X = (X1, ...,
Xn) to the origin O.
2) From this quantity, we subtract the squares of the projections of X on p orthogonal axes (the Yi, i = 1, ..., p).
3) We then create n - p supplementary axes as stated above.
4) The Pythagorean theorem then states that what's left (i.e. Q) is the sum of the squares of the projections of X on these supplementary axes. In fact, it states that Q is the square of the distance of the origin to XP, the projection of X on the supplementary subspace.
So the square of the length of OXP is:
OXP² =
iYi
² i = p+1, ..., n
Probabilities
* Each of the Yi is
N(0,
1) and the Yi are
independent (see above). So the square of the length of OXP
is the sum of n - p squared independent variables (on the figure,
Y2 and Y3) all N(0,
1), and is therefore distributed as
n - p .
* Besides, Q is a function of variables (the supplementary Yi) that are all independent of the Yi, i = 1, ..., p, and is therefore independent of any of them.