OUTLINE OF A PROOF OF FISHER'S THEOREM

 

 

The p linear forms  Yi (  i = 1, ..., p) generate a p-dimensional hyperplane spanned by p orthogonal axes Y1, ..., Yp. The supplementary subspace Y is (n - p)-dimensional, and is easily fitted with (n - p ) additional orthogonal axes Yp+1, ..., Yn, each axis being also orthogonal to each of the Yi (  i = 1, ..., p).

Each of the Yi (i = p+1, ..., n) carries a variable Yi that is  ~N(0, 1) (owing to the spherical symmetry of the joint distribution of the Xi), and these Yi are independent (owing to the orthogonality of the Yi).

 

 

In the lower image:

    * p = 1, and Y1 is the axis defined by the linear form Y1.

    * The supplementary space is the red plane spanned by Y2 and Y3.

    * XP is the projection of X on this plane.

___________ 


Let's now get back to the interpretation of Q:

Q(X1, X2 , ..., Xn) = (iXi ²)  - Y1² - Y2² -...- Yp²             p < n  

This interpretation has first a geometric part, then a probabilistic part.
 

Geometry

    1) iXi ²  is just the square of the distance of X = (X1, ..., Xn) to the origin O.

    2) From this quantity, we subtract the squares of the projections of X on p orthogonal axes (the Yi,   i = 1, ..., p).

    3) We then create n - p supplementary axes as stated above.

    4) The Pythagorean theorem then states that what's left (i.e. Q) is the sum of the squares of the projections of X on these supplementary axes. In fact, it states that Q is the square of the distance of the origin to XP, the projection of X on the supplementary subspace.

So the square of the length of OXP is:

OXP² =iYi ²          i = p+1, ..., n

 

Probabilities

    * Each of the Yi is N(0, 1) and the Yi are independent (see above). So the square of the length of OXP is the sum of n - p squared independent variables (on the figure, Y2 and Y3) all N(0, 1), and is therefore distributed as n - p .

    * Besides, Q is a function of variables (the supplementary Yi) that are all independent of the Yi,   i = 1, ..., p, and is therefore independent of any of them.

Download this Glossary