Degrees of freedom.

Author:

Abstract
A concept of central importance to modern statistical theory which few textbooks have attempted to clarify is that of "degrees of freedom." For the mathematician who reads the original papers in which statistical theory is now making such rapid advances, the concept is a familiar one needing no particular explanation. For the person who is unfamiliar with N-dimensional geometry or who knows the contributions to modern sampling theory only from secondhand sources such as textbooks, this concept often seems almost mystical, with no practical meaning. Tippett, one of the few textbook writers who attempt to make any general explanation of the concept, begins his account (p. 64) with the sentence, "This conception of degrees of freedom is not altogether easy to attain, and we cannot attempt a full justification of it here; but we shall show its reasonableness and shall illustrate it, hoping that as a result of familiarity with its use the reader will appreciate it." Not only do most texts omit all mention of the concept but many actually give incorrect formulas and procedures because of ignoring it. In the work of modern statisticians, the concept of degrees of freedom is not found before "Student's" paper of 1908, it was first made explicit by the writings of R. A. Fisher, beginning with his paper of 1915 on the distribution of the correlation coefficient, and has only within the decade or so received general recognition. Nevertheless the concept was familiar to Gauss and his astronomical associates. In his classical work on the Theory of the Combination of Observations (Theoria Combinationis Observationum Erroribus Minimis Obnoxiae) and also in a work generalizing the theory of least squares with reference to t he combination of observations (Ergänzung zur Theorie der den kleinsten Fehlern unterworfen Combination der Beobachtungen, 1826), he states both in words and by formula that the number of observations is to be decreased by the number of unknowns estimated from the data to serve as divisor in estimating the standard error