Principal Components and Factor Analysis

  • Ronald Christensen
Part of the Springer Texts in Statistics book series (STS)


Suppose that observations are available on q variables. In practice, q is often quite large. If, for example, q = 25, it can be very difficult to grasp the relationships between the many variables. It might be convenient if the 25 variables could be reduced to a more manageable number. Clearly, it is easier to work with 4 or 5 variables than with 25. Of course, one cannot reasonably expect to get a substantial reduction in dimensionality without some loss of information. We want to minimize that loss. Assuming that a reduction in dimensionality is desirable, how can it be performed efficiently? One reasonable method is to choose a small number of linear combinations of the dependent variables based on their ability to reproduce the entire set of variables. In effect, we want to create a few new variables that are best able to predict the original variables. Principal component analysis finds linear combinations of the original variables that are best linear predictors of the full set of variables. This predictive approach to dimensionality reduction seems intuitively reasonable. We emphasize this interpretation of principal component analysis rather than the traditional motivation of finding linear combinations that account for most of the variability in the data. The predictive approach is mentioned in Rao (1973, p. 591). Seber (1984) takes an approach that is essentially predictive. Seber’s discussion is derived from Okamoto and Kanazawa (1968).


Covariance Matrix Linear Predictor Factor Analysis Model Likelihood Ratio Test Statistic Multivariate Linear Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media New York 1991

Authors and Affiliations

  • Ronald Christensen
    • 1
  1. 1.Department of Mathematics and StatisticsUniversity of New MexicoAlbuquerqueUSA

Personalised recommendations