A “Leaps and Bounds” Algorithm for Variable Selection in Two-Group Discriminant Analysis

  • António Pedro Duarte Silva
Conference paper
Part of the Studies in Classification, Data Analysis, and Knowledge Organization book series (STUDIES CLASS)


An algorithm that identifies the variable subsets with most discriminatory power (in a predictive sense) is proposed. This algorithm minimizes parametric estimates of the error rate among all the possible variable subsets, evaluating only a fraction of the total number of subsets. The computational feasibility is illustrated by simulation experiments.


Discriminant Analysis Variable Selection Techniques Optimization Techniques 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Furnival, G.M. 1971. All Possible Regressions with Less Computation. Technometrics, 13: 403–408.CrossRefGoogle Scholar
  2. Furnival, G.M. & Wilson, R.W. 1974. Regressions by Leaps and Bounds. Technometrics, 16: 499–511.CrossRefGoogle Scholar
  3. Huberty, C.J. 1994. Applied Discriminant Analysis, New York, NY: Wiley.Google Scholar
  4. Huberty, C.J. & Wisenbaker, J.M. 1992. Variable Importance in Multivariate Group Comparisons. Journal of Educational Statistics, 17: 75–91.CrossRefGoogle Scholar
  5. Jain, A.K. & Waller, W.G. 1978. On the Optimal Number of Features in the Classification of Multivariate Gaussian Data. Pattern Recognition, 10: 365–374.CrossRefGoogle Scholar
  6. Lachenbruch, P A. 1968. On Expected Probabilities of Misclassification in Discriminant Analysis, Necessary Sample Size, and a Relation with the Multiple Correlation Coefficient. Biometrics, 24: 823–834.CrossRefGoogle Scholar
  7. McCabe, G.P. 1975. Computations for Variable Selection in Discriminant Analysis. Technometrics, 17: 103–109.CrossRefGoogle Scholar
  8. McKay, R.J. & Campbell, N.A. 1982a. Variable Selection Techniques in Discriminant Analysis I. Description. British Journal of Mathematical and Statistical Psychology, 3 5: 1–29.CrossRefGoogle Scholar
  9. McKay, R.J. & Campbell, N.A. 1982b. Variable Selection Techniques in Discriminant Analysis II. Allocation. British Journal of Mathematical and Statistical Psychology, 35: 30–41.CrossRefGoogle Scholar
  10. McLachlan, G. J. 1974. An Asymptotic Unbiased Technique for Estimating the Error Rates in Discriminant Analysis. Biometrics, 30: 239–249.CrossRefGoogle Scholar
  11. McLachlan, G. J. 1992. Discriminant Analysis and Statistical Pattern Recognition, New York, NY: Wiley.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin · Heidelberg 1998

Authors and Affiliations

  • António Pedro Duarte Silva
    • 1
  1. 1.Faculdade de Ciências Económicas e EmpresariaisUniversidade Católica Portuguesa at PortoPortoPortugal

Personalised recommendations