Computationally Efficient Linear Regression Trees

  • Luis Torgo
Part of the Studies in Classification, Data Analysis, and Knowledge Organization book series (STUDIES CLASS)


This paper describes a method for obtaining regression trees using linear regression models in the leaves in a computationally efficient way that allows the use of this method on large data sets. This work is focused on deriving a set of formulae with the goal of allowing an efficient evaluation of all candidate tests that are considered during tree growth.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. BONTEMPI, G. (2000): Local Learning Techniques for Modeling, Prediction and Control. PhD thesis, Universit Libre de Bruxelles, Belgium.Google Scholar
  2. BREIMAN, L., FRIEDMAN, J., OLSHEN, R. and STONE, C. (1984): Classification and Regression Trees. Statistics/Probability Series. Wadsworth Brooks/Cole Advanced Books Software.zbMATHGoogle Scholar
  3. CATLETT, J. (1991): Megainduction: machine learning on very large databases. PhD thesis, Basser Department of Computer Science, University of Sydney.Google Scholar
  4. CLEVELAND, W.S. and LOADER, C.R. (1995): Smoothing by local regression: Principles and methods (with discussion). Computational Statistics.Google Scholar
  5. GOODWIN, G. and SIN, K. (1984): Adaptive Filtering Prediction and Control. Prentice-Hall.Google Scholar
  6. KARALIC, A. (1992): Employing linear regression in regression tree leaves. In Proceedings of ECAI-92. WileySons.Google Scholar
  7. MYERS, R. (1990): Classical and modern Regression with Applications 2nd edition. Duxbury Press.Google Scholar
  8. QUINLAN, J.R. (1992): Learning with continuous classes. In Adams Sterling, editor, Proceedings of AI’92,pages 343–348. World Scientific.Google Scholar
  9. TORGO, L. (1999): Inductive Learning of Tree-based Regression Models. PhD thesis, Faculty of Sciences, University of Porto.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Luis Torgo
    • 1
  1. 1.LIACC/FEP, University of PortoPortoPortugal

Personalised recommendations