Abstract
In statistics, logistic regression is a regression model to predict a binomially distributed response variable. Recent research has investigated the opportunity of combining logistic regression with decision tree learners. Following this idea, we propose a novel Logistic Model Tree induction system, SILoRT, which induces trees with two types of nodes: regression nodes, which perform only univariate logistic regression, and splitting nodes, which partition the feature space. The multiple regression model associated with a leaf is then built stepwise by combining univariate logistic regressions along the path from the root to the leaf. Internal regression nodes contribute to the definition of multiple models and have a global effect, while univariate regressions at leaves have only local effects. Experimental results are reported.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chan, K.Y., Loh, W.Y.: Lotus: An algorithm for building accurate and comprehensible logistic regression trees. Journal of Computational and Graphical Statistic 13(4), 826–852 (2004)
Draper, N.R., Smith, H.: Applied regression analysis. John Wiley & Sons, Chichester (1982)
Hosmer, D.W., Lemeshow, S.: Applied Logistic Regression. Wiley, New York (1989)
Landwehr, N., Hall, M., Frank, E.: Logistic model trees 95(1-2), 161–205 (2005)
le Cessie, S., van Houwelingen, J.: Ridge estimators in logistic regression. Applied Statistics 41(1), 191–201 (1992)
Malerba, D., Esposito, F., Ceci, M., Appice, A.: Top down induction of model trees with regression and splitting nodes. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(5), 612–625 (2004)
Perlich, C., Provost, F., Simonoff, J.S.: Tree induction vs. logistic regression: a learning-curve analysis. J. Mach. Learn. Res. 4, 211–255 (2003)
Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S-PLUS, 3rd edn. Springer, New York (1999)
Weisberg, S.: Applied regression analysis. Wiley, New York (1985)
Zeileis, A., Hothorn, T., Hornik, K.: A model-based recursive partitioning. Journal of Computational and Graphical Statistics (2008)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Appice, A., Ceci, M., Malerba, D., Saponara, S. (2008). Stepwise Induction of Logistic Model Trees. In: An, A., Matwin, S., Raś, Z.W., Ślęzak, D. (eds) Foundations of Intelligent Systems. ISMIS 2008. Lecture Notes in Computer Science(), vol 4994. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68123-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-68123-6_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68122-9
Online ISBN: 978-3-540-68123-6
eBook Packages: Computer ScienceComputer Science (R0)