Abstract
Multi-target model trees are trees which predict the values of several target continuous variables simultaneously. Each leaf of such a tree contains several linear models, each predicting the value of a different target variable. We propose an algorithm for inducing such trees in a stepwise fashion. Experiments show that multi-target model trees are much smaller than the corresponding sets of single-target model trees and are induced much faster, while achieving comparable accuracies.
Chapter PDF
Similar content being viewed by others
References
Blockeel, H., Raedt, L.D., Ramon, J.: Top-down induction of clustering trees. In: Shavlik, J. (ed.) Proceedings of the 15th International Conference on Machine Learning, pp. 55–63. Morgan Kaufmann, San Francisco (1998)
Draper, N.R., Smith, H.: Applied regression analysis. John Wiley & Sons, Chichester (1982)
Karalic, A.: Linear regression in regression tree leaves. In: Proceedings of International School for Synthesis of Expert Knowledge, Slovenia, pp. 151–163 (1992)
Malerba, D., Esposito, F., Ceci, M., Appice, A.: Top down induction of model trees with regression and splitting nodes. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(5), 612–625 (2004)
Struyf, J., Dzeroski, S.: Constraint based induction of multi-objective regression trees. In: Bonchi, F., Boulicaut, J.-F. (eds.) Workshop on Knowledge Discovery in Inductive Databases, pp. 222–233 (2005)
Torgo, L.: Functional models for regression tree leaves. In: Fisher, D. (ed.) Proceedings of the 14th International Conference on Machine Learning, pp. 385–393. Morgan Kaufmann, San Francisco (1997)
Vens, C., Blockeel, H.: A simple regression based heuristic for learning model trees. Intelligent Data Analysis 10(3), 215–236 (2006)
Ženko, B.: Learning Predictive Clustering Rules. PhD thesis, Faculty of Computer and Information Science, University of Ljubljana, Slovenia (2007)
Suzuki, M.G.W., Choki, Y.: k-nearest neighbour classification of symbolic objects. In: De Raedt, L., Siebes, A. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 436–446. Springer, Heidelberg (2001)
Wang, Y., Witten, I.: Inducing model trees for continuous classes. In: van Someren, M., Widmer, G. (eds.) ECML 1997. LNCS, vol. 1224, pp. 128–137. Springer, Heidelberg (1997)
Weisberg, S.: Applied regression analysis, 2nd edn. Wiley, Chichester (1985)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Appice, A., Džeroski, S. (2007). Stepwise Induction of Multi-target Model Trees. In: Kok, J.N., Koronacki, J., Mantaras, R.L.d., Matwin, S., Mladenič, D., Skowron, A. (eds) Machine Learning: ECML 2007. ECML 2007. Lecture Notes in Computer Science(), vol 4701. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74958-5_46
Download citation
DOI: https://doi.org/10.1007/978-3-540-74958-5_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74957-8
Online ISBN: 978-3-540-74958-5
eBook Packages: Computer ScienceComputer Science (R0)