Abstract
This paper describes and evaluates T3, an algorithm that builds trees of depth at most three, and results in high accuracy whilst keeping the size of the tree reasonably small. T3 is an improvement over T2 in that it builds larger trees and adopts a less greedy approach. T3 gave better results than both T2 and C4.5 when run against publicly available data sets: T3 decreased classification error on average by 47% and generalisation error by 29%, compared to T2; and T3 resulted in 46% smaller trees and 32% less classification error compared to C4.5. Due to its way of handling unknown values, T3 outperforms C4.5 in generalisation by 99% to 66%, on a specific medical dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aha, D.W., Breslow, L.A: Comparing Simplification Procedures for Decision Trees on an Economics Classification, NRL/FR/5510 98-9881, (Technical Report AIC-98-009), May 11, 1998.
Auer, P. Holte, R.C., Maass, W.: Theory and Applications of Agnostic PAC-Learning with Small Decision Trees, Proc. 12th Int’l Machine Learning Conf. San Francisco, Morgan Kaufmann 1995, pp. 21–29.
Breslow, L., Aha, D.W.: Comparing Tree-Simplification Procedures, Proc. 6th Int’l Workshop Artificial Intelligence and Statistics, Ft. Lauderdale, 1997, pp. 67–74.
Ganti, V., Gehrke, J., Ramakrishnan, R.: Mining Very Large Databases, IEEE Computer, Special issue on Data Mining, August 1999.
Kohavi, R., Sommerfield, D., Dougherty, J.: Data Mining using MLC++: A Machine Learning Library in C++, Tools with AI, 1996.
Murthy, S., Saltzberg, S.: Decision Tree Induction: How effective is the Greedy Heuristic?, Proc. 1st Int’l Conf. on KDD and DM, 1995, pp. 156–161.
Quinlan, J.R.: C4.5: Programs for Machine Learning, San Mateo, Morgan Kaufmann, 1993.
Quinlan, J.R.: Improved Use of Continuous Attributes in C4.5, Journal of AI Research 4, Morgan Kaufmann 1996, pp. 77–90.
http://www.ics.uci.edu/~mlearn/MLRepository.html UCI Machine Learning Repository data sets converted to MLC++ format, http://www.sgi.com/tech/mlc/db/ (last accessed 5/02).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tjortjis, C., Keane, J. (2002). T3: A Classification Algorithm for Data Mining. In: Yin, H., Allinson, N., Freeman, R., Keane, J., Hubbard, S. (eds) Intelligent Data Engineering and Automated Learning — IDEAL 2002. IDEAL 2002. Lecture Notes in Computer Science, vol 2412. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45675-9_9
Download citation
DOI: https://doi.org/10.1007/3-540-45675-9_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44025-3
Online ISBN: 978-3-540-45675-9
eBook Packages: Springer Book Archive