Abstract
The sudden expansion of the web and the use of the internet has caused some research fields to regain (or even increase) its old popularity. Of them, text categorization aims at developing a classification system for assigning a number of predefined topic codes to the documents based on the knowledge accumulated in the training process. We propose a framework based on an automatic inductive classifier, called ILA, for text categorization, though this attempt is not a novel approach to the information retrieval community. Our motivation are two folds. One is that there is still much to do for efficient and effective classifiers. The second is of ILA’s (Inductive Learning Algorithm) well-known ability in capturing by canonical rules the distinctive features of text categories. Our results with respect to the Reuters 21578 corpus indicate (1) the reduction of features by information gain measurement down to 20 is essentially as good as the case where one would have more features; (2) recall/precision breakeven points of our algorithm without tuning over top 10 categories are comparable to other text categorization methods, namely similarity based matching, naive Bayes, Bayes nets, decision trees, linear support vector machines, steepest descent algorithm.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sebastiani, F.: Machine learning in automated text categorization. ACM Computing Surveys 34(1), 1–47 (2002)
Apte, C., Damerau, F., Weiss, S.M.: Automated learning of decision rules for text categorization. Information Systems 12(3), 233–251 (1994)
Tolun, M.R., Sever, H., Uludag, M., Abu-Soud, S.M.: Ila-2: An inductive learning algorithm for knowledge discovery. Cybernetics and Systems: An International Journal 30(7), 609–628 (1999)
Alsaffar, A.H., Deogun, J.S., Sever, H.: Optimal queries in information filtering. In: Ohsuga, S., Raś, Z.W. (eds.) ISMIS 2000. LNCS (LNAI), vol. 1932, pp. 435–443. Springer, Heidelberg (2000)
Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) ECML 1998. LNCS, vol. 1398, pp. 137–142. Springer, Heidelberg (1998)
Lewis, D.D.: Evaluating Text Categorization. In: Proceedings of Speech and Natural Language Workshop, pp. 312–318. Morgan Kaufmann, San Francisco (1991)
Schutze, H., Hull, D., Pedersen, J.O.: Acomparison of classifiers and document representations for the routing problem. Research and Development in Information Retrieval, 229–237 (1995)
Dumais, S., Platt, J., Heckerman, D., Sahami, M.: Inductive learning algorithms and representations for text categorization. In: Proceedings of the seventh international conference on Information and knowledge management, pp. 148–155. ACM Press, New York (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sever, H., Gorur, A., Tolun, M.R. (2003). Text Categorization with ILA. In: Yazıcı, A., Şener, C. (eds) Computer and Information Sciences - ISCIS 2003. ISCIS 2003. Lecture Notes in Computer Science, vol 2869. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39737-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-39737-3_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20409-1
Online ISBN: 978-3-540-39737-3
eBook Packages: Springer Book Archive