Text Categorization with ILA

  • Hayri Sever
  • Abdulkadir Gorur
  • Mehmet R. Tolun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2869)


The sudden expansion of the web and the use of the internet has caused some research fields to regain (or even increase) its old popularity. Of them, text categorization aims at developing a classification system for assigning a number of predefined topic codes to the documents based on the knowledge accumulated in the training process. We propose a framework based on an automatic inductive classifier, called ILA, for text categorization, though this attempt is not a novel approach to the information retrieval community. Our motivation are two folds. One is that there is still much to do for efficient and effective classifiers. The second is of ILA’s (Inductive Learning Algorithm) well-known ability in capturing by canonical rules the distinctive features of text categories. Our results with respect to the Reuters 21578 corpus indicate (1) the reduction of features by information gain measurement down to 20 is essentially as good as the case where one would have more features; (2) recall/precision breakeven points of our algorithm without tuning over top 10 categories are comparable to other text categorization methods, namely similarity based matching, naive Bayes, Bayes nets, decision trees, linear support vector machines, steepest descent algorithm.


Text Categorization Inductive Learning Feature Selection 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Sebastiani, F.: Machine learning in automated text categorization. ACM Computing Surveys 34(1), 1–47 (2002)CrossRefGoogle Scholar
  2. 2.
    Apte, C., Damerau, F., Weiss, S.M.: Automated learning of decision rules for text categorization. Information Systems 12(3), 233–251 (1994)Google Scholar
  3. 3.
    Tolun, M.R., Sever, H., Uludag, M., Abu-Soud, S.M.: Ila-2: An inductive learning algorithm for knowledge discovery. Cybernetics and Systems: An International Journal 30(7), 609–628 (1999)zbMATHCrossRefGoogle Scholar
  4. 4.
    Alsaffar, A.H., Deogun, J.S., Sever, H.: Optimal queries in information filtering. In: Ohsuga, S., Raś, Z.W. (eds.) ISMIS 2000. LNCS (LNAI), vol. 1932, pp. 435–443. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  5. 5.
    Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) ECML 1998. LNCS, vol. 1398, pp. 137–142. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  6. 6.
    Lewis, D.D.: Evaluating Text Categorization. In: Proceedings of Speech and Natural Language Workshop, pp. 312–318. Morgan Kaufmann, San Francisco (1991)CrossRefGoogle Scholar
  7. 7.
    Schutze, H., Hull, D., Pedersen, J.O.: Acomparison of classifiers and document representations for the routing problem. Research and Development in Information Retrieval, 229–237 (1995)Google Scholar
  8. 8.
    Dumais, S., Platt, J., Heckerman, D., Sahami, M.: Inductive learning algorithms and representations for text categorization. In: Proceedings of the seventh international conference on Information and knowledge management, pp. 148–155. ACM Press, New York (1998)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Hayri Sever
    • 1
  • Abdulkadir Gorur
    • 2
  • Mehmet R. Tolun
    • 3
  1. 1.Department of Computer EngineeringBaskent UniversityAnkaraTurkey
  2. 2.Department of Computer EngineeringEastern Mediterranean UniversityFamagusta, T.R.N.C.Turkey
  3. 3.Department of Computer EngineeringAtilim UniversityAnkaraTurkey

Personalised recommendations