Application of Text Categorization to Astronomy Field

  • Huaizhong Kou
  • Amedeo Napoli
  • Yannick Toussaint
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3513)


We introduce the application of text categorization techniques to the astronomy field to work out semantic ambiguities between table column’s names. In the astronomy field, astronomers often assign different names to table columns at their will even if they are about the same attributes of sky objects. As a result, it produces a big problem for data analysis over different tables. To solve this problem, the standard vocabulary called “unified concept descriptors (UCD)” has been defined. The reported data about sky objects can be easily analyzed through assigning columns to the predefined UCDs. In this paper, the widely used Rocchio categorization algorithm is implemented to assign UCD. An algorithm is realized to extract domain-specific semantics for text indexing while the traditional cosine-based category score model is extended by combining domain knowledge. The experiments show that Rocchio algorithm together with the proposed category score model performs well.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Cai, L., Hofmann, T.: Text categorization by boosting automatically extracted concepts. In: Proceedings of the 26th SIGIR conference, Canada, pp. 182–189 (2003)Google Scholar
  3. 3.
    Joachims, T.: A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. In: The 14th Int. Conf. Machine Learning, pp. 143–151 (1997)Google Scholar
  4. 4.
    Kou, H.: Intelligent Web Wrapper Generation Using Text Mining Techniques, PhD thesis, University of Versailles (July 2003) Google Scholar
  5. 5.
    Ortiz, P.F., Ochsenbein, F., Wicenec, A., Albrecht, M.: ESO/CDS Data-mining Tool Development Project. In: Mehringer, D.M., Plante, R.L., Roberts, D.A. (eds.) ASP Conf. Ser., vol. 172, ASP, San Francisco (1999)Google Scholar
  6. 6.
  7. 7.
    Riloff, E., Lehnert, W.: Information extraction as a basis for high-precision text classification. ACM Transactions on Information Systems 12(3), 296–333 (1994)CrossRefGoogle Scholar
  8. 8.
    Yang, Y.: A study on thresholding strategies for text categorization. In: Proceedings of the 24th ACM SIGIR Conference, pp. 137–145 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Huaizhong Kou
    • 1
  • Amedeo Napoli
    • 1
  • Yannick Toussaint
    • 1
  1. 1.LORIA and INRIA-LorraineVillers-lès-NancyFrance

Personalised recommendations