Application of Text Categorization to Astronomy Field
We introduce the application of text categorization techniques to the astronomy field to work out semantic ambiguities between table column’s names. In the astronomy field, astronomers often assign different names to table columns at their will even if they are about the same attributes of sky objects. As a result, it produces a big problem for data analysis over different tables. To solve this problem, the standard vocabulary called “unified concept descriptors (UCD)” has been defined. The reported data about sky objects can be easily analyzed through assigning columns to the predefined UCDs. In this paper, the widely used Rocchio categorization algorithm is implemented to assign UCD. An algorithm is realized to extract domain-specific semantics for text indexing while the traditional cosine-based category score model is extended by combining domain knowledge. The experiments show that Rocchio algorithm together with the proposed category score model performs well.
Unable to display preview. Download preview PDF.
- 2.Cai, L., Hofmann, T.: Text categorization by boosting automatically extracted concepts. In: Proceedings of the 26th SIGIR conference, Canada, pp. 182–189 (2003)Google Scholar
- 3.Joachims, T.: A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. In: The 14th Int. Conf. Machine Learning, pp. 143–151 (1997)Google Scholar
- 4.Kou, H.: Intelligent Web Wrapper Generation Using Text Mining Techniques, PhD thesis, University of Versailles (July 2003) Google Scholar
- 5.Ortiz, P.F., Ochsenbein, F., Wicenec, A., Albrecht, M.: ESO/CDS Data-mining Tool Development Project. In: Mehringer, D.M., Plante, R.L., Roberts, D.A. (eds.) ASP Conf. Ser., vol. 172, ASP, San Francisco (1999)Google Scholar
- 8.Yang, Y.: A study on thresholding strategies for text categorization. In: Proceedings of the 24th ACM SIGIR Conference, pp. 137–145 (2001)Google Scholar