Abstract
In this paper we focus on web sites categorization. We compare some quantitative characteristics of existing web directories, analyze the vocabulary used in descriptions of the web sites in Yahoo web directory and propose an approach to automatically categorize web sites. Our approach is based on the novel concept of salient words. Two realizations of the proposed concept are experimentally evaluated. The former uses words typical for just one category, while the latter uses words typical for several categories. Results show that there is a limitation of using single vocabulary based method to properly categorize highly heterogeneous spaces as the World Wide Web.
This work was partially supported by Slovak Science Grant Agency, grant No. G1/7611/20.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Brin, S., Page, L.:The Anatomy of a Large-Scale Hypertextual Web Search Engine (1998).
Dumais, S., Chen, H.: Hierarchical Classification ofWeb Content. In: Proc. of 23rd Int. ACMConf. on Research and Development in Information Retrieval (SIGIR), Athens, Greece (2000) 256–263.
Mase, H.: Experiments on Automatic Web Page Categorization for IR system. Technical report, Standford University (1998).
Mladenic, D.: Turning Yahoo into an Automatic Web-Page Classifier. In: Proceedings of ECAI-European Conference on Artificial Intelligence (1998).
Karypis, G., Han, E.: Fast Supervised Dimensionality Reduction Algorithm with Applications to Document Categorization & Retrieval (2000).
Koller, D. and Sahami, M., Hierarchically classifying documents using very few words, in International Conference on Machine Learning (ICML) (1997) 170–178.
Porter, M. F.: An Algorithm for Suffix Stripping. Program, 14 (3) (1980) 130–137.
Salton, G.: A New Comparison Between Conventional Indexing (MEDLARS) and Automatic Text Processing (SMART). In: Journal of the American Society for Information Science 23 (2) (1972) 75–84.
Trabalka, M.: Document Retrieval. A Written Part of Ph.D. Examination. Slovak University of Technology (2001).
Wang, K., Zhou, S., He, Y.: Hierarchical Classification of Real Life Documents. First SIAM International Conference on Data Mining (2001).
Yang, Y., Pedersen, J. O.: A Comparative Study on Feature Selection in Text Categorization. In: Proc. of 14th Int. Conf. on Machine Learning (1997).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Trabalka, M., Bieliková, M. (2002). Using Salient Words to Perform Categorization of Web Sites. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2002. Lecture Notes in Computer Science(), vol 2448. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46154-X_9
Download citation
DOI: https://doi.org/10.1007/3-540-46154-X_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44129-8
Online ISBN: 978-3-540-46154-8
eBook Packages: Springer Book Archive