Abstract
The following presents a method for constructing taxonomies by utilizing the Latent Semantic Indexing (LSI) technique. The LSI technique enables representation of textual data in a vector space, facilitates access to all documents and terms by contextual queries, and allows for text comparisons. A taxonomy generator downloads collection of documents, creates document clusters, assigns titles to clusters, and organizes the clusters in a hierarchy. The nodes in the hierarchy are ordered from general to specific in the depth of the hierarchy, and from most similar to least similar in the breadth of the hierarchy. This method is capable of producing meaningful classifications in a short time.
Keywords
- Singular Value Decomposition
- Latent Semantic Analysis
- Candidate Term
- Latent Semantic Indexing
- Taxonomist System
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by Latent Semantic Analysis. J. Am. Soc. Inf. Sc. 46(4), 391–407 (1990)
Landauer, T., Littman, M.: Fully Automatic Cross-language Document Retrieval Using LSI. In: Proc. 6th Conf. UW Centre New Oxford English Dict. and Text Research, pp. 31–38 (1990)
Choi, F.Y.Y., Wiemer-Hastings, P., Moore, J.: Latent Semantic Analysis for Text Segmentation. In: Lee, L., Harman, D. (eds.) Proc. Conf. Emp. Meth in NLP, pp. 109–117 (2001)
Dumais, S.: Using LSI for Information Retrieval, Information Filtering, and Other Things. In: Proc. of the Cognitive Technology Workshop (1997)
Osinski, S., Stefanowski, J., Weiss, D.: Lingo - Search Results Clustering Algorithm Based on Singular Value Decomposition. In: Proc. IIS: IIPWM Conf., pp. 359–368 (2004)
Wnek, J.: Document Ontology Discovery Tool. In: Proc. IIS: IIPWM Conf., pp. 475–480 (2004)
Lewis, D.D.: Reuters-21578 Text Categorization Test Collection. Distribution 1.0 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wnek, J. (2005). LSI-Based Taxonomy Generation: The Taxonomist System. In: Kantor, P., et al. Intelligence and Security Informatics. ISI 2005. Lecture Notes in Computer Science, vol 3495. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427995_33
Download citation
DOI: https://doi.org/10.1007/11427995_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25999-2
Online ISBN: 978-3-540-32063-0
eBook Packages: Computer ScienceComputer Science (R0)