Knowledge discovery through text-based similarity searches for astronomy literature
- 9 Downloads
The increase in the number of researchers coupled with the ease of publishing and distribution of scientific papers (due to technological advancements) has resulted in a dramatic increase in astronomy literature. This has likely led to the predicament that the body of the literature is too large for traditional human consumption and that related and crucial knowledge is not discovered by researchers. In addition to the increased production of astronomical literature, recent decades have also brought several advancements in computational linguistics. Especially, the machine-aided processing of literature dissemination might make it possible to convert this stream of papers into a coherent knowledge set. In this paper, we present the application of computational linguistics techniques to astronomy literature. In particular, we developed a tool that will find similar articles purely based on text content f rom an input paper. We find that our technique performs robustly in comparison with other tools recommending articles given a reference paper (known as recommender system). Our novel tool shows great power in combining computational linguistics with astronomy literature and suggests that additional research in this endeavor will likely produce even better tools that will help researchers cope with vast amounts of knowledge being produced.
KeywordsNatural language processing methods: statistical
The author was supported by an ESO Fellowship and the Excellence Cluster Universe, Technische Universität München, Boltzmannstrasse 2, D-85748 Garching, Germany. He would also like to thank the detailed discussions, encouragement and suggestions from Felix Stoehr and Jason Spyromillio. The support from the library team (Uta Grothkopf, Dominic Bordelon and Silvia Meakins) was invaluable to get an insight into the field of knowledge discovery. Christine Borgman and Bernie Randles (at UCLA) gave suggestions from an Information Sciences point-of-view and the visit would not have been possible if not for the generousity of the UCLA Galactic Center Group (especially Tuan Do and Andrea Ghez). He also thanks Bruno Leibundgut, Kathatrina Immer and Ivan Cabrera-Ziri for testing the algorithm on some well-known papers. Finally, he would like to thank Hinrich Schütze for useful discussion of tools and techniques in the NLP field.
- Baeza-Yates R., Ribeiro B. d. A. N. et al. 2011, Modern Information Retrieval, ACM Press, New YorkGoogle Scholar
- Bird S., Klein E., Loper, E. 2009, Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit, O’Reilly Media, Inc.Google Scholar
- Chyla R., Accomazzi A., Holachek A. et al. 2015, in Taylor A. R., & Rosolowsky E., eds., Astronomical Society of the Pacific Conference Series, Volume 495, Astronomical Data Analysis Software an Systems XXIV (ADASS XXIV), 401Google Scholar
- Fellbaum C. 1998, WordNet, Wiley Online LibraryGoogle Scholar
- Henneken E., Kurtz M. 2010, in APS March Meeting AbstractsGoogle Scholar
- Krstovski K., Smith D. A., Kurtz M. J. 2016, arXiv e-prints, arXiv:1601.01611.
- Manning C. D., Raghavan P., Schütze H. 2008, Introduction to Information Retrieval, 100, 2Google Scholar
- Page L., Brin S., Motwani R., Winograd T. 1999, The PageRank citation ranking: Bringing order to the web., Tech. rep., Stanford InfoLabGoogle Scholar
- Pedregosa F., Varoquaux G., Gramfort A., et al. 2011, Journal of Machine Learning Research, 12, 2825Google Scholar
- Simpson J., Weiner E. S. 1989, Clarendon Press, Oxford. Retrieved March, 6, 2008Google Scholar