Comparison of citation and usage indicators in research assessment in scientific disciplines and journals
Proceeding from the results of an earlier pilot study usage and citation impact data from the 2013 annual volume of the Web of Science Core Collection were collected and used to build indicators. Besides basic indicators on citation impact, usage counts and international collaboration, we applied the method of Characteristic Scores and Scales to analyse the distributions of citations and usage counts to further test the relation between the usage and citation impact. The results could confirm and extend the results of the previous study to a larger set of subjects and countries. In addition, a new journal metric, the Journals Usage Index, is proposed to supplement journal impact measures by a usage based index.
KeywordsUsage data Characteristic Scores and Scales Journals Usage Index Relative citation rate Relative usage rate
This paper is an extended version of a previous work presented at the 16th ISSI Conference in Wuhan, China (Chi and Glänzel 2017b). The authors thank Clarivate Analytics for providing usage data of the 2013 annual volume of the Web of Science Core Collection.
- Braun, T., Glänzel, W., & Schubert, A. (1985). Scientometric indicators. A 32 country comparison of publication productivity and citation impact. Singapore: World Scientific Publishing.Google Scholar
- Chi, P. S., & Glänzel, W. (2017b). Impact and usage indicators for the assessment of research in scientific disciplines and journals. In Proceedings of the ISSI conference 2017. Wuhan University (pp. 203–213).Google Scholar
- Clarivate Analytics. (2017). Usage count at web of science core collection help page. https://images.webofknowledge.com/images/help/WOS/hp_usage_score.html. Retrieved on December 14, 2017.
- Glänzel, W., & Heeffer, S. (2014). Cross-national preferences and similarities in downloads and citations of scientific articles: A pilot study. In E. Noyons (Ed.), Context counts: Pathways to master big and little data. Proceedings of the STI conference 2014. Leiden University (pp. 207–215).Google Scholar
- Glänzel, W., Thijs, B., & Debackere, K. (2018). Citation classes—A distribution-based approach to profiling citation impact for evaluative purposes. In W. Glänzel, H. F. Moed, U. Schmoch, & M. Thelwall (Eds.), Springer handbook of science and technology indicators. Heidelberg: Springer.Google Scholar
- Pringle, J., Nefedov, N., & Pop-Lazarov, E. (2015). A new interest indicator based on researcher behavior in the Web of Science. Presentation at ASIS&T SIG/MET metrics 2015 workshop. https://www.asist.org/SIG/SIGMET/wp-content/uploads/2015/11/Pringle-etal-Asist-Metrics2015.pdf. Retrieved on December 14, 2017.