A new approach to the analysis and evaluation of the research output of countries and institutions
A plethora of bibliometric indicators is available nowadays to gauge research performance. The spectrum of bibliometric based measures is very broad, from purely size-dependent indicators (e.g. raw counts of scientific contributions and/or citations) up to size-independent measures (e.g. citations per paper, publications or citations per researcher), through a number of indicators that effectively combine quantitative and qualitative features (e.g. the h-index). In this paper we present a straightforward procedure to evaluate the scientific contribution of territories and institutions that combines size-dependent and scale-free measures. We have analysed in the paper the scientific production of 189 countries in the period 2006–2015. Our approach enables effective global and field-related comparative analyses of the scientific productions of countries and academic/research institutions. Furthermore, the procedure helps to identifying strengths and weaknesses of a given country or institution, by tracking variations of performance ratios across research fields. Moreover, by using a straightforward wealth-index, we show how research performance measures are highly associated with the wealth of countries and territories. Given the simplicity of the methods introduced in this paper and the fact that their results are easily understandable by non-specialists, we believe they could become a useful tool for the assessment of the research output of countries and institutions.
KeywordsResearch output Bibliometric indicators Countries Institutions Publications Citations
We thank Dominique Dunon-Bluteau and Daniel Egret for initiating the human link between the authors. We are grateful to Paul Gouguet, Amélie Bernard and Pierre Madre for critical reading of the manuscript. The work of D. Docampo was supported by the European Regional Development Fund (ERDF) and the Galician Regional Government under an agreement for funding the Atlantic Research Center for Information and Communication Technologies (AtlantTIC).
- Clarivate Analytics. (2017). Clarivate analytics/web of sciences/in cites essential science indicators. https://clarivate.com/products/essential-science-indicators/. Accessed 9 Jan 2018.
- Clarivate Analytics. (2018a). InCites indicators handbook. http://ipscience-help.thomsonreuters.com/inCites2Live/8980-TRS/version/default/part/AttachmentData/data/InCites-Indicators-Handbook-6%2019.pdf. Accessed 17 Sept 2018.
- Clarivate Analytics. (2018b). Essential science—Highly cited papers. http://archive.sciencewatch.com/about/met/core-hcp/. Accessed 17 Sept 2018.
- European Commission. (2013). Country and regional scientific production profiles. https://ec.europa.eu/research/innovation-union/pdf/scientific-production-profiles.pdf. Accessed November 30, 2018.
- Garner, R. M., Hirsch, J. A., Albuquerque, F. C., & Fargen, K. M. (2018). Bibliometric indices: Defining academic productivity and citation rates of researchers, departments and journals. Journal of Neuro Interventional Surgery, 10(2), 102–106.Google Scholar
- Gupta, B. M. (2010). Ranking and performance of Indian Universities, based on publication and citation data. Indian Journal of Science and Technology, 3, 837–843.Google Scholar
- IMF. (2017). World Economic Outlook (WEO) http://www.imf.org/external/pubs/ft/weo/2017/01/weodata/index.aspx. Accessed October 17, 2018.
- UNESCO. (2015). UNESCO science report: Towards 2030, https://unesdoc.unesco.org/ark:/48223/pf0000235406. Accessed February 26, 2019.