Relative Value of Adapted Novel Bibliometrics in Evaluating Surgical Academic Impact and Reach
The Hirsch index, often used to assess research impact, suffers from questionable validity within the context of General Surgery, and consequently adapted bibliometrics and altmetrics have emerged, including the r-index, m-index, g-index and i10-index. This study aimed to assess the relative value of these novel bibliometrics in a single UK Deanery General Surgical Consultant cohort.
Five indices (h, r, m, g and i10) and altmetric scores (AS) were calculated for 151 general surgical consultants in a UK Deanery. Indices and AS were calculated from publication data via the Scopus search engine with assessment of construct validity and reliability.
The median number of publications, h-index, r-index, m-index, g-index and i10-index were 13 (range 0–389), 5 (range 0–63), 5.2 (range 0–64.8), 0.33 (range 0–1.5), 10 (range 0–125) and 4 (range 0–245), respectively. Correlation coefficients of r-index, m-index, g-index and i10-index with h-index were 0.913 (p < 0.001), 0.716 (p < 0.001), 0.961 (p < 0.001) and 0.939 (p < 0.001), respectively. Significant variance was observed when the cohort was ranked by individual bibliometric measures; the median ranking shifts were: r-index − 2 (− 46 to + 23); m-index − 6.5 (− 53 to + 22); g-index − 0.5 (− 24 to + 13); and i10-index 0 (− 8 to + 11), respectively (p < 0.001). The median altmetric score and AS index were 0 (range 0–225.5) and 1 (range 0–10), respectively; AS index correlated strongly with h-index (correlation coefficient 0.390, p < 0.001).
Adapted bibliometric indices appear to be equally valid measures of evaluating academic productivity, impact and reach.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- 1.OECD and SCImago Research Group (CSIC) (2016) Compendium of bibliometric science indicators. http://oe.cd/scientometrics. Accessed 28/06/18
- 2.Otlet P (1934) Traité De Documentation: Le Livre Sur Le Livre, Théorie Et Pratique, Editiones Mundaneum: Mons, BelgiumGoogle Scholar
- 3.Pritchard A (1969) Statistical bibliography or bibliometrics? J Doc 25(4):348–349Google Scholar
- 14.McInerney J (2011) h-Index, M-Index and Google Citations. http://mcinerneylab.com/research/h-index-m-index-and-google-citations/. Accessed 02/07/2018
- 15.Joint Committee on Surgical Training (2017/2018) Guidelines for the award of a CCT in General Surgery. https://www.jcst.org/quality-assurance/certification-guidelines-and-checklists/. Accessed 05/08/2018
- 19.Altmetric Support. How is the Altmetric Attention Score calculated? https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-attention-score-calculated. Accessed 30/08/18
- 20.Altmetric Support. When did Altmetric start tracking attention to each attention source? https://help.altmetric.com/support/solutions/articles/6000136884-when-did-altmetric-start-tracking-attention-to-each-attention-source. Accessed 28/08/18
- 22.The Economist Explains (2017) The problem with scientific publication, and how to fix it. https://www.economist.com/blogs/economist-explains/2017/03/economist-explains-23. Accessed 02/07/2018
- 23.Gingras Y (2016) Bibliometrics and research evaluation uses and abuses. MIT Press, MassachusettsGoogle Scholar
- 24.Matthew 13:12, Holy Bible: King James VersionGoogle Scholar