Advertisement

Scientometrics

, Volume 98, Issue 2, pp 1113–1130 | Cite as

The effect of additional citations in the stability of Journal Citation Report categories

  • Juan Miguel Campanario
  • William Cabos
Article

Abstract

We use a new approach to study the ranking of journals in JCR categories. The objectives of this study were to empirically evaluate the effect of increases in citations on the computation of the journal impact factor (JIF) for a large set of journals as measured by changes in JIF, and to ascertain the influence of additional citations on the rank order of journals according their new JIFs within JCR groups. To do so, modified JIFs were computed by adding additional citations to the number used by Thomson-Reuters to compute the JIF of journals listed in the JCR for 2008. We considered the effect on rank order of a given journal of adding 1, 2, 3 or more citations to the number used to compute the JIF, keeping everything else equal (i.e., without changing the JIF of other journals in a given group). The effect of additional citations on the internal structure of rankings in JCR groups increased with the number of citations added. In about one third of JCR groups, about half the journals changed their rank order when 1–5 citations were added. However, in general the rank order tended to be relatively stable after small increases in citations.

Keywords

Journal impact factor Journal citation report Citations Journal rankings 

Notes

Acknowledgments

We thank K. Shashok for improving the use of English in the manuscript and two anonymous referees for their suggestions.

Supplementary material

11192_2013_1116_MOESM1_ESM.doc (242 kb)
Table a Percentage of journals in each JCR group that experienced a change in CR when JIF1 was computed. (DOC 241 kb)
11192_2013_1116_MOESM2_ESM.doc (320 kb)
Table b Percentage of journals in each JCR group that experienced a change in CR when JIF5 was computed. (DOC 319 kb)
11192_2013_1116_MOESM3_ESM.doc (396 kb)
Table c Percentage of journals in each JCR group that experienced a change in CR when JIF10 was computed. (DOC 396 kb)
11192_2013_1116_MOESM4_ESM.doc (264 kb)
Table d Percentage of journals in every JCR group that needed a minimum of 1, 2, 3 or more citations (up to 10) to improve their rank order. (DOC 263 kb)
11192_2013_1116_MOESM5_ESM.doc (208 kb)
Table e Mean of CR1, CR5 and CR10 for each group and quartile in JCR group with 50 or more journals. (DOC 208 kb)

References

  1. Althouse, B. M., West, J. D., & Bergstrom, C. T. (2009). Differences in the impact factor across fields and over time. Journal of the American Society for Information Science and Technology, 60, 27–34.CrossRefGoogle Scholar
  2. Buela-Casal, G., & Zych, I. (2012). What do the scientists think about the impact factor? Scientometrics, 92, 281–292.CrossRefGoogle Scholar
  3. Campanario, J. M. (2012). Some research ideas on Journal Impact Factors as a crucial topic in science dynamics. Scientometrics, 92, 293–295.CrossRefGoogle Scholar
  4. Campanario, J. M. (in revision) The effect of citations on the significance of decimal places in the computation of journal impact factors.Google Scholar
  5. Glänzel, W., & Moed, H. F. (2002). Journal impact measures in bibliometric research. Scientometrics, 53, 171–193.CrossRefGoogle Scholar
  6. Golubic, R., Rudes, M., Kovacic, N., Marusic, M., & Marusic, A. (2008). Calculating impact factor: How bibliographical classification of journal items affects the impact factor of large and small journals. Science and Engineering Ethics, 14, 41–49.CrossRefGoogle Scholar
  7. Monastersky, R. (2005). The number that’s devouring science. The Chronicle of Higher Education, 52, A12.Google Scholar
  8. Togia, A., & Tsigilis, N. (2006). Impact factor and education journals: A critical examination and analysis. International Journal of Educational Research, 45, 362–379.CrossRefGoogle Scholar
  9. Tsigilis, N., Grouios, G., Tsorbatzoudis, H., & Koidou, I. (2010). Impact factors of the sport sciences journals: Current trends, relative positions, and temporal stability. European Journal of Sport Science, 10, 81–90.CrossRefGoogle Scholar
  10. Vanclay, J. K. (2012). Impact factor: Outdated artefact or stepping-stone to journal certification? Scientometrics, 92, 211–238.CrossRefGoogle Scholar
  11. Vinkler, P. (2013). Would it be possible to increase the Hirsch-index, π-index or CDS-index by increasing the number of publications or citations only by unity? Journal of Informetrics, 7, 72–83.CrossRefGoogle Scholar
  12. Yu, G., Yang, D. H., & Liang, W. (2010). Reliability-based citation impact factor and the manipulation of impact factor. Scientometrics, 83, 259–270.CrossRefGoogle Scholar

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2013

Authors and Affiliations

  1. 1.Departamento de Física y MatemáticasUniversidad de AlcaláAlcalá de HenaresSpain

Personalised recommendations