Abstract
The journal impact factor ( ) is, by far, the most discussed bibliometric indicator. Since its introduction over 40 years ago, it has had enormous effects on the scientific ecosystem: transforming the publishing industry, shaping hiring practices and the allocation of resources, and, as a result, reorienting the research activities and dissemination practices of scholars. Given both the ubiquity and impact of the indicator, the JIF has been widely dissected and debated by scholars of every disciplinary orientation. Drawing on the existing literature as well as original research, this chapter provides a brief history of the indicator and highlights well-known limitations—such as the asymmetry between the numerator and the denominator, differences across disciplines, the insufficient citation window, and the skewness of the underlying citation distributions. The inflation of the JIF and the weakening predictive power is discussed, as well as the adverse effects on the behaviors of individual actors and the research enterprise. Alternative journal-based indicators are described and the chapter concludes with a call for responsible application and a commentary on future developments in journal indicators.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
E. Garfield, I.H. Sher: New factors in the evaluation of scientific literature through citation indexing, Am. Doc. 14(3), 195–201 (1963)
E. Garfield: Citation analysis as a tool in journal evaluation, Science 178(4060), 471–479 (1972)
É. Archambault, V. Larivière: History of the journal impact factor: contingencies and consequences, Scientometrics 79(3), 639–653 (2009)
E. Garfield: Introduction I. Journals, References, and Citations. In: Journal Citation Reports ® A Bibliometric Analysis of References Processed for the 1974 Science Citation Index, Science Citation Index, Vol. 9, ed. by E. Garfield (1976)
E. Garfield: Introduction II. Why the Journal Citation Reports? In: Journal Citation Reports® A Bibliometric Analysis of References Processed for the 1974 Science Citation Index, Science Citation Index, Vol. 9, ed. by E. Garfield (1976)
P.L.K. Gross, E.M. Gross: College libraries and chemical education, Science 66(1713), 385–389 (1927)
E. Garfield: Preface. In: Journal Citation Reports® A Bibliometric Analysis of References Processed for the 1974 Science Citation Index, Science Citation Index, Vol. 9, ed. by E. Garfield (Institute for Scientific Information, Philadelphia 1976)
D. de Solla Price: Little Science, Big Science (Columbia Univ. Press, New York 1963)
R. Monastersky: The number that's devouring science, The Chronicle of Higher Education, http://www.chronicle.com/article/The-Number-Thats-Devouring/26481 (2005)
R. Müller, S. De Rijcke: Thinking with indicators. Exploring the epistemic impacts of academic performance indicators in the life sciences, Res. Eval. (2017), https://doi.org/10.1093/reseval/rvx023
M.E. McVeigh, S.J. Mann: The journal impact factor denominator. Defining citable (counted) items, J. Am. Med. Assoc. 302(10), 1107–1109 (2009)
D. Hicks, P. Wouters, L. Waltman, S. De Rijcke, I. Rafols: The Leiden Manifesto for research metrics, Nature 520(7548), 429–431 (2015)
F. Anseel, W. Duyck, W. De Baene, M. Brysbaert: Journal impact factors and self-citations: Implications for psychology journals, Am. Psychol. 59, 49–51 (2004)
M. Rossner, H. Van Epps, E. Hill: Show me the data, J. Cell Biol. 179(6), 1091–1092 (2007)
S. Curry: Sick of Impact Factors, Reciprocal Space, http://occamstypewriter.org/scurry/2012/08/13/sick-of-impact-factors/ (2012)
P. Campbell: Escape from the impact factor, Ethics Sci. Environ. Polit. 8(1), 5–7 (2008)
S.C. Hubbard, M.E. McVeigh: Casting a wide net: the journal impact factor numerator, Learn. Publ. 24, 133–137 (2011)
T. Kiesslich, S.B. Weineck, D. Koelblinger: Reasons for journal impact factor changes: influence of changing source items, PLOS ONE 11(4), e0154199 (2016)
H.F. Moed, T.N. van Leeuwen: Improving the accuracy of Institute for Scientific Information's journal impact factors, J. Am. Soc. Inf. Sci. 46(6), 461–467 (1995)
H.F. Moed, T.N. van Leeuwen: Impact factors can mislead, Nature 381(6579), 186 (1995)
D.N. Arnold, K.K. Fowler: Nefarious numbers, Notices AMS 58(3), 434–437 (2011)
J. Reedijk, H.F. Moed: Is the impact of journal impact factors decreasing?, J. Doc. 64(2), 183–192 (2008)
B.R. Martin: Whither research integrity? Plagiarism, self-plagiarism, and coercive citation in the age of research assessment, Res. Policy 42, 1005–1014 (2013)
R. Rousseau: Temporal differences in self-citation rates of scientific journals, Scientometrics 44, 521–531 (1999)
M.E. McVeigh: Journal self-citation in the Journal Citation Reports—Science Edition (2002), http://wokinfo.com/essays/journal-self-citation-jcr/ (2002)
T.E. Nisonger: Use of Journal Citation Reports for serials management in research libraries: An investigation of the effect of self-citation on journal rankings in library and information science and genetics, Coll. Res. Libr. 61, 263–275 (2000)
T. Opthof: Inflation of impact factors by journal self-citation in cardiovascular science, Neth. Heart J. 21(4), 163–165 (2013)
K. Hamilton: Subfield and Level Classification of Journals, CHI Report, Vol. 2012-R (CHI Research, Cherry Hill 2003)
W. Glänzel, H.F. Moed: Journal impact measures in bibliometric research, Scientometrics 53(2), 171–193 (2002)
A.J. Lotka: The frequency distribution of scientific productivity, J. Wash. Acad. Sci. 16(12), 317–323 (1926)
P.O. Seglen: The skewness of science, J. Am. Soc. Inf. Sci. 43(9), 628–638 (1992)
V. Larivière, V. Kiermer, C.J. MacCallum, M. McNutt, M. Patterson, B. Pulverer, S. Swaminathan, S. Taylor, S. Curry: A simple proposal for the publication of journal citation distributions, Biorxiv, p.062109, http://www.biorxiv.org/content/early/2016/07/05/062109 (2016)
N. Sombatsompop, T. Markpin, N. Premkamolnetr: A modified method for calculating the impact factors of journals in ISI Journal Citation Reports: Polymer science category in 1997–2001, Scientometrics 60, 217–235 (2004)
R. Rousseau: Median and percentile impact factors: A set of new indicators, Scientometrics 63(3), 431–441 (2005)
V. Larivière, Y. Gingras: The impact factor's Matthew effect: A natural experiment in bibliometrics, J. Assoc. Inf. Sci. Technol. 61(2), 424–427 (2010)
G.A. Lozano, V. Larivière, Y. Gingras: The weakening relationship between the impact factor and papers' citations in the digital age, J. Assoc. Inf. Sci. Technol. 63(11), 2140–2145 (2012)
A. Acharya, A. Verstak, H. Suzuki, S. Henderson, M. Iakhiaev, C.C.Y. Lin, N. Shetty: Rise of the rest: The growing impact of nonelite journals, arXiv:1410.2217 (2014)
V. Larivière, Y. Gingras, É. Archambault: The decline in the concentration of citations, 1900-2007, J. Assoc. Inf. Sci. Technol. 60(4), 858–862 (2009)
V. Larivière, É. Archambault, Y. Gingras: Long-term variations in the aging of scientific literature: From exponential growth to steady-state science (1900–2004), J. Assoc. Inf. Sci. Technol. 59(2), 288–296 (2008)
R.E. Lucas: Econometric policy evaluation: A critique. In: The Phillips Curve and Labor Markets, Carnegie-Rochester Conference Series on Public Policy, Vol. 1, ed. by K. Brunner, A. Meltzer (Elsevier, New York 1976) pp. 19–46
A. Schubert, T. Braun: Relative indicators and relational charts for comparative assessment of publication output and citation impact, Scientometrics 9(5–6), 281–291 (1986)
H.F. Moed, R.E. De Bruin, T.N. van Leeuwen: New bibliometric tools for the assessment of national research performance: database description, overview of indicators and first applications, Scientometrics 33(3), 381–422 (1995)
R. Bolli: The impact factor of Circulation Research reaches a new high, Circulation 121(3), 199 (2017)
M. Govendir: Veterinary Quarterly 2015 Impact Factor increases to 1.047, Vet. Q. 36(3), 121 (2016)
M. Simren, G. Mawe, J. Galligan, S. Bradesi, A. Bredenoord: Impact factor increases to its highest level ever, Neurogastroenterol. Motil. 27(8), 1051 (2015)
Elsevier: Elsevier announces significant increases in impact factors, https://www.elsevier.com/about/press-releases/research-and-journals/elsevier-announces-significant-increases-in-impact-factors (2007)
Springer: Impact factors of Springer and Palgrave Macmillan journals announced: increased number of journals in JCR, https://www.springer.com/gp/about-springer/media/press-releases/corporate/impact-factors-of-springer-and-palgrave-macmillan-journals-announced–increased-number-of-journals-in-jcr/10286018 (2016)
Wiley.: Wiley journals increase Impact Factors in 2015 Journal Citation Reports, http://www.wiley.com/WileyCDA/PressRelease/pressReleaseId-126482.html?campaign=jrpm (2016)
M. Sosteric: Endowing mediocrity: neoliberalism, information technology, and the decline of radical pedagogy, Radic. Pedagog. 1(1) (1999)
D.T. Campbell: Assessing the impact of planned social change, Eval. Program Plan. 2, 67–90 (1979)
C. Goodhart: Monetary relationships: a view from Threadneedle Street. In: Papers of Monetary Economics, Vol. 1 (Reserve Bank of Australia, Sydney 1975)
C. Goodhart: Problems of monetary management: the UK experience. In: Papers of Monetary Economics, Vol. 1 (Reserve Bank of Australia, Sydney 1975)
B. Cronin, C.R. Sugimoto (Eds.): Scholary Metrics Under the Microscope: Citation Analysis and Academic Auditing (InfoToday/ASIST, Medford 2015), p. 976
R. Smith: Journal accused of manipulating impact factor, BMJ 312, 461 (1997)
T.F. Frandsen: Journal self-citations—Analysing the JIF mechanism, J. Infometr. 1, 47–58 (2007)
R. Noorden: Record number of journals banned for boosting impact factor with self-citations, Nature News Blog, http://blogs.nature.com/news/2012/06/record-number-of-journals-banned-for-boosting-impact-factor-with-self-citations.html (2012)
G. Franck: Scientific communication—a vanity fair?, Science 286, 53–56 (1999)
A.W. Wilhite, E.A. Fong: Coercive citation in academic publishing, Science 335, 542–543 (2012)
E.A. Fong, A.W. Wilhite: Authorship and citation manipulation in academic research, PLOS ONE 12(12), e01897394 (2017)
B. Cronin: Do me a favor, J. Am. Soc. Inf. Sci. Technol. 63(7), 1281 (2012)
P. Davis: Citation cartel or editor gone rogue?, The Scholarly Kitchen, https://scholarlykitchen.sspnet.org/2017/03/09/citation-cartel-or-editor-gone-rogue/ (2017)
P. Davis: The emergence of a citation cartel, The Scholarly Kitchen, https://scholarlykitchen.sspnet.org/2012/04/10/emergence-of-a-citation-cartel/ (2012)
P. Mongeon, L. Waltman, S. de Rijcke: What do we know about journal citation cartels? A call for information, CWTS Blog, https://www.cwts.nl/blog?article=n-q2w2b4 (2016)
P. Heneberg: From excessive journal self-cites to citation stacking: Analysis of journal self-citation kinetics in search for journals, which boost their scientometric indicators, PLoS ONE 11(4), e0153730 (2016)
Clarivate Analytics: Title suppression from Journal Citation Reports, http://wokinfo.com/media/pdf/jcr-suppression.pdf (2017)
Thomson Reuters: Title suppressions, http://ipscience-help.thomsonreuters.com/incitesLiveJCR/JCRGroup/titleSuppressions.html (2016)
P. Davis: Reverse Engineering JCR's Self-Citation and Citation Stacking Thresholds, The Scholarly Kitchen, https://scholarlykitchen.sspnet.org/2017/06/05/reverse-engineering-jcrs-self-citation-citation-stacking-thresholds/ (2017)
S. Hubbard: Journal suppressions in the 2015 JCR data—why so few?, http://clarivate.com/journal-suppressions-in-the-2015-jcr-data-why-so-few/ (2016)
C. Chorus, L. Waltman: A large-scale analysis of impact factor biased journal self-citations, PLoS ONE 11(8), e0161021 (2016)
W. Quan, B.-C. Chen, F. Shu: Publish or poverish: An investigation of the monetary reward system of science in China, Aslib J. Inf. Manag. 69(4), 1999–2016 (2017)
L. Butler: Explaining Australia's increased share of ISI publications: the effects of a funding formula based on publication counts, Res. Policy 32, 143–155 (2003)
J. Qiu: Publish or perish in China, Nature 463(7278), 142–143 (2010)
M. Hvistendahl: China's publication bazaar, Science 342(6162), 1035–1039 (2013)
C. Franzoni, G. Scellato, P. Stephan: Science policy. Changing incentives to publish, Science 333(6043), 702–703 (2011)
V. Calcagno, E. Demoinet, K. Gollner, L. Guidi, D. Ruths, C. de Mazancourt: Flows of research manuscripts among scientific journals reveal hidden submission patterns, Science 338, 1065–1069 (2012)
R.K. Merton: The Sociology of Science: Theoretical and Empirical Investigation (Univ. Chicago Press, Chicago 1973)
B. Jin, R. Rousseau: Evaluation of research performance and scientometric indicators in China. In: Handbook of Quantitative Science and Technology Research: The Use of Publication and Patent Statistics in Studies of S&T Systems, ed. by H.F. Moed, W. Glänzel, U. Schmoch (Springer, Dordrecht 2004) pp. 497–514
E. Garfield: English — An international language for science?. In: Essays of an Information Scientist, Vol. 1 (ISI, Philadelphia 1977) p. 19–20
D. Cryanoski: Strong medicine for China's journals, Nature, http://www.nature.com/news/2010/100915/full/467261a.html (2010)
J. Shao, H. Shen: The outflow of academic papers from China: why is it happening and can it be stemmed?, Learn. Publ. 24, 95–97 (2011)
V. Larivière: De l'importance des revues de recherche nationales, Découvrir, la revue de l'ACFAS, http://www.acfas.ca/publications/decouvrir/2014/09/l-importance-revues-recherche-nationales (2014)
B. Alberts: Impact factor distortions, Science 340, 787 (2013)
R. Noorden: Metrics: A profusion of measures, Nature 465, 864–866 (2010)
H.F. Moed: The impact-factors debate: the ISI's uses and limits, Nature 415, 731–732 (2002)
A. Rushforth, S. de Rijcke: Accounting for impact? The journal impact factor and the making of biomedical research in the Netherlands, Minerva 53(2), 117–139 (2015)
R.A. Brumback: “3…2…1…Impact [Factor]: Target [Academic Career] Destroyed!”: Just another statistical casualty, J. Child Neurol. 27(12), 1565–1576 (2012)
M. Osterloh, B.S. Frey: Ranking Games, Eval. Rev. 39(1), 102–129 (2014)
H.W. Holub, G. Tappeiner, V. Eberharter: The iron law of important articles, South. Econ. J. 58, 317–328 (1991)
S. Shibayama, Y. Baba: Impact-oriented science policies and scientific publication practices: The case of life sciences in Japan, Res. Policy 44, 936–950 (2015)
ASCB: San Francisco Declaration on Research Assessment, http://www.ascb.org/dora/ (2012)
NHMRC: NHMRC removes journal impact factors from peer review of individual research grant and fellowship applications, https://www.nhmrc.gov.au/_files_nhmrc/file/grants/peer/impact%20factors%20in%20peer%20review.pdf (2010)
P. Doherty: How important is a journal's impact factor? Nobel Prize Inspiration Initiative, http://www.nobelprizeii.org/videos/important-journals-impact-factor/ (2015)
I. Sample: Nobel winner declares boycott of top science journals, The Guardian, https://www.theguardian.com/science/2013/dec/09/nobel-winner-boycott-science-journals (2013)
J. Beall: Beall's list of predatory journals and publishers, http://beallslist.weebly.com/misleading-metrics.html (2017)
Global Institute for Scientific Information: Journal Impact Factor (JIF), http://www.jifactor.com/index.asp (2017)
International Impact Factor Services: Homepage, http://impactfactorservice.com/ (2017)
M. Jalalian: The story of fake impact factor companies and how we detected them, Electron Phys. 7(2), 1069 (2015)
J. Beall: Index Copernicus has no value. Scholarly Open Access, https://web.archive.org/web/20140403010813/http://scholarlyoa.com/2013/11/21/index-copernicus-has-no-value/ (2013)
Global Impact Factor: Evaluation method, http://globalimpactfactor.com/evaluatiion-method/ (2017)
Academy of IRMBR: International Review of Social Sciences (IRSS), https://scholar.google.com.my/citations?user=k7ZMMxIAAAAJ&hl=en (2017)
International Scientific Indexing.: Payments, http://isindexing.com/isi/payment.php (2017)
Cal State East Bay: Analyzing scholarly research: Bibliometrics, altmetrics, journal impact factors, citation analysis: Journal Impact Factors, http://library.csueastbay.edu/analyzingscholarlyresearch/journalimpactfactors (2017)
George Washington University: Himmelfarb Health Sciences Library: Scholarly Publishing: Predatory Publishing, http://libguides.gwumc.edu/scholarlypub/predatory_publishing (2017)
J.D. West, T.C. Bergstrom, C.T. Bergstrom: The Eigenfactor™ metrics: a network approach to assessing scholarly journals, Coll. Res. Libr. 71, 236–244 (2010)
P. Bonacich: Factoring and weighting approaches to status scores and clique identification, J. Math. Sociol. 2(1), 113–120 (1972)
H.F. Moed: Measuring contextual citation impact of scientific journals, J. Informetr. 4, 265–277 (2010)
L. Waltman, N.J. van Eck, T.N. van Leeuwen, M.S. Visser: Some modifications to the SNIP journal impact indicator, J. Informetr. 7(2), 272–285 (2013)
H. Zijlstra, R. McCullough: CiteScore: a new metric to help you track journal performance and make decisions, Elsevier, https://www.elsevier.com/editors-update/story/journal-metrics/citescore-a-new-metric-to-help-you-choose-the-right-journal (2016)
B. González-Pereira, V.P. Guerrero-Bote, F. Moya-Anegón: A new approach to the metric of journals scientific prestige: The SJR indicator, J. Informetr. 4(3), 379–391 (2010)
V.P. Guerrero-Bote, F. Moya-Anegón: A further step forward in measuring journals' scientific prestige: The SJR2 indicator, J. Informetr. 6, 674–688 (2012)
C.T. Bergstrom, J. West: Comparing Impact Factor and Scopus CiteScore, Eigenfactor.org, http://eigenfactor.org/projects/posts/citescore.php (2016)
C.R. Sugimoto, V. Larivière: Measuring Research: What Everyone Needs to Know (Oxford Univ. Press, Oxford 2018)
A. Bagust, T. Walley: An alternative to body mass index for standardizing body weight for stature, Q. J. Med. 93(9), 589–596 (2000)
M.K. Lebiedowska, K.E. Alter, S.J. Stanhope: Human body shape index based on an experimentally derived model of human growth, J. Pediatr. 152(1), 45–49 (2008)
L. Waltman, V.A. Traag: Use of the journal impact factor for assessing individual articles need not be wrong. arXiv:1703.02334 (2017)
P. Dasgupta, P.A. David: Toward a new economics of science, Res. Policy 23, 487–521 (1994)
M. Strathern: Improving ratings: audit in the British university system, Eur. Rev. 5(3), 305–321 (1997)
S.L. Montgomery: Does science need a global language? English and the future of research (Univ. Chicago Press, Chicago 2013)
P. Lawrence: The politics of publication, Nature 422, 259–261 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Larivière, V., Sugimoto, C.R. (2019). The Journal Impact Factor: A Brief History, Critique, and Discussion of Adverse Effects. In: Glänzel, W., Moed, H.F., Schmoch, U., Thelwall, M. (eds) Springer Handbook of Science and Technology Indicators. Springer Handbooks. Springer, Cham. https://doi.org/10.1007/978-3-030-02511-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-02511-3_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-02510-6
Online ISBN: 978-3-030-02511-3
eBook Packages: Economics and FinanceEconomics and Finance (R0)