Abstract
In this chapter, we describe a scientometric assessment tool that was first introduced as early as the second half of the 1980s, but due to the high computational requirements at that time, the method fell undeservedly into oblivion. The method is called Characteristic Scores and Scales (CSS) and is aimed at providing a more detailed picture of citation impact, with particular regard to the high end of performance. More than two decades after its introduction, the method experienced a revival as a consequence of the burning need for improved and versatile assessment tools, facilitated by the rapid development of information technology and the broad access to electronic data sources.
The first part of this chapter will describe the model, its background and the statistical properties underlying this approach, while the following sections will deal with its implementation within the framework of research evaluation at different levels of aggregation and in various disciplinary and multidisciplinary contexts. Special attention is paid to the applicability to various aggregation levels, such as national research performance, the comparative analysis of institutional research output, as a tool to assist the assessment of individual researchers and as journal impact measures. A graphical sketch of possible applications is used as a road map throughout the chapter to navigate the various methodological issues and fields of use. The chapter begins with a review of previous work, but also aims at presenting new insights and applications in a systematic manner. In addition to the presentation of new results, future perspectives and possible applications of this model within and outside traditional scientometrics will be sketched and highlighted.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
W. Glänzel, A. Schubert: Theoretical and empirical studies of the tail of scientometric distributions. In: Informetrics 87/88, ed. by L. Egghe, R. Rousseau (Elsevier, Amsterdam 1988) pp. 75–83
W. Glänzel: High-end performance or outlier? Evaluating the tail of scientometric distribution, Scientometrics 97(1), 13–23 (2013)
W. Glänzel, K. Debackere, B. Thijs: Citation classes: A novel indicator base to classify scientific output. Paper presented at the OECD Blue Sky Forum, Ghent, 19–21 September 2016. Available via: https://www.oecd.org/sti/051%20-%20Blue%20Sky%20Biblio%20Submitted.pdf (2016)
W. Glänzel, A. Schubert: Characteristic scores and scales in assessing citation impact, J. Inf. Sci. 14(2), 123–127 (1988)
A. Bookstein: Informetric distributions. 3. Ambiguity and randomness, J. Am. Soc. Inf. Sci. 48(1), 2–10 (1997)
H.-P. Kriegel, P. Kröger, A. Zimek: Outlier detection techniques. Tutorial. In: 13th Pac.-Asia Conf. Knowl. Discov. Data Min (PAKDD), Bangkok (2009)
L. Waltman, C. Calero-Medina, J. Kosten, E.C.M. Noyons, R.J.W. Tijssen, N.J. van Eck, T.N. van Leeuwen, A.F.J. van Raan, M.S. Visser, P. Wouters: The Leiden ranking 2011/2012: Data collection, indicators, and interpretation. In: Proc. STI 2012, ed. by E. Archambault, Y. Gingras, V. Lariviere (Science-Metrix, Montreal 2012) pp. 791–802
G. Matthys, E. Delafosse, A. Guillou, J. Beirlant: Estimating catastrophic quantile levels for heavy-tailed distributions, Insur. Math. Econ. 34(3), 517–537 (2004)
W. Glänzel, K. Debackere: On the opportunities and limitations in using bibliometric indicators in a policy relevant context. In: Bibliometric Analysis in Science and Research: Applications, Benefits and Limitations, ed. by R. Ball (Publication Forschungszentrum Jülich, Jülich 2003)
W. Glänzel, H.F. Moed: Opinion paper: Thoughts and facts on bibliometric indicators, Scientometrics 96(1), 381–394 (2013)
W. Glänzel, H.F. Moed: Journal impact measures in bibliometric research, Scientometrics 53(2), 171–193 (2002)
W. Glänzel: The multi-dimensionality of journal impact, Scientometrics 78(2), 355–374 (2009)
W. Glänzel, K. Debackere: On the “multi-dimensionality” of ranking and the role of bibliometrics in university assessment. In: Ranking Universities, ed. by C. Dehon, D. Jacobs, C. Vermandele (Editions de l'Université de Bruxelles, Brussels 2009) pp. 65–75
J. Beirlant, W. Glänzel, A. Carbonez, H. Leemans: Scoring research output using statistical quantile plotting, J. Informetrics 1(3), 185–192 (2007)
L. Leydesdorff, L. Bornmann, R. Mutz, T. Opthof: Turning the tables on citation analysis one more time: Principles for comparing sets of documents, J. Am. Soc. Inf. Sci. Technol. 62(7), 1370–1381 (2011)
L. Waltman, M. Schreiber: On the calculation of percentile-based bibliometric indicators, J. Am. Soc. Inf. Sci. Technol. 64(2), 372–379 (2013)
M.A. Hamdan: On a characterization by conditional expectation, Technometrics 14, 497–499 (1972)
S. Kotz, D.N. Shanbhag: Some new approaches to probability distributions, Adv. Appl. Probab. 12, 903–921 (1980)
W. Glänzel, A. Telcs, A. Schubert: Characterization by truncated moments and its application to Pearson-type distributions, Z. Wahrscheinlichkeitstheor. Verwandte Geb. 66, 173–183 (1984)
W. Glänzel: Characteristic scores and scales. A bibliometric analysis of subject characteristics based on long-term citation observation, J. Informetrics 1(1), 92–102 (2007)
A. Schubert, W. Glänzel: A systematic analysis of Hirsch-type indices for journals, J. Informetrics 1(3), 179–184 (2007)
A. Schubert, W. Glänzel, T. Braun: Scientometric datafiles. A comprehensive set of indicators on 2649 journals and 96 countries in all major fields and subfields 1981–1985, Scientometrics 16(1–6), 3–478 (1989)
W. Glänzel: The application of characteristic scores and scales to the evaluation and ranking of scientific journals, J. Inf. Sci. 37(1), 40–48 (2011)
W. Glänzel, B. Thijs, K. Debackere: The application of citation-based performance classes to the disciplinary and multidisciplinary assessment in national comparison and institutional research assessment, Scientometrics 101(2), 939–952 (2014)
W. Glänzel, B. Thijs, P.S. Chi: The challenges to expand bibliometric studies from periodical literature to monographic literature with a new data source: The Book Citation Index, Scientometrics 109(3), 2165–2179 (2016)
W. Glänzel, A. Schubert: A new classification scheme of science fields and subfields designed for scientometric evaluation purposes, Scientometrics 56(3), 357–367 (2003)
B.C. Peritz: Are methodological papers more cited than theoretical or empirical ones? The case of sociology, Scientometrics 5(4), 211–218 (1983)
W. Marx, L. Bornmann: On the causes of subject-specific citation rates in Web of Science, Scientometrics 102(2), 1823–1827 (2015)
P. Albarrán, J. Ruiz-Castillo: References made and citations received by scientific articles, J. Am. Soc. Inf. Sci. Technol. 62(1), 40–49 (2011)
I. Vincze: Mathematical Statistics, University Script, 4th edn. (Eötvös University, Budapest 1974), in Hungarian
W. Glänzel, A. Schubert, B. Thijs, K. Debackere: Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance, Scientometrics 78(1), 165–188 (2009)
B. Thijs, K. Debackere, W. Glänzel: Improved author profiling through the use of citation classes, Scientometrics 111(2), 829–839 (2017)
P. Wouters, W. Glänzel, J. Gläser, I. Rafols: The dilemmas of performance indicators of individual researchers – An urgent debate in bibliometrics, ISSI Newsletter 9(3), 48–53 (2013)
W. Glänzel, P. Zhou: Publication activity, citation impact and bi-directional links between publications and patents in biotechnology, Scientometrics 86(2), 505–525 (2011)
W. Glänzel: On co-authorship at the individual level, Transinformação 26(3), 229–238 (2014)
A. Schubert, W. Glänzel, T. Braun: Subject field characteristic citation scores and scales for assessing research performance, Scientometrics 12(5/6), 267–291 (1987)
W. Glänzel, B. Thijs: The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles. In: Proc. ISSI 2015 – The 15th Int. Conf. Scientometr. Informetr. (Wuhan) (2017) pp. 1190–1200
H.F. Moed: Measuring contextual citation impact of scientific journals, J. Informetr. 4(3), 265–277 (2010)
M. Zitt, H. Small: Modifying the journal impact factor by fractional citation weighting: The audience factor, J. Am. Soc. Inf. Sci. Technol. 59(11), 1856–1860 (2008)
M. Zitt: Citing-side normalization of journal impact: A robust variant of the audience factor, J. Informetrics 4(3), 392–406 (2010)
M. Zitt: Behind citing-side normalization of citations: Some properties of the journal impact factor, Scientometrics 89(1), 329–344 (2011)
L. Waltman, N.J. van Eck: A systematic empirical comparison of different approaches for normalizing citation impact indicators, J. Informetrics 7(4), 833–849 (2013)
L. Waltman, N.J. van Eck: Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison, Scientometrics 96(3), 699–716 (2013)
J. Priem, B.H. Hemminger: Scientometrics 2.0: New metrics of scholarly impact on the social Web, First Monday (2010), https://doi.org/10.5210/fm.v15i7.2874
J. Priem: Altmetrics. In: Beyond Bibliometrics: Harnessing multidimensional indicators of scholarly impact, ed. by B. Cronin, C.R. Sugimoto (MIT Press, Cambridge 2015)
W. Glänzel, P.S. Chi: Scientometrics 2.0 – And beyond? Background, promises, challenges and limitations, ISSI Newsletter 12(3), 33–36 (2016)
L. Egghe: Power Laws in the Information Production Process: Lotkaian Informetrics (Emerald Group Limited, Bingley 2005)
L. Egghe: Lotkaian informetrics and applications to social networks, Bull. Belg. Math. Soc. – Simon Stevin 16(4), 689–703 (2009)
P.-S. Chi, W. Glänzel: An empirical investigation of the associations among usage, scientific collaboration and citation impact, Scientometrics 112(1), 403–412 (2017)
J. Pringle: The Web of Science Usage Count (Thomson Reuters, 2015) available at: http://thomsonreuters.com/content/dam/openweb/documents/pdf/scholarly-scientific-research/white-paper/web-of-science-usage-countreport.pdf
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix
Appendix
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Glänzel, W., Thijs, B., Debackere, K. (2019). Citation Classes: A Distribution-based Approach for Evaluative Purposes. In: Glänzel, W., Moed, H.F., Schmoch, U., Thelwall, M. (eds) Springer Handbook of Science and Technology Indicators. Springer Handbooks. Springer, Cham. https://doi.org/10.1007/978-3-030-02511-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-02511-3_13
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-02510-6
Online ISBN: 978-3-030-02511-3
eBook Packages: Economics and FinanceEconomics and Finance (R0)