Skip to main content
SpringerLink
Log in

Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Evaluating the scholarly reputation of journals has become one of the key concerns and research focuses in academia. The scholarly performance of a journal’s editorial team helps to enhance the journal’s academic impact. This paper develops an editorial team scholarly index from the new perspective of journal editorship, combining the editors’ scholarly performance and the editors’ titles (e.g., associate, assistant) to provide an alternative indicator for evaluating academic journal reputation. This index is useful to measure and rank journals, especially new journals. The paper classifies journal editorial teams and evaluates academic journals using data for 738 members of editorial teams for 21 well-known journals in the field of library and information science. The study concludes that the new index has a significantly positive relationship with journal reputation and shows that the journals’ rankings according to the new index are neither far away from nor uselessly close to the four baseline indicators traditionally measuring journal reputation. Finally, the research finds that there are significant positive correlations between journal reputation and the new index when three different levels of titles of editors are considered, and a comparative empirical analysis of the title levels is provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Andrikopoulos, A., & Economou, L. (2015). Editorial board interlocks in financial economics. International Review of Financial Analysis, 37, 51–62.

    Google Scholar 

  • Asnafi, S., Gunderson, T., McDonald, R. J., & Kallmes, D. F. (2017). Association of h-index of editorial board members and impact factor among radiology journals. Academic Radiology, 24(2), 119–123.

    Google Scholar 

  • Baccini, A., & Barabesi, L. (2011). Seats at the table: The network of the editorial boards in information and library science. Journal of Informetrics, 5(3), 382–391.

    Google Scholar 

  • Bedeian, A. G., Van Fleet, D. D., & Hyman, H. H. (2009). Scientific achievement and editorial board membership. Organizational Research Methods, 12(2), 211–238.

    Google Scholar 

  • Besancenot, D., Huynh, K. V., & Faria, J. R. (2012). Search and research: The influence of editorial boards on journals’ quality. Theory and Decision, 73(4), 687–702.

    MathSciNet  MATH  Google Scholar 

  • Braun, T., Dióspatonyi, I., Zsindely, S., & Zádor, E. (2007). Gatekeeper index versus impact factor of science journals. Scientometrics, 71(3), 541–543.

    Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (2006). A Hirsch-type index for journals. Scientometrics, 69(1), 169–173.

    Google Scholar 

  • Burgess, T. F., & Shaw, N. E. (2010). Editorial board membership of management and business journals: A social network analysis study of the financial times 40. British Journal of Management, 21(3), 627–648.

    Google Scholar 

  • Cai, L., Tian, J., Liu, J., Bai, X., Lee, I., Kong, X., et al. (2019). Scholarly impact assessment: A survey of citation weighting solutions. Scientometrics, 118(2), 453–478.

    Google Scholar 

  • Callaway, E. (2016). Publishing elite turns against impact factor. Nature, 535(7611), 210–211.

    Google Scholar 

  • Chan, K. C., & Fok, R. C. (2003). Membership on editorial boards and finance department rankings. Journal of Financial Research, 26(3), 405–420.

    Google Scholar 

  • da Silva, J. A. T., & Al-Khatib, A. (2017). How are editors selected, recruited and approved? Science and Engineering Ethics, 23(6), 1801–1804.

    Google Scholar 

  • Faria, J. R. (2005). The game academics play: Editors versus authors. Bulletin of Economic Research, 57(1), 1–12.

    MathSciNet  Google Scholar 

  • Finlay, S. C., Ni, C., Tsou, A., & Sugimoto, C. R. (2013). Publish or practice? An examination of librarians’ contributions to research. portal: Libraries and the Academy, 13(4), 403–421.

    Google Scholar 

  • Frey, B. S., & Rost, K. (2010). Do rankings reflect research quality? Journal of Applied Economics, 13(1), 1–38.

    Google Scholar 

  • García-Carpintero, E., Granadino, B., & Plaza, L. M. (2010). The representation of nationalities on the editorial boards of international journals and the promotion of the scientific output of the same countries. Scientometrics, 84(3), 799–811.

    Google Scholar 

  • Giménez-Toledo, E., Román-Román, A., Perdiguero, P., & Palencia, I. (2009). The editorial boards of Spanish scholarly journals: What are they like? What should they be like? Journal of Scholarly Publishing, 40(3), 287–306.

    Google Scholar 

  • Glänzel, W. (2006). On the opportunities and limitations of the H-index. Science Focus, 1(1), 10–11. English version retrieved from http://eprints.rclis.org/9378/1/H_Index_opprtunities.pdf.

  • Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572.

    MATH  Google Scholar 

  • Hirsch, J. E. (2019). hα: An index to quantify an individual’s scientific leadership. Scientometrics, 118(2), 673–686.

    Google Scholar 

  • Kay, J., Memon, M., de Sa, D., Simunovic, N., Duong, A., Karlsson, J., et al. (2017). The h-index of editorial board members correlates positively with the impact factor of sports medicine journals. Orthopaedic Journal of Sports Medicine, 5(3), 2325967117694024.

    Google Scholar 

  • Konrad, A. M. (2008). Knowledge creation and the journal editor’s role. In Y. Baruch, A. M. Konrad, H. Aguinis, & W. H. Starbuck (Eds.), Opening the black box of editorship (pp. 3–15). New York: Palgrave MacMillan.

    Google Scholar 

  • Lowe, D. J., & Van Fleet, D. D. (2009). Scholarly achievement and accounting journal editorial board membership. Journal of Accounting Education, 27(4), 197–209.

    Google Scholar 

  • Mauleón, E., Hillán, L., Moreno, L., Gómez, I., & Bordons, M. (2013). Assessing gender balance among journal authors and editorial board members. Scientometrics, 95(1), 87–114.

    Google Scholar 

  • Mazov, N. A., & Gureev, V. N. (2016). The editorial boards of scientific journals as a subject of scientometric research: A literature review. Scientific and Technical Information Processing, 43(3), 144–153.

    Google Scholar 

  • Mendonça, S., Pereira, J., & Ferreira, M. E. (2018). Gatekeeping African studies: What does “editormetrics” indicate about journal governance? Scientometrics, 117(3), 1513–1534.

    Google Scholar 

  • Metz, I., Harzing, A. W., & Zyphur, M. J. (2016). Of journal editors and editorial boards: Who are the trailblazers in increasing editorial board gender equality? British Journal of Management, 27(4), 712–726.

    Google Scholar 

  • Mingers, J., & Yang, L. (2017). Evaluating journal quality: A review of journal citation indicators and ranking in business and management. European Journal of Operational Research, 257(1), 323–337.

    MathSciNet  MATH  Google Scholar 

  • Mukaka, M. M. (2012). A guide to appropriate use of correlation coefficient in medical research. Malawi Medical Journal, 24(3), 69–71.

    Google Scholar 

  • Nisonger, T. (2002). The relationship between international editorial board composition and citation measures in political science, business, and genetics journals. Scientometrics, 54(2), 257–268.

    Google Scholar 

  • Oleinik, A. (2014). Conflict (s) of interest in peer review: Its origins and possible solutions. Science and Engineering Ethics, 20(1), 55–75.

    Google Scholar 

  • Pagel, P. S., & Hudetz, J. A. (2011). Bibliometric analysis of anaesthesia journal editorial board members: Correlation between journal impact factor and the median h-index of its board members. British Journal of Anaesthesia, 107(3), 357–361.

    Google Scholar 

  • Paulus, F. M., Cruz, N., & Krach, S. (2018). The impact factor fallacy. Frontiers in Psychology, 9, 1487.

    Google Scholar 

  • Petersen, J., Hattke, F., & Vogel, R. (2017). Editorial governance and journal impact: A study of management and business journals. Scientometrics, 112(3), 1593–1614.

    Google Scholar 

  • Resnik, D. B., & Elmore, S. A. (2016). Ensuring the quality, fairness, and integrity of journal peer review: A possible role of editors. Science and Engineering Ethics, 22(1), 169–188.

    Google Scholar 

  • Roth, W. M. (2002). Editorial power/authorial suffering. Research in Science Education, 32(2), 215–240.

    Google Scholar 

  • Straub, D., & Anderson, C. (2010). Journal quality and citations: Common metrics and considerations about their use. MIS Quarterly, 34(1), iii–xii.

    Google Scholar 

  • Teixeira, E. K., & Oliveira, M. (2018). Editorial board interlocking in knowledge management and intellectual capital research field. Scientometrics, 117(3), 1853–1869.

    Google Scholar 

  • Tsui, A. S., & Hollenbeck, J. R. (2009). Successful authors and effective reviewers: Balancing supply and demand in the organizational sciences. Organizational Research Methods, 12(2), 259–263.

    Google Scholar 

  • Walters, W. H. (2016). The research contributions of editorial board members in library and information science. Journal of Scholarly Publishing, 47(2), 121–146.

    Google Scholar 

  • Walters, W. H. (2017a). Citation-based journal rankings: Key questions, metrics, and data sources. IEEE Access, 5, 22036–22053.

    Google Scholar 

  • Walters, W. H. (2017b). Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact? Journal of Informetrics, 11(3), 730–744.

    Google Scholar 

  • Walters, W. H., & Wilder, E. I. (2016). Disciplinary, national, and departmental contributions to the literature of library and information science, 2007–2012. Journal of the Association for Information Science and Technology, 67(6), 1487–1506.

    Google Scholar 

  • Wu, D., Li, J., Lu, X., & Li, J. (2018). Journal editorship index for assessing the scholarly impact of academic institutions: An empirical analysis in the field of economics. Journal of Informetrics, 12(2), 448–460.

    Google Scholar 

  • Zdeněk, R. (2018). Editorial board self-publishing rates in Czech economic journals. Science and Engineering Ethics, 24(2), 669–682.

    Google Scholar 

  • Zdeněk, R., & Lososová, J. (2018). An analysis of editorial board members’ publication output in agricultural economics and policy journals. Scientometrics, 117(1), 563–578.

    Google Scholar 

  • Zhang, J., Zhao, Y., & Wang, Y. (2016). A study on statistical methods used in six journals of library and information science. Online Information Review, 40(3), 416–434.

    Google Scholar 

  • Zsindely, S., Schubert, A., & Braun, T. (1982). Editorial gatekeeping patterns in international science journals: A new science indicator. Scientometrics, 4(1), 57–68.

    Google Scholar 

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China (Grants 71874173 and 71273250) and the Academic Division of Mathematics and Physics of the Chinese Academy of Sciences (Grant No. 2018-M04-B-004). We would like to thank the editor and anonymous reviewers for their constructive comments and suggestions, which helped us to improve the paper.

Author information

Authors and Affiliations

  1. School of Management, University of Science and Technology of China, 96 Jinzhai Road, Hefei, 230026, China

    Yundong Xie, Qiang Wu & Xingchen Li

Authors
  1. Yundong Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xingchen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiang Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, Y., Wu, Q. & Li, X. Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation. Scientometrics 120, 1333–1349 (2019). https://doi.org/10.1007/s11192-019-03177-x

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-019-03177-x

Keywords

Search

Navigation