Anchoring effects in world university rankings: exploring biases in reputation scores
Despite ongoing debates about their uses and validity, university rankings are a popular means to compare institutions within a country and around the world. Anchoring theory suggests that these rankings may influence assessments of institutional reputation, and this effect may be particularly strong when a new rankings system is introduced. We test this possibility by examining data from the first 3 years of the Times Higher Education Supplement (THES) world university rankings. Consistent with an anchoring hypothesis, the initial THES rankings influenced peer assessments of reputation in subsequent surveys, but second-year rankings were not related to changes in reputation in the third year. Furthermore, as expected, early peer assessment ratings were not associated with changes in future rankings. These findings provide strong evidence for an anchoring effect on assessments of institutional reputation. We discuss the usefulness of these peer assessments, along with ways in which reputational surveys can be improved.
KeywordsUniversity rankings Higher education Institutional reputation Anchoring effects Global competition
- Bastedo, M. N., & Bowman, N. A. (in press). College rankings as an interorganizational dependency: Establishing the foundation for strategic and institutional accounts. Research in Higher Education.Google Scholar
- Bollen, K. A. (1989). Structural equation models with latent variables. New York: Wiley.Google Scholar
- Byrne, B. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.Google Scholar
- Crabbe, N. (2009, June 17). On survey, Machen rates UF with Harvard, other Fla. schools low. The Gainesville Sun. Retrieved April 2, 2010, from http://bit.ly/y9AAb.
- Gottlieb, B. (1999, September 1). Cooking the school books: How U.S. News cheats in picking its “best American colleges.” Slate. Retrieved November 19, 2009, from http://www.slate.com/id/34027/.
- Institute for Higher Education Policy (IHEP). (2007). College and university ranking systems: Global perspectives and American challenges. Washington, DC: Author.Google Scholar
- Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: Guilford Press.Google Scholar
- Lee, S. (2009, August 19). Reputation without rigor. Inside Higher Ed. Retrieved April 2, 2010, from http://www.insidehighered.com/news/2009/08/19/rankings.
- Monks, J., & Ehrenberg, R. G. (1999). The impact of U.S. News & World Report college rankings on admissions outcomes and pricing policies at selective private institutions (Working Paper #7227). Washington, DC: National Bureau of Economic Research.Google Scholar
- Mussweiler, T., & Strack, F. (1999). Comparing is believing: A selective accessibility model of judgmental anchoring. In W. Stroebe & M. Hewstone (Eds.), European review of social psychology (Vol. 10, pp. 135–167). Chichester, UK: Wiley.Google Scholar
- Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). New York: Wadsworth.Google Scholar
- Shanghai Jiao Tong University (2003). Academic ranking of world universities—2003. Retrieved November 23, 2009, from http://www.arwu.org/ARWU2003.jsp.
- Sponsler, B. (2009). The role and relevance of rankings in higher education policymaking. Washington, DC: Institute for Higher Education Policy.Google Scholar
- Stake, J. E. (2006). The interplay between law school rankings, reputations, and resource allocations: Ways rankings mislead. Indiana Law Journal, 82, 229–270.Google Scholar
- Usher, A., & Savino, M. (2006). A world of difference: A global survey of university league tables. Toronto, ON: Educational Policy Institute.Google Scholar