Evolving regimes of multi-university research evaluation
- 479 Downloads
Since 1980, national university departmental ranking exercises have developed in several countries. This paper reviews exercises in the U.S., U.K. and Australia to assess the state-of-the-art and to identify common themes and trends. The findings are that the exercises are becoming more elaborate, even unwieldy, and that there is some retreat from complexity. There seems to be a movement towards bibliometric measures. The exercises also seem to be effective in enhancing university focus on research strategy.
KeywordsComposite index ERA NRC ranking RAE Ranking Research RQF University
Consultations with Ben R. Martin, Linda Butler and Phil Shapira were most helpful in the writing of this paper and the author is grateful for their insights. There remains a distinct possibility that misinterpretations remain however, and for those the author is solely responsible.
- Australian Bureau of Statistics. (2006). Research and experimental development: higher education organisations, 2004 Reissue, 8111.0, July, http://www.ausstats.abs.gov.au/ausstats/.
- Australian Government, Department of Education, Science and Training. (2006). Research quality framework: Assessing the quality and impact of research in Australia, The Recommended RQF. Commonwealth of Australia: October.Google Scholar
- Australian Vice Chancellors Committee (AVCC). (2005). University Funding and Expenditure, January, http://www.universitiesaustralia.edu.au/documents/publications/stats/Funding&Expenditure.pdf.
- Carr, K. (2008). New era for research quality: Announcement of Excellence in Research for Australia Initiative. Press release, February 26, 2008. Retrieved March 6, 2008 from: http://minister.industry.gov.au/SenatortheHonKimCarr/Pages/NEWERAFORRESEARCHQUALITY.aspx.
- Department of Trade and Industry (DTI), Office of Science and Innovation. (2007). PSA Target Metrics 2006. London: HMSO.Google Scholar
- Dusansky, R., & Vernon, C. J. (1998). Rankings of U.S. Economics Departments. The Journal of Economic Perspectives, 12(1), 157–170.Google Scholar
- Gläser, J., Laudel, G., Hinze, S., & Butler, L. (2002). Impact of evaluation-based funding on the production of scientific knowledge: What to worry about and how to find out. Expertise for the German Ministry for Education and Research, May, http://repp.anu.edu.au/expertise-glae-lau-hin-but.pdf.
- Higher Education Research Opportunities in the United Kingdom (HERO). (2008). http://www.hero.ac.uk/uk/research/research_assessment_exercise_.cfm. Accessed 12 June 2007.
- Lipsett, A. (2005). RAE raises UK journal activity. Times Higher Education Supplement, July 1, section 1698, 4.Google Scholar
- Lipsett, A. (2007). RAE selection gets brutal. Times Higher Education Supplement, February 2, section 1779, 1.Google Scholar
- Martin, B. R. (2007, January). Replacing the RAE with Metrics—Is this the way forward? Seminar presented at Imperial College.Google Scholar
- Moed, H. F. (2007). UK Research assessment exercises: Informed judgments on research quality or quantity? Scientometrics, Forthcoming.Google Scholar
- National Research Council. (2004). Assessing research doctorate programs: A methodology study. Washington DC: National Academies Press. http://www.nap.edu/openbook/030909058X/html/28.html.
- Sanders, C. (2006). Boom time for high-flyers. Times Higher Education Supplement, March 17, section 1734, 6.Google Scholar
- Sastry, T., & Bekhradnia, B. (2006). Using metrics to allocate research funds: A short evaluation of alternatives to the Research Assessment Exercise. Oxford: Higher Education Policy Institute.Google Scholar
- Segal, Quince Wickstead (SQW). (1996). A study of selectivity. Bristol: HEFCE, M 20/96. http://www.hefce.ac.uk/pubs/hefce/1996/m20_96_2.htm.
- U.K. Department of Trade and Industry (DTI). (2007). Science, engineering and technology statistics, Table 5.1. Higher Education Funding Council for England (HEFCE). (1997). The impact of the 1992 Research Assessment Exercise on higher education institutions in England. Bristol: Higher Education Funding Council for England, M6/97. http://www.hefce.ac.uk/pubs/hefce/1997/m6_97.htm.
- Wojtas, O. (2007). RAE fuels trend for research only time. Times Higher Education Supplement, January 19, section 1777, 64.Google Scholar