, Volume 87, Issue 2, pp 399–413 | Cite as

A national-scale cross-time analysis of university research performance

  • Giovanni Abramo
  • Ciriaco Andrea D’Angelo
  • Flavia Di Costa


Research policies in the more developed nations are ever more oriented towards the introduction of productivity incentives and competition mechanisms intended to increase efficiency in research institutions. Assessments of the effects of these policy interventions on public research activity often neglect the normal, inherent variation in the performance of research institutions over time. In this work, we propose a cross-time bibliometric analysis of research performance by all Italian universities in two consecutive periods (2001–2003 and 2004–2008) not affected by national policy interventions. Findings show that productivity and impact increased at the level of individual scientists. At the level of university, significant variation in the rank was observed.


Research assessment Bibliometrics Productivity Cross-time analysis University 


  1. Abramo, G., D’Angelo, C. A., & Pugini, F. (2008a). The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology. Scientometrics, 76(2), 225–244.CrossRefGoogle Scholar
  2. Abramo, G., D’Angelo, C. A., & Di Costa, F. (2008b). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111–121.CrossRefGoogle Scholar
  3. Abramo, G., D’Angelo, C. A., & Di Costa, F. (2009). Research collaboration and productivity: Is there correlation? Higher Education, 57(2), 155–171.CrossRefGoogle Scholar
  4. Auranen, O., & Nieminen, M. (2010). University research funding and publication performance—An international comparison. Research Policy, 39(6), 822–834.CrossRefGoogle Scholar
  5. Bonaccorsi, A., Daraio, C., & Simar, L. (2006). Advanced indicators of productivity of universities. An application of robust nonparametric methods to Italian data. Scientometrics, 66(2), 389–410.CrossRefGoogle Scholar
  6. Butler, L. (2003). Explaining Australia’s increased share of ISI publications. The effects of a funding formula based on publication counts. Research Policy, 32(1), 143–155.CrossRefGoogle Scholar
  7. Franceschet, M., & Costantini, A. (2010). The effect of scholar collaboration on impact and quality of academic papers. Journal of Informetrics, 4(4), 540–553.CrossRefGoogle Scholar
  8. Giuffrida, C., D’Angelo, C. A., Abramo, G. (2010). A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology (forthcoming).Google Scholar
  9. Gómez, I., Bordons, M., Fernández, M. T., & Morillo, F. (2009). Structure and research performance of Spanish universities. Scientometrics, 79(1), 131–146.CrossRefGoogle Scholar
  10. He, Z. L., Geng, X. S., & Campbell-Hunt, C. (2009). Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university. Research Policy, 38(2), 306–317.CrossRefGoogle Scholar
  11. Hung, W.-C., Lee, L.-C., & Tsai, M.-H. (2009). An international comparison of relative contributions to academic productivity. Scientometrics, 81(3), 703–718.CrossRefGoogle Scholar
  12. Lundberg, J. (2007). Lifting the crown-citation z-score. Journal of Informetrics, 1(2), 145–154.CrossRefMathSciNetGoogle Scholar
  13. Moed, H. F. (2008). UK Research Assessment Exercises: Informed judgments on research quality or quantity? Scientometrics, 74(1), 153–161.CrossRefGoogle Scholar
  14. van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133–143.CrossRefGoogle Scholar

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2010

Authors and Affiliations

  • Giovanni Abramo
    • 1
    • 2
  • Ciriaco Andrea D’Angelo
    • 1
  • Flavia Di Costa
    • 1
  1. 1.Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of ManagementUniversity of Rome “Tor Vergata”RomeItaly
  2. 2.National Research Council of ItalyRomeItaly

Personalised recommendations