Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted?
- 299 Downloads
Quantifying the relative performance of individual scholars has become an integral part of decision-making in research policy. The objective of the present study was to evaluate if the scholarship rank of Brazilian Council for Scientific and Technological Development (CNPq) researchers in Medicine is consistent with their scientific productivity. The Lattes curricula of 411 researchers (2006–2008) were included in the study. Scholarship category was the variable of interest. Other variables analyzed were: time since receiving the doctorate, teaching activity (undergraduate, master’s and doctoral students), number of articles published, and number of papers indexed by the Institute for Scientific Information (ISI) and Scopus databases. Additional performance indicators included were: citations, h-index, and m-index. There was a significant difference among scholarship categories regarding number of papers per year, considering the entire scientific career (P < 0.001) or the last 5 years (P < 0.001). There was no significant difference among scholarship categories regarding the number of citations per article in the ISI (Thomson Reuters) database (P = 0.23). There was a significant difference in h-index among scholarship categories in both databases, i.e. (P < 0.001) and Scopus (P < 0.001). Regarding the m-index, there was a significant difference among categories only in the ISI database (P = 0.012). According to our findings, a better instrument for qualitative and quantitative indicators is needed to identify researchers with outstanding scientific output.
KeywordsScientific publication indicators Clinical medicine Health postgraduate programs Health sciences H index Scopus
This study was partially supported by CNPq (National Council for Scientific and Technological Development) and FAPEMIG (Research Support Foundation of Minas Gerais). Eduardo A. Oliveira and Ana Cristina Simões e Silva were the recipients of CNPq scholarships Category 2 in the area of Medicine. Hercílio Martelli-Júnior and Enrico A. Colosimo were the recipients of CNPq scholarships Category 2 in the areas of Dentistry and Mathematics, respectively.
- Abramo, G., D’Angelo, C. A., & Costa, F. (2011b). Research productivity: Are higher academic ranks more productive than lower ones? Scientometrics. doi: 10.1007/s11192-011-0426-6.
- Bornmann, L., Mutz, R., & Daniel, H.-D. (2008a). Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science & Technology, 59(5), 830–837.CrossRefGoogle Scholar
- CNPq, Ministério de Ciência e Tecnologia. (2010). Critérios de Julgamento—CA-MD. http://www.cnpq.br/cas/ca-md.htm#criterios. Accessed 4th Aug 2010.
- Mendes, P. H. C., Martelli, D. R., Souza, W. P., Filho, S. Q., & Martelli Junior, H. (2010). Perfil dos pesquisadores bolsistas de produtividade científica na medicina no CNPq, Brasil. Revista Brasileira de Educação Médica (in press).Google Scholar
- Montgomery, D. C. (2008). Design and analysis of experiments (Vol. 1, 7th ed.). Boston: Wiley.Google Scholar
- Oliveira, E. A., Ribeiro, A. L. P., Quirino, I. G., Oliveira, M. C., Martelli, D. R., Lima, L. S., et al. (2011b). Perfil e produção científica dos pesquisadores do Conselho Nacional de Desenvolvimento Científico e Tecnológico na área de Cardiologia. Arquivos Brasileiro de Cardiologia. doi: 10.1590/S0066-782X2011005000086
- van Raan, A. F. J. (2006). Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics, 67, 491–502.Google Scholar