Skip to main content
SpringerLink
Log in

Assessment of Clinical Performance: In-Training Evaluation

  • Chapter
  • First Online:
International Handbook of Research in Medical Education

Part of the book series: Springer International Handbooks of Education ((SIHE,volume 7))

Summary

Of those evaluation methods currently available for the assessment of clinical competence, in-training evaluation comes closest to measuring true performance. Unfortunately, current methods are neither reliable nor valid, leaving evaluative decisions made on this basis indefensible. The objectives of this chapter are to characterize existing methods of in-training evaluation, and discuss what we know from the literature pertaining to their strengths and weaknesses. Drawing upon evidence from the cognitive and psychometric sciences, new models and methods of in-training evaluation are proposed. The chapter will conclude with a future agenda for research in this domain.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 429.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 549.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Butterfield, P. S., & Mazzaferri, E. L. (1991). New rating form for use by nurses in assessing residents’ humanistic behavior.Journal of General Internal Medicine6, 155–161.

    Article  Google Scholar 

  • Crocker, L., & Algina, J. (1986).Introduction to classical and modem test theory.Fort Worth: Harcourt Brace Jovanovich College Publishers.

    Google Scholar 

  • Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.)Educational measurement(2nd ed., pp. 443–507). Washington, D.C.: American Council on Education.

    Google Scholar 

  • Eldin, M., Magzoub, M. A., Schmidt, H. G., Abdel-Hameed, A. A., Dolmans, D., & Mustafa, S. E. (1998). Student assessment in community settings: a comprehensive approach.Medical Education 3250–59.

    Article  Google Scholar 

  • Fisher Jr., W. P., Vial, R. H., & Sanders, C. V. (1997).Removing rater effects from medical clerkship evaluation.Academic Medicine72(5), 443–444.

    Article  Google Scholar 

  • Foldevi, M., & Svendin, C. G. (1996).“Phase Examination” an assessment of consultation skills and integrative knowledge based in general practice.Medical Education30(5), 326–332.

    Article  Google Scholar 

  • Fowell, S. L., Southgate, L. J.&Bligh, J. G. (1999) Evaluating assessment: The missing link?Medical Education33(4), 276–281.

    Article  Google Scholar 

  • Fung Kee Fung, M. P., Parboosingh, I. J., Temple, L. M., Guy-d’Anjou, C., Haebe, J., & Lussier, R. (1997).Development of a computerized telecommunications system for in-training evaluation of residents in a laparoscopie educational program.Obstetrics and Gynecology90(1), 148–152.

    Article  Google Scholar 

  • Gray, J. D. (1996a). Primer on resident evaluation.Annals of the Royal College of Physicians and Surgeons of Canada29(2), 91–94.

    Google Scholar 

  • Gray, J. D. (1996b). Global rating scales in residency education.Academic Medicine21(1 Suppl.), S55–63.Haber, R. J., & Avins, A. L. (1994). Do ratings on the American Board of Internal Medicine resident evaluation form detect differences in clinical competence?Journal of General Internal Medicine 9140–145.

    Google Scholar 

  • Hastings Center Report (1996).The goals of medicine: setting new priorities.Special Supplement. Briarcliff Manor, New York.

    Google Scholar 

  • Henkin, Y., Friedman, M., Bouskila, D., Kushnir, D.&Glick, S. (1990). The use of patients as student evaluators.Medical Teacher12(3/4), 279–289.

    Article  Google Scholar 

  • Holmboe, E. S., & Hawkins,(1998). Methods for evaluating the clinical competence of residents in internal medicine: a review.Annals of Internal Medicine129(1), 42–48.

    Article  Google Scholar 

  • Hull, A.L., Hodder, S., Berger, B., Gindberg, D., Lindheim,N., Quan, J., & Kleinhenz, M. E. (1995). Validity of three clinical performance assessments of internal medicine clerks.Academic Medicine70(6), 517–522.

    Article  Google Scholar 

  • Hunt, D. D. (1992). Functional and dysfunctional characteristics of the prevailing model of clinical evaluation systems in North American medical schools.Academic Medicine67(4), 254–259.

    Article  Google Scholar 

  • Kane, M. T. (1992). The assessment of professional competence.Evaluation in the Health Professions 15163–152.

    Article  Google Scholar 

  • Littlefield, J. H., DaRosa, D. A., Anderson, K. D., Bell, R. M., Nicholas, G. G., & Wolfson, P. J. (1991). Assessing performance in clerkships: accuracy of surgery clerkship performance raters.Academic Medicine66(9), S16–S18.

    Google Scholar 

  • Maguire T., Hattie J., & Haig B. (1994). Construct-validity and achievement assessmentAlberta Journal of Educational Research 40(2)109–126.

    Google Scholar 

  • Maudsley, R. F. (1999). Content in context: medical education and society’s needs.Academic Medicine74(2), 143–145.

    Article  Google Scholar 

  • McCrae, H. M., Vu, N. V., Graham, B., Word-Sims, M., Colliver, J. A.&Robbs, R. S. (1995). Comparing checklists and databases with physicians ratings as measures of students’ history and physical-examination skills.Academic Medicine 70(4)313–317.

    Article  Google Scholar 

  • McGuire, C. (1993). Perspectives in assessment.Academic Medicine68(2), S3–S8.

    Google Scholar 

  • McManus, I. C., Richards, P., Winder, B. C., & Sproston, K. A. (1998) Clinical experience, performance in final examinations, and learning style in medical students: Prospective study.British Medical Journal316(7128), 345–350.

    Article  Google Scholar 

  • Medical School Objectives Writing Group (1999). Leaming objectives for medical student education - guidelines for medical schools: report I of the Medical Schools Objectives Project.Academic Medicine74(1), 13–18.

    Article  Google Scholar 

  • Messick, S. (1995). Validity of psychological-assessment - validation of inferences from persons’ responses and performances as scientific inquiry into score meaning.American Psychologist 50(9), 741–749.

    Article  Google Scholar 

  • Miller, G. E. (1990). The assessment of clinical skills/competence/performance.Academic Medicine65(Suppl.), S63–67.

    Article  Google Scholar 

  • Moss, P. (1995). Themes and variations in validity theory.Educational Measurement Issues and Practice 25–13.

    Google Scholar 

  • Neufeld, V. R. (1993). Demand-side medical education: educating future physicians for Ontario.Canadian Medical Association Journal 148(9)1471–1477.

    Google Scholar 

  • Neufeld, V. R., & Norman G. R. (Eds.). (1985).Assessing clinical competence.New York: Springer.

    Google Scholar 

  • Neufeld, V. R., Maudsley, R. F., Pickering, R. J., Turnbull, J. M., Weston, W. W., & Brown, M. G. (1998). Educating future physicians for OntarioAcademic Medicine 731133–1148.

    Article  Google Scholar 

  • Norcini, J. J., & Shea, J. (1992). The reproducibility of standards over groups and occasions.Applied Measurement in Education5, 62–72.

    Article  Google Scholar 

  • Pangaro, L. (1999). A new vocabulary and other innovations for improving descriptive in-training evaluations.Academic Medicine 74(11)1203–1207.

    Article  Google Scholar 

  • Pearson, S., Rolfe, I. E., & Henry, R. (1998). The relationship between assessment measures at Newcastle Medical School (Australia) and performance ratings during internship.Medical Education 3240–45.

    Article  Google Scholar 

  • Ramsey, P. G., Carline, J.D., Blank, L. L., & Wenrich, M. D. (1996). Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physicians.Academic Medicine 71(4)364–370.

    Article  Google Scholar 

  • Ramsey, P. G., Wenrich, M. D., Carline, J. D., Inui,T. S., Larson, E. B., & Logerfo, J. P. (1993). Use of peer ratings to evaluate physician performance.Journal of the American Medical Association 269(13)1655–1660.

    Article  Google Scholar 

  • Regher, G. (1996). Issues in cognitive psychology: implications for professional education.Academic Medicine 71(9)988–1000.

    Google Scholar 

  • Schmidt, H. G.,Norman, G. R., & Boshuizen, H. P. (1990). A cognitive perspective on medical expertise: theory and implication.Academic Medicine 65611–621.

    Article  Google Scholar 

  • Short, J. P. (1993). The importance of strong evaluation standards and procedures in training residents.Academic Medicine 68(7)522–525.

    Article  Google Scholar 

  • Smith, R. M. (1993). The triple-jump examination as an assessment tool in the problem-based medical curriculum at the University of Hawaii.Academic Medicine 68(5)366–372.

    Article  Google Scholar 

  • Societal Needs Working Group, CanMEDS 2000 Project (1996). Skills for the new millennium.Annals of the Royal College of Physicians and Surgeons of Canada29(4), 206–216.

    Google Scholar 

  • Speer, A. J.,Solomon, D. J., & Ainsworth, M. A. (1996) An innovative evaluation method in an internal medicine clerkship.Academic Medicine (Suppl.)71(1), S76–S78.

    Article  Google Scholar 

  • Stillman, P. L. (1991). Positive effects of a clinical performance assessment program.Academic Medicine 66(8), 481–483.

    Article  Google Scholar 

  • Tamblyn, R., Benaroya, S., Snell, L., McLeod, P.,Schnarch, B., & Abrahamowicz, M. (1994). The feasibility and value of using patient satisfaction ratings to evaluate internal medicine residents.Journal of General Internal Medicine9146–152.

    Article  Google Scholar 

  • Thomas, C. S., Mellsop, G., Callender, K., Crawshaw, J., Ellis, P. M., Hall, A., Macdonald, J.,Silfverskiold, P., & Romansclarkson, S. (1993). The oral examinations — a study of academic and nonacademic factors.Medical Education 27(5), 433–439.

    Article  Google Scholar 

  • Turnbull,J., Gray, J., & MacFadyen, J. (1998). Improving in-training evaluation programs.Journal of General Internal Medicine13(5), 317–323.

    Article  Google Scholar 

  • Turnbull, J., MacFadyen, J., Van Barneveld, C., and Norman, G. (2000). Clinical work sampling: A new approach to the problem of in training evaluation.Journal of General Internal Medicine 15556–561.

    Article  Google Scholar 

  • Van der Vleuten, C. P. M. (2000). There is a paradigm shift in medical education assessment from quantitive to qualitative. Is medical education able and prepared to make such a move? Paper presented at the 9th International Ottawa Conference on Medical Education. Capetown, South Africa.

    Google Scholar 

  • Van der Vleuten, C. P. M.,Norman, G. R., & de Graaff, E. (1991). Pitfalls in the pursuit of objectivity: issues of reliability.Medical Education 25110–118.

    Article  Google Scholar 

  • Weaver, M.J.Ow, C., Walker, D. J., & Degenhardt, E. F. (1993). A questionnaire for patients’ evaluations of their physicians’ humanistic behaviors.Journal of General Internal Medicine 8135–139.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Ottawa, Canada

    Jeff Turnbull

  2. University of Toronto, Canada

    Christina Van Barneveld

Authors
  1. Jeff Turnbull
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christina Van Barneveld
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. McMaster University, Canada

    Geoff R. Norman

  2. University of Maastricht, The Netherlands

    Cees P. M. van der Vleuten  & Diana H. J. M. Dolmans  & 

  3. University of Sheffield, UK

    David I. Newble

  4. Dalhousie University, Canada

    Karen V. Mann

  5. University of Toronto, Canada

    Arthur Rothman

  6. CurryCorp, Canada

    Lynn Curry

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Turnbull, J., Van Barneveld, C. (2002). Assessment of Clinical Performance: In-Training Evaluation. In: Norman, G.R., et al. International Handbook of Research in Medical Education. Springer International Handbooks of Education, vol 7. Springer, Dordrecht. https://doi.org/10.1007/978-94-010-0462-6_29

Download citation

  • DOI: https://doi.org/10.1007/978-94-010-0462-6_29

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-3904-8

  • Online ISBN: 978-94-010-0462-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation