Academic Psychiatry

, Volume 26, Issue 3, pp 134–161 | Cite as

Creating, Monitoring, and Improving a Psychiatry OSCE

A Guide for Faculty
  • Brian Hodges
  • Mark Hanson
  • Nancy McNaughton
  • Glenn Regehr
Special Article


Academic Psychiatry Global Rating Standardize Patient Postpartum Depression Objective Structure Clinical Examination 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Harden RM, Gleeson FA: Assessment of clinical competence using an observed structured clinical examination. Med Educ 1979; 13: 41–47PubMedGoogle Scholar
  2. 2.
    Barrows HS, Abrahamson S: The programmed patient: a technique for appraising student performance in clinical neurology. Journal of Medical Education 1964; 39: 802–805PubMedGoogle Scholar
  3. 3.
    van der Vleuten CPM, Swanson D: Assessment of clinical skills with standardized patients: state of the art. Teaching and Learning in Medicine 1990; 2: 58–76CrossRefGoogle Scholar
  4. 4.
    Abrahmson S (ed): The oral examination: the case for and against, in Evaluating the Clinical Skills of Medical Specialists. Evanston, IL, American Board of Medical Specialties, 1983, pp 121–124Google Scholar
  5. 5.
    McGuire CH: The oral examination as a measure of professional competence. Journal of Medical Education 1966; 41: 267–274PubMedGoogle Scholar
  6. 6.
    Davidson RG: A point of view: oral examinations (letter). Annals of the Royal College of Physicians and Surgeons of Canada [Annals RCPSC] 1983; 16: 114Google Scholar
  7. 7.
    Valberg LS, Stuart RK: A point of view: university in-training evaluation and oral examinations in internal medicine. Annals RCPSC 1983; 16: 513–515Google Scholar
  8. 8.
    Jayawickramarajah PT: Oral examinations in medical education. Med Educ 1985; 19: 290–293PubMedCrossRefGoogle Scholar
  9. 9.
    Muzzin LJ, Hart L: Oral examinations, in Assessing Clinical Competence, edited by Neufeld VR, Norman GR. New York, Springer, 1985, pp 71–93Google Scholar
  10. 10.
    Leichner P, Sisler GC, Harper D: A study of the reliability of the clinical oral examination in psychiatry. Can J Psychiatry 1984; 29: 394–397PubMedGoogle Scholar
  11. 11.
    Leichner P, Sisler GC, Harper D: The clinical oral examination in psychiatry: the patient variable. Annals RCPSC 1986; 19: 283–284Google Scholar
  12. 12.
    Rothman AI, Cohen R: Understanding the objective structured clinical examination (OSCE): issues and options. Annals RCPSC 1995; 28: 283–287Google Scholar
  13. 13.
    Kowlovitz V, Hoole AJ, Sloane PD: Implementing the objective structured clinical examination in a traditional medical school. Acad Med 1991; 66: 345–347CrossRefGoogle Scholar
  14. 14.
    Matsell DG, Wolfish NM, Hsu E: Reliability and validity of the objective structured clinical examination in paediatrics. Med Educ 1991; 25: 293–299PubMedCrossRefGoogle Scholar
  15. 15.
    Sloan DA, Donnelly MB, Johnson SB, et al: Use of an objective structured clinical examination to measure improvement in clinical competence during the surgical internship. Surgery 1993; 114: 343–351PubMedGoogle Scholar
  16. 16.
    McFaul PB, Taylor DJ, Howie PW: The assessment of clinical competence in obstetrics and gynecology in two medical schools by an objective structured clinical examination. British Journal of Obstetrics and Gynaecology 1993; 100: 842–846PubMedCrossRefGoogle Scholar
  17. 17.
    Cohen R, Rothman A, Ross J, et al: A comprehensive assessment of graduates of foreign medical schools. Annals RCPSC 1989; 21: 505–509Google Scholar
  18. 18.
    Hodges B, Turnbull J, Cohen R, et al: Evaluating communication skills in the OSCE format: reliability and generalizability. Med Educ 1996; 30: 38–43PubMedCrossRefGoogle Scholar
  19. 19.
    Loschen EL: Using the objective structured clinical examination in a psychiatry residency. Academic Psychiatry 1993; 17: 95–104Google Scholar
  20. 20.
    Famuyiwa OO, Zachariah MP, Ilechukwu STC: The objective structured clinical exam in psychiatry. Med Educ 1991; 25: 45–50PubMedCrossRefGoogle Scholar
  21. 21.
    Hodges B, Lofchy J: Examining psychiatry clinical clerks with a mini-OSCE. Academic Psychiatry 1997; 21: 219–225Google Scholar
  22. 22.
    Hodges B, Regehr G, Hanson M, et al: Evaluating psychiatric clinical clerks with an objective structured clinical examination. Acad Med 1997; 72: 715–721PubMedCrossRefGoogle Scholar
  23. 23.
    Hodges B, Regehr G, Hanson M, et al: The objective structured clinical exam in psychiatry: a validation study. Acad Med 1998; 73: 74–76CrossRefGoogle Scholar
  24. 24.
    Hanson M, Hodges B, McNaughton N, et al: The integration of child psychiatry into a psychiatry clerkship OSCE. Can J Psychiatry 1998; 43: 614–618PubMedGoogle Scholar
  25. 25.
    Hodges B, Hanson M, McNaughton N, et al: What do psychiatry residents think of an objective structured clinical examination? Academic Psychiatry 1999; 23: 1–7Google Scholar
  26. 26.
    McNaughton N, Tiberius R, Hodges B: Effects of portraying psychologically and emotionally complex standardized patient roles. Teaching and Learning in Medicine 1999; 11: 135–141CrossRefGoogle Scholar
  27. 27.
    Cusimano MD, Cohen R, Tucker W, et al: A comparative analysis of the costs of administration of an OSCE. Acad Med 1994; 69: 571–576PubMedCrossRefGoogle Scholar
  28. 28.
    Reznick R, Regehr G, Yee G, et al: Process rating forms versus task-specific checklists in an OSCE for medical licensure. Acad Med 1998; 73(10, suppl): S97–S99PubMedCrossRefGoogle Scholar
  29. 29.
    Regehr G, MacRae H, Reznick R, et al: Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998; 73: 993–997PubMedCrossRefGoogle Scholar
  30. 30.
    Regehr G, Freeman R, Robb A, et al: OSCE performance evaluations made by standardized patients: comparing checklist and global rating scores. Acad Med 1999; 74(10, suppl): S135–S137PubMedCrossRefGoogle Scholar
  31. 31.
    Hunter DM, Jones RM, Randhawa BS: The use of holistic versus analytic scoring for large-scale assessment of writing. The Canadian Journal of Program Evaluation 1996; 11: 61–85Google Scholar
  32. 32.
    Charlin B, Tardif J, Boshuizen PA: Scripts and medical diagnostic knowledge: theory and applications for clinical reasoning instruction and research. Acad Med 2000; 72: 182–190CrossRefGoogle Scholar
  33. 33.
    Hodges B, Regehr G, McNaughton N, et al: OSCE checklists do not capture increasing levels of expertise. Acad Med 1999; 74: 1129–1134PubMedCrossRefGoogle Scholar
  34. 34.
    Hodges B, McNaughton N, Regehr G, et al: The challenge of creating OSCE measures to capture the characteristics of expertise. Med Educ (in press)Google Scholar
  35. 35.
    Regehr G, Freeman R, Hodges B, et al: Assessing the generalizability of OSCE measures across content domains. Acad Med 1999; 74: 1320–1322PubMedCrossRefGoogle Scholar
  36. 36.
    Barrows HS: Simulated Patients (Programmed Patients): Development and Use of a New Technique in Medical Education. Springfield, IL, CC Thomas, 1971Google Scholar
  37. 37.
    Stillman P, Ruggill JS, Rutala PJ, et al: Patient instructors as teachers and evaluators. Journal of Medical Education 1980; 55: 186–193PubMedGoogle Scholar
  38. 38.
    King A, Perkowski-Roger L, Pohl S: Planning standardized patient programs: case development, patient training and costs. Teaching and Learning in Medicine 1994; 6: 6–14CrossRefGoogle Scholar
  39. 39.
    Hanson M, Tiberius R, Hodges B, et al: Adolescent standardized patients: methods of selection and assessment of benefits and risks. Teaching and Learning in Medicine 2002; 14: 104–113PubMedCrossRefGoogle Scholar
  40. 40.
    Educating Future Physicians for Ontario: How to Run an OSCE (video and manual). University of Toronto, University of Ottawa, Queen’s University, McMaster University, and University of Western Ontario, 1994 [See Appendix B for ordering information.]Google Scholar
  41. 41.
    Hodges B, Russell L, MacRury K, et al: The anatomy of an OSCE station: augmenting classical item statistics with expert item classification (abstract). Proceedings of the International Ottawa Conference on Assessment, Maastricht, The Netherlands, 1996Google Scholar
  42. 42.
    Hambleton RK, Powell S: A framework for viewing the process of standard setting. Evaluation and the Health Professions 1983; 6: 3–24PubMedCrossRefGoogle Scholar
  43. 43.
    Meskauskas JA: Setting standards for credentialling examinations: an update. Evaluation and the Health Professions 1986; 9: 187–203CrossRefGoogle Scholar

Copyright information

© Academic Psychiatry 2002

Authors and Affiliations

  • Brian Hodges
    • 1
  • Mark Hanson
    • 2
  • Nancy McNaughton
    • 2
  • Glenn Regehr
    • 2
  1. 1.Department of Psychiatry and Wilson Centre for Research in Education, Faculty of MedicineUniversity of TorontoTorontoCanada
  2. 2.Psychiatric Skills Assessment Project teamUniversity of TorontoTorontoCanada

Personalised recommendations