Skip to main content

How to Build Assessments for Clinical Learners

  • Chapter
  • First Online:
  • 3065 Accesses

Abstract

This chapter describes common methods of assessment and how to create or evaluate assessment items. It also urges a comprehensive approach to implementing assessment, setting standards, and using assessment results to inform learners and the curriculum. Instructors are frequently asked to write multiple-choice test questions, but without question-writing training, the result is often poorly written, flawed questions that test fact memorization and recognition rather than the application of knowledge. In clinical assessments, patient notes are dificult to grade fairly and consistently, especially when multiple instructors are doing the scoring and writing the feedback. This chapter introduces assessment methods that encourage student learning. It also addresses common problems in assessment creation and implementation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Case SM, Swanson DB. Constructing written test questions for the basic and clinical sciences. 3rd ed. Philadelphia, PA: National Board of Medical Examiners; 2002. http://www.nbme.org/publications/item-writing-manual.html.

    Google Scholar 

  2. Downing SM. The effects of violating standard item writing principles on tests and students: the consequences of using flawed test items on achievement examinations in medical education. Adv in Health Sci Educ. 2005;133–143.

    Google Scholar 

  3. Schuwirth LWT, van der Vleuten CPM. Written assessment. Br Med J. 2003;326:643–5.

    Article  Google Scholar 

  4. Waugh CK, Gronlund NE. Assessment of student achievement. 10th ed. New Jersey: Pearson; 2013.

    Google Scholar 

  5. Hodges B, Hanson M, McNaughton N, Regehr G. Creating, monitoring, and improving a psychiatry OSCE: a guide for faculty. Acad Psychiatry. 2002;26(3):134–61.

    Article  PubMed  Google Scholar 

  6. Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29:855–71.

    Article  PubMed  Google Scholar 

  7. Miller A, Archer J. Impact of workplace based assessment on doctors’ education and performance: a systematic review. BMJ. 2010;341:c5064. doi:10.1136/bmj.c5064.

    Article  PubMed  Google Scholar 

  8. Boulet JR, De Champlain AF, McKinley DW. Setting defensible performance standards on OSCEs and ­standardized patient examinations. Med Teach. 2003;25(3):245–9.

    Article  PubMed  Google Scholar 

Additional Resources

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999.

    Google Scholar 

  • Boulet JR. Summative assessment in medicine: the promise of simulation for high-stakes evaluation. Acad Emerg Med. 2008;15:1017–24.

    Article  PubMed  Google Scholar 

  • Black P, Wiliam D. Inside the black box: raising standards through classroom assessment. Phi Delta Kappan. 1998;80(2):139–44.

    Google Scholar 

  • Mager RF. Preparing instructional objectives: a critical tool in the development of effective instruction. 3rd ed. Atlanta: CEP; 1997.

    Google Scholar 

  • Boulet JR, Murray D, Kras J, Woodhouse J, McAllister J, Ziv A. Reliability and validity of a simulation-based acute care skills assessment for medical ­students and residents. Anesthesiology. 2003;99(6):1270–80.

    Article  PubMed  Google Scholar 

  • McKinley DW, Boulet JR, Hambleton RK. A work-­centered approach for setting passing scores on ­performance-based assessments. Eval Health Prof. 2005;28(3):349–69.

    Article  PubMed  Google Scholar 

  • Page G, Bordage G, Allen T. Developing key-feature problems and examinations to assess clinical decision-making skills. Acad Med. 1995;70:194–201.

    Article  PubMed  CAS  Google Scholar 

  • Page G, Bordage G. The medical council of Canada’s key features project: a more valid written examination of clinical decision-making skills. Acad Med. 1995;70(2):104–10.

    Article  PubMed  CAS  Google Scholar 

  • Shepard LA. The role of assessment in a learning culture. Educ Res. 2000;29(7):4–14.

    Google Scholar 

  • Smee S. Skill based assessment. Br Med J. 2003;326:703–6.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Teresita McCarty M.D. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

McCarty, T. (2013). How to Build Assessments for Clinical Learners. In: Roberts, L. (eds) The Academic Medicine Handbook. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-5693-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-5693-3_9

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-5692-6

  • Online ISBN: 978-1-4614-5693-3

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics