Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Simulation for Licensure and Certification

  • Chapter
  • First Online:
The Comprehensive Textbook of Healthcare Simulation

Abstract

In the past two decades, there is a growing recognition of the power of simulation-based assessment (SBA) to serve as a complimentary method to the traditional examination methods used for licensure and certification in medical education.

This chapter deals with the role SBA can and should play in regulatory-driven assessment programs. We introduce the main challenges that accompany SBA programs and suggest ways to overcome these challenges. The challenges are discussed in reference to a few key questions regarding SBA: Does SBA really simulate reality? Can SBA really measure what we want it to measure? Can examinees in SBA show their real ability? and Does SBA worth the huge investment? In the answers suggested, the keys to successful SBA are presented, with a focus on the unique multi-professional collaboration that is required for sound SBA: the collaboration between content experts, simulation experts, and measurement experts—psychometricians. Finally, the chapter describes the Israeli experience in SBA at MSR—the Israel Center for Medical Simulation—and highlights the authors’ insights from 10 years of experience in high-stakes SBA programs, such as the Israeli Board Examination in Anesthesiology, Paramedics Certification Exam, National Registration Exam for Nurse Specialists, and the “MOR” assessment center—selection of candidates to medical schools.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Boulet JR. Summative assessment in medicine: the promise of simulation for high-stakes evaluation. Acad Emerg Med. 2008;15:1017–124.

    Article  PubMed  Google Scholar 

  2. Gaba DM. Do as we say, not as you do: using simulation to investigate clinical behavior in action. Simul Healthc. 2009;4:67–9.

    Article  PubMed  Google Scholar 

  3. Scalese RJ, Issenberg SB. Simulation-based assessment. In: Holmboe ES, Hawkins RE, editors. A practical approach to the evaluation of clinical competence. Philadelphia: Mosby/Elsevier; 2008.

    Google Scholar 

  4. Holmboe E, Rizzolo MA, Sachdeva A, Rosenberg M, Ziv A. Simulation based assessment and the regulation of healthcare professionals. Simul Healthc. 2011;6:s58–62.

    Article  PubMed  Google Scholar 

  5. MSR Israel Center for Medical Simulation. Available at: http://www.msr.org.il/. Accessed Oct 2006.

  6. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28.

    Article  PubMed  Google Scholar 

  7. Medical Council of Canada. Medical Council of Canada qualifying Examination Part II (MCCQE Part II). 2008. Medical Council of Canada.

    Google Scholar 

  8. Whelan G. High–Stakes medical performance testing: the Clinical Skills Assessment Program. JAMA. 2000;283:1748.

    Article  CAS  PubMed  Google Scholar 

  9. Federation of State Medical Board, Inc. and National Board of Medical Examiners. United States Medical Licensing Examination: Step 2 clinical skills (cs) content description and general information. 2008. Federation of State Medical Board, Inc. and National Board of Medical Examiners.

    Google Scholar 

  10. American Board of Surgery. ABS to Require ACLS, ATLS and FLS for General Surgery Certification. Available at: http://home.absurgery.org/default.jsp?news_newreqs. Accessed 27 May 2011.

  11. Soper NJ, Fried GM. The fundamentals of laparoscopic surgery: its time has come. Bulletin of the American College of Surgeons. 2008. Available at: http://www.flsprogram.org/wp-content/uploads/2010/10/FLSprogramSoperFried.pdf. Accessed 7 Mar 2011.

  12. Petrusa ER. Clinical performance assessment. In: Norman GR, van der Vleuten CPM, Newble DI, editors. International Handbook of Research in Medical Education. Dordrecht: Kluwer Academic Publications; 2002.

    Google Scholar 

  13. Tombeson P, Fox RA, Dacre JA. Defining the content for the objective structured clinical examination component of the Professional and Linguistic Assessment Board examination: development of a blueprint. Med Educ. 2000;34:566–72.

    Article  Google Scholar 

  14. Boyd MA, Gerrow JD, Duquette P. Rethinking the OSCE as a tool for national competency evaluation. Eur J Dent Educ. 2004;8:95.

    Article  Google Scholar 

  15. Boulet JR, Smee SM, Dillon GF, Gimplr JR. The use of standardized patient assessments for certification and licensure decisions. Simul Healthc. 2009;4:35–42.

    Article  PubMed  Google Scholar 

  16. Ordre des Infirmieres et Infirmiers Quebec. Available at: http://www.oiiq.org/. Accessed 7 Mar 2011.

  17. College and Association of Registered Nurses of Alberta. Available at: http://www.nurses.ab.ca/carna/index.aspx?WebStructureID_3422. Accessed 7 Mar 2011.

  18. Ziv A, Rubin O, Moshinsky A, et al. MOR: a simulation-based assessment centre for evaluating the personal and interpersonal qualities of medical school candidates. Med Educ. 2008;42:991–8.

    Article  PubMed  Google Scholar 

  19. Harris S, Owen C. Discerning quality: using the multiple mini-interview in student selection for the Australian National University Medical School. Med Educ. 2007;41(3):234–41.

    Article  PubMed  Google Scholar 

  20. O’Brien A, Harvey J, Shannon M, Lewis K, Valencia O. A comparison of multiple mini-interviews and structured interviews in a UK setting. Med Teach. 2011;33(5):397–402.

    Article  PubMed  Google Scholar 

  21. Eva KW, Rosenfeld J, Reiter HI. Norman GR An admissions OSCE: the multiple mini-interview. Med Educ. 2004;38(3):314–26.

    Article  PubMed  Google Scholar 

  22. Issenberg SB, Scalese RJ. Simulation in health care education. Perspect Biol Med. 2008;51:31–46.

    Article  PubMed  Google Scholar 

  23. Boulet JR, van Zanten M, de Champlain A, Hawkins RE, Peitzman SJ. Checklist content on a standardized patient assessment: an ex post facto review. Adv Health Sci Educ. 2008;13:59–69.

    Article  Google Scholar 

  24. Baker DP, Salas E, King H, Battles J, Barach P. The role of teamwork in the professional education of physicians: current status and assessment recommendations. Jt Comm J Qual Patient Saf. 2005;31:185–202.

    PubMed  Google Scholar 

  25. van Zanten M, Boulet JR, McKinley DW, de Champlain A, Jobe AC. Assessing the communication and interpersonal skills of graduates of international medical schools as part of the United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills (CS) Exam. Acad Med. 2007;82(10 Suppl l):S65–8.

    Article  PubMed  Google Scholar 

  26. Weller JM, Bloch M, Young S, et al. Evaluation of high fidelity patient simulator in assessment of performance of anesthetists. Br J Anaesth. 2003;90:43–7.

    Article  CAS  PubMed  Google Scholar 

  27. Morgan PJ, Cleave-Hogg D, Guest CB. A comparison of global ratings and checklist scores from an undergraduate assessment using anesthesia simulator. Acad Med. 2001;76:1053–5.

    Article  CAS  PubMed  Google Scholar 

  28. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ. 2003;37:830–7.

    Article  PubMed  Google Scholar 

  29. Newble D. Techniques for measuring clinical competence: objective structured clinical examinations. Med Educ. 2004;38:199–203.

    Article  PubMed  Google Scholar 

  30. Berkenstadt H, Ziv A, Gafni N, Sidi A. The validation process of incorporating simulation-based accreditation into the anesthesiology Israeli national board exams. Isr Med Assoc J. 2006;8: 728–33.

    PubMed  Google Scholar 

  31. Murray DJ, Boulet JR, Avidan M, et al. Performance of residents and anesthesiologists in a simulation based skill assessment. Anesthesiology. 2007;107:705–13.

    Article  PubMed  Google Scholar 

  32. Girzadas Jr DV, Clay L, Caris J, Rzechula K, Harwood R. High fidelity simulation can discriminate between novice and experienced residents when assessing competency in patient care. Med Teach. 2007;29:452–6.

    Article  Google Scholar 

  33. Rosenthal R, Gantert WA, Hamel C, et al. Assessment of construct validity of a virtual reality laparoscopy simulator. J Laparoendosc Adv Surg Tech A. 2007;7:407–13.

    Article  Google Scholar 

  34. Tamblyn R, Abrahamowicz M, Dauphinee D, et al. Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. JAMA. 2007;298:993–1001.

    Article  CAS  PubMed  Google Scholar 

  35. Hatala R, Issenberg SB, Kassen B, Cole G, Bacchus CM, Scalese RJ. Assessing cardiac physical examination skills using simulation technology and real patients: a comparison study. Med Educ. 2008;42:628–36.

    Article  PubMed  Google Scholar 

  36. Ziv A, Erez D, Munz Y, Vardi A, Barsuk D, Levine I, et al. The Israel Center for Medical Simulation: a paradigm for cultural change in medical education. Acad Med. 2006;81(12):1091–7.

    Article  PubMed  Google Scholar 

  37. National Institute for Testing and Evaluation. Available at: http://www.nite.org.il/. Accessed Oct 2006.

  38. Berkenstadt H, Ziv A, Gafni N, Sidi A. Incorporating simulation-based objective structured clinical examination into the Israeli National Board Examination in Anesthesiology. Anesth Analg. 2006;102(3):853–8.

    Article  PubMed  Google Scholar 

  39. Ziv A, Rubin O, Sidi A, Berkenstadt H. Credentialing and certifying with simulation. Anesthesiol Clin. 2007;25(2):261–9.

    Article  PubMed  Google Scholar 

  40. Ben-Menachem E, Ezri T, Ziv A, Sidi A, Berkenstadt H. Identifying and managing technical faults in the anesthesia machine: lessons learned from the Israeli Board of Anesthesiologists. Anesth Analg. 2011;112(4):864–6. Epub 2011 Feb 2.

    Article  PubMed  Google Scholar 

  41. Gafni N, Moshinsky A, Eisenberg O, Zeigler D, Ziv A. Reliability estimates: behavioural stations and questionnaires in medical school admissions. Med Educ. 2012;46(3):277–88.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Medical Education, Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel

    Amitai Ziv MD, MHA

  2. Patient Safety and Risk Management, Israel Center for Medical Simulation (MSR), Chaim Sheba Medical Center, Tel Hashomer, 52621, Israel

    Amitai Ziv MD, MHA

  3. Department of Anesthesiology and Intensive Care, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, 69978, Israel

    Haim Berkenstadt MD

  4. Department of Anesthesiology, Sheba Medical Center, Ramat Gan, Israel

    Haim Berkenstadt MD

  5. MAROM—Assessment and Admissions Centers, National Institute for Testing and Evaluation, 26015, Jerusalem, 91260, Israel

    Orit Eisenberg PhD

  6. Assessment Unit, The Israel Center for Medical Simulation, Tel Hashomer, Israel

    Orit Eisenberg PhD

Authors
  1. Amitai Ziv MD, MHA
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haim Berkenstadt MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Orit Eisenberg PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amitai Ziv MD, MHA .

Editor information

Editors and Affiliations

  1. Departments of Anesthesiology Otolaryngology, and Structural & Chemical Biology, Icahn School of Medicine at Mount Sinai, New York, NY, USA

    Adam I. Levine MD

  2. Department of Anesthesiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA

    Samuel DeMaria Jr. MD , Andrew D. Schwartz MD  & Alan J. Sim MD ,  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Ziv, A., Berkenstadt, H., Eisenberg, O. (2013). Simulation for Licensure and Certification. In: Levine, A.I., DeMaria, S., Schwartz, A.D., Sim, A.J. (eds) The Comprehensive Textbook of Healthcare Simulation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-5993-4_12

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-5993-4_12

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-5992-7

  • Online ISBN: 978-1-4614-5993-4

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation