Advertisement

Implementing and Managing a Mastery Learning Program

  • Elaine R. CohenEmail author
  • Kenzie A. Cameron
  • Jeffrey H. Barsuk
  • Diane B. Wayne
Chapter
  • 30 Downloads
Part of the Comprehensive Healthcare Simulation book series (CHS)

Abstract

A rigorous education intervention cannot succeed without well-planned implementation and careful ongoing management. Specific steps needed to achieve education and translational science goals include (a) planning for mastery learning, (b) pilot testing, (c) implementation, and (d) continuous management. Successful mastery learning programs rely on numerous resources. Planning for implementation includes obtaining resources such as space, time, supplies, equipment, and faculty. Pilot testing ensures that scenarios and assessment tools are refined and accurate. Implementation requires highly engaged faculty and learners who complete rigorous deliberate practice with individualized performance feedback. During outcome assessment, predetermined outcome measures are evaluated. Finally, ongoing management is necessary for mastery learning programs that may undergo periodic revision based on feedback and reaching education and clinical outcomes. When planning for dissemination, understanding culture, setting, and the downstream collateral impact of a mastery learning program is critical.

This chapter discusses the execution and management of mastery learning programs. We highlight specific examples that illustrate barriers and facilitators including faculty time, materials, scheduling logistics, data collection, and follow-up.

Keywords

Implementation Mastery learning Pilot testing Study management 

References

  1. 1.
    Cohen ER, Feinglass J, Barsuk JH, et al. Cost savings from reduced catheter-related bloodstream infection after simulation-based education for residents in a medical intensive care unit. Simul Healthc. 2010;5(2):98–102.CrossRefGoogle Scholar
  2. 2.
    Thompson LL. Making the team: a guide for managers. 6th ed. New York: Pearson Education; 2016.Google Scholar
  3. 3.
    Salas E, Rosen MA, Burke CS, et al. The making of a dream team: when expert teams do best. In: Ericsson KA, Charness N, Feltovich PJ, Hoffman RR, editors. The Cambridge handbook of expertise and expert performance. New York: Cambridge University Press; 2006.Google Scholar
  4. 4.
    McGaghie WC, Pugh CM, Wayne DB. Fundamentals of educational research using clinical simulation. In: Kyle RR, Murray WB, editors. Clinical simulation: operations, engineering, and management. Burlington: Academic Press; 2008.Google Scholar
  5. 5.
    Stagl KC, Salas E, Burke CS. Best practices in team leadership: what team leaders do to facilitate team effectiveness. In: Conger J, Riggio R, editors. The practice of leadership: developing the next generation of leaders. San Francisco: Jossey-Bass; 2007.Google Scholar
  6. 6.
    Wayne DB, Didwania A, Feinglass J, Fudala MJ, Barsuk JH, McGaghie WC. Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. Chest. 2008;133(1):56–61.CrossRefGoogle Scholar
  7. 7.
    Barsuk JH, Cohen ER, Vozenilek JA, O’Connor L, McGaghie WC, Wayne DB. Simulation-based education with mastery learning improves paracentesis skills. J Grad Med Educ. 2012;4(1):23–7.Google Scholar
  8. 8.
    Salzman DH, McGaghie WC, Caprio TW, et al. A mastery learning capstone course to teach and assess components of three entrustable professional activities to graduating medical students. Teach Learn Med. 2019;31(2):186–94.CrossRefGoogle Scholar
  9. 9.
    Schroedl CJ, Corbridge TC, Cohen ER, Fakhran SS, Schimmel D, McGaghie WC, Wayne DB. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):219.e7–219.e13.CrossRefGoogle Scholar
  10. 10.
    Barsuk JH, McGaghie WC, Cohen ER, Balachandran JS, Wayne DB. Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. J Hosp Med. 2009;4(7):397–403.CrossRefGoogle Scholar
  11. 11.
    Barsuk JH, McGaghie WC, Cohen ER, O’Leary KJ, Wayne DB. Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit. Crit Care Med. 2009;37(10):2697–701.PubMedGoogle Scholar
  12. 12.
    Cohen ER, Barsuk JH, Moazed F, Caprio C, Didwania A, McGaghie WC, Wayne DB. Making July safer: simulation-based mastery learning during intern bootcamp. Acad Med. 2013;88(2):233–9.CrossRefGoogle Scholar
  13. 13.
    Butter J, McGaghie WC, Cohen ER, Kaye M, Wayne DB. Simulation-based mastery learning improves cardiac auscultation skills in medical students. J Gen Intern Med. 2010;25(8):780–5.Google Scholar
  14. 14.
    Barsuk JH, Cohen ER, Simuni T, Caprio T, McGaghie WC, Wayne DB. Simulation-based education with mastery learning improves residents’ lumbar puncture skills. Neurology. 2012;79(2):132–7.Google Scholar
  15. 15.
    Szmuilowicz E, Neeley KJ, Sharma RK, Cohen ER, McGaghie WC, Wayne DB. Improving residents’ code status discussion skills: a randomized trial. J Palliat Med. 2012;15(7):768–74.Google Scholar
  16. 16.
    Gossett DR, Gilchrist-Scott D, Wayne DB, Gerber SE. Simulation training for forceps-assisted vaginal delivery and rates of maternal perineal trauma. Obstet Gynecol. 2016;128(3):429–35.CrossRefGoogle Scholar
  17. 17.
    Wayne DB, Butter J, Siddall VJ, et al. Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice. J Gen Intern Med. 2006;21(3):251–6.CrossRefGoogle Scholar
  18. 18.
    Barsuk JH, Cohen ER, Wayne DB, Siddall VJ, McGaghie WC. Developing a simulation-based mastery learning curriculum: lessons learned from 11 years of advanced cardiac life support. Simul Healthc. 2016;11(1):52–9.CrossRefGoogle Scholar
  19. 19.
    Schwab B, Teitelbaum EN, Barsuk JH, Soper NJ, Hungness ES. Single-stage laparoscopic management of choledocholithiasis: an analysis after implementation of a mastery learning resident curriculum. Surgery. 2018;163(3):503–8.CrossRefGoogle Scholar
  20. 20.
    Barsuk JH, Cohen ER, Feinglass J, et al. Cost savings of performing paracentesis procedures at the bedside after simulation-based education. Simul Healthc. 2014;9(5):312–8.CrossRefGoogle Scholar
  21. 21.
    Downing SM, Tekian A, Yudkowsky R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med. 2006;18(1):50–7.CrossRefGoogle Scholar
  22. 22.
    Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377–84.PubMedPubMedCentralGoogle Scholar
  23. 23.
    Vermylen JH, Wood GJ, Cohen ER, Barsuk JH, McGaghie WC, Wayne DB. Development of a simulation-based mastery learning curriculum for breaking bad news. J Pain Symptom Manag. 2019;57(3):682–7.CrossRefGoogle Scholar
  24. 24.
    Barsuk JH, Cohen ER, Wayne DB, McGaghie WC, Yudkowsky R. A comparison of approaches for mastery learning standard setting. Acad Med. 2018;93(7):1079–84.CrossRefGoogle Scholar
  25. 25.
    Wayne DB, Butter J, Cohen ER, McGaghie WC. Setting defensible standards for cardiac auscultation skills in medical students. Acad Med. 2009;84(10 Suppl):S94–6.CrossRefGoogle Scholar
  26. 26.
    Miami Group. UMedic user manual. Miami: Gordon Center for Research in Medical Education, University of Miami Miller School of Medicine; 2008.Google Scholar
  27. 27.
    Downing SM, Haladyna TM. Handbook of test development. Mahwah: L. Erlbaum; 2006.Google Scholar
  28. 28.
    Stufflebeam DL. The checklists development checklist. 2000. Available at: https://wmich.edu/sites/default/files/attachments/u350/2014/guidelines_cdc.pdf. Accessed 10 Dec 2018.
  29. 29.
    Adler MD, Vozenilek JA, Trainor JK, et al. Comparison of checklist and anchored global rating instruments for performance rating of simulated pediatric emergencies. Simul Healthc. 2011;6(1):18–24.Google Scholar
  30. 30.
    Dunning D, Heath C, Suls JM. Flawed self-assessment: implications for health, education, and the workplace. Psychol Sci Public Interest. 2004;5(3):69–106.CrossRefGoogle Scholar
  31. 31.
    Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094–102.CrossRefGoogle Scholar
  32. 32.
    Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Unexpected collateral effects of simulation-based medical education. Acad Med. 2011;86(12):1513–7.CrossRefGoogle Scholar
  33. 33.
    Cohen ER, Barsuk JH, McGaghie WC, Wayne DB. Raising the bar: reassessing standards for procedural competence. Teach Learn Med. 2013;25(1):6–9.CrossRefGoogle Scholar
  34. 34.
    International Liaison Committee on Resuscitation and Emergency Cardiovascular Care Science with Treatment Recommendations. Circulation. 2005;112(Suppl III):III-1-136. [Context Link].Google Scholar
  35. 35.
    Proceedings of the 2005 international consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Resuscitation. 2005;67:157–341.Google Scholar
  36. 36.
    Wayne DB, Nitzberg M, Reddy S, et al. Advanced cardiac life support checklists for simulation-based education. MedEdPORTAL. 2014. Available at: https://www.mededportal.org/publication/9697/. Accessed 10 Dec 2018.
  37. 37.
    Robbins S. Organizational behavior. 10th ed. Upper Saddle River: Prentice Hall; 2003.Google Scholar
  38. 38.
    Kotter JP. Leading change. Boston: Harvard Business Review Press; 2012.Google Scholar
  39. 39.
    Rogers EM. Diffusion of innovations. New York: Free Press of Glencoe; 1962.Google Scholar
  40. 40.
    Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRefGoogle Scholar
  41. 41.
    Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43.CrossRefGoogle Scholar
  42. 42.
    Glasgow RE. The REAIM model. In: Glanz K, Lewis FM, Rimer BK, editors. Health behavior and health education. San Francisco: John Wiley & Sons; 2002.Google Scholar
  43. 43.
    Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7:149–58.CrossRefGoogle Scholar
  44. 44.
    Cameron KA, Cohen ER, Hertz JR, Wayne DB, Mitra D, Barsuk JH. Barriers and facilitators to central venous catheter insertion: a qualitative study. J Patient Saf. 2018. [Epub ahead of print].Google Scholar
  45. 45.
    Cohen ER, Barsuk JH, Hertz JR, et al. Healthcare providers’ awareness and understanding of competency requirements for central venous catheter insertion. AMEE MedEDPublish. 2018. Available at:  https://doi.org/10.15694/mep.2018.0000012.1.
  46. 46.
    Barsuk JH, Cohen ER, Potts S, et al. Dissemination of a simulation-based mastery learning intervention reduces central line-associated bloodstream infections. BMJ Qual Saf. 2014;23(9):749–56.Google Scholar
  47. 47.
    Dearing JW. Applying diffusion of innovation theory to intervention development. Res Soc Work Pract. 2009;19(5):503–18.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Elaine R. Cohen
    • 1
    Email author
  • Kenzie A. Cameron
    • 2
  • Jeffrey H. Barsuk
    • 3
  • Diane B. Wayne
    • 3
  1. 1.Northwestern University Feinberg School of Medicine, Department of MedicineChicagoUSA
  2. 2.Northwestern University Feinberg School of Medicine, Departments of Medicine, Medical Education, Medical Social Sciences, and Preventive MedicineChicagoUSA
  3. 3.Northwestern University Feinberg School of Medicine, Departments of Medicine and Medical EducationChicagoUSA

Personalised recommendations