Advertisement

Measuring Medical Competence and Entrusting Professional Activities in an Assessment Simulating the First Day of Residency

  • S. PredigerEmail author
  • P. O. Berberat
  • M. Kadmon
  • S. Harendza
Chapter

Abstract

Medical students are supposed to achieve a certain level of entrustment in different professional activities including relevant core and medical competences at the end of their undergraduate studies. To measure relevant facets of competence (FOC) and to evaluate entrusted professional activities (EPA), an assessment, which simulated a first day of residency in a hospital, was carried out twice. In total, 119 students participated once and 11 students participated twice. Linear regression models showed an influence of FOC rating in “Verbal communication with colleagues and supervisors” and “Structure, work planning and priorities” on EPA ratings. Students who participated twice showed significant improvements in these two FOCs and in two EPAs related to these FOCs. The FOC “Responsibility” and the personality characteristics “Extraversion” and “Conscientiousness” positively influenced more difficult entrustment decisions, while “Agreeableness” had a negative influence on their entrustment level. Our assessment format including the FOC and EPA instruments shows good validity and provides important aspects of competence and professionalism, which should be included in teaching and feedback during the final year of undergraduate medical education.

Keywords

Assessment competences competence-based assessment entrustable professional activities (EPA) NEO – Five-Factor Inventory (NEO-FFI) personality characteristics professionalism simulation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barton, J. R., Corbett, S., & an der Vleuten, C: P. (2012). The validity and reliability of a direct observation of procedural skills assessment tool: Assessing colonoscopic skills of senior endoscopists. Gastrointestinal Endosccopy 75, pp. 591–597.Google Scholar
  2. Costa, P. T., & McCrae, R. R. (2008). The Revised Neo Personality Inventory (NEO-PI-R). The SAGE Handbook of Personality Theory and Assessment 2, pp. 179–198.Google Scholar
  3. Ferguson, E., James, D., O’Hehir, F., Sanders, A., & McManus, I. C. (2003). Pilot study of the roles of personality, references, and personal statements in relation to performance over the five years of a medical degree. BMJ 326(7386), pp. 429–432.Google Scholar
  4. Fincke, F., Prediger, S., Schick, K., Fürstenberg, S., Spychala, N., Berberat, P. O., Harendza, S., & Kadmon, M. (in preparation). Entrustable professional activities and facets of competence in a simulated workplace-based assessment for advanced medical students. Medical Teacher.Google Scholar
  5. Fischer, M. R., Bauer, D., & Mohn, K. (2015). Finally finished! National competence based catalogues of learning objectives for undergraduate medical education (NKLM) and dental education (NKLZ) ready for trial. GMS Zeitschirft für Medizinische Ausbildung 32, Doc35.Google Scholar
  6. Frank, J. R., & Danoff, D. (2007).The CanMEDS initiative: implementing an outcomebased framework of physician competencies. Medical Teacher 29, pp. 642–647.Google Scholar
  7. Fürstenberg, S., Prediger, S., Kadmon, M., Berberat, P. O., & Harendza, S. (2018). Perceived strain of undergraduate medical sutdents during a simulated first day of residency. BMC Medical Education 18(1), pp. 322.Google Scholar
  8. Fürstenberg, S., Schick, K., Deppermann, J., Prediger, S., Berberat, P. O., Kadmon, M., & Harendza, S. (2017). Competencies for first year residents. physicians’ views from medical schools with different undergraduate curricula. BMC Medical Education 17(1), pp. 154.Google Scholar
  9. Groener, J. B., Bugaj, T. J., Scarpone, R., Koechel, A., Stiepak, J., Branchereau, S., Krautter, M., Herzog, W., & Nikendei, C. (2015). Video-based on-ward supervision for final year medical students. BMC Medical Education 15, pp. 163.Google Scholar
  10. Guilbert, J. J. (2002). The ambiguous and bewitching power of knowledge, skills and attitudes leads to confusing statements of learning objectives. Education for Health 15(3), pp. 362–369.CrossRefGoogle Scholar
  11. Harendza, S., Berberat, P. O., & Kadmon, M. (2017). Assessing competences in medical students with a newly designed 360-degree examination of a simulated first day of residency: a feasibility study. Journal of Community Medicine and Health Education 7, pp. 4.Google Scholar
  12. Hojat, M., Callahan, C. A., & Gonnella, J. S. (2004). Students’ personality and ratings of clinical competence in medical school clerkships: a longitudinal study. Psychology, Health & Medicine 9(2), pp. 247–252.Google Scholar
  13. Holmboe, E. S., Sherbino, J., Long, D. M., Swing, S. R., & Frank, J. R. (2010). The role of assessment in competency-based medical education. Medical Teacher 32(8), pp. 676–682.Google Scholar
  14. Khan, K. Z., Gaunt, K., Ramachandran, S., & Pushkar, P. (2013). The objective structured clinical examination (OSCE): AMEE guide no. 81. Part II: organisation & administration. Medical Teacher 35(9), pp. 1447–1463.Google Scholar
  15. Lievens, P., Ones, D. S., & Dilchert, S. (2009). Personality scale validities increase throughout medical school. Journal of Applied Psychology 94(6), pp. 1514–1535.Google Scholar
  16. Mann, K. V., Ruedy, J., Millar, N., & Andreou, P. (2005). Achievement of non-cognitive goals of undergraduate medical education: perceptions of medical students, residents, faculty and other health professionals. Medical Education 39(1), pp. 40–48.Google Scholar
  17. McLachlan, J. C., Finn, G., & Macnaughton, J. (2009). The conscientiousness index: a novel tool to explore students’ professionalism. Academic Medicine 84(5), pp. 559–565.Google Scholar
  18. McCrae, R. R., & Costa, P. T. (1994). The stability of personality: Observation and evaluations. Current Directions in Psychological Science 3, pp. 173–175.Google Scholar
  19. Meyer, E. G., Chen, H. C., Uijtdehaage, S, Durning, S. J, & Maggio, L. A. (2019). Scoping Review of Entrustable Professional Activities in Undergraduate Medical Eduction. Academic Medicine 94(7), pp. 1040–1049.Google Scholar
  20. Mulder, H., Ten Cate, O., Daalder, R., & Berkvens, J. (2010). Building a competency-based workplace curriculum around entrustable professional activities: The case of physician assistant training. Medical Teacher 32(10), pp. 453–459.Google Scholar
  21. Norcini, J. J., Blank, L. L., Arnold, G. K., & Kimball, H. R. (1995). The mini-CEX (clinical evaluation exercise): A preliminary investigation. Annal of Internal Medicine 123, pp. 795–799.Google Scholar
  22. O’Tuathaigh, C. M. P., Nadhirah Idris, A., Duggan, E., Costa, P., & Costa, M. J. (2019). Medical students’ empathy and attitudes towards professionalism: Relationship with personality, specialty preference and medical programme. PLoS One 14(5), pp. 215–675.Google Scholar
  23. Prediger, S., Schick, K., Fincke, F., Fürstenberg, S., Oubaid, V., Kadmon, M., Berberat, P. O., & Harendza, S. (under review). Validation of a competence-based assessment of medical students’ performance in the physician’s role. BMC Medical Education.Google Scholar
  24. Prediger, S., Fürstenberg, S., Berberat, P. O., Kadmon, M., & Harendza, S. (2019). Interprofessional assessment of medical students’ competences with an instrument suitable for physicians and nurses. BMC Medical Education 19(1), p. 46.Google Scholar
  25. Raupach, T., Vogel, D., Schiekirka, S., Keijsers, C., Ten Cate, O., & Harendza, S. (2013). Increase in medical knowledge during the final year of undergraduate medical education in Germany. GMS Zeitschrift für Medizinische Ausbildung 30(3), Doc33.Google Scholar
  26. Roberts B. W., & Mroczek, D. (2008). Personality Trait Change in Adulthood. Current Directions in Psychological Science 17(1), pp. 31–35.Google Scholar
  27. Schreckenbach, T., Ochsendorf, F., Sterz, J., Rüsseler, M., Bechstein, W. O., Bender, B., & Bechtoldt, M. N. (2018). Emotion recognition and extraversion of medical students interact to predict their empathic communication perceived by simulated patients. BMC Medical Education 18(1), p. 237.Google Scholar
  28. Ten Cate, O. (2005). Entrustability of professional activities and competency-based training. Medical Education 39(12), pp. 1176–1177.CrossRefGoogle Scholar
  29. Ten Cate, O., Chen, H. C., Hoff, R. G., Peters, H., Bok, H., & van der Schaaf, M. (2015). Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Medical Teacher 37(11), pp. 983–1002.Google Scholar
  30. Ten Cate, T. J. O., Snell, L., & Carraccio, C. (2010). Medical competence: the interplay between individual ability and the health care environment. Medical Teacher 32(8), pp. 669–675.Google Scholar
  31. Tyssen, R., Dolatowski, F. C., Røvik, J. O., Thorkildsen, R. F., Ekeberg, O., Hem, E., Gude, T., Gronvold, N. T., & Vaglum, P. (2007). Personality traits and types predict medical school stress: a 6-year longitudinal and nationwide study. Medical Education 41(8), pp. 781–787.Google Scholar
  32. Walldorf, J., & Fischer, M. R. (2018). Risk factors for a delay in medical education: Results of an online survey among four German medical schools. Medical Teacher 40(1), pp. 86–90.Google Scholar
  33. Wijnen-Meijer, M., van der Schaaf, M., Nillesen, K., Harendza, S., & Ten Cate, O. (2013a). Essential facets of competence that enable trust in medical graduates: a ranking study among physician educators in two countries. Perspectives on Medical Education 2(5–6), pp. 290–297.Google Scholar
  34. Wijnen-Meijer, M., Van der Schaaf, M., Booij, E., Harendza, S., Boscardin, C., Van Wijngaarden, J., & Ten Cate, T. J. (2013b). An argument-based approach to the validation of UHTRUST: Can we measure how recent graduates can be trusted with unfamiliar tasks? Advances in Health Science Education. Theory and Practice 18, pp. 1009–1027.Google Scholar
  35. Zundel, S., Blumenstock, G., Zipfel, S., Herrmann-Werner, A., & Holderried, F. (2015). Portfolios enhance clinical activity in surgical clerks. Journal of Surgical Education 72(5), pp. 927–935.Google Scholar

Copyright information

© Springer Fachmedien Wiesbaden GmbH, part of Springer Nature 2020

Authors and Affiliations

  • S. Prediger
    • 1
    Email author
  • P. O. Berberat
    • 2
  • M. Kadmon
    • 3
  • S. Harendza
    • 1
  1. 1.Universitätsklinikum Hamburg-EppendorfHamburgGermany
  2. 2.Technische Universität MünchenMünchenGermany
  3. 3.Universität AugsburgAugsburgGermany

Personalised recommendations