How Much Is Too Much? Imposed and Perceived Evaluative Demands Among Physician Educators
The number and frequency of physician-performed assessments of medical trainees is on the rise within medical academia. Because the consequences of implementing these higher assessment demands remain unknown, it is timely to establish a framework for monitoring the imposed and perceived evaluative responsibilities of physician educators. This study explored the imposed and perceived evaluative responsibilities among different populations of physician educators who complete clinical clerkship evaluations (CCEs) using the constructs “evaluative strain,” “evaluative assignment,” and “evaluative activity.” An evaluative strain instrument was administered in 2016 at Indiana University School of Medicine to physician educators who evaluate third-year medical trainees using CCEs. Evaluative assignment and evaluative activity were estimated using CCEs as a proxy for the assigned and completed volume of evaluations. Evaluative strain, assignment, and activity scores were reported globally and compared across medical departments. Evaluative strain was regressed on evaluative assignment and evaluative activity to determine the extent of their relationships. Physician educators had moderate evaluative strain scores (M = 45.4/100, SD = 19.4) with OBGYN physicians reporting significantly higher scores (p ≤ 0.015) than other departments. The “temporal demands” dimension of evaluative strain was perceived to be the most influential aspect of the evaluative process. Neither evaluative assignment nor evaluative activity was related to evaluative strain (p ≥ 0.61). This research demonstrated evidence of moderate evaluative strain levels among participating physicians. The utility of this study may hold promise as a framework for future research aimed at monitoring changes in the evaluative demands placed on physician educators.
KeywordsMedical student assessment Performance-based assessments Clinical clerkship evaluations Evaluation fatigue Survey fatigue
The authors wish to thank the physicians from IUSM for participating in the study, the medical school leadership for their recruitment efforts, and Joel Smith from the IUSM Office of Medical Student Education for his generous assistance with data collection.
Compliance with Ethical Standards
The authors declare that there is no conflict of interest.
This study was granted exemption status by the local Institutional Review Board at Indiana University School of Medicine (Protocol No. 1604657202) on June 9, 2016.
- 9.American Board of Surgery. Training and certification: resident performance assessments. 2015. http://www.absurgery.org/default.jsp?certgsqe_resassess. [Accessed January 3, 2016.]
- 14.Katowa-Mukwato P, Andrews B, Maimbolwa M, Lakhi S, Michelo C, Mulla Y, et al. Medical students’ clerkship experiences and self-perceived competence in clinical skills. Afr J Health Prof Educ. 2014;6(2):155–60.Google Scholar
- 21.Oaks WW, Scheinok PA, Husted FL. Objective evaluation of a method of assessing student performance in a clinical clerkship. J Med Educ. 1969;44(3):207–13.Google Scholar
- 33.MedHub. Medical education solutions. 2016. http://www.evaluehealthcare.com/who-we-serve/undergraduate-medical-education. [Accessed Februray 24, 2016.]
- 42.Murphy KR, Myors B, Wolach, A. Statistical power analysis: a simple and general model for traditional and modern hypothesis tests. 3rd ed. New York: Routledge; 2009.Google Scholar
- 49.Apodaca R, Lea S, Edwards B. The effect of longitudinal burden on survey participation. Presented at the Annual Conference of the American Association of Public Opinion Research, 1998, St. Louis, MO.Google Scholar
- 51.Asiu BW, Antons CM, Fultz ML. Undergraduate perceptions of survey participation: improving response rates and validity. Presented at the Annual Meeting of the Association of Institutional Research, 1998, Minneapolis, MN.Google Scholar
- 54.Nutter D, Whitcomb M. The AAMC project on the clinical education of medical students. Washington, DC: Association of American Colleges; 2001.Google Scholar