Abstract
An educator’s assumptions regarding the nature of learning and their approaches to teaching are inseparable from assumptions about assessment. Assessment is the measurement of learning, and demands quantification and well-informed decisions for course progression, however assessment in practice typically reveals a competence-based approach. Such an approach assumes that if a minimum standard is met, competence is retained over the course of a career. In this chapter, the complexities of assessment validity theories are presented, with reference to the nuances of assessor expertise and assumptions around forming subjective and objective judgements. The simulated ambulance assessment then undergoes its own critique, to prompt reconsideration of this as a major, high-stakes assessment procedure.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Cronbach’s frustration in this 2001 text is clear, and well worth a glance if nothing else than to warn researchers of the foibles in reporting measures and statistics which are not understood.
References
Hammond, E., et al. (2012). An exploratory study to examine the phenomenon and practice of ambulance ramping at hospitals within the Queensland Health Southern Districts and the Queensland Ambulance Service. 2012: Queensland Health and Griffith University.
MacLennan, L. (2018). Call for action after ambulances wait up to seven hours outside Adelaide hospital. [Online news article] 2018 28 Sept 2018 [cited 2018 28 Nov]; https://www.abc.net.au/news/2018-09-28/crisis-talks-after-ambulance-waits-seven-hours-adelaide-hospital/10317964.
Schuwirth, L., & Ash, J. (2013). Principles of assessment. In K. Walsh (Ed.), Oxford Textbook of Medical Education. Oxford University Press.
Berg, D., et al. (2013). The development of a validated checklist for thoracentesis: Preliminary results. American Journal of Medical Quality, 28(3), 220–226.
Berg, K., et al. (2013). The development of a validated checklist for adult lumbar puncture preliminary results. American Journal of Medical Quality, 28(4), 330–334.
Berg, K., et al. (2014). The development of a validated checklist for radial arterial line placement: Preliminary results. American Journal of Medical Quality, 29(3), 242–246.
Hartman, N., et al. (2014). Delphi method validation of a procedural performance checklist for insertion of an ultrasound-guided internal jugular central line. American Journal of Medical Quality, 31(1), 81–85.
Riesenberg, L. A., et al. (2013). The development of a validated checklist for femoral venous catheterization preliminary results. American Journal of Medical Quality, 29(5), 445–450.
Riesenberg, L. A., et al. (2013). The development of a validated checklist for paracentesis: Preliminary results. American Journal of Medical Quality, 28(3), 227–231.
Riesenberg, L. A., et al. (2013). The development of a validated checklist for nasogastric tube insertion preliminary results. American Journal of Medical Quality, 28(5), 429–433.
Riesenberg, L. A., et al. (2013). The development of a validated checklist for nasogastric tube insertion: Preliminary results. American Journal of Medical Quality, 28(5), 429–433.
Seymour-Walsh, A. (2018). The development and critique of validated assessment tools for pre-hospital resuscitation skills. International Journal of Emergency Services.
Gingerich, A., et al. (2014). Seeing the ‘black box’differently: Assessor cognition from three research perspectives. Medical Education, 48(11), 1055–1068.
Keeney, S., Hasson, F., & McKenna, H. (2011). The Delphi technique. In The Delphi Technique in Nursing and Health Research (pp. 1–17). Blackwell Publishing: West Sussex, UK.
Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418.
Cook, D. A., et al. (2014). What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Advances in Health Sciences Education, 19(2), 233–250.
Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.) Educational Measurement. Praeger Pub Text.
Guion, R. (1977). Content validity-3 years of talk-whats action. Public Personnel Management, 6(6), 407–414.
Schuwirth, L., & van der Vleuten, C. (2012). Programmatic assessment and Kane’s validity perspective. Medical Education, 46(1), 38–48.
Van der Vleuten, C. (2000). Validity of final examinations in undergraduate medical training. BMJ: British Medical Journal, 321(7270), 1217.
Govaerts, M., et al. (2007). Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Advances in Health Sciences Education, 12(2), 239–260.
Vnuk, A. K. (2013). Going through the motions: Medical students’ experiences of learning physical examinations. In School of Education (p. 127). Flinders University: Adelaide.
Downing, S. M., Tekian, A., & Yudkowsky, R. (2006). Research methodology: procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teaching and Learning in Medicine, 18(1), 50–57.
Hays, R. (2015). Standard setting. The Clinical Teacher, 12(4), 226–230.
Norcini, J. J. (2003). Setting standards on educational tests. Medical Education, 37(5), 464–469.
Boursicot, K. A., Roberts, T. E., & Pell, G. (2007). Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools. Medical Education, 41(11), 1024–1031.
George, S., Haque, M. S., & Oyebode, F. (2006). Standard setting: comparison of two methods. BMC Medical Education, 6(1), 46.
Schuwirth, L., & Van der Vleuten, C. (2011). Programmatic assessment: From assessment of learning to assessment for learning. Medical Teacher, 33(6), 478–485.
Miller, G. E. (1990). The assessment of clinical skills/competence/performance. Academic Medicine, 65(9), S63–s67.
Driessen, E. W., et al. (2012). The use of programmatic assessment in the clinical workplace: A Maastricht case report. Medical Teacher, 34(3), 226–231.
Van der Vleuten, C., et al. (2012). A model for programmatic assessment fit for purpose. Medical Teacher, 34(3), 205–214.
Quilici, A. P., et al. (2005). Is the Advanced Trauma Life Support simulation exam more stressful for the surgeon than emergency department trauma care? Clinics (Sao Paulo, Brazil), 60(4), 287–292.
Koltko-Rivera, M. E. (2006). Rediscovering the later version of Maslow’s hierarchy of needs: Self-transcendence and opportunities for theory, research, and unification. Review of general psychology, 10(4), 302.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Seymour-Walsh, A. (2019). Assessment. In: Foundations for Paramedic Education. SpringerBriefs in Education. Springer, Cham. https://doi.org/10.1007/978-3-030-26792-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-26792-6_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-26791-9
Online ISBN: 978-3-030-26792-6
eBook Packages: EducationEducation (R0)