An Italian version of the Ottawa Crisis Resource Management Global Rating Scale: a reliable and valid tool for assessment of simulation performance
- 262 Downloads
Objective measurement of simulation performance requires a validated and reliable tool. However, no published Italian language assessment tool is available. Translation of a published English language tool, the Ottawa Crisis Resource Management Global Rating Scale (GRS), may lead to a validated and reliable tool. After developing an Italian language translation of the English language tool, the study measured the reliability of the new tool by comparison with the English language tool used independently in the same simulation scenarios. In addition, the validity of the Italian language tool was measured by comparison to a skills score also applied independently. The correlation coefficient between the Italian language overall GRS and the English language overall GRS was 0.82 (adjusted 95 % confidence interval: 0.62–0.92). The correlation coefficient between the Italian language overall GRS and the skill score was 0.85 (adjusted 95 % confidence interval 0.68–0.94). This study demonstrated that the Italian language GRS has acceptable reliability when compared with the English language tool, suggesting that it can be used reliably to evaluate the performance during simulated emergencies. The study also suggests that the tool has acceptable validity for assessing the simulation performance. The study suggests that the Italian language GRS translation has reasonable reliability when compared with the English language GRS and reasonable validity when compared with the assessment of the skills scores. Data suggest that the instrument is adequately reliable for informal and formative type of examinations, but may require further confirmation before use for high-stake examinations such as licensing.
KeywordsHigh-fidelity simulation Reliability Validity Assessment tool Emergency medicine
Compliance with ethical standards
Conflicts of interest
The authors declare that they have no conflict of interest.
Statement of human and animal rights
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institution an/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors.
Informed consent was obtained from all individual participants included in the study.
- 2.Gibbs G (1988) Learning by doing: a guide to teaching and learning methods. FEUGoogle Scholar
- 3.Grant J (1992) Training senior house officers by service-based learning. Joint centre for education in medicine, LondonGoogle Scholar
- 4.Kolb DA (2014) Experiential learning: experience as the source of learning and development. Pearson EducationGoogle Scholar
- 11.Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J (2006) A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, high-fidelity simulation, and crisis resource management I study. Crit Care Med 34:2167–2174CrossRefPubMedGoogle Scholar
- 13.Devore J (2011) Probability and statistics for engineering and the sciences. Thomson Brooks/Cole, USAGoogle Scholar
- 17.Franc JM (2016) Reveal project. http://www.medstatstudio.com/studies/project.php?pid=15. Accessed 18 Mar 2016
- 18.Montgomery DC (2009) Design and analysis of experiments. Wiley, USAGoogle Scholar
- 23.Brunckhorst O, Shahid S, Aydin A, Khan S, Mcllhenny C, Brewin J, Sahai A, Bello F, Kneebone R, Shamim Khan M, Dasgupta P, Ahmed K (2015) The relationship between technical and nontechnical skills within a simulation-based ureteroscopy training environment. J Surg Educ 72(5):1039–1044CrossRefPubMedGoogle Scholar