Abstract
In previous work, we have developed an advanced medical training system based on the cognitive ITS paradigm. In multiple laboratory studies, we showed a marked performance improvement among physicians in training. We now report on the evaluation of our tutoring system as a potential patient safety intervention among practicing community physicians. Fourteen community pathologists were matched for years of practice, and then randomly assigned to intervention or control groups. Participants in the intervention group used the tutoring system for a total of 4-19 (mean 11.5) hours over 1-4 (mean 3.1) sessions over a period of 37-138 (mean 86) days. Participants in the control group studied standard continuing medical education (CME) materials for a similar amount of time over a similar interval. All participants took glass slide pre-tests and post-tests, and virtual slide interval tests. Participants in the intervention group showed a significant improvement in the completeness of their surgical pathology reports when compared to the control group (p<.001, RM-ANOVA). There was no significant gain for diagnostic reasoning, likely due to the already high performance levels and small number of participants.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Lillehaug, S.I., Lajoie, S.P.: AI in medical education–another grand challenge for medical informatics. Artif. Intell. Med. 12(3), 197–225 (1998)
Lajoie, S.P., Lavigne, N.C., Guerrera, C., Munsie, S.: Constructing knowledge in the context of BioWorld. Instructional Science 29(2), 155–186 (2001)
Murray, T., Rath, K., Woolf, B.P., Marshall, D., Bruno, M., Dragon, T., Kohler, K.: Evaluating Inquiry Learning Through Recognition-Based Tasks. In: Proceedings of the 12th International Conference on AI and Education, Amsterdam (2005)
Evens, M., Brandle, S., Change, R., Freedman, R., Glass, M., Lee, Y., et al.: CIRSIM-Tutor: an intelligent tutoring system using natural language dialogue. In: Proceedings of the 12th Midwest AI and cognitive science conference (MAICS), pp. 16–23 (2001)
Eliot, C., Williams, K., Woolf, B.: An intelligent learning environment for advanced cardiac life support. In: AMIA Annu. Symp. Proc., pp. 7–11 (1996)
Romeroa, C., Venturaa, S., Gibajaa, E.L., Hervása, C., Romerob, F.: Web-based adaptive training simulator system for cardiac life support. Artif. Intell. Med. 38(1), 67–78 (2006)
Clancey, W.: Knowledge-based tutoring–the GUIDON program. MIT Press, Cambridge (1987)
Clancey, W., Letsinger, R.: NEOMYCIN: reconfiguring a rulebased expert system for application to teaching. In: Proceedings of the seventh international joint conference on AI, pp. 829–835 (1981)
Crowley, R.S., Medvedeva, O.: An intelligent tutoring system for visual classification problem solving. Artif. Intell. Med. 36(1), 85–117 (2006)
Crowley, R.S., Medvedeva, O., Jukic, D.: SlideTutor – A model-tracing Intelligent Tutoring System for teaching microscopic diagnosis. In: 11th AIED International Conference on Artificial Intelligence in Education, Sydney, Australia, pp. 157–164. ISO Press (2003)
Crowley, R.S., Tseytlin, E., Jukic, D.: ReportTutor – an intelligent tutoring system that uses a natural language interface. In: AMIA Annu. Symp. Proc., pp. 171–175 (2005)
Crowley, R.S., Legowski, E., Medvedeva, O.M., Tseytlin, E., Roh, E., Jukic, D.: Evaluation of an Intelligent Tutoring System in Pathology: Effects of External Representation on Performance Gains, Metacognition, and Acceptance. JAMIA 14(2), 182–190 (2007)
Saadawi, G.M., Tseytin, E., Legowski, E., Jukic, D., Castine, M., Crowley, R.S.: A natural language intelligent tutoring system for training pathologists: implementation and evaluation. Adv. in Health Sci. Educ. 13(5), 709–722 (2008)
Saadawi, G.M., Azevedo, A., Castine, M., Payne, V., Medvedeva, O., Tseytlin, E., Legowski, E., Jukic, D., Crowley, R.S.: Factors Affecting Feeling-of-knowing in a Medical Intelligent Tutoring System – the role of Immediate Feedback as a Metacognitive Scaffold. Adv. Health Sci. Educ. Theory Pract. 15(1), 9–30 (2010)
American Cancer Society. What are the key statistics about melanoma?, http://www.cancer.org/docroot/CRI/content/CRI_2_4_1X_What_are_the_key_statistics_for_melanoma_50.asp?sitearea (accessed: March 17, 2010)
Troxel, D.B.: An insurer’s perspective on error and loss in pathology. Arch. Pathol. Lab Med. 129, 1234–1236 (2005)
Ruby, S.G., Henson, D.E.: Practice protocols for surgical pathology: a communication from the Cancer Committee of the College of American Pathologists. Arch. Pathol. Lab Med. 118, 120–121 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Crowley, R. et al. (2010). Use of a Medical ITS Improves Reporting Performance among Community Pathologists. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6094. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13388-6_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-13388-6_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13387-9
Online ISBN: 978-3-642-13388-6
eBook Packages: Computer ScienceComputer Science (R0)