Abstract
This research combines knowledge from Computer Science and Health Science in order to propose an evaluation methodology for Automatic Transcription System of Radiology Reports. This methodology was designed based on Voice User interface requirements and specific requirements of automatic transcription systems of Radiology report. The same methodology was previously validated through some inspections and usability tests outside the hospital environment and, afterwards, it was used in two hospitals in São Paulo city. This approach aims to reduce costs of testing and available time by radiologists interviewed. Thus, the final product in this work consists of a set of criteria for evaluation of usability, comprising the name of the metric, evaluating method, steps to be followed and material to be used. By the use of this set, the evaluators can process the results of each requirement from the software.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allen, J., Perrault, C.: Analysing intention in utterances. Artificial Intelligence 15, 143–178 (1980)
Kamm, C., Walker, M., Rabiner, L.: The role of speech processing in human computer intelligent communication. Speech Communication 23, 263–278 (1997)
Price, P.: Evaluation of spoken language systems: the ATIS domain. In: Proceedings of the Third DARPA Speech and Natural Language Workshop. Morgan Kaufmann, San Francisco (1990)
Walker, M.A., Litman, D., Kamm, C., Abella, A.: Evaluating spoken dialogue agents with PARADISE: Two case studies. Computer Speech and Language 12(3), 317–347 (1998)
Gibbon, D., Moore, R., Winski, R. (eds.): Hand-book of Standards and Resources for Spoken Language Systems. Mouton de Gruyter, New York (1997)
Dybkjaer, L., Bernsen, N.O., Dybkjaer, H.: Generality and objectivity: central issues in putting a dialogue evaluation tool into practical use. In: Hirschberg, J., Kamm, C., Walker, M. (eds.) Interactive Spoken Dialog Systems. Proceedings of a Workshop Sponsored by the Association for Computational Linguistics, Madrid, Spain, pp. 17–24. ACL (1997)
Nielsen, J.: Usability Engineering. Academic Press, Cambridge (1993)
Sommerville, I.: Software Engineering, 6th edn. Addison Wesley, New York (2001)
Kanal, K.M., Hangiandreou, N.J., Sykes, A.M.G., Eklund, H.E., Araoz, P.A., Leon, J.A., Erickson, B.J.: Initial Evaluation of a Continuous Speech Recognition Program for Radiology. Journal of Digital Imaging 14(1), 30–37 (2001)
Kimberly, D.V.: A Methodology of Error Detection Improving Speech Recognition. Simon Fraser University Library, Canada (2006)
Voll, K., Atkins, S., Forster, B.: Improving the Utility of Speech Recognition Through Error Detection. Journal of Digital Imaging 21(4), 371–377 (2008)
Paulett, J.M., Langlotz, C.P.: Improving language models for radiology speech recognition. Journal of Biomedical Informatics 42, 53–58 (2009)
White, K.S.: Speech recognition implementation in radiology. Springer, Heidelberg (2005)
Bhan, S.N., Coblentz, C., Norman, G.R., Ali, A.H.: Effect of Voice Recognition on Radiologist Reporting Time. CARJ 59(4) (October 2008)
Durling, S., Lumsden, J.: Speech Recognition Use in Healthcare Applications. In: Proceedings of MoMM 2008, MoCoHe. ACM, New York (2008) 978-1-60558-269-6/08/0011
Diah, N.M., Ismaili, M., Ahmad, S., Dahari, M.K.M.: Usability testing for educational computer game using observation method. In: CAMP 2010, The First International Conference on Information Retrieval and Knowledge Management, Shah Alam, Malaysia (2010)
Mitchell, P.P.: A step-by-step guide to usability testing. iUniverse, Lincoln, NE (2007)
Möller, S.: A new taxonomy for the quality of telephone services based on spoken dialogue systems. In: Proc. 3rd SIGdial Worksh. on Discourse and Dialogue, US, Philadelphia, pp. 142–153 (2002)
Salvador, V.F.M., Oliveira Neto, J.S., Kawamoto A.L.: Requirement Engineering Contributions to Voice User Interface. In: First International Conference on Advances in Computer-Human Interaction, Sainte Luce, pp. 309–314 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Martins, V.F., de Assis Moura, L. (2011). An Evaluation Methodology for Automatic Transcription System of Radiology Reports. In: Cruz-Cunha, M.M., Varajão, J., Powell, P., Martinho, R. (eds) ENTERprise Information Systems. CENTERIS 2011. Communications in Computer and Information Science, vol 221. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24352-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-24352-3_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24351-6
Online ISBN: 978-3-642-24352-3
eBook Packages: Computer ScienceComputer Science (R0)