Abstract
In this paper, we propose a learning-based algorithm for automatic medical image annotation based on sparse aggregation of learned local appearance cues, achieving high accuracy and robustness against severe diseases, imaging artifacts, occlusion, or missing data. The algorithm starts with a number of landmark detectors to collect local appearance cues throughout the image, which are subsequently verified by a group of learned sparse spatial configuration models. In most cases, a decision could already be made at this stage by simply aggregating the verified detections. For the remaining cases, an additional global appearance filtering step is employed to provide complementary information to make the final decision. This approach is evaluated on a large-scale chest radiograph view identification task, demonstrating an almost perfect performance of 99.98% for a posteroanterior/anteroposterior (PA-AP) and lateral view position identification task, compared with the recently reported large-scale result of only 98.2% [1]. Our approach also achieved the best accuracies for a three-class and a multi-class radiograph annotation task, when compared with other state of the art algorithms. Our algorithm has been integrated into an advanced image visualization workstation, enabling content-sensitive hanging-protocols and auto-invocation of a computer aided detection algorithm for PA-AP chest images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Luo, H., Hao, W., Foos, D., Cornelius, C.: Automatic image hanging protocol for chest radiographs in PACS. IEEE Transactions on Information Technology in Biomedicine 10(2), 302–311 (2006)
Boone, J.M., Hurlock, G.S., Seibert, J.A., Kennedy, R.L.: Automated recognition of lateral from PA chest radiographs: saving seconds in a PACS environment. Journal of Digital Imaging 16(4), 345–349 (2003)
Deselaers, T., Deserno, T.M., Müller, H.: Automatic medical image annotation in ImageCLEF 2007: overview, results, and discussion. Pattern Recognition Letters 29(15), 1988–1995 (2008)
Deselaers, T., Ney, H.: Deformations, patches, and discriminative models for automatic annotation of medical radiographs. Pattern Recognition Letters 29(15), 2003–2010 (2008)
Müller, H., Gass, T., Geissbuhler, A.: Performing image classification with a frequency-based information retrieval schema for ImageCLEF 2006. In: ImageCLEF 2006. working notes of the Cross Language Evalutation Forum (CLEF 2006), Alicante, Spain (2006)
Güld, M.O., Deserno, T.M.: Baseline results for the ImageCLEF 2007 medical automatic annotation task using global image features. In: Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (eds.) CLEF 2006. LNCS, vol. 4730, pp. 637–640. Springer, Heidelberg (2007)
Keysers, D., Deselaers, T., Gollan, C., Ney, H.: Deformation models for image recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(8), 1422–1435 (2007)
Tommasi, T., Orabona, F., Caputo, B.: Discriminative cue integration for medical image annotation. Pattern Recognition Letters 29(15), 1996–2002 (2008)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal on Computer Vision 60(2), 91–110 (2004)
Pietka, E., Huang, H.K.: Orientation correction for chest images. Journal of Digital Imaging 5(3), 185–189 (1992)
Kao, E., Lee, C., Jaw, T., Hsu, J., Liu, G.: Projection profile analysis for identifying different views of chest radiographs. Academic Radiology 13(4), 518–525 (2006)
Arimura, H., Katsuragawa, S., Ishida, T., Oda, N., Nakata, H., Doi, K.: Performance evaluation of an advanced method for automated identification of view positions of chest radiographs by use of a large database. In: Proceeding of SPIE Medical Imaging, vol. 4684, pp. 308–315 (2002)
Lehmann, T.M., Güld, O., Keysers, D., Schubert, H., Kohnen, M., Wein, B.B.: Determining the view of chest radiographs. Journal of Digital Imaging 16(3), 280–291 (2003)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), vol. 1, pp. 511–518 (2001)
Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences 55(1), 119–139 (1997)
Zhan, Y., Zhou, X.S., Peng, Z., Krishnan, A.: Active scheduling of organ detection and segmentation in whole-body medical images. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part I. LNCS, vol. 5241, pp. 313–321. Springer, Heidelberg (2008)
Netter, F.H.: Atlas of human anatomy, 4th edn. Netter Basic Science. Elsevier Health Sciences (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tao, Y., Peng, Z., Jian, B., Xuan, J., Krishnan, A., Sean Zhou, X. (2010). Robust Learning-Based Annotation of Medical Radiographs. In: Caputo, B., Müller, H., Syeda-Mahmood, T., Duncan, J.S., Wang, F., Kalpathy-Cramer, J. (eds) Medical Content-Based Retrieval for Clinical Decision Support. MCBR-CDS 2009. Lecture Notes in Computer Science, vol 5853. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11769-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-11769-5_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-11768-8
Online ISBN: 978-3-642-11769-5
eBook Packages: Computer ScienceComputer Science (R0)