Abstract
Automatic segmentation techniques, despite demonstrating excellent overall accuracy, can often produce inaccuracies in local regions. As a result, correcting segmentations remains an important task that is often laborious, especially when done manually for 3D datasets. This work presents a powerful tool called Intelligent Learning-Based Editor of Segmentations (IntellEditS) that minimizes user effort and further improves segmentation accuracy. The tool partners interactive learning with an energy-minimization approach to editing. Based on interactive user input, a discriminative classifier is trained and applied to the edited 3D region to produce soft voxel labeling. The labels are integrated into a novel energy functional along with the existing segmentation and image data. Unlike the state of the art, IntellEditS is designed to correct segmentation results represented not only as masks but also as meshes. In addition, IntellEditS accepts intuitive boundary-based user interactions. The versatility and performance of IntellEditS are demonstrated on both MRI and CT datasets consisting of varied anatomical structures and resolutions.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Top, A., Hamarneh, G., Abugharbieh, R.: Active Learning for Interactive 3D Image Segmentation. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part III. LNCS, vol. 6893, pp. 603–610. Springer, Heidelberg (2011)
Baerentzen, J.A., Aanaes, H.: Generating Signed Distance Fields From Triangle Meshes. Tech. rep., Informat. and Math. Mod., Tech. Univ. of Denmark (2002)
Beichel, R., Bauer, C., Bornik, A., Sorantin, E., Bischof, H.: Liver segmentation in CT Data: A Segmentation Refinement Approach. In: Proceedings of 3D Segmentation in the Clinic: A Grand Challenge, pp. 235–245 (2007)
Birkbeck, N., Sofka, M., Zhou, S.: Fast Boosting Trees for Classification, Pose Detection, and Boundary Detection on a GPU. In: 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW, pp. 36–41 (2011)
Grady, L.: Random Walks for Image Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1768–1783 (2006)
Grady, L., Funka-Lea, G.: An Energy Minimization Approach to the Data Driven Editing of Presegmented Images/Volumes. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4191, pp. 888–895. Springer, Heidelberg (2006)
Hamarneh, G., Yang, J., Mcintosh, C., Langille, M.: 3D live-wire-based semi-automatic segmentation of medical images. In: Proceedings of SPIE Medical Imaging: Image Processing, vol. 5747, pp. 1597–1603 (2005)
Heckel, F., Moltz, J.H., Bornemann, L., Dicken, V., Bauknecht, H.C., Fabel, M., Hittinger, M., Kießling, A., Meier, S., Púsken, M., Peitgen, H.O.: 3D contour based local manual correction of tumor segmentations in CT scans. In: Proceedings of SPIE Medical Imaging: Image Processing, vol. 7259, pp. 1–9
Heimann, T., van Ginneken, B., et al.: Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets. IEEE Trans. Med. Imaging 28(8), 1251–1265 (2009)
Jagadeesh, V., Manjunath, B.: Interactive graph cut segmentation of touching neuronal structures from electron micrographs. In: 2010 17th IEEE International Conference on Image Processing, ICIP, pp. 3625–3628 (2010)
Kang, Y., Engelke, K., Kalender, W.A.: Interactive 3D editing tools for image segmentation. Medical Image Analysis 8(1), 35–46 (2004)
Lorensen, W.E., Cline, H.E.: Marching Cubes: A High Resolution 3D Surface Construction Algorithm. Computer Graphics 21(4), 163–169 (1987)
Santner, J., Unger, M., Pock, T., Leistner, C., Saffari, A., Bischof, H.: Interactive Texture Segmentation using Random Forests and Total Variation. In: British Machine Vision Conference, BMVC (2009)
Tu, Z.: Probabilistic Boosting-Tree: Learning Discriminative Models for Classification, Recognition, and Clustering. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, vol. 2, pp. 1589–1596 (2005)
Yang, H.-F., Choe, Y.: An Interactive Editing Framework for Electron Microscopy Image Segmentation. In: Bebis, G., et al. (eds.) ISVC 2011, Part I. LNCS, vol. 6938, pp. 400–409. Springer, Heidelberg (2011)
Yang, Q., Tang, X., Wang, C., Ye, Z., Chen, M.: Progressive Cut: An Image Cutout Algorithm that Models User Intentions. IEEE MultiMedia 14(3), 56–66 (2007)
Yang, W., Cai, J., Zheng, J., Luo, J.: User-friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs. IEEE Trans. Image Process 19(9), 2470–2479 (2010)
Zhao, Y., Zhu, S.C., Luo, S.: CO3 for Ultra-fast and Accurate Interactive Segmentation. In: Proceedings of the International Conference on Multimedia, pp. 93–102. ACM (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Harrison, A.P., Birkbeck, N., Sofka, M. (2013). IntellEditS: Intelligent Learning-Based Editor of Segmentations. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2013. MICCAI 2013. Lecture Notes in Computer Science, vol 8151. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40760-4_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-40760-4_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40759-8
Online ISBN: 978-3-642-40760-4
eBook Packages: Computer ScienceComputer Science (R0)