Zusammenfassung
Deep learning approaches have been very successful in segmenting cardiac structures from CT and MR volumes. Despite continuous progress, automated segmentation of these structures remains challenging due to highly complex regional characteristics (e.g. homogeneous gray-level transitions) and large anatomical shape variability. To cope with these challenges, the incorporation of shape priors into neural networks for robust segmentation is an important area of current research. We propose a novel approach that leverages shared information across imaging modalities and shape segmentations within a unified multi-modal encoder-decoder network. This jointly end-to-end trainable architecture is advantageous in improving robustness due to strong shape constraints and enables further applications due to smooth transitions in the learned shape space. Despite no skip connections are used and all shape information is encoded in a low-dimensional representation, our approach achieves high-accuracy segmentation and consistent shape interpolation results on the multi-modal whole heart segmentation dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Literatur
Tobon-Gomez C, et al. Benchmark for algorithms segmenting the left atrium from 3D CT and MRI datasets. IEEE Trans Med Imag. 2015;34(7):1460–1473.
Milletari F, et al.; IEEE. V-net: fully convolutional neural networks for volumetric medical image segmentation. Proc 3D Vis. 2016; p. 565–571.
Ronneberger O, et al.; Springer. U-net: convolutional networks for biomedical image segmentation. Proc MICCAI. 2015; p. 234–241.
Oktay O, et al. Anatomically constrained neural networks (ACNN): application to cardiac image enhancement and segmentation. CoRR. 2017;abs/1705.08302.
Ravishankar H, et al. Learning and incorporating shape models for semantic segmentation. Proc MICCAI. 2017; p. 203–211.
Jetley S, Sapienza M, Golodetz S, et al. Straight to shapes: real-time detection of encoded shapes. CoRR. 2016;abs/1611.07932.
Bouteldja N, Heinrich MP. Deep 3D encoder-decoder networks with applications to organ segmentation. Stud Conf. 2018; p. 229–232.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Bouteldja, N., Merhof, D., Ehrhardt, J., Heinrich, M.P. (2019). Deep Multi-Modal Encoder-Decoder Networks for Shape Constrained Segmentation and Joint Representation Learning. In: Handels, H., Deserno, T., Maier, A., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2019. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-25326-4_8
Download citation
DOI: https://doi.org/10.1007/978-3-658-25326-4_8
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-25325-7
Online ISBN: 978-3-658-25326-4
eBook Packages: Computer Science and Engineering (German Language)