Abstract
Ultrasound (US) images suffer from artefacts which limit its diagnostic value, notably acoustic shadow. Shadows are dependent on probe orientation, with each view giving a distinct, partial view of the anatomy. In this work, we fuse the partially imaged fetal head anatomy, acquired from numerous views, into a single coherent compounding of the full anatomy. Firstly, a stream of freehand 3D US images is acquired, capturing as many different views as possible. The imaged anatomy at each time-point is then independently aligned to a canonical pose using an iterative spatial transformer network (iSTN), making our approach robust to fast fetal and probe motion. Secondly, images are fused by averaging only the best (most salient) features from all images, producing a more detailed compounding. Finally, the compounding is iteratively refined using a groupwise registration approach. We evaluate our compounding approach quantitatively and qualitatively, comparing it with average compounding and individual US frames. We also evaluate our alignment accuracy using two physically attached probes, that capture separate views simultaneously, providing ground-truth. Lastly, we demonstrate the potential clinical impact of our method for assessing cranial, facial and external ear abnormalities, with automated atlas-based masking and 3D volume rendering.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Perperidis, A., Cusack, D., White, A., McDicken, N., MacGillivray, T., Anderson, T.: Temporal compounding: a novel implementation and its impact on quality and diagnostic value in echocardiography. UMB 41(6), 1749–1765 (2015)
Yao, C.: 3D echocardiography image compounding. Ph.D. thesis, King’s College London (2012)
Zimmer, V.A., et al.: Multi-view image reconstruction: application to fetal ultrasound compounding. In: Melbourne, A., et al. (eds.) PIPPI/DATRA -2018. LNCS, vol. 11076, pp. 107–116. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00807-9_11
Gomez, A., et al.: Fast registration of 3D fetal ultrasound images using learned corresponding salient points. In: Cardoso, M.J., et al. (eds.) FIFI/OMIA -2017. LNCS, vol. 10554, pp. 33–41. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67561-9_4
Contreras Ortiz, S.H., Chiu, T., Fox, M.D.: Ultrasound image enhancement: a review. BSPC 7(5), 419–428 (2012)
Khanal, B., et al.: EchoFusion: tracking and reconstruction of objects in 4D freehand ultrasound imaging without external trackers. In: Melbourne, A., et al. (eds.) PIPPI/DATRA -2018. LNCS, vol. 11076, pp. 117–127. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00807-9_12
Perez-Gonzalez, J., et al.: Spatial compounding of 3-D fetal brain ultrasound using probabilistic maps. UMB 44(1), 278–291 (2018)
Wright, R., et al.: LSTM spatial co-transformer networks for registration of 3D fetal US and MR brain images. In: Melbourne, A., et al. (eds.) PIPPI/DATRA -2018. LNCS, vol. 11076, pp. 149–159. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00807-9_15
Grau, V., Noble, J.A.: Adaptive multiscale ultrasound compounding using phase information. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 589–596. Springer, Heidelberg (2005). https://doi.org/10.1007/11566465_73
Li, S., Kang, X., Hu, J.: Image fusion with guided filtering. TIP 22(7), 2864–2875 (2013)
Burt, P., Adelson, E.: The laplacian pyramid as a compact image code. TCOM 31(4), 532–540 (1983)
Vercauteren, T., Perchant, A., Pennec, X., Ayache, N.: Mosaicing of confocal microscopic In Vivo soft tissue video sequences. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 753–760. Springer, Heidelberg (2005). https://doi.org/10.1007/11566465_93
Modat, M., Cash, D.M., Daga, P., Winston, G.P., Duncan, J.S., Ourselin, S.: Global image registration using a symmetric block-matching approach. JMI 1(2), 024003 (2014)
Acknowledgements
This work was supported by the Wellcome/EPSRC Centre for Medical Engineering [WT203148/Z/16/Z], Wellcome Trust IEH Award [102431] and NVIDIA with the donation of a Titan Xp GPU.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wright, R. et al. (2019). Complete Fetal Head Compounding from Multi-view 3D Ultrasound. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-32248-9_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32247-2
Online ISBN: 978-3-030-32248-9
eBook Packages: Computer ScienceComputer Science (R0)
