Abstract
Deep learning for accelerated magnetic resonance (MR) image reconstruction is a fast growing field, which has so far shown promising results. However, most works are limited in the sense that they assume equidistant rectilinear (Cartesian) data acquisition in 2D or 3D. In practice, a reconstruction from nonuniform samplings such as radial and spiral is an attractive choice for more efficient acquisitions. Nevertheless, it has less been explored as the reconstruction process is complicated by the necessity to handle non-Cartesian samples. In this work, we present a novel approach for reconstructing from nonuniform undersampled MR data. The proposed approach, termed nonuniform variational network (NVN), is a convolutional neural network architecture based on the unrolling of a traditional iterative nonlinear reconstruction, where the knowledge of the nonuniform forward and adjoint sampling operators are efficiently incorporated. Our extensive evaluation shows that the proposed method outperforms existing state-of-the-art deep learning methods, hence offering a method that is widely applicable to different imaging protocols for both research and clinical deployments.
J. Schlemper and S. S. M. Salehi—Co-first authors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
For \(N=192^2\) and \(M=10,000\) (i.e. \(\approx 3{\times } \) acceleration), storing the complex-valued matrix alone already takes 3 GB of memory.
- 2.
References
Delattre, B.M., et al.: Spiral demystified. JMRI 28(6), 862–881 (2010)
Fessler, J.A., Sutton, B.P.: Nonuniform fast fourier transforms using min-max interpolation. IEEE TSP 51(2), 560–574 (2003)
Forbes, K.P., et al.: Propeller MRI: clinical testing of a novel technique for quantification and compensation of head motion. MRM 14(3), 215–222 (2001)
Greengard, L., Lee, J.Y.: Accelerating the nonuniform fast fourier transform. SIAM Rev. 46(3), 443–454 (2004)
Hammernik, K., et al.: Learning a variational network for reconstruction of accelerated mri data. MRM 79(6), 3055–3071 (2018)
Han, Y., Ye, J.C.: k-space deep learning for accelerated MRI. arXiv preprint arXiv:1805.03779 (2018)
Han, Y., et al.: Deep learning with domain adaptation for accelerated projection-reconstruction MR. MRM 80(3), 1189–1205 (2018)
Knoll, F., et al.: Second order total generalized variation (TGV) for MRI. MRM 65(2), 480–491 (2011)
Knoll, F., et al.: Adapted random sampling patterns for accelerated MRI. Magn. Reson. Mater. Phys. Biol. Med. 24(1), 43–50 (2011)
Lazarus, C., et al.: SPARKLING: variable-density k-space filling curves for accelerated t2*-weighted MRI. MRM 81, 3643–3661 (2019)
Lustig, M., et al.: Compressed sensing MRI. IEEE Signal Process. Mag. 25(2), 72–82 (2008)
Mardani, M., et al.: Deep generative adversarial networks for compressed sensing automates MRI. arXiv preprint arXiv:1706.00051 (2017)
Meinhardt, T., et al.: Learning proximal operators: using denoising networks for regularizing inverse imaging problems. In: ICCV, pp. 1781–1790 (2017)
Pipe, J.G.: Motion correction with propeller MRI: application to head motion and free-breathing cardiac imaging. MRM 42(5), 963–969 (1999)
Qin, C., et al.: Convolutional recurrent neural networks for dynamic MR image reconstruction. arXiv preprint arXiv:1712.01751 (2017)
Roth, S., Black, M.J.: Fields of experts. IJCV 82(2), 205 (2009)
Yang, G., et al.: DAGAN: deep de-aliasing generative adversarial networks for fast compressed sensing MRI reconstruction. IEEE TMI 37(6), 1310–1321 (2018)
Zhu, B., et al.: Image reconstruction by domain-transform manifold learning. Nature 555(7697), 487 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Schlemper, J. et al. (2019). Nonuniform Variational Network: Deep Learning for Accelerated Nonuniform MR Image Reconstruction. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-32248-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32247-2
Online ISBN: 978-3-030-32248-9
eBook Packages: Computer ScienceComputer Science (R0)
