Self-supervised Learning of Inverse Problem Solvers in Medical Imaging

  • Ortal Senouf
  • Sanketh VedulaEmail author
  • Tomer Weiss
  • Alex Bronstein
  • Oleg Michailovich
  • Michael Zibulevsky
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11795)


In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question: Given a set of measurements obtained from real imaging experiments, what is the best way to use a learnable model and the physics of the modality to solve the inverse problem and reconstruct the latent image? Standard supervised learning based methods approach this problem by collecting data sets of known latent images and their corresponding measurements. However, these methods are often impractical due to the lack of availability of appropriately sized training sets, and, more generally, due to the inherent difficulty in measuring the “groundtruth” latent image. In light of this, we propose a self-supervised approach to training inverse models in medical imaging in the absence of aligned data. Our method only requiring access to the measurements and the forward model at training. We showcase its effectiveness on inverse problems arising in accelerated magnetic resonance imaging (MRI).


Deep learning Inverse problems Self-supervised learning Accelerated MRI 


  1. 1.
    Kingma, D.P., et al.: Adam: a method for stochastic optimization. arXiv e-prints arXiv:1412.6980, December 2014
  2. 2.
    Lustig, M., et al.: Sparse MRI: the application of compressed sensing for rapid MR imaging. Magn. Reson. Med. 58(6), 1182–1195 (2007)CrossRefGoogle Scholar
  3. 3.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). Scholar
  4. 4.
    Rudin, L.I., et al.: Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Shocher, A., et al.: “Zero-Shot” super-resolution using deep internal learning. In: Proceedings CVPR (2018)Google Scholar
  6. 6.
    Uecker, M., et al.: ESPIRiT - an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA. Magn. Reson. Med. (2014)Google Scholar
  7. 7.
    Ulyanov, D., et al.: Deep image prior. In: Proceedings CVPR (2018)Google Scholar
  8. 8.
    Zbontar, J., et al.: fastMRI: an open dataset and benchmarks for accelerated MRI. arXiv preprint arXiv:1811.08839 (2018)
  9. 9.
    Zhu, J., et al.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings ICCV (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ortal Senouf
    • 1
  • Sanketh Vedula
    • 1
    Email author
  • Tomer Weiss
    • 1
  • Alex Bronstein
    • 1
  • Oleg Michailovich
    • 2
  • Michael Zibulevsky
    • 1
  1. 1.TechnionHaifaIsrael
  2. 2.University of WaterlooWaterlooCanada

Personalised recommendations