CUST: CNN for Ultrasound Thermal Image Reconstruction Using Sparse Time-of-Flight Information

  • Younsu Kim
  • Chloé Audigier
  • Emran M. A. Anas
  • Jens Ziegle
  • Michael Friebe
  • Emad M. BoctorEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11042)


Thermotherapy is a clinical procedure to induce a desired biological tissue response through temperature changes. To precisely operate the procedure, temperature monitoring during the treatment is essential. Ultrasound propagation velocity in biological tissue changes as temperature increases. An external ultrasound element was integrated with a bipolar radiofrequency (RF) ablation probe to collect time-of-flight information carried by ultrasound waves going through the ablated tissues. Recovering temperature at the pixel level from the limited information acquired from this minimal setup is an ill-posed problem. Therefore, we propose a learning approach using a designed convolutional neural network. Training and testing were performed with temperature images generated with a computational bioheat model simulating a RF ablation. The reconstructed thermal images were compared with results from another sound velocity reconstruction method. The proposed method showed better stability and accuracy for different ultrasound element locations. Ex-vivo experiments were also performed on porcine liver to evaluate the proposed temperature reconstruction method.


Ultrasound thermal monitoring Temperature image reconstruction Bipolar ablation Hyperthermia Thermotherapy CNN Ultrasound 



This work was supported by the National Institute of Health (R01EB021396) and the National Science Foundation (1653322).


  1. 1.
    Landon, C.D., Park, J.Y., Needham, D., Dewhirst, M.W.: Nanoscale drug delivery and hyperthermia: the materials design and preclinical and clinical testing of low temperature-sensitive liposomes used in combination with mild hyperthermia in the treatment of local cancer. Open Nanomed. J. 3, 38–64 (2011)CrossRefGoogle Scholar
  2. 2.
    Issels, R.D.: Neo-adjuvant chemotherapy alone or with regional hyperthermia for localised high-risk soft-tissue sarcoma: a randomised phase 3 multicentre study. Lancet Oncol. 11(6), 561–570 (2010)CrossRefGoogle Scholar
  3. 3.
    Dinerman, J.L., Berger, R., Calkins, H.: Temperature monitoring during radiofrequency ablation. J. Cardiovasc. Electrophysiol. 7(2), 163–173 (1996)CrossRefGoogle Scholar
  4. 4.
    Saccomandi, P., Schena, E., Silvestri, S.: Techniques for temperature monitoring during laser-induced thermotherapy: an overview. Int. J. Hyperth. 29(7), 609–619 (2013)CrossRefGoogle Scholar
  5. 5.
    Poorter, J.D., Wagter, C.D., Deene, Y.D., Thomsen, C., Ståhlberg, F., Achten, E.: Noninvasive MRI thermometry with the proton resonance frequency (PRF) method: in vivo results in human muscle. Magn. Res. Med. 33(1), 74–81 (1995)CrossRefGoogle Scholar
  6. 6.
    Lewis, M.A., Staruch, R.M., Chopra, R.: Thermometry and ablation monitoring with ultrasound. Int. J. Hyperth. 31(2), 163–181 (2015)CrossRefGoogle Scholar
  7. 7.
    Norton, S.J., Testardi, L.R., Wadley, H.N.G.: Reconstructing internal temperature distributions from ultrasonic time-of-flight tomography and dimensional resonance measurements. In: 1983 Ultrasonics Symposium, pp. 850–855, October 1983Google Scholar
  8. 8.
    Wang, G.: A perspective on deep imaging. IEEE Access 4, 8914–8924 (2016)CrossRefGoogle Scholar
  9. 9.
    Ziegle, J., Audigier, C., Krug, J., Ali, G., Kim, Y., Boctor, E.M., Friebe, M.: RF-ablation pattern shaping employing switching channels of dual bipolar needle electrodes: ex vivo results. IJCARS, 13, 1–12 (2018)CrossRefGoogle Scholar
  10. 10.
    Pennes, H.H.: Analysis of tissue and arterial blood temperatures in the resting human forearm. J. Appl. Physiol. 85(1), 5–34 (1998)CrossRefGoogle Scholar
  11. 11.
    Audigier, C.: Efficient Lattice Boltzmann solver for patient-specific radiofrequency ablation of hepatic tumors. IEEE TMI 34(7), 1576–1589 (2015)Google Scholar
  12. 12.
    Martnez-Valdez, R., Contreras, M., Vera, A., Leija, L.: Sound speed measurement of chicken liver from 22C to 60C. Phys. Procedia 70, 1260–1263 (2015)CrossRefGoogle Scholar
  13. 13.
    Kim, Y., Audigier, C., Ziegle, J., Friebe, M., Boctor, E.M.: Ultrasound thermal monitoring with an external ultrasound source for customized bipolar RF ablation shapes. IJCARS, 13, 815–826 (2018)CrossRefGoogle Scholar
  14. 14.
    Paszke, A., et al.: Automatic differentiation in pytorch (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Younsu Kim
    • 1
  • Chloé Audigier
    • 1
  • Emran M. A. Anas
    • 1
  • Jens Ziegle
    • 2
  • Michael Friebe
    • 2
  • Emad M. Boctor
    • 1
    Email author
  1. 1.Johns Hopkins UniversityBaltimoreUSA
  2. 2.Otto-von-Guericke UniversityMagdeburgGermany

Personalised recommendations