Fast and Robust 3D to 2D Image Registration by Backprojection of Gradient Covariances

  • Žiga Špiclin
  • Boštjan Likar
  • Franjo Pernuš
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8545)


Visualization and analysis of intra-operative images in imageguided radiotherapy and surgery are mainly limited to 2D X-ray imaging, which could be beneficially fused with information-rich pre-operative 3D image information by means of 3D-2D image registration. To keep the radiation dose delivered by the X-ray system low, the intra-operative imaging is usually limited to a single projection view. Registration of 3D to a single 2D image is a very challenging registration task for most of current state-of-the-art 3D-2D image registration methods. We propose a novel 3D-2D rigid registration method based on evaluation of similarity between corresponding 3D and 2D gradient covariances, which are mapped into the same space using backprojection. Normalized scalar product of covariances is computed as similarity measure. Performance of the proposed and state-of-the-art 3D-2D image registration methods was evaluated on two publicly available image datasets, one of cerebral angiograms and the other of a spine cadaver, using standardized evaluation methodology. Results showed that the proposed method outperformed the current state-of-the-art methods and achieved registration accuracy of 0.5 mm, capture range of 9 mm and success rate >80%. Considering also that GPU-enabled execution times ranged from 0.5-2.0 seconds, the proposed method has the potential to enhance with 3D information the visualization and analysis of intra-operative 2D images.


Image-guided surgery 3D-2D image registration gradient backprojection covariance similarity measure quantitative evaluation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hipwell, J., Penney, G., McLaughlin, R., Rhode, K., Summers, P., Cox, T., Byrne, J., Noble, J., Hawkes, D.: Intensity-based 2-D-3-D registration of cerebral angiograms. IEEE Transactions on Medical Imaging 22(11), 1417–1426 (2003)CrossRefGoogle Scholar
  2. 2.
    van de Kraats, E., Penney, G., Tomaževič, D., van Walsum, T., Niessen, W.: Standardized evaluation methodology for 2-D-3-D registration. IEEE Transactions on Medical Imaging 24(9), 1177–1189 (2005)CrossRefGoogle Scholar
  3. 3.
    Livyatan, H., Yaniv, Z., Joskowicz, L.: Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT. IEEE Transactions on Medical Imaging 22(11), 1395–1406 (2003), PMID: 14606673Google Scholar
  4. 4.
    Markelj, P., Tomaževič, D., Likar, B., Pernuš, F.: A review of 3D/2D registration methods for image-guided interventions. Medical Image Analysis 16(3), 642–661 (2012)CrossRefGoogle Scholar
  5. 5.
    Mitrović, U., Špiclin, Z., Likar, B., Pernuš, F.: 3D-2D registration of cerebral angiograms: a method and evaluation on clinical images. IEEE Transactions on Medical Imaging 32(8), 1550–1563 (2013)CrossRefGoogle Scholar
  6. 6.
    Peeters, T., Rodrigues, P.R., Vilanova, A., ter Haar Romeny, B.M.: Analysis of distance/similarity measures for diffusion tensor imaging. In: Visualization and Processing of Tensor Fields, pp. 113–136. Springer (2009)Google Scholar
  7. 7.
    Powell, M.J.D.: An efficient method for finding the minimum of a function of several variables without calculating derivatives. The Computer Journal 7(2), 155–162 (1964)CrossRefzbMATHMathSciNetGoogle Scholar
  8. 8.
    Powell, M.J.D.: The BOBYQA algorithm for bound constrained optimization without derivatives. Department of Applied Mathematics and Theoretical Physics, Cambridge, England, technical report NA2009/06 (2009)Google Scholar
  9. 9.
    Ruijters, D., Homan, R., Mielekamp, P., van de Haar, P., Babic, D.: Validation of 3D multimodality roadmapping in interventional neuroradiology. Physics in Medicine and Biology 56(16), 5335–5354 (2011)CrossRefGoogle Scholar
  10. 10.
    Tomaževič, D., Likar, B., Pernuš, F.: Gold standard data for evaluation and comparison of 3D/2D registration methods. Computer Aided Surgery 9(4), 137–144 (2004)CrossRefGoogle Scholar
  11. 11.
    Tomaževič, D., Likar, B., Slivnik, T., Pernuš, F.: 3-D/2-D registration of CT and MR to X-ray images. IEEE Transactions on Medical Imaging 22(11), 1407–1416 (2003)CrossRefGoogle Scholar
  12. 12.
    Truong, M., Aslam, A., Ginks, M., Rinaldi, C., Rezavi, R., Penney, G., Rhode, K.: 2D-3D registration of cardiac images using catheter constraints. Computers in Cardiology, 605–608 (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Žiga Špiclin
    • 1
  • Boštjan Likar
    • 1
  • Franjo Pernuš
    • 1
  1. 1.Faculty of Electrical Engineering, Laboratory of Imaging TechnologiesUniversity of LjubljanaLjubljanaSlovenia

Personalised recommendations