Signal, Image and Video Processing

, Volume 13, Issue 1, pp 135–143 | Cite as

PET–MRI image fusion using adaptive filter based on spectral and spatial discrepancy

  • Arash SabooriEmail author
  • Javad Birjandtalab
Original Paper


Recently, medical imaging equipment has undergone major developments. They play an important role in healthcare industry since they provide visual interpretation of human organs. Magnetic resonance imaging (MRI) and positron emission tomography (PET) are two well-known technologies which capture the structural and functional characteristics of the body organs, respectively. Fusing such functional and structural information can help physicians to better understand the normal and abnormal behaviors of tissues and organs. The contribution of this paper is twofold. First, an adaptive filter-based image fusion method is proposed to integrate information of MRI and PET images. Second, the notion of spatial discrepancy is added to the conventional spectral discrepancy and both discrepancy criteria are used for optimizing the filter parameters. The proposed image fusion technique is tested on seven publicly available brain image datasets including two cases of Alzheimer’s disease, normal coronal, normal sagittal, normal axial, grade II astrocytoma, and grade IV astrocytoma provided by Harvard University. The proposed method is compared with other biomedical image fusion approaches in both quantitative and visual manners. The results show that the proposed image fusion technique provides better performance in improving spectral and structural characteristics of the original images.


Biomedical imaging PET–MRI Image fusion Adaptive filter Discrepancy criteria 


  1. 1.
    Aiazzi, B., Baronti, S., Lotti, F., Selva, M.: A comparison between global and context-adaptive pansharpening of multispectral images. IEEE Geosci. Remote Sens. Lett. 6(2), 302–306 (2009)CrossRefGoogle Scholar
  2. 2.
    Al-Wassai, F.A., Kalyankar, N., Al-Zuky, A.A.: The IHS transformations based image fusion. arXiv preprint arXiv:11074396 (2011)
  3. 3.
    Amini, N., Fatemizadeh, E., Behnam, H.: MRI and PET image fusion by using curvelet transform. J. Adv. Comput. Res. 5(4), 23–30 (2014)Google Scholar
  4. 4.
    Amini, N., Fatemizadeh, E., Behnam, H.: MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules. J. Med. Eng. Technol. 38(4), 211–219 (2014)CrossRefGoogle Scholar
  5. 5.
    Angle, H., Ste-Croix, C., Kittel, E.: Review of fusion systems and contributing technologies for SIHS. Contract 519(836), 5911 (2007)Google Scholar
  6. 6.
    Bhatnagar, G., Wu, Q.J., Liu, Z.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimed. 15(5), 1014–1024 (2013)CrossRefGoogle Scholar
  7. 7.
    Bushberg, J.T., Boone, J.M.: The Essential Physics of Medical Imaging. Lippincott Williams & Wilkins, Philadelphia (2011)Google Scholar
  8. 8.
    Daneshvar, S., Ghassemian, H.: MRI and PET images fusion based on human retina model. J. Zhejiang Univ. Sci. A 8(10), 1624–1632 (2007)CrossRefzbMATHGoogle Scholar
  9. 9.
    Daneshvar, S., Ghassemian, H.: MRI and PET image fusion by combining IHS and retina-inspired models. Inf. Fusion 11(2), 114–123 (2010)CrossRefGoogle Scholar
  10. 10.
    Deshmukh, M., Bhosale, U.: Image fusion and image quality assessment of fused images. Int. J. Image Process. 4(5), 484 (2010)Google Scholar
  11. 11.
    Dou, W., Chen, Y.H.: Image fusion method of high-pass modulation including interband correlations. J. Infrared. Millim. Waves 29(2), 140–144 (2010)CrossRefGoogle Scholar
  12. 12.
    Huang, S.G., et al.: Wavelet for image fusion. National Taiwan University, Graduate Institute of Communication Engineering and Department of Electrical Engineering (2010)Google Scholar
  13. 13.
    James, A.P., Dasarathy, B.V.: Medical image fusion: a survey of the state of the art. Inf. Fusion 19, 4–19 (2014)CrossRefGoogle Scholar
  14. 14.
    Krishn, A., Bhateja, V., Himanshi, S.A.: Medical image fusion using combination of PCA and wavelet analysis. In: Advances in Computing, Communications and Informatics (ICACCI, 2014 International Conference, pp. 986–991. (2014)
  15. 15.
    Kumar, B.S.: Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform. SIViP 7(6), 1125–1143 (2013)CrossRefGoogle Scholar
  16. 16.
    Kumar, T.S., Arivazhagan, S., Ganesan, L.: A modified statistical approach for image fusion using wavelet transform. SIViP 3(2), 137–144 (2009)CrossRefGoogle Scholar
  17. 17.
    Lakshmi, S., Sankaranarayanan, D.V., et al.: A study of edge detection techniques for segmentation computing approaches. IJCA Special Issue on Computer Aided Soft Computing Techniques for Imaging and Biomedical Applications CASCT, pp. 35–40 (2010)Google Scholar
  18. 18.
    Lillo-Saavedra, M., Gonzalo, C., Arquero, A., Martinez, E.: Fusion of multispectral and panchromatic satellite sensor imagery based on tailored filtering in the fourier domain. Int. J. Remote Sens. 26(6), 1263–1268 (2005)CrossRefGoogle Scholar
  19. 19.
    Liu, X., Mei, W., Du, H., Bei, J.: A novel image fusion algorithm based on nonsubsampled shearlet transform and morphological component analysis. SIViP 10(5), 959–966 (2016)CrossRefGoogle Scholar
  20. 20.
    Mule, M.B., Padmavathi, N.: Basic medical image fusion methods. Int. J. Adv. Res. Comput. Eng. Technol. 4(3), 10 (2015)Google Scholar
  21. 21.
    Pietrzyk, U.: Registration of MRI and PET Images for Clinical Applications. CRC, Boca Raton, FL (2001)CrossRefGoogle Scholar
  22. 22.
    Ramandeep, R.K.: Review on different aspects of image fusion for medical imaging. Int. J. Sci. Res. 3(5), 1887–1889 (2014)Google Scholar
  23. 23.
    Shah, P., Merchant, S.N., Desai, U.B.: Multifocus and multispectral image fusion based on pixel significance using multiresolution decomposition. SIViP 7(1), 95–109 (2013)CrossRefGoogle Scholar
  24. 24.
    Shahdoosti, H.R.: MS and PAN image fusion by combining brovey and wavelet methods. In: International Conference on Information Technology, Computer and Communication (arXiv preprint arXiv:170101996) (2017)
  25. 25.
    Shahdoosti, H.R., Ghassemian, H.: Fusion of MS and PAN images preserving spectral quality. Geosci. Remote Sens. Lett. IEEE 12(3), 611–615 (2015)CrossRefGoogle Scholar
  26. 26.
    Sharma, K., Sharma, M.: Image fusion based on image decomposition using self-fractional Fourier functions. SIViP 8(7), 1335–1344 (2014)CrossRefGoogle Scholar
  27. 27.
    Shreyamsha, K.B.: Image fusion based on pixel significance using cross bilateral filter. SIViP 9(5), 1193–1204 (2015)CrossRefGoogle Scholar
  28. 28.
    Tu, T.M., Huang, P., Hung, C.L., Chang, C.P.: A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci. Remote Sens. Lett. 1, 309–312 (2004)CrossRefGoogle Scholar
  29. 29.
    Xu, Z.: Medical image fusion using multi-level local extrema. Inf. Fusion 19, 38–48 (2014)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2018

Authors and Affiliations

  1. 1.Faculty of Electrical and Computer Engineering, Science and Research BranchIslamic Azad UniversityTehranIran
  2. 2.The University of Texas at DallasRichardsonUSA

Personalised recommendations