A sum-modified-Laplacian and sparse representation based multimodal medical image fusion in Laplacian pyramid domain
- 22 Downloads
Fusion of multimodal medical images provides complementary information for diagnosis, surgical planning, and clinical outcome evaluation. Although the multiscale decomposition–based fusion methods have attracted much attention among researchers, the challenges of determining the decomposition levels and the loss of contrast hindered their applications. Here, we present a multimodal medical images fusion method combining the sum-modified-Laplacian (SML) with sparse representation (SR) in the Laplacian pyramid domain. In this method, we first transformed the original images into the high-pass and low-pass bands by the Laplacian pyramid (LP). Then, we use SML and SR to fuse the high- and low-pass bands, respectively. The proposed method has been compared with different methods including NSST_VGG_MAX, DWT_ARV_BURTS, CVT_MAX_LIS, and NSCT_SR_MAX. We also conducted multiple experiments on four groups of medical images, including CT and MR, T1-weighted MR and T2-weighted MR, PET and MR, as well as SPECT and MR, to demonstrate the advantages of our method. Visual and quantitative results illustrate that our method can produce the fused images with better brightness contrast and retain more image details than other evaluated methods on the basis of MI, LAB/F, QAB/F, and Qw. Furthermore, our method could preserve more fine and useful functional information with better image contrast, which is highly relevant in the assessment of lesion shapes and positions.
KeywordsSparse representation Sum-modified-Laplacian Laplacian pyramid Medical image fusion
This work was supported by the National Natural Science Foundation of China (grant no. 81571754) and partly supported by the Major National Scientific Instrument and Equipment Development Project (grant no. 2013YQ160551).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflicts of interest.
- 8.Kim T, Rivara FP, Mozingo DW, Lottenberg L, Harris ZB, Casella G, Liu H, Moldawer LL, Efron PA, Ang DN (2012) A regionalised strategy for improving motor vehicle-related highway driver deaths using a weighted averages method. Inj Prev 18(1):16–21. https://doi.org/10.1136/ip.2010.030759 CrossRefGoogle Scholar
- 11.Vollnhals F, Audinot JN, Wirtz T, Mercier-Bonin M, Fourquaux I, Schroeppel B, Kraushaar U, Lev-Ram V, Ellisman MH, Eswara S (2017) Correlative microscopy combining secondary ion mass spectrometry and electron microscopy: comparison of intensity-hue-saturation and Laplacian pyramid methods for image fusion. Anal Chem 89(20):10702–10710. https://doi.org/10.1021/acs.analchem.7b01256 CrossRefGoogle Scholar
- 34.Atlas, the Whole Brain. http://www.med.harvard.edu/aanlib/home.html. Accessed 12 Aug 2019