Multimodal Image Fusion Based on Non-subsampled Shearlet Transform and Neuro-Fuzzy
Due to the appealing advantages in term of medical decision making, the problem of multimodal medical image fusion has received focused research over the recent years. Moreover, complimentary imaging modalities such as CT and MRI are able to improve medical reliability by reducing uncertainty. In this paper, we propose a new algorithm for multimodal medical image fusion based on non-subsampled shearlet transform (NSST) and neuro-fuzzy. Firstly, CT and MR source images are decomposed using the NSST to obtain low and high frequency sub-bands. Maximization of absolute value is performed to fuse low frequency coefficients while high frequency coefficients are fused using the neuro-fuzzy approach. Finally, the inverse NSST is performed to gain the fused image. To assess the performance of the proposed method, several experiments are carried on different medical CT and MR image datasets. Subjective and objective assessments reveal that the proposed scheme produces better results in various quantitative criterions compared to other existing methods.
KeywordsMultimodal image fusion Non-subsampled shearlet transform Neuro-fuzzy
The authors would like to thank Dr S. Rajkuma, the VIT University, Vellore-India, for providing image datasets of patients at different modalities.
- 3.Wang, A., Sun, H., Guan, Y.: The application of wavelet transform to multi-modality medical image fusion. In: IEEE International Conference on Networking, Sensing and Control, Ft. Lauderdale, FL, pp. 270–274 (2006)Google Scholar
- 5.Mankar, R., Daimiwal, N.: Multimodal medical image fusion under non-subsampled contourlet transform domain. In: International Conference on Communications and Signal Processing (ICCSP), 2015, Melmaruvathur, pp. 0592–0596 (2015)Google Scholar
- 6.Jothi, C., Elvina, N., Vetrivelan, P.: Medical image fusion using ridgelet transform. In: International Conference on Innovations in Intelligent Instrumentation, Optimization and Signal Processing, pp. 21–25 (2013)Google Scholar
- 9.Kutyniok, G., Labate, D.: Introduction to shearlets. In: Kutyniok, G., Labate, D. (eds.) Shearlets: Multiscale Analysis for Multivariate Data, Birkhäuser, Boston (2012)Google Scholar
- 14.Deng, C., Wang, S., Chen, X.: Remote sensing images fusion algorithm base on shearlet transform. In: Proceeding of International Conference on Environmental Science and Information Application Technology, pp. 451–454. ACM, Wu Han, China, (2009)Google Scholar
- 17.Teng, J., Wang, S., Zhang, J., Wang, X.: Neuro-fuzzy logic based fusion algorithm of medical images. In: 3rd International Congress on Image and Signal Processing (CISP), 2010, Yantai, pp. 1552–1556 (2010)Google Scholar
- 19.Kavitha, C.T., Chellamuthu, C.: Multimodal medical image fusion based on Integer Wavelet Transform and Neuro-Fuzzy. In: International Conference on Signal and Image Processing (ICSIP), 2010, pp. 296–300 (2010)Google Scholar
- 20.Rajkumar, S., Bardhan, P., Akkireddy, S.K., Munshi, C.: CT and MRI image fusion based on Wavelet Transform and Neuro-Fuzzy concepts with quantitative analysis. In: International Conference on Electronics and Communication Systems (ICECS), 2014, Coimbatore, pp. 1–6 (2014)Google Scholar
- 22.Liu, S., Shi, M., Zhu, Z., Zhao, J.: Image fusion based on complex-shearlet domain with guided filtering. Multidimension. Syst. Signal Process. 20(2), 1–18 (2015)Google Scholar
- 23.Kong, W.W., Liu, J.P.: Technique for image fusion based on non-subsampled shearlet transform and improved pulse-coupled neural network. Optical Eng. 52(1), 017001/1–12 (2013)Google Scholar
- 25.Rao, D.S., Seetha, M., Hazarath, M.: Iterative image fusion using neuro fuzzy logic and applications. In: International Conference on Machine Vision and Image Processing (MVIP), 2012, Taipei, pp. 121–124 (2012)Google Scholar
- 28.Shearlet webpage. www.shearlab.org