Advertisement

Journal of the Indian Society of Remote Sensing

, Volume 47, Issue 1, pp 125–137 | Cite as

Translate SAR Data into Optical Image Using IHS and Wavelet Transform Integrated Fusion

  • Wenyuan ZhangEmail author
  • Min Xu
Research Article
  • 48 Downloads

Abstract

Although synthetic aperture radar (SAR) sensors function well at all times and under all weather conditions, the images they produce are not intuitively straightforward. A novel idea based on data fusion is introduced to translate SAR data into optical image in this paper. The proposed SAR-optical image translation is implemented using an intensity–hue–saturation (IHS) and wavelet transform integrated fusion (IHSW), so as to preserve as much as spatial details from SAR data, and minimize the spectral distortion of translated output. COSMO-SkyMed and ENVISAT-ASAR images are translated into optical images with the fusion of Landsat TM images, and the fusion results are compared with some conventional fusion methods, as well as the texture synthesis approach. Quality assessment of different fused outputs is carried out by using six quality indices. Visual and statistical comparisons of the final results indicate that the proposed approach achieves an effective translation from SAR to optical image and is superior to texture synthesis-based algorithm in terms of preserving spatial and spectral information. The proposed translation technique presents an alternative to improve the interpretability of SAR images.

Keywords

Image translation Image fusion Synthetic aperture radar (SAR) Wavelet transform 

Notes

Funding

This work was funded by National Key Technologies R&D Program of China (2012BAH83F00).

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

References

  1. Abdikan, S., Balik Sanli, F., Sunar, F., & Ehlers, M. (2014). A comparative data-fusion analysis of multi-sensor satellite images. International Journal of Digital Earth, 7(8), 671–687.CrossRefGoogle Scholar
  2. Aiazzi, B., Alparone, L., Baronti, S., & Garzelli, A. (2002). Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis. IEEE Transactions on Geoscience and Remote Sensing, 40(10), 2300–2312.CrossRefGoogle Scholar
  3. Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2006). MTF-tailored multiscale fusion of high-resolution MS and PAN imagery. Photogrammetric Engineering and Remote Sensing, 72(5), 591–596.CrossRefGoogle Scholar
  4. Amolins, K., Zhang, Y., & Dare, P. (2007). Wavelet based image fusion techniques: An introduction, review and comparison. ISPRS Journal of Photogrammetry and Remote Sensing, 62(4), 249–263.CrossRefGoogle Scholar
  5. Bigdeli, B., & Pahlavani, P. (2016). High resolution multisensor fusion of SAR, optical and LiDAR data based on crisp vs. fuzzy and feature vs. decision ensemble systems. International Journal of Applied Earth Observation and Geoinformation, 52, 126–136.CrossRefGoogle Scholar
  6. Byun, Y., Choi, J., & Han, Y. (2013). An area-based image fusion scheme for the integration of SAR and optical satellite imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 6(5), 2212–2220.CrossRefGoogle Scholar
  7. Carper, W. J. (1990). The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photogrammetric Engineering and Remote Sensing, 56(4), 457–467.Google Scholar
  8. Chavez, P. S., Jr., & Yaw Kwarteng, A. (1989). Extracting spectral contrast in Landsat Thematic Mapper image data using selective principal component analysis. Photogrammetric Engineering and Remote Sensing, 55(3), 339–348.Google Scholar
  9. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009). Sketch2Photo: Internet image montage. ACM Transactions on Graphics (TOG), 28(5), 1–10.Google Scholar
  10. Dong, H., Neekhara, P., Wu, C., & Guo, Y. (2017). Unsupervised image-to-image translation with generative adversarial networks. arXiv Preprint arXiv:1701.02676. Retrieved from http://arxiv.org/abs/1701.02676.
  11. Du, Y., Vachon, P. W., & Van der Sanden, J. J. (2003). Satellite image fusion with multiscale wavelet analysis for marine applications: Preserving spatial information and minimizing artifacts (PSIMA). Canadian Journal of Remote Sensing, 29(1), 14–23.CrossRefGoogle Scholar
  12. Ehlers, M., & Klonus, S. (2008). Quality assessment for multitemporal and multisensor image fusion. In SPIE remote sensing (Vol. 7110, pp. 71100T-71100T-9).Google Scholar
  13. Frost, V. S., Stiles, J. A., Shanmugan, K. S., & Holtzman, J. C. (1982). A model for radar images and its application to adaptive digital filtering of multiplicative noise. IEEE Transactions on Pattern Analysis and Machine Intelligence, 4(2), 157–166.CrossRefGoogle Scholar
  14. Fu, Z., & Zhang, W. (2012). Research on image translation between SAR and optical imagery. In ISPRS annals of photogrammetry, remote sensing and spatial information sciences (Vol. I-7, pp. 273–278).Google Scholar
  15. Garzelli, A. (2002). Possibilities and limitations of the use of wavelets in image fusion. In Procedings of the international geoscience and remote sensing symposium, 2002 (pp. 66–68).Google Scholar
  16. Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image style transfer using convolutional neural networks. In The IEEE conference on computer vision and pattern recognition (pp. 2414–2423).Google Scholar
  17. Hong, G., Zhang, Y., & Mercer, B. (2009). A Wavelet and IHS integration method to fuse high resolution SAR with moderate resolution multispectral images. Photogrammetric Engineering and Remote Sensing, 75(10), 1213–1223.CrossRefGoogle Scholar
  18. Huang, B., Li, Y., Han, X., Cui, Y., Li, W., & Li, R. (2015). Cloud removal from optical satellite imagery with SAR imagery using sparse representation. IEEE Geoscience and Remote Sensing Letters, 12(5), 1046–1050.CrossRefGoogle Scholar
  19. Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2016). Image-to-Image translation with conditional adversarial networks. arXiv:1611.07004[cs.CV], 1–16. Retrieved from http://arxiv.org/abs/1611.07004.
  20. Laben, C., & Brower, B. (2000). Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. United States Patent 6.Google Scholar
  21. Lin, C., Tsai, P., Lai, K., & Chen, J. (2013). Cloud removal from multitemporal satellite images using information cloning. IEEE Transactions on Geoscience and Remote Sensing, 51(1), 232–241.CrossRefGoogle Scholar
  22. Longbotham, N., Pacifici, F., Glenn, T., Zare, A., Volpi, M., Tuia, D., et al. (2012). Multi-modal change detection, application to the detection of flooded areas: Outcome of the 2009–2010 data fusion contest. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 5(1), 331–342.CrossRefGoogle Scholar
  23. Mallat, S. (1989). A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(7), 674–693.CrossRefGoogle Scholar
  24. Paul Skinner, J., Kent, B. M., Wittmann, R. C., Mensa, D. L., & Andersh, D. J. (1998). Normalization and interpretation of radar images. IEEE Transactions on Antennas and Propagation, 46(4), 502–506.CrossRefGoogle Scholar
  25. Prashanth, H. S., Shashidhara, H. L., & Murthy, K. N. B. (2009). Image scaling comparison using universal image quality index. In 2009 international conference on advances in computing control and telecommunication technologies (pp. 859–863).Google Scholar
  26. Reiche, J., Verbesselt, J., Hoekman, D., & Herold, M. (2015). Fusing Landsat and SAR time series to detect deforestation in the tropics. Remote Sensing of Environment, 156, 276–293.CrossRefGoogle Scholar
  27. Teimouri, M., Mokhtarzade, M., & Valadan Zoej, M. J. (2016). Optimal fusion of optical and SAR high-resolution images for semiautomatic building detection. GIScience and Remote Sensing, 53(1), 45–62.CrossRefGoogle Scholar
  28. Thomas, C., Ranchin, T., Wald, L., & Chanussot, J. (2008). Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1301–1312.CrossRefGoogle Scholar
  29. Vrabel, J. (1996). Multispectral imagery band sharpening study. Photogrammetric Engineering and Remote Sensing, 62(9), 1075–1083.Google Scholar
  30. Wald, L. (2000). Quality of high resolution synthesized images: Is there a simple criterion? In Proceedings of the fusion of earth data: Merging point measurements, raster maps and remotely sensed images (Vol. 1, pp. 99–105).Google Scholar
  31. Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.CrossRefGoogle Scholar
  32. Wang, T., & Jin, Y. (2012). Postearthquake building damage assessment using multi-mutual information from pre-event optical image and postevent SAR image. IEEE Geoscience and Remote Sensing Letters, 9(3), 452–456.CrossRefGoogle Scholar
  33. Werner, A., Storie, C. D., & Storie, J. (2014). Evaluating SAR-optical image fusions for urban LULC classification in Vancouver Canada. Canadian Journal of Remote Sensing, 40(4), 278–290.CrossRefGoogle Scholar
  34. Yuhas, R., Goetz, A. F. H., & Boardman, J. W. (1992). Descrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. In Summaries of the third annual JPL airborne geoscience workshop (pp. 147–149).Google Scholar
  35. Zhang, J. (2010). Multi-source remote sensing data fusion: status and trends. International Journal of Image Data Fusion, 1(1), 5–24.CrossRefGoogle Scholar
  36. Zhang, Y., & Hong, G. (2005). An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images. Information Fusion, 6(3), 225–234.CrossRefGoogle Scholar
  37. Zhou, W., & Bovik, A. C. (2002). A universal image quality index. IEEE Signal Processing Letters, 9(3), 81–84.CrossRefGoogle Scholar
  38. Zhou, Z., Meng, Y., Yang, P., Hu, B., & Chen, C. (2016). Extended GIHS fusion for pan-sharpening based on image model. In Geoscience and remote sensing symposium (IGARSS 2016) (Vol. 1, pp. 2598–2601).Google Scholar

Copyright information

© Indian Society of Remote Sensing 2018

Authors and Affiliations

  1. 1.National Research Center of Cultural IndustriesCentral China Normal UniversityWuhanChina
  2. 2.State Key Laboratory of Remote Sensing ScienceInstitute of Remote Sensing and Digital Earth of Chinese Academy of SciencesBeijingChina

Personalised recommendations