Skip to main content
SpringerLink
Log in

Capture and fusion of 3d surface texture

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image fusion is a process that multiple images of a scene are combined to form a single image. The aim of image fusion is to preserve the full content and retain important features of each original image. In this paper, we propose a novel approach based on wavelet transform to capture and fusion of real-world rough surface textures, which are commonly used in multimedia applications and referred to as3D surface texture. These textures are different from 2D textures as their appearances can vary dramatically with different illumination conditions due to complex surface geometry and reflectance properties. In our approach, we first extract gradient/height and albedo maps from sample 3D surface texture images as their representation. Then we measure saliency of wavelet coefficients of these 3D surface texture representations. The saliency values reflect the meaningful content of the wavelet coefficients and are consistent with human visual perception. Finally we fuse the gradient/height and albedo maps based on the measured saliency values. This novel scheme aims to preserve the original texture patterns together with geometry and reflectance characteristics from input images. Experimental results show that the proposed approach can not only capture and fuse 3D surface texture under arbitrary illumination directions, but also has the ability to retain the surface geometry properties and preserve perceptual features in the original images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Abidi M, Ganzalo P (1992) Data fusion in robotics and machine intelligence. Academic, USA, pp 10–50

    MATH  Google Scholar 

  2. Burschka D, Cobzas D, Dodds Z, Hager G, Jagersand M, Yerex K (2003). IEEE Virtual Reality 2003 tutorial 1: recent methods for image-based modelling and rendering. March 2003. http://webdocs.cs.ualberta.ca/~vis/VR2003tut/vrtut03.pdf

  3. Burt PJ, Kolczynski RJ (1993) Enhancement with application to image fusion. Proceeding of the 4th International Conference on Computer Vision, Berlin, Germany. pp 173–182

  4. Cardinali A, Nason GP (2005) A statistical multiscale approach to image segmentation and fusion. 8th International Conference on Information Fusion, pp 475–482. http://www.maths.bris.ac.uk/~guy/Research/papers/NCFusion2005.pdf

  5. Dong J, Chantler M (2003) Comparison of five 3D surface texture synthesis methods. Proceeding of the 3rd International Workshop on Texture Analysis & Synthesis, Nice, France. 17 October 2003, pp 31–34. http://lear.inrialpes.fr/people/triggs/events/iccv03/cdrom/texture03/texture03-ab032.pdf

  6. Dong J, Chantler M (2005) Capture and synthesis of 3D surface texture. Int J Comput Vis (IJCV) 62(1–2):177–194

    Google Scholar 

  7. Dong J, Chantler M (2004) Estimating parameters of illumination models for the synthesis of 3D surface texture. Proceedings of the 2004 International Conference on Computer and Information Technology, September 2004, pp 716–721

  8. Drbohlav O, Sára R (2002) Specularities reduce ambiguity of uncalibrated photometric stereo. Lecture Notes In Computer Science; Vol. 2351 Proceedings of 7th European Conference on Computer Vision-Part II, May 28–31, 2002, pp 46–62

  9. ftp://219.231.169.12/Results/

  10. Ganzalo P, Jesus M (2004) A wavelet-based image fusion tutorial. Pattern Recogn 37(8):1855–1872

    Google Scholar 

  11. Hill P, Canagarajah N, Bull D (2002) Image fusion using complex wavelets. In: Proceeding of the 13th British Machine Vision Conference (BMVC-2002), pp 487–496

  12. http://www.macs.hw.ac.uk/texturelab/resources/databases/Photex/index.htm

  13. Jian M, Dong J, Jiang R (2007) Wavelet-based salient regions and their spatial distribution for image retrieval. In Proceedings of the 2007 IEEE International Conference on Multimedia and Expo. ICME 2007, pp 2194–2197

  14. Jian M-W, Dong J-Y, Wu J-H (Jerry) (2007) Image capture and fusion of 3d surface texture using wavelet transform. International Conference on Wavelet Analysis and Pattern Recognition. ICWAPR ′07. 1:338–343, 2–4 Nov

  15. Jian M, Dong J, Zhang Y (2007) Image fusion based on wavelet transform. Proceedings of the Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007) Volume 1, Issue, July 30 2007–Aug. 1 2007. pp 764–769

  16. Koren I, Laine A, Taylor F (1995) Image fusion using steerable dyadic wavelet transforms. Proceedings of the 1995 International Conference on Image Processing 1:323–2352

  17. Lewis JJ, O’Callaghan RJ, Nikolov SG, Bull DR, Canagarajah CN (2004) Region-based image fusion using complex wavelets. In: Proceedings of the 7th International Conference on Information Fusion, Stockholm, Sweden, June 28-July 1, pp 555–562

  18. Li H, Manjunath BS, Mitra SK (1995) Multisensor image fusion using the wavelet transform. Graph Models Image Process 57(3):235–245

    Article  Google Scholar 

  19. Li ZH, Jing ZL, Liu G, Sun SY, Leung H (2003) A region-based image fusion algorithm using multiresolution segmentation. Proceedings of the IEEE International Conference on Intelligent Transportation Systems, Shanghai, Oct. 12-15, 2003, vol. 1, pp 96–101. http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01251928

  20. Ma H, Jia CY, Liu S (2005) Multisource image fusion based on wavelet transform. Int J Inf Technol 11(7):81–91

    Google Scholar 

  21. Mallat S (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693

    Article  MATH  Google Scholar 

  22. Piella G (2002) A region-based multiresolution image fusion algorithm. Proceeding of the 5th International Conference on Information Fusion, pp 1557–1564

  23. Robb M, Spence AD, Chantler MJ, Timmins M (2003) Real-time per-pixel rendering of bump-mapped textures captured using photometric stereo. In Proceedings of Vision Video and Graphics 2003, Bath, UK, pp 79–87

  24. Rockinger O (1997) Image sequence fusion using a shift invariant wavelet transform. IEEE Trans Image Process 3:288–291

    Google Scholar 

  25. Rushmeier H, Taubin G, Gueziec A (1997) Applying shape from lighting variation to bump map capture. In Proceedings of the 8th Eurographics Rendering Workshop, Saint-Etienne, France, pp 35–44

  26. Sebe N, Tian Q, Loupias E, Lew MS, Huang TS (2000) Color indexing using wavelet-based salient points. In IEEE Workshop on Content-based Access of Image and Video Libraries, pp 15–19

  27. Tian Q, Sebe N, Lew MS, Loupias E, Huang TS (2001) Image retrieval using wavelet-based salient points. J Electron Imaging, October

  28. Toet A (1990) Hierarchical image fusion. Mach Vis Appl 3(1):1–11. doi:10.1007/BF01211447

    Article  Google Scholar 

  29. Woodham R (1981) Analysing images of curved surfaces. Artif Intell 17:117–140

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the anonymous reviewers for their helpful comments. The project (No.60702014) is supported by National Natural Science Foundation of China.

Author information

Authors and Affiliations

  1. School of Space Science and Physics, Shandong University at Weihai, 108 Wenhuaxi Road, Weihai, China, 264209

    Muwei Jian

  2. Department of Computer Science and Technology, Ocean University of China, 238 Songling Road, Qingdao, China, 266100

    Junyu Dong

Authors
  1. Muwei Jian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junyu Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Junyu Dong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jian, M., Dong, J. Capture and fusion of 3d surface texture. Multimed Tools Appl 53, 237–251 (2011). https://doi.org/10.1007/s11042-010-0509-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0509-z

Keywords

Search

Navigation