Abstract
This study aims at building photorealistic 3D models of real-world objects. We discuss the problem of combining a 3D textureless model obtained by 3D scanner, with optical images that provide textural information of the object. Recently, we have proposed a novel method to register an uncalibrated image pair to a 3D surface model. After registration, the images are mapped to the surface. However, as the images show different parts of the objects, partial overlapping textures can only be extracted from them. Combining the images into a complete texture map that covers the entire object is not trivial. We present a method to build photorealistic 3D models that includes algorithms for data registration and for merging multiple texture maps using surface flattening. Experimental results on real and synthetic data are shown.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Csendes, T.: Nonlinear parameter estimation by global optimization – Efficiency and Reliability. Acta Cybernetica 8, 361–370 (1988)
Bernardini, F., et al.: Building a digital model of Michelangelo’s Florentine Pietà. IEEE Comp. Graphics & Applications 22(1), 59–67 (2002)
Mayer, H., et al.: Multiresolution texture for photorealistic rendering. In: Proc. 17th Spring Conference on Computer Graphics, p. 109. IEEE Comp. Soc., Los Alamitos (2001)
Ikeuchi, K., et al.: The great Buddha project: Modeling cultural heritage for VR systems through observation. In: Proc. IEEE ISMAR 2003 (2003)
Clarkson, M.J., et al.: Using photo-consistency to register 2D optical images of the human face to a 3D surface model. IEEE Tr. on PAMI 23, 1266–1280 (2001)
Haker, S., et al.: Conformal surface parameterization for texture mapping. IEEE Tr. on Visualization and Comp. Graphics 6(2), 181–189 (2000)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Univ. Press, Cambridge (2000)
Jankó, Z., Chetverikov, D.: Photo-consistency based registration of an uncalibrated image pair to a 3D surface model using genetic algorithm. In: Proc. 2nd Int. Symp. on 3D Data Processing, Visualization & Transmission, pp. 616–622 (2004)
Jankó, Z., Chetverikov, D.: Registration of an uncalibrated image pair to a 3D surface model. In: Proc. 17th Int. Conf. on Pattern Recognition, vol. 2, pp. 208–211 (2004)
Kós, G.: An algorithm to triangulate surfaces in 3D using unorganised point clouds. Computing Suppl. 14, 219–232 (2001)
Kós, G., Várady, T.: Parameterizing complex triangular meshes. In: Proc. 5th International Conf. on Curves and Surfaces, pp. 265–274 (2003)
Kutulakos, K.N., Seitz, S.M.: A Theory of Shape by Space Carving. Prentice Hall, Englewood Cliffs (1993)
Levoy, M., et al.: The digital Michelangelo project. ACM Computer Graphics Proceedings, 131–144 (2000)
Piponi, D., Borshukov, G.: Seamless texture mapping of subdivision surfaces by model pelting and texture blending. In: Proc. 27th Annual Conf. on Comp. Graphics and Interactive Techniques, pp. 471–478. ACM Press, New York (2000)
Sequeira, V., Gonçalves, J.G.M.: 3D reality modelling: Photo-realistic 3D models of real world scenes. In: Proc. 1st Int. Symp. on 3D Data Processing, Visualization & Transmission, pp. 776–783 (2002)
Sheffer, A., de Sturler, E.: Smoothing an overlay grid to minimize linear distortion in texture mapping. ACM Tr. Graphics 21(4), 874–890 (2002)
Walker, J.: Satellite data, http://www.fourmilab.ch/cgi-bin/uncgi/Earth
Yemez, Y., Schmitt, F.: 3D reconstruction of real objects with high resolution shape and texture. Image and Vision Computing 22, 1137–1153 (2004)
Zigelman, G., Kimmel, R., Kiryati, N.: Texture mapping using surface flattening via multi-dimensional scaling. IEEE Tr. on Visualization and Comp. Graphics 8(2), 198–207 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jankó, Z., Chetverikov, D. (2005). Data Fusion for Photorealistic 3D Models. In: Gagalowicz, A., Philips, W. (eds) Computer Analysis of Images and Patterns. CAIP 2005. Lecture Notes in Computer Science, vol 3691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11556121_30
Download citation
DOI: https://doi.org/10.1007/11556121_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28969-2
Online ISBN: 978-3-540-32011-1
eBook Packages: Computer ScienceComputer Science (R0)