Abstract
We consider the problem of simultaneously registering several images to a 3D model. We propose a global approach based on mutual information that extends previous methods to incorporate the color, and does not require segmentation or feature extraction. We give a stochastic model for joint optimization of multiple image-to-model alignment and we propose a heuristic to solve it. Experiments with synthetic models showed that our algorithm is robust to varying illumination and surface characteristics. Experiments with real data showed that we can achieve very good accuracy even for an object with highly specular surface, in moderate lighting conditions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Clarkson, M.J., Rueckert, D., Hill, D.L.G., Hawkes, D.J.: Using photo-consistency to register 2D optical images of the human face to a 3D surface model. IEEE Trans. Pattern Analysis and Machine Intelligence 23(11), 1266–1280 (2001)
David, P., DeMenthon, D., Duraiswami, R., Samet, H.: Simultaneous pose and correspondence determination using line features. In: Proc. Computer Vision and Pattern Recognition, pp. 424–431. IEEE Computer Society Press, Los Alamitos (2003)
Duda, R., Hart, P.: Pattern Classification and Scene Analysis. John Wiley and Sons, Chichester (1973)
Faugeras, O.: Three-Dimensional Computer Vision A Geometric Viewpoint. The MIT Press, Cambridge (1993)
Jank, Z., Chetverikov, D.: Photo-consistency based registration of an uncalibrated image pair to a 3D surface model using genetic algorithm. In: Second Int. Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 2004), pp. 616–622 (2004)
Lensch, H.P.A., Heidrich, W., Seidel, H.-P.: A silhouette-based algorithm for texture registration and stitching. Graphical Models 63(4), 245–262 (2001)
Leventon, M., Wells III, W.M., Grimson, W.E.L.: Multiple view 2D-3D mutual information registration. In: Image Understanding Workshop (1997)
Neugebauer, P.J., Klein, K.: Texturing 3D models of real world objects from multiple unregistered photographic views. Computer Graphics Forum 3(18), 245–256 (1999)
Nishino, K., Sato, Y., Ikeuchi, K.: Appearance compression and synthesis based on 3D model for mixed reality. In: Proc. IEEE Int. Conf. Computer Vision, pp. 38–45. IEEE Computer Society Press, Los Alamitos (1999)
Taylor, C.J., Kriegman, D.J.: Minimization on the Lie group SO(3) and related manifolds. Technical report, Center for Systems Science, Dept. of Electrical Engineering Yale University (1994)
Viola, P., Wells III, W.M.: Alignment by maximization of mutual information. Int. J. Computer Vision 24(2), 137–154 (1997)
Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proc. Int. Conf. Computer Vision, vol. 1, pp. 666–673 (1999)
Zwicker, M., Pfister, H., van Baar, J., Gross, M.H.: Surface splatting. In: Proc. SIGGRAPH, pp. 371–378 (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cleju, I., Saupe, D. (2007). Stochastic Optimization of Multiple Texture Registration Using Mutual Information. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds) Pattern Recognition. DAGM 2007. Lecture Notes in Computer Science, vol 4713. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74936-3_52
Download citation
DOI: https://doi.org/10.1007/978-3-540-74936-3_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74933-2
Online ISBN: 978-3-540-74936-3
eBook Packages: Computer ScienceComputer Science (R0)