Handling Missing Data in the Computation of 3D Affine Transformations
The reconstruction of rigid scenes from multiple images is a central topic in computer vision. Approaches merging partial 3D models in a hierarchical manner have proven the most effective to deal with large image sequences. One of the key building blocks of these hierarchical approaches is the alignment of two partial 3D models, which requires to express them in the same 3D coordinate frame by computing a 3D transformation. This problem has been well-studied for the cases of 3D models obtained with calibrated or uncalibrated pinhole cameras.
We tackle the problem of aligning 3D models – sets of 3D points – obtained using uncalibrated affine cameras. This requires to estimate 3D affine transformations between the models. We propose a factorization-based algorithm estimating simultaneously the aligning transformations and corrected points, exactly matching the estimated transformations, such that the reprojection error over all cameras is minimized. In the case of incomplete image data our algorithm uses an Expectation Maximization (EM) based scheme that alternates prediction of the missing data and estimation of the affine transformation.
We experimentally compare our algorithm to other methods using simulated and real data.
KeywordsImage Point Point Correspondence Factorization Algorithm Reprojection Error Corrected Point
Unable to display preview. Download preview PDF.
- 1.Fitzgibbon, A., Zisserman, A.: Automatic camera recovery for closed or open image sequences. In: ECCV, pp. 311–326 (1998)Google Scholar
- 6.Mundy, J., Zisserman, A. (eds.): Geometric Invariance in Computer Vision. MIT Press, Cambridge (1992)Google Scholar
- 7.Bartoli, A., Martinsson, H., Gaspard, F., Lavest, J.M.: On aligning sets of points reconstructed from uncalibrated affine cameras. In: SCIA, pp. 531–540 (2005)Google Scholar
- 9.Golub, G., van Loan, C.: Matrix Computation. Johns Hopkins University Press, Baltimore (1989)Google Scholar
- 10.Jacobs, D.: Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In: CVPR, pp. 206–212 (1997)Google Scholar