Fast 3D Structure From Motion with Missing Points from Registration of Partial Reconstructions
Structure From Motion (SFM) technique is usually used for camera motion recovery and 3D shape estimation. But the major problem with SFM is the occlusion of feature points which lead to hallucinate them, and thus increase the computation time. In this paper, we propose a method for a 3D shape reconstruction from a video sequence based on registering multiple partial reconstructions (patches). The proposed method avoids relying on hallucination step, which means a reduction of computation time. A realistic 3D textured shape is provided using a texture mapping pipeline based on the recovered motion of the camera. Experimental results on both synthetic and real images show that the proposed method is more than 200 times (on average) faster than the classical SFM methods which need to hallucinate the occluded points.
Keywords3D Reconstruction SFM Feature Tracking
Unable to display preview. Download preview PDF.
- 2.Wu, C., Sun, Y., Chang, C.: Three-dimensional modeling from endoscopic video using geometric constraints via feature poisitioning. IEEE Trans. on Biomedical Engineering 54(7) (2007)Google Scholar
- 3.Schweighofer, G., Pinz, A.: Fast and Globally Convergent Structure and Motion Estimation for General Camera Models. In: Proceedings of British Machine Vision Conference, vol. 1, pp. 147–156 (2006)Google Scholar
- 4.Schweighofer, G., Segvic, S., Pinz, A.: Online/Realtime Structure and Motion for General Camera Models. In: IEEE Workshop on Applications of Computer Vision, pp. 1–6 (January 2008)Google Scholar
- 7.Mazzon, R.: Real-time structure from motion for monocular and stereo cameras. In: MELECON 15th IEEE Mediterranean Electrotechnical Conference, pp. 498–503 (April 2010)Google Scholar
- 8.Jacobs, D.: Linear fitting with missing data: applications to structure-from-motion and to characterizing intensity images. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 206–212 (June 1997)Google Scholar
- 12.Jianbo, S., Tomasi, C.: Good features to track. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 593–600 (June 1994)Google Scholar
- 13.Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of Imaging Understanding Workshop, pp. 121–130 (1981)Google Scholar