Interactively Modeling with Photogrammetry
We describe an interactive system to reconstruct 3D geometry and extract textures from a set of photographs taken with arbitrary camera parameters. The basic idea is to let the user draw 2D geometry on the images and set constraints using these drawings. Because the input comes directly from the user, he can more easily resolve most of the ambiguities and difficulties traditional computer vision algorithms must deal with.
A set of geometrical linear constraints formulated as a weighted least-squares problem is efficiently solved for the camera parameters, and then for the 3D geometry. Iterations between these two steps lead to improvements on both results. Once a satisfying 3D model is reconstructed, its color textures are extracted by sampling the projected texels in the corresponding images. All the textures associated with a polygon are then fitted to one another, and the corresponding colors are combined according to a set of criteria in order to form a unique texture. The system produces 3D models and environments more suitable for realistic image synthesis and computer augmented reality.
KeywordsComputer Graphic Camera Parameter Realistic Image Synthesis High Dynamic Range Radiance Pattern Analysis Machine Intelligence
Unable to display preview. Download preview PDF.
- 1.P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In SIGGRAPH 96 Conference Proceedings, pages 11–20. August 1996.Google Scholar
- 2.P.E. Debevec and J. Malik. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH 97 Conference Proceedings, pages 369–378. August 1997.Google Scholar
- 3.O. Faugeras, S. Laveau, L. Robert, G. Csurka, and C. Zeller. 3D reconstruction of urban scenes from sequences of images. Tech. Report 2572, INRIA Sophia-Antipolis, May 1995.Google Scholar
- 4.O.D. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig? In Proceedings of Computer Vision (ECCV’ 92), pages 563–578, May 1992.Google Scholar
- 5.O. Faugeras. Three-dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 1993.Google Scholar
- 6.W.E.L. Grimson. From Images to Surfaces: A Computational Study of the Human Early Vision System. MIT Press, 1981.Google Scholar
- 8.P. Havaldar, M.-S. Lee, and G. Medioni. View synthesis from unregistered 2-D images. In Proceedings of Graphics Interface’ 96, pages 61–69, May 1996.Google Scholar
- 9.D.J. Heeger and J.R. Bergen. Pyramid-Based texture analysis/synthesis. In SIGGRAPH 95 Conference Proceedings, pages 229–238. August 1995.Google Scholar
- 10.F. Leymarie et al. Realise: Reconstruction of reality from image sequences. In International Conference on Image Processing, pages 651–654. September 1996. http://www.inria.fr/robotvis/projects/RealiseGoogle Scholar
- 13.J. Mundy and A. Zisserman, editors. Geometric Invariance in Computer Vision. MIT Press, Cambridge, Massachusetts, 1992.Google Scholar
- 14.W. Niem and H. Broszio. Mapping texture from multiple camera views onto 3D-object models for computer animation. In Proceedings of the International Workshop on Stereoscopic and Three Dimensional Imaging, September 1995.Google Scholar
- 16.http://www.photomodeler.comGoogle Scholar
- 17.W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery. Numerical Recipes in C: The Art of Scientific Computing (2nd ed.). Cambridge University Press, Cambridge, 1992.Google Scholar
- 18.D.F. Rogers and J.A. Adams. Mathematical Elements for Computer Graphics. McGraw-Hill, 1976.Google Scholar
- 19.Y. Sato, M.D. Wheeler, and K. Ikeuchi. Object shape and reflectance modeling from observation. In SIGGRAPH 97 Conference Proceedings, pages 379–387. August 1997.Google Scholar
- 20.J. Semple and G. Kneebone. Algebraic projective geometry. Oxford University Press, 1952.Google Scholar
- 21.S. Weik and O. Grau. Recovering 3-D object geometry using a generic constraint description. In ISPRS96 — 18th Congress of the International Society for Photogrammetry and Remote Sensing, July 1996.Google Scholar
- 22.L. Williams. Pyramidal parametrics. In Computer Graphics (SIGGRAPH’ 83 Proceedings), pages 1–11, July 1983.Google Scholar