Abstract
3D models are an essential part of computer graphics applications such as games, movie special effects, urban and landscape design, architecture, virtual heritage, visual impact studies, and virtual environments such as Second Life. We have developed a novel technique which allows the construction of 3D models using image sequences acquired by a handheld low-cost digital camera. In contrast to alternative technologies, such as laser scanners, structured lighting, and sets of calibrated cameras, our approach can be used by everyone having access to a consumer-level camera. The user only has to create a set of images from different view directions, input them into our algorithm, and a 3D model is returned. We use a novel combination of advanced computer vision algorithms for feature detection, feature matching, and projection matrix estimation in order to reconstruct a 3D point cloud representing the location of geometric features estimated from input images. In a second step a full 3D model is reconstructed using the projection matrix and a triangulation process. We tested our algorithm using a variety of data sets of objects of different scales acquired under different weather and lighting conditions. The results show that our algorithm is stable and enables inexperienced users to easily create complex 3D content using a simple consumer level camera.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yang, R., Wünsche, B.C.: Life-sketch: a framework for sketch-based modelling and animation of 3d objects. In: Proceedings of the Eleventh Australasian Conference on User Interface, AUIC 2010, vol. 106, pp. 61–70. Australian Computer Society, Inc. (2010), http://www.cs.auckland.ac.nz/~burkhard/Publications/AUIC2010_YangWuensche.pdf
Zhang, R., Tsai, P.S., Cryer, J.E., Shah, M.: Shape from shading: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 21, 690–706 (1999)
Matusik, W., Buehler, C., Raskar, R., Gortler, S.J., McMillan, L.: Image-based visual hulls. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2000, pp. 369–374. ACM Press/Addison-Wesley Publishing Co., New York (2000)
Franco, J.S., Lapierre, M., Boyer, E.: Visual shapes of silhouette sets. In: International Symposium on 3D Data Processing Visualization and Transmission, pp. 397–404 (2006)
David Fofi, T.S., Voisin, Y.: A comparative survey on invisible structured light. In: Proceedings of SPIE, vol. 5303, pp. 90–98 (2004)
Zollhöfer, M., Martinek, M., Greiner, G., Stamminger, M., Süßmuth, J.: Automatic reconstruction of personalized avatars from 3d face scans. Comput. Animat. Virtual Worlds 22, 195–202 (2011)
Brown, M., Lowe, D.G.: Unsupervised 3d object recognition and reconstruction in unordered datasets. In: Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, pp. 56–63. IEEE Computer Society, Washington, DC (2005)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 835–846 (2006)
Schaffalitzky, F., Zisserman, A.: Multi-View Matching for Unordered Image Sets, or How Do I Organize My Holiday Snaps? In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 414–431. Springer, Heidelberg (2002)
Schaffalitzky, F., Zisserman, A.: Automated location matching in movies. Comput. Vis. Image Underst. 92, 236–264 (2003)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1996, pp. 11–20. ACM, New York (1996)
Martinec, D., Pajdla, T.: 3d reconstruction by gluing pair-wise euclidean reconstructions, or ”how to achieve a good reconstruction from bad images”. In: Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT 2006), 3DPVT 2006, pp. 25–32. IEEE Computer Society, Washington, DC (2006), http://cmp.felk.cvut.cz/~martid1/articles/Martinec-3DPVT2006.pdf
Hua, S., Liu, T.: Realistic 3d reconstruction from two uncalibrated views. International Journal of Computer Science and Network Security 7, 178–183 (2007)
Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. International Journal of Computer Vision 40, 123–148 (2000)
Cazals, F., Giesen, J.: Delaunay triangulation based surface reconstruction: Ideas and algorithms. In: Effective Computational Geometry for Curves and Surfaces, pp. 231–273. Springer, Heidelberg (2006)
Amenta, N., Bern, M.: Surface reconstruction by voronoi filtering. In: Proceedings of the Fourteenth Annual Symposium on Computational Geometry, SCG 1998, pp. 39–48. ACM, New York (1998)
Edelsbrunner, H., Mücke, E.P.: Three-dimensional alpha shapes. ACM Trans. Graphics 13, 43–72 (1994)
Amenta, N., Choi, S., Kolluri, R.K.: The power crust. In: Proceedings of the Sixth ACM Symposium on Solid Modeling and Applications, SMA 2001, pp. 249–266. ACM, New York (2001)
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points. SIGGRAPH Comput. Graph. 26, 71–78 (1992)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP 2006, pp. 61–70. Eurographics Association, Aire-la-Ville (2006)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference, pp. 147–151 (1988)
Derpanis, K.G.: The harris corner detector (2004), http://www.cse.yorku.ca/~kosta/CompVis_Notes/harris_detector.pdf
Muyun, W., Mingyi, H.: Image feature detection and matching based on susan method. In: Proceedings of the First International Conference on Innovative Computing, Information and Control, ICICIC 2006, vol. 1, pp. 322–325. IEEE Computer Society, Washington, DC (2006)
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, ICCV 1999, vol. 2, p. 1150. IEEE Computer Society, Washington, DC (1999)
Hu, S., Qiao, J., Zhang, A., Huang, Q.: 3d reconstruction from image sequence taken with a handheld camera. In: International Society for Photogrammetry and Remote Sensing, Congress Beijing 2008, Proceedings of Commission IV, pp. 559–562 (2008), http://www.isprs.org/proceedings/XXXVII/congress/4_pdf/99.pdf
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004)
Zhang, J., Boutin, M., Aliaga, D.G.: Robust bundle adjustment for structure from motion. In: Proceedings of IEEE International Conference on Image Processing, pp. 2185–2188 (2006)
Betexa, Z.S. s.r.o.: The prague castle, paper model of the biggest castle complex in the world. Scale 1:450 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, M.H., Wünsche, B., Delmas, P., Lutteroth, C. (2013). Modelling of 3D Objects Using Unconstrained and Uncalibrated Images Taken with a Handheld Camera. In: Csurka, G., Kraus, M., Mestetskiy, L., Richard, P., Braz, J. (eds) Computer Vision, Imaging and Computer Graphics. Theory and Applications. VISIGRAPP 2011. Communications in Computer and Information Science, vol 274. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32350-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-32350-8_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32349-2
Online ISBN: 978-3-642-32350-8
eBook Packages: Computer ScienceComputer Science (R0)