Abstract
Mosaicing is a classical application of image registration where images from the same scene are stitched together to generate a larger seamless image. This paper presents a real-time incremental mosaicing method that generates 2D mosaics by stitching video key-frames as soon as they are detected. The contributions are three-fold: (1) we propose a “fast” key-frame selection procedure based solely on the distribution of the distance of matched feature descriptors. This procedure automatically selects key-frames that are used to expand the mosaics while achieving real-time performance; (2) we register key-frame images by using a non-rigid deformation model in order to “smoothly” stitch images when scene transformations can not be expressed by homography: (3) we add a new constraint on the non-rigid deformation model that penalizes over-deformation in order to create “visually natural” mosaics. The performance of the proposed method was validated by experiments in non-controlled conditions and by comparison with the state-of-the-art method.
Chapter PDF
Similar content being viewed by others
References
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. International Journal of Computer Vision 74, 59–73 (2007)
Can, A., Stewart, C.V., Roysam, B., Tanenbaum, H.L.: A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: application to mosaicing the curved human retina. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 585–591 (2000)
Chaiyasarn, K., Kim, T.-K., Viola, F., Cipolla, R., Soga, K.: Image mosaicing via quadric surface estimation with priors for tunnel inspection. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 537–540 (2009)
Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding 89(2-3), 114–141 (2003)
Crispell, D., Mundy, J., Taubin, G.: Parallax-free registration of aerial video. In: Proc. British Machine Vision Conf. (2008)
Deng, Y., Zhang, T.: Generating panorama photos. In: Proc. of SPIE Internet Multimedia Management Systems IV (2003)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)
Hsu, S., Sawhney, H.S., Kumar, R.: Automated mosaics via topology inference. IEEE Computer Graphics and Applications 22(2), 44–54 (2002)
Peleg, S., Rousso, B., Rav-Acha, A., Zomet, A.: Mosaicing on adaptive manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1144–1154 (2000)
Pilet, J., Lepetit, V., Fua, P.: Real-time non-rigid surface detection. In: Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 822–828 (2005)
Sawhney, H.S., Hsu, S., Kumar, R.: Robust Video Mosaicing Through Topology Inference and Local to Global Alignment. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 103–119. Springer, Heidelberg (1998)
Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trends. Comput. Graph. Vis. 2, 1–104 (2006)
Zhu, J., Lyu, M.R., Huang, T.S.: A fast 2d shape recovery approach by fusing features and appearance. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 1210–1224 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Castanheira de Souza, R.H., Okutomi, M., Torii, A. (2011). Real-Time Image Mosaicing Using Non-rigid Registration. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7087. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25367-6_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-25367-6_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25366-9
Online ISBN: 978-3-642-25367-6
eBook Packages: Computer ScienceComputer Science (R0)