Abstract
In this work, a method that synchronizes two video sequences is proposed. Unlike previous methods, which require the existence of correspondences between features tracked in the two sequences, and/or that the cameras are static or jointly moving, the proposed approach does not impose any of these constraints. It works when the cameras move independently, even if different features are tracked in the two sequences. The assumptions underlying the proposed strategy are that the intrinsic parameters of the cameras are known and that two rigid objects, with independent motions on the scene, are visible in both sequences. The relative motion between these objects is used as clue for the synchronization. The extrinsic parameters of the cameras are assumed to be unknown. A new synchronization algorithm for static or jointly moving cameras that see (possibly) different parts of a common rigidly moving object is also proposed. Proof-of-concept experiments that illustrate the performance of these methods are presented, as well as a comparison with a state-of-the-art approach.
Chapter PDF
Similar content being viewed by others
Keywords
- Video Sequence
- Intrinsic Parameter
- Epipolar Geometry
- Synchronization Algorithm
- Homogeneous Transformation
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bouguet, J.: Camera Calibration Toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/
Caspi, Y., Irani, M.: Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(11), 1409–1424 (2002)
Crassidis, J., Markley, F., Cheng, Y.: Survey of nonlinear attitude estimation methods. Journal of Guidance, Control, and Dynamics 30(1), 12–28 (2007)
Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2790–2797 (2009)
Golub, G.H., Loan, C.F.V.: Matrix Computations, 3rd edn., vol. 1. JHU Press (1996)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004)
Horaud, R., Dornaika, F.: Hand-eye calibration. The International Journal of Robotics Research 14(3), 195–210 (1995)
Kanade, T., Morris, D.: Factorization methods for structure from motion. Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 356, 1153–1173 (1998)
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(1), 171–184 (2013)
Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial & Applied Mathematics 11(2), 431–441 (1963)
Meyer, B., Stich, T., Magnor, M., Pollefeys, M.: Subframe temporal alignment of non-stationary cameras. In: British Machine Vision Conference (2008)
Murray, R., Li, Z., Sastry, S.: A Mathematical Introduction to Robotic Manipulation, 1st edn. CRC Press, Inc. (1994)
Ozden, K.E., Schindler, K., Van Gool, L.: Multibody structure-from-motion in practice. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(6), 1134–1141 (2010)
Schönemann, P.: A generalized solution of the orthogonal procrustes problem. Psychometrika 31(1), 1–10 (1966)
Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (June 1994)
Sinha, S.N., Pollefeys, M.: Synchronization and calibration of camera networks from silhouettes. In: International Conference on Pattern Recognition, vol. 1, pp. 116–119 (August 2004)
Stewénius, H., Engels, C., Nistér, D.: Recent developments on direct relative orientation. Journal of Photogrammetry and Remote Sensing 60(4), 284–294 (2006)
Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Buxton, B., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 709–720. Springer, Heidelberg (1996)
Tomasi, C.: Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision 9, 137–154 (1992)
Tresadern, P., Reid, I.: Synchronizing image sequences of non-rigid objects. In: British Machine Vision Conference, pp. 629–638 (2003)
Tuytelaars, T., Van Gool, L.: Synchronizing video sequences. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 762–768 (June 2004)
Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002)
Yan, J., Pollefeys, M.: Video synchronization via space-time interest point distribution. Advanced Concepts for Intelligent Vision Systems (2004)
Yilma, A., Shah, M.: Recognizing human actions in videos acquired by uncalibrated moving cameras. In: IEEE International Conference on Computer Vision, vol. 1, pp. 150–157 (October 2005)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)
Zhou, C., Tao, H.: Dynamic depth recovery from unsynchronized video streams. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 351–358 (June 2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Gaspar, T., Oliveira, P., Favaro, P. (2014). Synchronization of Two Independently Moving Cameras without Feature Correspondences. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8689. Springer, Cham. https://doi.org/10.1007/978-3-319-10590-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-10590-1_13
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10589-5
Online ISBN: 978-3-319-10590-1
eBook Packages: Computer ScienceComputer Science (R0)