Abstract
This paper presents a 3D (Three dimensional) video stabilization algorithm combined with a joint spatial and temporal strategy. On the temporal axis, SURF (Speeded-Up Robust Features) are extracted from the consecutive frames and then motion parameters are estimated, with which we calibrate and compensate the video frames after smoothing the motion parameters using Kalman filtering. Then, on the spatial axis, a histogram statistics method based on the extracted features is applied to detect the vertical parallax between the two views. Adjustments are implemented only when the parallax is larger than the safety threshold, which is conducted through subjective assessment, to maintain the consistency of 3D videos. The experimental results have shown that the proposed method is effective to reduce the vertical instability and inconsistency between binocular views and improve the quality and comfortableness of 3D videos.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gleicher, M.L., Liu, F.: Re-cinematography: improving the camera dynamics of casual video. In: International Conference on Multimedia, pp. 27–36. ACM (2007)
Liu, S., Yuan, L., Tan, P., et al.: SteadyFlow: spatially smooth optical flow for video stabilization. In: Computer Vision and Pattern Recognition, pp. 4209–4216. IEEE (2014)
Battiato, S., Gallo, G., Puglisi, G., et al.: SIFT features tracking for video stabilization. In: International Conference on Image Analysis and Processing, pp. 825–830 (2007)
Chen, Y.H., Lin, H.Y.S., Su, C.W.: Full-frame video stabilization via sift feature matching. In: Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing. IEEE (2014)
He, M., Huang, C., Xiao, C., et al.: Digital video stabilization based on hybrid filtering. In: International Congress on Image and Signal Processing, pp. 94–98. IEEE (2014)
Matsushita, Y., Ofek, E., Tang, X., et al.: Full-frame video stabilization. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005, CVPR 2005, vol. 1, pp. 50–57 (2005)
Yu, H., Zhang, W.: Moving camera video stabilization based on Kalman filter and least squares fitting. In: Intelligent Control and Automation. IEEE (2015)
Kooi, F.L., Toet, A.: Visual comfort of binocular and 3D displays. Displays 25(2–3), 99–108 (2004)
Liu, W.X., Chin, T.J.: Smooth globally warp locally: video stabilization using homography fields. In: International Conference on Digital Image Computing: Techniques and Applications. IEEE (2015)
Salunkhe, A.U., Jagtap, S.K.: A survey on an adaptive video stabilization with tone adjustment. In: International Conference on Computing Communication Control and Automation. IEEE (2015)
Liu, F., Niu, Y., Jin, H.: Joint subspace stabilization for stereoscopic video. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 73–80. IEEE (2013)
Goldstein, A., Fattal, R.: Video stabilization using epipolar geometry. ACM Trans. Graph. 32(5), 573–587 (2012)
Liu, S., Yuan, L., Tan, P., et al.: Bundled camera paths for video stabilization. ACM Trans. Graph. 32(4), 96 (2013)
Song, J., Ma, X.: A novel real-time digital video stabilization algorithm based on the improved diamond search and modified Kalman filter 91–95 (2015)
Pinto, B., Anurenjan, P.R.: Video stabilization using speeded up robust features. In: 2011 International Conference on Communications and Signal Processing (ICCSP), pp. 527–531. IEEE (2011)
Mayen, K., Espinoza, C., Romero, H., et al.: Real-time video stabilization algorithm based on efficient block matching for UAVs. In: The Workshop on Research, Education and Development of Unmanned Aerial Systems. IEEE (2015)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Acknowledgment
This work was supported in part by the National Natural Science Foundation of China, under Grants 61571285, and U1301257. The work is also supported by the 2016 peak discipline of filmology of Shanghai University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhou, J., You, Z., An, P., Wu, X., Du, T. (2017). A Joint Spatial-Temporal 3D Video Stabilization Algorithm. In: Yang, X., Zhai, G. (eds) Digital TV and Wireless Multimedia Communication. IFTC 2016. Communications in Computer and Information Science, vol 685. Springer, Singapore. https://doi.org/10.1007/978-981-10-4211-9_8
Download citation
DOI: https://doi.org/10.1007/978-981-10-4211-9_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-4210-2
Online ISBN: 978-981-10-4211-9
eBook Packages: Computer ScienceComputer Science (R0)