Abstract
Video text provides important clues for semantic-based video analysis, indexing and retrieval. And text tracking is performed to locate specific text information across video frames and enhance text segmentation and recognition over time. This paper presents a multilingual video text tracking algorithm based on the extraction and tracking of Scale Invariant Feature Transform (SIFT) features description through video frames. SIFT features are extracted from video frames to correspond the region of interests across frames. Meanwhile, a global matching method using geometric constraint is proposed to decrease false matches, which effectively improves the accuracy and stability of text tracking results. Based on the correct matches, the motion of text is estimated in adjacent frames and a match score of text is calculated to determine Text Change Boundary (TCB). Experimental results on a large number of video frames show that the proposed text tracking algorithm is robust to different text forms, including multilingual captions, credits, scene texts with shift, rotation and scale change, under complex backgrounds and light changing.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Battiato, S., Gallo, G., Puglisi, G.: SIFT Features Tracking for Video Stabilization. In: 14th International Conference on Image Analysis and Processing (2007)
Jung, K., Kim, K.I., Jain, A.K.: Text information extraction in images and video: a survey. Pattern Recognition 37, 977–977 (2004)
Lienhart, R.: Video OCR: A Survey and Practitioner’s Guide. In: Video Mining, pp. 155–184. Kluwer Academic Publisher, Dordrecht (2003)
Lienhart, R., Effelsberg, W.: Automatic Text Segmentation and Text Recognition for Video Indexing, Technical Report TR-98-009, Praktische Informatik IV, University of Mannheim (1998)
Antani, S., Gargi, U., Crandall, D., Gandhi, T., Kasturi, R.: Extraction of Text in Video, Technical Report of Department of Computer Science and Engineering, Penn. State University, CSE-99-016 (August 30, 1999)
Gargi, U., Crandall, D., Antani, S., Gandhi, T., Keener, R., Kasturi, R.: A System for Automatic Text Detection in Video. In: Proc. of International Conference on Document Analysis and Recognition, pp. 29–32 (1999)
Nakajima, Y., Yoneyama, A., Yanagihara, H., Sugano, M.: Moving Object Detection from MPEG Coded Data. In: Proc. of SPIE, vol. 3309, pp. 988–996 (1998)
Pilu, M.: On Using Raw MPEG Motion Vectors to Determine Global Camera Motion. In: Proc. of SPIE, vol. 3309, pp. 448–459 (1998)
Li, H., Kia, O., Doermann, D.: Text Enhancement in Digital Video. In: Proc. of SPIE, Document Recognition IV, pp. 1–8 (1999)
Shi, J., Luo, X., Zhang, J.: DCT Feature Based Text Capturing and Tracking. In: Chinese Conference on Pattern Recognition, pp. 294–297 (2009)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Na, Y., Wen, D. (2010). An Effective Video Text Tracking Algorithm Based on SIFT Feature and Geometric Constraint. In: Qiu, G., Lam, K.M., Kiya, H., Xue, XY., Kuo, CC.J., Lew, M.S. (eds) Advances in Multimedia Information Processing - PCM 2010. PCM 2010. Lecture Notes in Computer Science, vol 6297. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15702-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-15702-8_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15701-1
Online ISBN: 978-3-642-15702-8
eBook Packages: Computer ScienceComputer Science (R0)