Abstract
In accessing large collections of digitized videos, it is often difficult to find both the appropriate video file and the portion of the video that is of interest. This paper describes a novel technique for determining keyframes that are different from each other and provide a good representation of the whole video. We use keyframes to distinguish videos from each other, to summarize videos, and to provide access points into them. The technique can determine any number of keyframes by clustering the frames in a video and by selecting a representative frame from each cluster. Temporal constraints are used to filter out some clusters and to determine the representative frame for a cluster. Desirable visual features can be emphasized in the set of keyframes. An application for browsing a collection of videos makes use of the keyframes to support skimming and to provide visual summaries.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
J. Boreczky and L. Rowe, “Comparison of video shot boundary detection techniques,” in Storage and Retrieval for Still Image and Video Databases IV, Proc. SPIE 2670, San Jose, CA, 1996, pp. 170-179.
A.M. Ferman and A.M. Tekalp, “Multiscale content extraction and representation for video indexing,” in Multimedia Storage and Archiving Systems II, Proc. SPIE 3229, Dallas, TX, 1997, pp. 23-31.
A. Girgensohn, J. Boreczky, L. Wilcox, and J. Foote, “Facilitating video access by visualizing automatic analysis,” in Human-Computer Interaction INTERACT '99, 1999, IOS Press, pp. 205-212.
A. Girgensohn and J. Foote, “Video classification using transform coefficients,” in Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (Phoenix, AZ), 1999, Vol. 6, pp. 3045–3048.
B. Günsel, Y. Fu, and A.M. Tekalp, “Hierarchical temporal video segmentation and content characterization,” in Multimedia Storage and Archiving Systems II, Proc. SPIE 3229, Dallas, TX, 1997, pp. 46-56.
E. Rasmussen, “Clustering algorithms”, in Information Retrieval: Data Structures and Algorithms, W.B. Frakes and R. Baeza-Yates (Eds.), Prentice Hall, 1992, pp. 419-442.
X. Sun, M.S. Kankanhalli, Y. Zhu, and J. Wu, “Content-based representative frame extraction for digital video,” 1998 IEEE Conference of Multimedia Computing and Systems, Austin TX, 1998, pp. 190-193.
Y. Taniguchi, A. Akutsu, and Y. Tonomura, “Panorama Excerpts: Extracting and packing panoramas for video browsing,” in Proc. ACM Multimedia 97, Seattle, WA, 1997, pp. 427-436.
Y. Tonomura, A. Akutsu, K. Otsuji, and T. Sadakata, “VideoMAP and VideoSpaceIcon: Tools for anatomizing video content,” in INTERCHI '93 Conference Proceedings, 1993, ACM Press, pp. 131-141.
H. Ueda, T. Miyatake, and S. Yoshizawa, “An interactive natural-motion-picture dedicated multimedia authoring system,” in CHI '91 Conference Proceedings, 1991, ACM Press, pp. 343-350.
M.M. Yeung, B.L. Yeo, W. Wolf, and B. Liu, “Video browsing using clustering and scene transitions on compressed sequences,” in SPIE Vol. 2417 Multimedia Computing and Networking 1995, 1995, pp. 399-413.
H.J. Zhang, C.Y. Low, S.W. Smoliar, and J.H. Wu, “Video parsing, retrieval and browsing: An integrated and content-based solution,” ACM Multimedia 95, San Francisco, CA, 1995, pp. 15-24.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Girgensohn, A., Boreczky, J. Time-Constrained Keyframe Selection Technique. Multimedia Tools and Applications 11, 347–358 (2000). https://doi.org/10.1023/A:1009630817712
Issue Date:
DOI: https://doi.org/10.1023/A:1009630817712