Handwritten Notes as a Visual Interface to Index, Edit and Publish Audio/Video Highlights
- 719 Downloads
Digital libraries aim to make media-rich information accessible to “anyone, anywhere, anytime.” However, digital audio and video are difficult to search and share. This paper describes Souvenir, a system which enables people to use their handwritten or text notes to retrieve and share specific media moments. Souvenir enables users to take time-stamped notes on a variety of devices, such as the paper-based CrossPad, the Palm Pilot and standard keyboard devices. Souvenir can segment unstructured handwriting into an effective media index without the need for handwriting recognition. People can use their notes to create hyperlinks to random-access media stored in digital libraries. Souvenir has also web publishing and email capabilities to enable anyone to access or email media moments directly from a web page. This paper presents an overview of Souvenir’s functionality and describes its handwriting segmentation as well as note and media synchronization algorithms.
KeywordsDigital Library Digital Medium Specific Moment Digital Audio Text Note
Unable to display preview. Download preview PDF.
- 1.Abowd, G. D., Atkeson, C. G., Brotherton, J. A., Enqvist, T., Gulley, P., and LeMon, J. “Investigating the Capture, Integration and Access Problem of Ubiquitous Computing in an Educational Setting,” Proc. of CHI’ 98 (April 1998), ACM Press, 440–447.Google Scholar
- 2.Brotherton, J. A., Bhalodia, J. R. and Abowd, G. D. “Automated Capture, Integration, and Visualization of Multiple Media Streams,” Proc. of IEEE Multimedia’ 98, July, 1998.Google Scholar
- 3.Chiu, P. and Wilcox, L. “A Dynamic Grouping Technique for Ink and Audio,” Symposium on User Interface Software and Technology’ 98, (San Francisco, Nov 1998), 195–202.Google Scholar
- 4.Cruz, G. and R. Hill. “Capturing and Playing Multimedia Events with STREAMS”, Proc. of ACM Multimedia’ 94, October 1994, pp. 193–200.Google Scholar
- 5.Moran, T. P., Palen, L., Harrison, S., Chiu, P., Kimber, D., Minneman, S., van Melle, W., and Zelweger, P. “‘I’ll Get That Off the Audio,’: A Case Study of Salvaging Multimedia Meeting Records,” Proc. of CHI’ 97 (Atlanta, April 1997), ACM Press, 202–209.Google Scholar
- 6.Stifelman, L. J. “Augmenting Real-World Objects: A Paper-Based Audio Notebook,” Proc. of CHI’ 96 (Vancouver, Canada, April 1996), ACM Press, 199–200.Google Scholar
- 8.Weber, K., and Poon, A. “Marquee: A Tool for Real-Time Video Logging,” Proc. of CHI’ 94 (Boston, April 1994), ACM Press, 58–64.Google Scholar
- 9.Wactlar, H., Kanade, T., Smith, M., and Stevens, S. “Intelligent Access to Digital Video: The Informedia Project.” IEEE Computer, Vol. 29, No.5, May 1996.Google Scholar
- 10.Whittaker, S., Hyland, P., and Wiley, M. “Filochat: Handwritten Notes Provide Access to Recorded Conversations,” Proc. of CHI’ 94 (Boston, April 1994), ACM Press, 271–277.Google Scholar
- 11.Wilcox, L., Schilit, B. and Sawhney, N. “Dynomite: A Dynamically Organized Ink and Audio Notebook,” Proc. of CHI’ 97 (Atlanta, April 1997), ACM Press, 186–193.Google Scholar