Handwritten Notes as a Visual Interface to Index, Edit and Publish Audio/Video Highlights

  • Anselm Spoerri
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2539)


Digital libraries aim to make media-rich information accessible to “anyone, anywhere, anytime.” However, digital audio and video are difficult to search and share. This paper describes Souvenir, a system which enables people to use their handwritten or text notes to retrieve and share specific media moments. Souvenir enables users to take time-stamped notes on a variety of devices, such as the paper-based CrossPad, the Palm Pilot and standard keyboard devices. Souvenir can segment unstructured handwriting into an effective media index without the need for handwriting recognition. People can use their notes to create hyperlinks to random-access media stored in digital libraries. Souvenir has also web publishing and email capabilities to enable anyone to access or email media moments directly from a web page. This paper presents an overview of Souvenir’s functionality and describes its handwriting segmentation as well as note and media synchronization algorithms.


Digital Library Digital Medium Specific Moment Digital Audio Text Note 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abowd, G. D., Atkeson, C. G., Brotherton, J. A., Enqvist, T., Gulley, P., and LeMon, J. “Investigating the Capture, Integration and Access Problem of Ubiquitous Computing in an Educational Setting,” Proc. of CHI’ 98 (April 1998), ACM Press, 440–447.Google Scholar
  2. 2.
    Brotherton, J. A., Bhalodia, J. R. and Abowd, G. D. “Automated Capture, Integration, and Visualization of Multiple Media Streams,” Proc. of IEEE Multimedia’ 98, July, 1998.Google Scholar
  3. 3.
    Chiu, P. and Wilcox, L. “A Dynamic Grouping Technique for Ink and Audio,” Symposium on User Interface Software and Technology’ 98, (San Francisco, Nov 1998), 195–202.Google Scholar
  4. 4.
    Cruz, G. and R. Hill. “Capturing and Playing Multimedia Events with STREAMS”, Proc. of ACM Multimedia’ 94, October 1994, pp. 193–200.Google Scholar
  5. 5.
    Moran, T. P., Palen, L., Harrison, S., Chiu, P., Kimber, D., Minneman, S., van Melle, W., and Zelweger, P. “‘I’ll Get That Off the Audio,’: A Case Study of Salvaging Multimedia Meeting Records,” Proc. of CHI’ 97 (Atlanta, April 1997), ACM Press, 202–209.Google Scholar
  6. 6.
    Stifelman, L. J. “Augmenting Real-World Objects: A Paper-Based Audio Notebook,” Proc. of CHI’ 96 (Vancouver, Canada, April 1996), ACM Press, 199–200.Google Scholar
  7. 7.
    Truong, K. N. and Abowd, G. D. “StuPad: Integrating Student Notes with Class Lectures,” Proceedings of CHI’ 99, (Pittsburgh, May 1999), ACM Press, Volume 2, 208–209.CrossRefGoogle Scholar
  8. 8.
    Weber, K., and Poon, A. “Marquee: A Tool for Real-Time Video Logging,” Proc. of CHI’ 94 (Boston, April 1994), ACM Press, 58–64.Google Scholar
  9. 9.
    Wactlar, H., Kanade, T., Smith, M., and Stevens, S. “Intelligent Access to Digital Video: The Informedia Project.” IEEE Computer, Vol. 29, No.5, May 1996.Google Scholar
  10. 10.
    Whittaker, S., Hyland, P., and Wiley, M. “Filochat: Handwritten Notes Provide Access to Recorded Conversations,” Proc. of CHI’ 94 (Boston, April 1994), ACM Press, 271–277.Google Scholar
  11. 11.
    Wilcox, L., Schilit, B. and Sawhney, N. “Dynomite: A Dynamically Organized Ink and Audio Notebook,” Proc. of CHI’ 97 (Atlanta, April 1997), ACM Press, 186–193.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Anselm Spoerri
    • 1
  1. 1.School of Communication, Information & Library StudiesRutgers UniversityNew BrunswickUSA

Personalised recommendations