Automatic Summarization of Wearable Video - Indexing Subjective Interest -

Abstract

“We want to keep our entire life by video” is the motivation of this research. Recent development of wearable devices and huge storage devices will make it possible to keep entire life by video. We could capture 70 years of our life, however, the problem is how to handle such a huge data. Automatic summarization based on personal interest should be indispensable. In this paper we propose an approach to automatic structuring and summarization of wearable video. (Wearable video is our abbreviation of “video captured by a wearable camera”.) In our approach, we make use of a wearable camera and a sensor of brain waves. Video is firstly structured by objective features of video, and the shots are rated by subjective measures based on brain waves. The approach was very successful for real world experiments and it automatically extracted all the events that the subjects reported they had felt interesting.