Attention Monitoring for Music Contents Based on Analysis of Signal-Behavior Structures
In this paper, we propose a method to estimate user attention to displayed content signals with temporal analysis of their exhibited behavior. Detecting user attention and controlling contents are key issues in our “networked interaction therapy system” that effectively attracts the attention of memory-impaired people. In our proposed method, user behavior, including body motions (beat actions), is detected with auditory/vision-based methods. This design is based on our observations of the behavior of memory-impaired people under video watching conditions. User attention to the displayed content is then estimated based on body motions synchronized to auditorial signals. Estimated attention levels can be used for content control to attract deeper attention of viewers to the display system. Experimental results suggest that the proposed method effectively extracts user attention to musical signals.
KeywordsUser Behavior Video Content User Motion Music Signal User Attention
Unable to display preview. Download preview PDF.
- 1.Boiman, O., Irani, M.: Detecting irregularities in images and in video. In: Proceedings of International Conference on Computer Vision, pp. 462–469 (2005)Google Scholar
- 2.Osawa, T., Wu, X., Wakabayashi, K., Yasuno, T.: Human tracking by particle filtering using full 3d model of both target and environment. In: Porceedings of International Conference on Pattern Recognition, pp. 25–28 (2006)Google Scholar
- 3.Kuwahara, N., Kuwabara, K., Utsumi, A., Yasuda, K., Tetsutani, N.: Networked interaction therapy: Relieving stress in memory-impaired people and their family members. In: Proc. of IEEE Engineering in Medicine and Biology Society, IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
- 5.Kuwahara, N., Kuwabara, K., Tetsutani, N., Yasuda, K.: Reminiscence video - helping at-home caregivers of people with dementia. In: HOIT 2005, pp. 145–154 (2005)Google Scholar
- 10.Lim, J., Kriegman, D.: Tracking humans using prior and learned representations of shape and appearance. In: Proc. of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 869–874. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
- 11.Widrow, B., Hoff, M.E.: Adaptive switching circuit, 96–104 (1960)Google Scholar