Abstract
Automatic detection and description of events, particularly human behavior, is one of the most challenging issues, since event interpretation is highly dependent on the target of attention, which is not uniquely specified. In order to tackle this problem, we propose the concept of a “Cognitive Ontology” as a framework for a system that can automatically decide the attention focus and describe the events. A cognitive ontology is structured with conceptual units which are Entities and Relations, and these units enable robot endogenous attention fixation and jumps based on a networked Cognitive Ontology. In addition, we introduce exogenous attention fixation based on how the observed targets differ from a predicted pattern. In this process, the corresponding target of attention is updated and assigned to an event description buffer that consists of two Entities and one Relation. In this paper, we have developed and experimented with this holistic event interpretation process taking into account endogenous attention, exogenous attention and determined event description.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Zhai, Y., Shah, M.: Video scene segmentation using Markov chain Monte Carlo. IEEE Transactions on Multimedia 8(4), 686–697 (2006)
Radke, R.J., Andra, S., Al-Kofahi, O., Roysam, B.: Image change detection algorithms: a systematic survey. IEEE Transactions on Image Processing 14(3), 294–307 (2005)
Rav-Acha, A., Pritch, Y., Peleg, S.: Making a Long Video Short: Dynamic Video Synopsis. In: Proc. on Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference (CVPR), vol. 1, pp. 435–441 (2006)
Hongeng, S., Nevatia, R., Bremond, F.: Video-based event recognition: activity representation and probabilistic recognition methods. Computer Vision and Image Understanding 96(2), 129–162 (2004)
Cheng, F., Christmas, W.J., Kittler, J.: Detection and description of human running behaviour in sportsvideo multimedia database. In: Proceedings of 11th International Conference on Image Analysis and Processing, pp. 366–371 (2001)
Ngo, C.-W., Pong, T.-C., Zhang, H.-J.: On clustering and retrieval of video shots through temporal slices analysis. IEEE Transactions on Multimedia 4(4), 446–458 (2002)
Collins, R.T., et al.: A system for video surveillance and monitoring: VSAM final report, CMU-RI-TR-00-12, Technical Report, Carnegie Mellon University (2000)
Yu, X., Yang, S.X.: A study of motion recognition from video sequences. Computing and Visualization in Science archive 8(1) (2005)
Chen, G., Kotz, D.: A Survey of Context-Aware Mobile Computing Research. Dartmouth Computer Science Technical Report TR2000-381 (2000)
Dedeoglu, Y., Toreyin, B.U., Gudukbay, U., Cetin, A.E.: Real-Time Fire and Flame Detection in Video. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 2, pp. 669–672 (2005)
Silveira Jacques Jr., J.C., Braun, A., Soldera, J., Raupp Musse, S., Rosito Jung, C.: Understanding people motion in video sequences using Voronoi diagrams: Detecting and classifying groups. Pattern Analysis & Applications archive 10(4), 321–332 (2007)
Cavanagh, P., Labianca, A.T., Thornton, I.M.: Attention-based visual routines: sprites. Cognition 80, 47–60 (2001)
Itti, L., Koch, C.: Computational modelling of visual attention. Nature Reviews. Neuroscience, 194–203 (2001)
Demiris, Y., Khadhouri, B.: Hierarchical attentive multiple models for execution and recognition of actions. Robotics and Autonomous Systems 54(5), 361–369 (2006)
Walther, D., Rutishauser, U., Koch, C., Perona, P.: Selective visual attention enables learning and recognition of multiple objects in cluttered scenes. Computer Vision and Image Understanding 100(1-2), 41–63 (2005)
John, P.: Biopsychology, 5th edn. Pearson, London (2005)
Sowa, J.: Distinction, combination, and constraints. In: Proc. of IJCAI 1995 Workshop on Basic Ontological Issues in Knowledge Sharing (1995)
Cutler, R., Davis, L.S.: Robust real-time periodic motion detection, analysis, and applications. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(8), 781–796 (2000)
Mohan, A., Papageorgiou, C., Poggio, T.: Example-based object detection in images by components. IEEE Trans. on Pattern Recognition and Machine Intelligence 23(4), 349–361 (2001)
Ioffe, S., Forsyth, D.: Probabilistic methods for finding people. International Journal of Computer Vision 43(1), 45–68 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wakuda, Y., Sekiyama, K., Fukuda, T. (2009). Cognitive Ontology: A Concept Structure for Dynamic Event Interpretation and Description from Visual Scene. In: Asama, H., Kurokawa, H., Ota, J., Sekiyama, K. (eds) Distributed Autonomous Robotic Systems 8. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00644-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-00644-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00643-2
Online ISBN: 978-3-642-00644-9
eBook Packages: EngineeringEngineering (R0)