Abstract
This paper describes a framework which exploits the use of computer animation to evaluate the performance of tracking algorithms. This can be achieved in two different, complementary strategies. On the one hand, augmented reality allows to gradually increasing the scene complexity by adding virtual agents into a real image sequence. On the other hand, the simulation of virtual environments involving autonomous agents provides with synthetic image sequences. These are used to evaluate several difficult tracking problems which are under research nowadays, such as performance processing long–time runs and the evaluation of sequences containing crowds of people and numerous occlusions. Finally, a general event–based evaluation metric is defined to measure whether the agents and actions in the scene given by the ground truth were correctly tracked by comparing two event lists. This metric is suitable to evaluate different tracking approaches where the underlying algorithm may be completely different.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aguilera, J., Wildenauer, H., Kampel, M., Borg, M., Thirde, D., Ferryman, J.: Evaluation of motion segmentation quality for aircraft activity surveillance. In: ICCCN 2005, Washington, DC, USA, pp. 293–300 (2005)
Baiget, P., Soto, J., Roca, X., Gonzàlez, J.: Automatic generation of computer animated sequences based on human behavior modeling. In: 10th International Conference in Computer Graphics and Artificial Intelligence, Athens, Greece (2007)
Bashir, F., Porikli, F.: Performance evaluation of object detection and tracking systems. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS) (2006)
Conde, T., Thalmann, D.: Autonomous virtual agents learning a cognitive model and evolving. In: Intelligent Virtual Agents, pp. 88–98 (2005)
Desurmont, X., Sebbe, R., Martin, F., Machy, C., Delaigle, J.-F.: Performance evaluation of frequent events detection systems. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS) (2006)
Gonzàlez, J., Roca, F.X., Villanueva, J.J.: Hermes: A research project on human sequence evaluation. In: Computational Vision and Medical Image Processing (VipIMAGE 2007), Porto, Portugal (2007)
Haag, M., Nagel, H.-H.: Incremental recognition of traffic situations from video image sequences. Image and Vision Computing 18(2), 137–153 (2000)
Varona-, J., Roca, F.X., Gonzàlez, J., Rowe, D.: Understanding dynamic scenes based on human sequence evaluation. Image and Vision Computing
Mozerov, M., Amato, A., Al Haj, M., Gonzàlez, J.: A simple method of multiple camera calibration for the joint top view projection. In: 5th International Conference on Computer Recognition Systems, Wroclaw, Poland (2007)
Nagel, H.-H.: From image sequences towards conceptual descriptions. Image and Vision Computing 6(2), 59–74 (1988)
Nghiem, A.T., Bremond, F., Thonnat, M., Ma, R.: A new evaluation approach for video processing algorithms. In: Motion 2007, p. 15 (2007)
Rowe, D., Huerta, I., Gonzàlez, J., Villanueva, J.J.: Robust multiple-people tracking using colour-based particle filters. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 113–120. Springer, Heidelberg (2007)
Tambellini, W., Conde, T., Thalmann, D.: Behavioral animation of autonomous virtual agents helped by reinforcement. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 175–180. Springer, Heidelberg (2003)
CAVIAR: Context Aware Vision using Image-based Active Recognition. Ec’s information society technology, http://homepages.inf.ed.ac.uk/rbf/CAVIAR/
Wu, B., Nevatia, R.: Tracking of multiple, partially occluded humans based on static body part detection. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, pp. 951–958. IEEE Computer Society, Los Alamitos (2006)
Young, D.P., Ferryman, J.M.: Pets metrics: On-line performance evaluation service. In: 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, October 15-16, 2005, pp. 317–324 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baiget, P., Roca, X., Gonzàlez, J. (2008). Autonomous Virtual Agents for Performance Evaluation of Tracking Algorithms. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2008. Lecture Notes in Computer Science, vol 5098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70517-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-70517-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70516-1
Online ISBN: 978-3-540-70517-8
eBook Packages: Computer ScienceComputer Science (R0)