Abstract
Localization metrics permit to quantify the correctness of object detection in an image interpretation result. This paper deals with the definition of a protocol in order to evaluate the behavior of localization metrics. We first define some properties that metrics should verify and create a synthetic database that enables to verify those properties on different metrics. After presenting the tested localization metrics, the results obtained following the proposed protocol are exposed. Finally, some conclusions and perspectives are given.
Chapter PDF
References
Everingham, M., Zisserman, A., Williams, C., Van Gool, L., Allan, M., Bishop, C., Chapelle, O., Dalal, N., Deselaers, T., Dorko, G., et al.: The 2005 pascal visual object classes challenge (2005)
D’Angelo, E., Herbin, S., Ratiéville, M.: Robin challenge evaluation principles and metrics (2006)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: 8th Int’l Conf. Computer Vision, pp. 416–423 (2001)
Odet, C., Belaroussi, B., Benoit-Cattin, H. (eds.): Scalable Discrepancy Measures for Segmentation Evaluation, vol. 1 (2002)
Pratt, W., Faugeras, O.D., Gagalowicz, A.: Visual discrimination of stochastic texture fields. IEEE Transactions on Systems, Man, and Cybernetics 8(11), 796–804 (1978)
Yasnoff, W.A., Mui, J.K., Bacus, J.W.: Error measures for scene segmentation. Pattern Recognition 9, 217–231 (1977)
Baddeley, A.J.: An error metric for binary images. Robust Computer Vision, 59–78 (1992)
Chabrier, S.: Contribution à l’évaluation de performances en segmentation d’images. PhD thesis, Université d’Orléans (2005)
Wilson, D.L., Baddeley, A.J., Owens, R.A.: A new metric for grey-scale image comparison. International Journal of Computer Vision 24(1), 5–17 (1997)
Henricsson, O., Baltsavias, E.: 3-d building reconstruction with aruba: A qualitative and quantitative evaluation. In: Automatic Extraction of Man-Made Objects from Aerial and Space Images (II), pp. 65–76 (1997)
Coquin, D., Bolon, P., Chehadeh, Y.: Evaluation quantitative d’images filtrées. In: GRETSI 1997, vol. 2, pp. 1351–1354 (1997)
Basseville, M.: Distance measures for signal processing and pattern recognition. Signal Processing 18(4), 349–369 (1989)
Huang, Q., Dom, B.: Quantitative methods of evaluating image segmentation. In: International Conference on Image Processing (ICIP 1995), Washington DC, USA, vol. 3, pp. 53–56 (1995)
Peli, T., Malah, D.: A study of edge detection algorithms. Comp. Graphics Image (1982)
Hafiane, A.: Caractérisation de textures et segmentation pour la recherche d’images par le contenu. PhD thesis, Université de Paris-Sud XI (2005)
Hafiane, A., Chabrier, S., Rosenberger, C., Laurent, H.: A new supervised evaluation criterion for region based segmentation methods. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 439–448. Springer, Heidelberg (2007)
Vinet, L.: Segmentation et mise en correspondance de régions de paires d’images stéréoscopiques. PhD thesis, Université de Paris IX Dauphine (1991)
Cocquerez, J.P., Philipp, S.: Analyse d’Images: filtrage et segmentation. Masson (1995)
Beauchemin, M., Thomson, K.B., Edwards, G.: On the hausdorff distance used for the evaluation of segmentation results. Canadian Journal of Remote Sensing 24(1), 3–8 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hemery, B., Laurent, H., Rosenberger, C., Emile, B. (2008). Evaluation Protocol for Localization Metrics. In: Elmoataz, A., Lezoray, O., Nouboud, F., Mammass, D. (eds) Image and Signal Processing. ICISP 2008. Lecture Notes in Computer Science, vol 5099. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69905-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-540-69905-7_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69904-0
Online ISBN: 978-3-540-69905-7
eBook Packages: Computer ScienceComputer Science (R0)