Fast and Accurate Ground Truth Generation for Skew-Tolerance Evaluation of Page Segmentation Algorithms
- 691 Downloads
Many image segmentation algorithms are known, but often there is an inherent obstacle in the unbiased evaluation of segmentation quality: the absence or lack of a common objective representation for segmentation results. Such a representation, known as the ground truth, is a description of what one should obtain as the result of ideal segmentation, independently of the segmentation algorithm used. The creation of ground truth is a laborious process and therefore any degree of automation is always welcome. Document image analysis is one of the areas where ground truths are employed. In this paper, we describe an automated tool called GROTTO intended to generate ground truths for skewed document images, which can be used for the performance evaluation of page segmentation algorithms. Some of these algorithms are claimed to be insensitive to skew (tilt of text lines). However, this fact is usually supported only by a visual comparison of what one obtains and what one should obtain since ground truths are mostly available for upright images, that is, those without skew. As a result, the evaluation is both subjective; that is, prone to errors, and tedious. Our tool allows users to quickly and easily produce many sufficiently accurate ground truths that can be employed in practice and therefore it facilitates automatic performance evaluation. The main idea is to utilize the ground truths available for upright images and the concept of the representative square  in order to produce the ground truths for skewed images. The usefulness of our tool is demonstrated through a number of experiments with real-document images of complex layout.
KeywordsGround Truth Segmentation Algorithm Objective Representation Document Image Text Line
- 2.Antonacopoulos A, Brough A: Methodology for flexible and efficient analysis of the performance of page segmentation algorithms. Proc. 5th International Conference on Document Analysis and Recognition (ICDAR '99), September 1999, Bangalore, India 451–454.Google Scholar
- 5.Hobby JD: Matching document images with ground truth. International Journal on Document Analysis and Recognition 1998, 1(1):52–61.Google Scholar
- 11.Randriamasy S, Vincent L: Benchmarking page segmentation algorithms. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '94), June 1994, Seattle, Wash, USA 411–416.Google Scholar