Abstract
In this chapter, we will review the related work on symbol spotting which has been done in the last years. We first present a review of the contributions from the Graphics Recognition community to the spotting problem. In the second part, we focus our attention on the different symbol description techniques and the families we can find in the literature. Then, the existing data structures which aim to store the extracted descriptors and provide efficient access to them will be analyzed. We finally review the existing methods for hypotheses validation which can be used for spotting purposes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adam, S., Ogier, J., Cariou, C., Mullot, R., Labiche, J., Gardes, J.: Symbol and character recognition: Application to engineering drawings. International Journal on Document Analysis and Recognition 3(2), 89–101 (2000)
Ah-Soon, C., Tombre, K.: Architectural symbol recognition using a network of constraints. Pattern Recognition Letters 22(2), 231–248 (2001)
Apté, C., Damerau, F., Weiss, S.: Towards language independent automated learning of text categorization models. In: Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 23–30. ACM, New York (1994)
Bagdanov, A., Ballan, L., Bertini, M., Bimbo, A.D.: Trademark matching and retrieval in sports video databases. In: Proceedings of the International Workshop on Multimedia Information Retrieval, pp. 79–86. ACM, New York (2007)
Ballard, D.: Generalizing the Hough transform to detect arbitrary shapes. Pattern Recognition 13(2), 111–122 (1981)
Barbu, E., Hérroux, P., Adam, S., Trupin, E.: Using bags of symbols for automatic indexing of graphical document image databases. In: Graphics Recognition. Ten Years Review and Future Perspectives, Lecture Notes on Computer Science, vol. 3926, pp. 195–205. Springer, Berlin (2005)
Bayer, R., Metzger, J.: On the encipherment of search trees and random access files. ACM Transactions on Database Systems 1(1), 37–52 (1976)
Beckmann, N., Kriegel, H., Schneider, R., Seeger, B.: The R *-tree: An efficient and robust access method for points and rectangles. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 322–331. ACM, New York (1990)
Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(4), 509–522 (2002)
Bentley, J.: Multidimensional binary search trees used for associative searching. Communications of the ACM 18(9), 509–517 (1975)
Berretti, S., Bimbo, A.D., Pala, P.: Retrieval by shape similarity with perceptual distance and effective indexing. IEEE Transactions on Multimedia 2(4), 225–239 (2000)
Bimbo, A.D., Pala, P.: Visual image retrieval by elastic matching of user sketches. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(2), 121–132 (1997)
Bokser, M.: Omnidocument technologies. In: Proceedings of the IEEE, vol. 80, pp. 1066–1078. IEEE Computer Society, Los Alamitos (1992)
Bunke, H.: Attributed programmed graph grammars and their application to schematic diagram interpretation. IEEE Transactions on Pattern Analysis and Machine Intelligence 4(6), 574–582 (1982)
Califano, A., Mohan, R.: Multidimensional indexing for recognizing visual shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(4), 373–392 (1994)
Cheng, T., Khan, J., Liu, H., Yun, D.: A symbol recognition system. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 918–921. IEEE Computer Society, Los Alamitos (1993)
Chong, C., Raveendran, P., Mukundan, R.: Translation and scale invariants of Legendre moments. Pattern Recognition 37(1), 119–129 (2004)
Ciaccia, P., Patella, M., Zezula, P.: M-tree: An efficient access method for similarity search in metric spaces. In: Proceedings of the Twenty-Third International Conference on Very Large Data Bases, pp. 426–435. Morgan Kaufmann, San Mateo (1997)
Dosch, P., Lladós, J.: Vectorial signatures for symbol discrimination. In: Graphics Recognition: Recent Advances and Perspectives, Lecture Notes on Computer Science, vol. 3088, pp. 154–165. Springer, Berlin (2004)
Etemadi, A., Schmidt, J., Matas, G., Illinworth, J., Kittler, J.: Low-level grouping of straight line segments. In: Proceedings of the British Machine Vision Conference, pp. 119–126. The British Machine Vision Association and Society for Pattern Recognition (1991)
Ferrer, M., Valveny, E., Serratosa, F.: Median graph: A new exact algorithm using a distance based on the maximum common subgraph. Pattern Recognition Letters 30(5), 579–588 (2009)
Ferrer, M., Valveny, E., Serratosa, F., Riesen, K., Bunke, H.: Generalized median graph computation by means of graph embedding in vector spaces. Pattern Recognition 43(4), 1642–1655 (2010)
Franco, P., Ogier, J., Loonis, P., Mullot, R.: A topological measure for image object recognition. In: Graphics Recognition: Recent Advances and Perspectives, Lecture Notes on Computer Science, vol. 3088, pp. 279–290. Springer, Berlin (2004)
Freeman, H.: On the encoding of arbitrary geometric configurations. IRE Transactions on Electronic Computers 2, 260–268 (1961)
Fu, K.: Syntactic Methods in Pattern Recognition. Academic Press, New York (1974)
Gaede, V., Günther, O.: Multidimensional access methods. ACM Computing Surveys 30(2), 170–231 (1998)
Garey, M., Johnson, D.: Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman, New York (1979)
Guillas, S., Bertet, K., Ogier, J.: A generic description of the concept lattices classifier: Application to symbol recognition. In: Graphics Recognition. Ten Years Review and Future Perspectives, Lecture Notes in Computer Science, vol. 3926, pp. 47–60. Springer, Berlin (2006)
Guttman, A.: R-trees: A dynamic index structure for spatial searching. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 47–57. ACM, New York (1984)
Henrich, A., Six, H., Widmayer, P.: The LSD-tree: Spatial access to multidimensional point and non point objects. In: Proceedings of the Fifteenth International Conference on Very Large Databases, pp. 45–53. Morgan Kaufmann, San Mateo (1989)
Hse, H., Newton, A.: Sketched symbol recognition using Zernike moments. In: Proceedings of the Seventeenth International Conference on Pattern Recognition, pp. 367–370. IEEE Computer Society, Los Alamitos (2004)
Hu, M.: Visual pattern recognition by moment invariants. IRE Transactions on Information Theory 8, 179–187 (1962)
Huet, B., Hancock, E.: Line pattern retrieval using relational histograms. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(12), 1363–1370 (1999)
Huttenlocher, D., Ullman, S.: Object recognition using alignment. In: Proceedings of the First IEEE International Conference on Computer Vision, pp. 102–111. IEEE Computer Society, Los Alamitos (1987)
Jagadish, H.: Spatial search with polyhedra. In: Proceedings of the Sixth International Conference on Data Engineering, pp. 311–319. IEEE Computer Society, Los Alamitos (1990)
Jiang, X., Munger, A., Bunke, H.: On median graphs: Properties, algorithms, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1144–1151 (2001)
Katayama, N., Satoh, S.: The SR-tree: An indexing structure for high-dimensional nearest neighbor queries. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 369–380. ACM, New York (1997)
Khotanzad, A., Hong, Y.: Invariant image recognition by Zernike moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(5), 489–497 (1990)
Kindratenko, V.: Development and application of image analysis techniques for identification and classification of microscopic particles. Ph.D. Thesis, University of Antwerp, Belgium (1997)
Kise, K., Tsujino, M., Matsumoto, K.: Spotting where to read on pages— retrieval of relevant parts from page images. In: Document Analysis Systems V, Lecture Notes on Computer Science, vol. 2423, pp. 388–399. Springer, Berlin (2002)
Konidaris, T., Gatos, B., Ntzios, K., Pratikakis, I., Theodoridis, S., Perantonis, S.: Keyword-guided word spotting in historical printed documents using synthetic data and user feedback. International Journal on Document Analysis and Recognition 9(24), 167–177 (2007)
Korn, F., Pagel, B., Faloustos, C.: On the “dimensionality curse” and the “self-similarity blessing”. IEEE Transactions on Knowledge and Data Engineering 13(1), 96–111 (2001)
Kumar, A., Jawahar, C.V., Manmatha, R.: Efficient search in document image collections. In: Computer Vision—ACCV2007, Lecture Notes on Computer Science, vol. 4843, pp. 586–595. Springer, Berlin (2007)
Kuo, S., Agazzi, O.: Keyword spotting in poorly printed documents using pseudo 2D hidden Markov models. IEEE Transactions Pattern Analysis and Machine Intelligence 16(8), 842–848 (1994)
Lamdan, Y., Wolfson, H.: Geometric hashing: A general and efficient model-based recognition scheme. In: Proceedings of the Second IEEE International Conference on Computer Vision, pp. 238–249. IEEE Computer Society, Los Alamitos (1988)
Lamiroy, B., Gros, P.: Rapid object indexing and recognition using enhanced geometric hashing. In: Computer Vision, Lecture Notes on Computer Science, vol. 1064, pp. 59–70. Springer, Berlin (1996)
Leydier, Y., Lebourgeois, F., Emptoz, H.: Text search for medieval manuscript images. Pattern Recognition 40(12), 3552–3567 (2007)
Lladós, J., Martí, E., Villanueva, J.: Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1137–1143 (2001)
Lladós, J., Sánchez, G.: Indexing historical documents by word shape signatures. In: Proceedings of the Ninth International Conference on Document Analysis and Recognition, pp. 362–366. IEEE Computer Society, Los Alamitos (2007)
Lladós, J., Valveny, E., Sánchez, G., Martí, E.: Symbol recognition: Current advances and perspectives. In: Graphics Recognition Algorithms and Applications, Lecture Notes on Computer Science, vol. 2390, pp. 104–127. Springer, Berlin (2002)
Locteau, H., Adam, S., Trupin, E., Labiche, J., Hérroux, P.: Symbol spotting using full visibility graph representation. In: Proceedings of the Seventh International Workshop on Graphics Recognition (2007)
Lorenz, O., Monagan, G.: A retrieval system for graphical documents. In: Proceedings of the Fourth Symposium on Document Analysis and Information Retrieval, pp. 291–300 (1995)
Lowe, D.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, pp. 1150–1157. IEEE Computer Society, Los Alamitos (1999)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Lu, G., Sajjanhar, A.: Region-based shape representation and similarity measure suitable for content-based image retrieval. Multimedia Systems 7(2), 165–174 (1999)
Lu, S., Tan, C.: Retrieval of machine-printed Latin documents through word shape coding. Pattern Recognition 41(5), 1816–1826 (2008)
Mas, J., Jorge, J., Sánchez, G., Lladós, J.: Representing and parsing sketched symbols using adjacency grammars and a grid-directed parser. In: Graphics Recognition. Recent Advances and New Opportunities, Lecture Notes on Computer Science, vol. 5046, pp. 169–180. Springer, Berlin (2008)
Mehtre, B., Kankanhalli, M., Lee, W.: Shape measures for content based image retrieval: A comparison. Information Processing & Management 33(3), 319–337 (1997)
Messmer, B., Bunke, H.: Automatic learning and recognition of graphical symbols in engineering drawings. In: Graphics Recognition Methods and Applications, Lecture Notes on Computer Science, vol. 1072, pp. 123–134. Springer, Berlin (1996)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)
Mokhtarian, F., Abbasi, S., Kittler, J.: Robust and efficient shape indexing through curvature scale space. In: Proceedings of the British Machine Vision Conference, pp. 53–62. The British Machine Vision Association and Society for Pattern Recognition (1996)
Mori, G., Belongie, S., Malik, J.: Shape contexts enable efficient retrieval of similar shapes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 723–730. IEEE Computer Society, Los Alamitos (2001)
Müller, S., Rigoll, G.: Engineering drawing database retrieval using statistical pattern spotting techniques. In: Graphics Recognition Recent Advances, Lecture Notes on Computer Science, vol. 1941, pp. 246–255. Springer, Berlin (2000)
Najman, L., Gibot, O., Barbey, M.: Automatic title block location in technical drawings. In: Proceedings of the Fourth International Workshop on Graphics Recognition, pp. 19–26 (2001)
Neumann, J., Samet, H., Soffer, A.: Integration of local and global shape analysis for logo classification. Pattern Recognition Letters 23(12), 1449–1457 (2002)
Nievergelt, J., Hinterberger, H., Sevcik, K.: The grid file: An adaptable symmetric multikey file structure. ACM Transactions on Database Systems 9(1), 38–71 (1984)
Nishida, H.: Structural feature indexing for retrieval of partially visible shapes. Pattern Recognition 35, 55–67 (2002)
Punitha, P., Guru, D.: Symbolic image indexing and retrieval by spatial similarity: An approach based on B-tree. Pattern Recognition 41, 2068–2085 (2008)
Qureshi, R., Ramel, J., Barret, D., Cardot, H.: Spotting symbols in line drawing images using graph representations. In: Graphics Recognition. Recent Advances and New Opportunities, Lecture Notes on Computer Science, vol. 5046, pp. 91–103. Springer, Berlin (2008)
Rath, T., Manmatha, R.: Features for word spotting in historical manuscripts. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 218–222. IEEE Computer Society, Los Alamitos (2003)
Rath, T., Manmatha, R.: Word image matching using dynamic time warping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 521–527. IEEE Computer Society, Los Alamitos (2003)
Robinson, J.: The K-D-B-tree: A search structure for large multidimensional dynamic indexes. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 10–18. ACM, New York (1981)
Rodríguez, J.A.: Statistical framework and prior information modeling in handwritten word-spotting. Ph.D. Thesis, Computer Vision Center/Universitat Autònoma de Barcelona, CVC/UAB (2009)
Samet, H.: The quadtree and related hierarchical data structures. ACM Computing Surveys 16(1), 187–260 (1984)
Samet, H.: The Design and Analysis of Spatial Data Structures. Addison-Wesley, Reading (1990)
Shaw, A.: A formal picture description scheme as a basis for picture processing systems. InfoControl 14(1), 9–52 (1969)
Sivic, J., Russell, B., Efros, A., Zisserman, A., Freeman, W.: Discovering objects and their localization in images. In: Proceedings of the Tenth IEEE International Conference on Computer Vision, pp. 370–377. IEEE Computer Society, Los Alamitos (2005)
Stein, F., Medioni, G.: Structural indexing: Efficient 2D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(12), 1198–1204 (1992)
Su, M., Chen, H., Cheng, W.: A neural-network-based approach to optical symbol recognition. Neural Processing Letters 15(2), 117–135 (2002)
Syeda-Mahmood, T.: Indexing of technical line drawing databases. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(8), 737–751 (1999)
Tabbone, S., Wendling, L.: Recognition of symbols in grey level line-drawings from an adaptation of the Radon transform. In: Proceedings of the Seventeenth International Conference on Pattern Recognition, pp. 570–573. IEEE Computer Society, Los Alamitos (2004)
Tabbone, S., Wendling, L., Tombre, K.: Matching of graphical symbols in line-drawing images using angular signature information. International Journal on Document Analysis and Recognition 6(2), 115–125 (2003)
Tabbone, S., Wendling, L., Zuwala, D.: A hybrid approach to detect graphical symbols in documents. In: Document Analysis Systems VI, Lecture Notes on Computer Science, vol. 3163, pp. 342–353. Springer, Berlin (2004)
Tabbone, S., Zuwala, D.: An indexing method for graphical documents. In: Proceedings of the Ninth International Conference on Document Analysis and Recognition, pp. 789–793. IEEE Computer Society, Los Alamitos (2007)
Tapia, E., Rojas, R.: Recognition of on-line handwritten mathematical formulas in the E-chalk system. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 980–984. IEEE Computer Society, Los Alamitos (2003)
Taxt, T., Ólafsdóttir, J., Dæhlenshort, M.: Recognition of handwritten symbols. Pattern Recognition 23(11), 1155–1166 (1990)
Teague, M.: Image analysis via the general theory of moments. Journal of the Optical Society of America 70(8), 920–930 (1980)
Teh, C., Chin, R.: On image analysis by the methods of moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 10(4), 496–513 (1988)
Terasawa, K., Tanaka, Y.: Slit style HOG feature for document image word spotting. In: Proceedings of the Tenth International Conference on Document Analysis and Recognition, pp. 116–120. IEEE Computer Society, Los Alamitos (2009)
Tsay, Y., Tsai, W.: Model-guided attributed string matching by split-and-merge for shape recognition. International Journal on Pattern Recognition and Artificial Intelligence 3(2), 159–179 (1989)
Valveny, E., Dosch, P.: Symbol recognition contest: A synthesis. In: Graphics Recognition, Recent Advances and Perspectives, Lecture Notes on Computer Science, vol. 3088, pp. 368–385. Springer, Berlin (2004)
della Ventura, A., Schettini, R.: Graphic symbol recognition using a signature technique. In: Proceedings of the Twelfth International Conference on Pattern Recognition, pp. 533–535. IEEE Computer Society, Los Alamitos (1994)
Wagner, R., Fischer, M.: The string-to-string correction problem. Journal of the Association for Computing Machinery 21(1), 168–173 (1974)
Weber, R., Schek, H., Blott, S.: A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: Proceedings of the Twentyfourth International Conference on Very Large Data Bases, pp. 194–205. Morgan Kaufmann, San Mateo (1998)
Wenyin, L., Zhang, W., Yan, L.: An interactive example-driven approach to graphics recognition in engineering drawings. International Journal on Document Analysis and Recognition 9(1), 13–29 (2007)
White, D., Jain, R.: Similarity indexing with the SS-tree. In: Proceedings of the Twelfth International Conference on Data Engineering, pp. 516–523. IEEE Computer Society, Los Alamitos (1996)
Wolfson, H.: On curve matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(5), 483–489 (1990)
Yang, S.: Symbol recognition via statistical integration of pixel-level constraint histograms: A new descriptor. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(2), 278–281 (2005)
Zhang, D., Lu, G.: Shape-based image retrieval using generic Fourier descriptor. Signal Processing 17, 825–848 (2002)
Zhang, D., Lu, G.: Review of shape representation and description techniques. Pattern Recognition 37, 1–19 (2004)
Zhang, W., Wenyin, L.: A new vectorial signature for quick symbol indexing, filtering and recognition. In: Proceedings of the Ninth International Conference on Document Analysis and Recognition, pp. 536–540. IEEE Computer Society, Los Alamitos (2007)
Zuwala, D.: Reconaissance de symboles sans connaisance a priori. Ph.D. Thesis, Laboratoire Lorrain de Recherche en Informatique et ses Applications, LORIA (2006)
Zuwala, D., Tabbone, S.: A method for symbol spotting in graphical documents. In: Document Analysis Systems VII, Lecture Notes on Computer Science, vol. 3872, pp. 518–528. Springer, Berlin (2006)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag London Limited
About this chapter
Cite this chapter
Rusiñol, M., Lladós, J. (2010). State-of-the-Art in Symbol Spotting. In: Symbol Spotting in Digital Libraries. Springer, London. https://doi.org/10.1007/978-1-84996-208-7_2
Download citation
DOI: https://doi.org/10.1007/978-1-84996-208-7_2
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84996-207-0
Online ISBN: 978-1-84996-208-7
eBook Packages: Computer ScienceComputer Science (R0)