Hand-Drawn Diagram Recognition with Hierarchical Parsing: An Experimental Evaluation

  • Vincenzo Deufemia
  • Michele Risi
  • Genoveffa Tortora
Conference paper


This paper presents the evaluation of a parsing strategy for the recognition of sketched diagrams. The architecture of the recognition system consists of three hierarchically arranged layers where the user’ strokes are first segmented and interpreted as primitive shapes, then by exploiting the domain context they are clustered into symbols of the domain and an interpretation of whole sentence is given. The experimental results achieved in the domain of UML class diagrams demonstrate good performances in terms of recognition accuracy.


Recognition Accuracy Abstract Syntax Class Symbol Symbol Recognition Primitive Shape 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Aho, A.V., Sethi, R., and Ullman, J.D. (1987) Compilers Principles, Techniques, and Tools. Addison-Wesley Series in Computer Science.Google Scholar
  2. 2.
    Costagliola, G., Deufemia, V., and Risi, M. (2005) Sketch Grammars: A Formalism for Describing and Recognizing Diagrammatic Sketch Languages. In Proceedings of ICDAR’05, IEEE CS Press, 1226–1230.Google Scholar
  3. 3.
    Costagliola, G., Deufemia, V., and Risi, M. (2006) A Multi-layer Parsing Strategy for On-line Recognition of Hand-drawn Diagrams. In Proceedings of VL/HCC’06, 103–110.Google Scholar
  4. 4.
    Costagliola, G., Deufemia, V., and Risi, M. (2007) Using Error Recovery Techniques to Improve Sketch Recognition Accuracy. In Proceedings of GREC’07, Curitiba, Brazil, September 20–21, 2007. Also in Lecture Notes in Computer Science, Vol. 5026, 2008, pp. 157–168.Google Scholar
  5. 5.
    Davis, R. (2007) Magic Paper: Sketch-Understanding Research, IEEE Comp., 40(9): 34–41.CrossRefGoogle Scholar
  6. 6.
    Fitzgibbon, A., Pilu, M., and Fisher, R.B. (1999) Direct Least Square Fitting of Ellipses, IEEE Transactions on PAMI, 21(5):476–480.CrossRefGoogle Scholar
  7. 7.
    Igarashi, T., and Zeleznik, B. (2007) Sketch-based Interaction. IEEE Computer Graphics and Applications, 27(1): 26–27.CrossRefGoogle Scholar
  8. 8.
    Oltmans M., Alvarado C., Davis R. (2004) ETCHA Sketches: Lessons Learned from Collecting Sketch Data. In AAAI Fall Symposium on Making Pen-Based Interaction Intelligent and Natural, AAAI Press, 134–140.Google Scholar
  9. 9.
    Salton, G., and McGill, M. (1983) Introduction to Modern Information Retrieval. McGraw Hill.Google Scholar
  10. 10.
    Stahovich, T.F., Davis, R., and Shrobe, H. (1998) Generating Multiple New Designs from a Sketch, Artificial Intelligence, 104(1–2): 211–264.CrossRefGoogle Scholar
  11. 11.
    Weisstein, E.W. Least Squares Fitting – Perpendicular Offsets, MathWorld,

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Vincenzo Deufemia
    • 1
  • Michele Risi
    • 1
  • Genoveffa Tortora
    • 1
  1. 1.Facoltà di Scienze MM. FF. NNUniversity of SalernoFiscianoItaly

Personalised recommendations