A Novel Recognition Approach for Sketch-Based Interfaces

  • Danilo Avola
  • Andrea Del Buono
  • Giorgio Gianforme
  • Stefano Paolozzi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5716)


Multimodal interfaces can be profitably used to support the more and more complex applications and services which support human activities in everyday life. In particular, sketch-based interfaces offer users an effortless and powerful communication way to represent concepts and/or commands on different devices. Developing a sketch-based interface for a specific application or service is a time-consuming operation that requires the re-engineering and/or the re-designing of the whole recognizer framework. This paper describes a definitive framework that allows users to define each kind of sketch-based interface, using freehand drawing only. The definition of the interface and its recognition process are performed using our developed Sketch Modeling Language (SketchML).


Sketch-based interfaces sketch-based interaction sketch recognition multi-domain vectorization segmentation XML SVG 


  1. 1.
    Hammond, T., et al.: Free-sketch Recognition: Putting the CHI in Sketching. In: Proc. of CHI 2008 Extended Abstracts on Human Factors in Computing Systems, CHI 2008, pp. 3027–3032. ACM Press, Florence (2008)Google Scholar
  2. 2.
    Alvarado, C., Davis, R.: Dynamically Constructed Bayes Nets for Multi-Domain Sketch Understanding. In: Proc. of ACM SIGGRAPH 2007 courses, SIGGRAPH 2007, p. 33. ACM Press, California (2007)Google Scholar
  3. 3.
    Casella, G., Deufemia, V., Mascardi, V., Costagliola, G., Martelli, M.: An Agent-Based Framework for Sketched Symbol Interpretation. Journal of Visual Languages and Computing 19(2), 225–257 (2008)CrossRefGoogle Scholar
  4. 4.
    Sahoo, G., Singh, B.K.: A New Approach to Sketch Recognition Using Heuristic. JCSNS International Journal of Computer Science and Network Security 8(2), 102–108 (2008)Google Scholar
  5. 5.
    Shu-Xia, W., Man-Tun, G., Le-Hua, Q.: Freehand Sketching Interfaces: Early Processing for Sketch Recognition. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4551, pp. 161–170. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  6. 6.
    Hammond, T., Davis, R.: LADDER: a Language to Describe Drawing, Display, and Editing in Sketch Recognition. In: Proceedings of SIGGRAPH 2006: ACM SIGGRAPH 2006 Courses, p. 27. ACM Press, New York (2006)Google Scholar
  7. 7.
    Peng, B., Liu, Y., Wenyin, L., Huang, G.: Sketch Recognition Based on Topological Spatial Relationship. In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR&SPR 2004. LNCS, vol. 3138, pp. 434–443. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Sezgin, T.M., Davis, R.: HMM-Based Efficient Sketch Recognition. In: Proceedings of the 10th International Conference on Intelligent User Interfaces, IUI 2005, pp. 281–283. ACM Press, San Diego (2005)Google Scholar
  9. 9.
    Sezgin, T.M., Davis, R.: Sketch Recognition in Interspersed Drawings Using Time-Based Graphical Models. In: Proceedings of Computer Graphics, vol. 32(5), pp. 500–510. Pergamon Press, Inc., Elmsford (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Danilo Avola
    • 1
  • Andrea Del Buono
    • 1
  • Giorgio Gianforme
    • 2
  • Stefano Paolozzi
    • 2
  1. 1.Department of Advanced ResearchCSKLab National Research CenterRomeItaly
  2. 2.Department of Computer Science and AutomationUniversity of “Rome 3”RomeItaly

Personalised recommendations