QuickDiagram: A System for Online Sketching and Understanding of Diagrams

  • Liu Wenyin
  • Xiangfei Kong
  • Yiming Wang
  • Chester Wan
  • Cheuk-Yin Ho
  • Tong Lu
  • Zhengxing Sun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6020)


In this paper, a system named QuickDiagram is proposed for quick diagram input and understanding. With a user sketching a (complete or partial) component/symbol or a wire (connecting two components) of the diagram, the system can recognize and beautify it immediately. After the entire diagram is finished, certain understandings can be obtained. Especially, the following two methods are used to interpret the recognized diagram: 1) Nodal Analysis on resistive circuits, and 2) generation of PSpice codes from the recognized diagrams. Experiments on a few sketched circuit diagrams show that the results are robust and accurate for both recognition and understanding.


Circuit Diagram Connection Point Nodal Analysis Resistive Circuit Graphic Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Al-Hashimi, B.: The art of simulation using PSPICE. CRC Press, Boca Raton (2000)Google Scholar
  2. 2.
    Alvarado, C., Davis, R.: Resolving ambiguities to create a natural computer-based Sketching Environment. In: Proceedings of IJCAI 2001, pp. 1365–1371 (2001)Google Scholar
  3. 3.
    Alvarado, C., Davis, R.: SketchREAD: a multi-domain sketch recognition engine. In: Proceedings of UIST 2004, pp. 23–32 (2004)Google Scholar
  4. 4.
    Arvo, J., Novins, K.: Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes. In: Proceedings of ACM Symposium on UIST, San Diego, California (2000)Google Scholar
  5. 5.
    Calhoun, C., Stahovich, T.F., Kurtoglu, T., Kara, L.M.: Recognizing multi-stroke symbols. In: Proceedings of AAAI Spring Symposium Series–Sketch Understanding (2002)Google Scholar
  6. 6.
    Candence: PSpice Student Edition with the manual,
  7. 7.
    Davis, R.: Magic paper: sketch understanding research. Computer 40(9), 34–41 (2007)CrossRefGoogle Scholar
  8. 8.
    de Silva, R., Bischel, D.T., Lee, W., Peterson, E.J., Calfee, R.C., Stahovich, T.F.: Kirchhoff’s pen: a pen-based circuit analysis tutor. In: Proceedings of Eurographics Workshop on Sketch-Based Interfaces and Modeling, Annecy, France, June 11–13 (2007)Google Scholar
  9. 9.
    Mynatt, E.D., Igarashi, T., Edwards, W.K., LaMarca, A.: Flatland: new dimensions in office whiteboards. In: Proceedings of SIGCHI Conf. Human Factors in Computing Systems: The CHI is the Limit, pp. 346–353 (1999)Google Scholar
  10. 10.
    Fenical, L.H.: PSpice: a tutorial, pp. 202–204. Regents/Prentice Hall (1995)Google Scholar
  11. 11.
    Forsberg, A., Dieterich, M., Zeleznik, R.: The music notepad. In: Proceedings of ACM Symposium on UIST, San Francisco, CA (1998)Google Scholar
  12. 12.
    Gennari, L., Kara, L.B., Stahovich, T.F., Shimada, K.: Combining geometry and domain knowledge to interpret hand-drawn diagrams. Computers & Graphics 29(4), 547–562 (2005)CrossRefGoogle Scholar
  13. 13.
    Gross, M.D.: Stretch-A-Sketch: a dynamic diagrammer. In: Proceedings of IEEE Sym. on Visual Languages, pp. 232–238 (1994)Google Scholar
  14. 14.
    Hammond, T., Davis, R.: Ladder: A language to describe drawing, display, and editing in sketch recognition. In: Proceedings of IJCAI, pp. 461–467. AAAI Press, Menlo Park (2003)Google Scholar
  15. 15.
    Hammond, T., Davis, R.: Interactive learning of structural shape descriptions from automatically generated near-Miss examples. In: Proceedings of Intelligent User Interfaces, pp. 37–40. ACM Press, New York (2006)Google Scholar
  16. 16.
    Juchmes, R., Leclercq, P., Azar, S.: A freehand-sketch environment for architectural design supported by a multi-agent system. Computers and Graphics 29(6), 905–915 (2005)CrossRefGoogle Scholar
  17. 17.
    Kara, L.B., Stahovich, T.F.: An image-based, trainable symbol recognizer for hand-drawn sketches. Computers & Graphics 29(4), 501–517 (2005)CrossRefGoogle Scholar
  18. 18.
    Liu, Y., Yu, Y., Liu, W.: Online segmentation of freehand stroke by dynamic programming. In: Proceedings of ICDAR 2005, pp. 197–201 (2005)Google Scholar
  19. 19.
    Lank, E., Thorley, J., Chen, S., Blostein, D.: On-line recognition of UML diagrams. In: Proceedings of 6th ICDAR, pp. 356–360 (2001)Google Scholar
  20. 20.
    Leclercq, P.: Invisible sketch interface in architectural engineering. In: Lladós, J., Kwon, Y.-B. (eds.) GREC 2003. LNCS, vol. 3088, pp. 353–363. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  21. 21.
    Liu, Y., Liu, W., Jiang, C.: A structural approach to recognizing incomplete graphic objects. In: Proceedings of ICPR, vol. 1, pp. 371–375 (2004)Google Scholar
  22. 22.
    Matsuda, K., et al.: Freehand sketch system for 3D geometric modelling. In: Proceedings of International Conference on Shape Modeling and Applications, pp. 55–62 (1997)Google Scholar
  23. 23.
    Narayanaswamy, S.: Pen and speech recognition in the user interface for mobile multimedia terminals. Ph.D. thesis, University of California, Berkeley (1996)Google Scholar
  24. 24.
    Nodal analysis of electric circuits,
  25. 25.
    Ouyang, T.Y., Davis, R.: Recognition of hand drawn chemical diagrams. In: Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, Vancouver, British Columbia, Canada, July 22-26, pp. 846–851 (2007)Google Scholar
  26. 26.
    Pedersen, E.R.: Tivoli: an electronic whiteboard for informal workgroup meetings. In: Proceedings of SIGCHI 1993, pp. 391–398 (1993)Google Scholar
  27. 27.
    Pinto-Albuquerque, M., Fonseca, M.J., Jorge, J.A.: Visual languages for sketching documents. In: Proceedings of IEEE Int. Sym. on Visual Languages 2000, pp. 225–232 (2000)Google Scholar
  28. 28.
    Sezgin, T.M., Stahovich, T., Davis, R.: Sketch based interfaces: early processing for sketch understanding. In: Workshop on Perceptive User Interfaces, Orlando, FL (2001)Google Scholar
  29. 29.
    Sezgin, T.M.: Sketch interpretation using multiscale stochastic models of temporal patterns, PhD thesis, Dept. of Electrical Eng., Massachusetts Institute of Technology (2006)Google Scholar
  30. 30.
    Sutherland, I.E.: SketchPad: a man-machine graphic communication system. PhD Thesis, Massachusetts Institute of Technology (1963)Google Scholar
  31. 31.
    Tapia, E., Rojas, R.: Recognition of on-line handwritten mathematical expressions using a minimum spanning tree construction and symbol dominance. In: Lladós, J., Kwon, Y.-B. (eds.) GREC 2003. LNCS, vol. 3088, pp. 329–340. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  32. 32.
    Veselova, O., Davis, R.: Perceptually based learning of shape descriptions. In: Proceedings of Intelligent User Interfaces, pp. 37–40. ACM Press, New York (2006)Google Scholar
  33. 33.
    Wan, Z., Liu, W.: A new vectorial signature for quick symbol spotting, filtering and recognition. In: Proceedings of ICDAR 2007, pp. 516–520 (2007)Google Scholar
  34. 34.
    Xu, X., Sun, Z., Peng, B., Jin, X., Liu, W.: An online composite graphics recognition approach based on matching of spatial relation graphs. International Journal on Document Analysis and Recognition 7(1), 44–55 (2004)Google Scholar
  35. 35.
    Yang, S.: Symbol recognition via statistical integration of pixel-level constraint histograms: a new descriptor. IEEE Trans. on PAMI 27, 278–281 (2005)Google Scholar
  36. 36.
    Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: SKETCH: an interface for sketching 3D scenes. In: Proceedings of SIGGRAPH, New Orleans, pp. 163–170 (1996)Google Scholar
  37. 37.
    Zhang, W., Liu, W., Zhang, K.: Symbol recognition with kernel density matching. IEEE Trans. on PAMI 28(12), 2020–2024 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Liu Wenyin
    • 1
    • 2
  • Xiangfei Kong
    • 2
  • Yiming Wang
    • 1
  • Chester Wan
    • 2
  • Cheuk-Yin Ho
    • 2
  • Tong Lu
    • 1
  • Zhengxing Sun
    • 1
  1. 1.State Key Lab. for Novel Software TechnologyNanjing UniversityNanjingChina
  2. 2.Department of Computer ScienceCity University of Hong KongHong Kong SARPR China

Personalised recommendations