PeNTa: Formal Modeling for Multi-touch Systems Using Petri Net

  • Francisco R. Ortega
  • Su Liu
  • Frank Hernandez
  • Armando Barreto
  • Naphtali Rishe
  • Malek Adjouadi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8510)


Multi-touch technology has become pervasive in our daily lives, with iPhones, iPads, touch displays, and other devices. It is important to find a user input model that can work for multi-touch gesture recognition and can serve as a building block for modeling other modern input devices (e.g., Leap Motion, gyroscope). We present a novel approach to model multi-touch input using Petri Nets. We formally define our method, explain how it works, and the possibility to extend it for other devices.


Multi-touch Petri Nets Modern Input Devices 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Buxton, W.: A three-state model of graphical input. In: Human-computer Interaction-INTERACT 1990, pp. 449–456 (1990)Google Scholar
  2. 2.
    English, W.K., Engelbart, D.C., Berman, M.L.: Display-Selection Techniques for Text Manipulation. IEEE Transactions on Human Factors in Electronics (1), 5–15 (1967)Google Scholar
  3. 3.
    Gray, W.D., John, B.E., Atwood, M.E.: Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human–Computer Interaction 8(3), 237–309 (1993)CrossRefGoogle Scholar
  4. 4.
    Pew, R.W., Baron, S.: Perspectives on human performance modelling. Automatica 19(6), 663–676 (1983)CrossRefGoogle Scholar
  5. 5.
    Mackenzie, I.S.: Human-Computer Interaction. An Empirical Research Perspective. Newnes (December 2012)Google Scholar
  6. 6.
    Bowman, D.A., Kruijff, E., LaViola Jr., J.J., Poupyrev, I.: 3D user interfaces: theory and practice. Addison-Wesley Professional (2004)Google Scholar
  7. 7.
    Newman, W.M.: A system for interactive graphical programming, pp. 47–54 (1968)Google Scholar
  8. 8.
    Myers, B.A.: A new model for handling input. ACM Transactions on Information Systems (TOIS) 8(3), 289–320 (1990)CrossRefGoogle Scholar
  9. 9.
    Kin, K., Hartmann, B., DeRose, T., Agrawala, M.: Proton++: a customizable declarative multitouch framework. In: UIST 2012: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, ACM Request Permissions (October 2012)Google Scholar
  10. 10.
    Lao, S., Heng, X., Zhang, G., Ling, Y., Wang, P.: A gestural interaction design model for multi-touch displays, pp. 440–446 (2009)Google Scholar
  11. 11.
    Kammer, D., Wojdziak, J., Keck, M., Groh, R., Taranko, S.: Towards a formalization of multi-touch gestures. In: ITS 2010: International Conference on Interactive Tabletops and Surfaces, ACM Request Permissions (November 2010)Google Scholar
  12. 12.
    Lü, H., Li, Y.: Gesture coder: a tool for programming multi-touch gestures by demonstration, pp. 2875–2884 (2012)Google Scholar
  13. 13.
    Scholliers, C., Hoste, L., Signer, B., De Meuter, W.: Midas: a declarative multi-touch interaction framework, pp. 49–56 (2011)Google Scholar
  14. 14.
    Nam, Y., Wohn, N., Lee-Kwang, H.: Modeling and recognition of hand gesture using colored Petri nets. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 29(5), 514–521 (1999)CrossRefGoogle Scholar
  15. 15.
    Hamon, A., Palanque, P., Silva, J.L., Deleris, Y., Barboni, E.: Formal description of multi-touch interactions. In: EICS 2013: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, ACM Request Permissions, New York, USA, pp. 207–216 (June 2013)Google Scholar
  16. 16.
    Spano, L.D., Cisternino, A., Paternò, F.: A compositional model for gesture definition. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 34–52. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  17. 17.
    Spano, L.D., Cisternino, A., Paternò, F., Fenu, G.: GestIT: a declarative and compositional framework for multiplatform gesture definition. In: EICS 2013: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, ACM Request Permissions, New York, USA, pp. 187–196 (June 2013)Google Scholar
  18. 18.
    David, R., Alla, H.: Discrete, Continuous, and Hybrid Petri Nets. Springer (November 2010)Google Scholar
  19. 19.
    Ortega, F.R., Hernandez, F., Barreto, A., Rishe, N.D., Adjouadi, M., Liu, S.: Exploring modeling language for multi-touch systems using petri nets. In: ITS 2013: Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces. ACM (October 2013)Google Scholar
  20. 20.
    High-level Petri Nets-Concepts: Definitions and graphical notation. Final Draft International Standard ISO/IEC 15909 (2000)Google Scholar
  21. 21.
    Genrich, H.J., Lautenbach, K.: System modelling with high-level Petri nets. Theoretical Computer Science 13(1), 109–135 (1981)CrossRefzbMATHMathSciNetGoogle Scholar
  22. 22.
    Liu, S., Zeng, R., He, X.: PIPE-A Modeling Tool for High Level Petri Nets (2011)Google Scholar
  23. 23.
    Peterson, J.L.: Petri net theory and the modeling of systems. Prentice Hall (1981)Google Scholar
  24. 24.
    Mortensen, K.H.: Efficient data-structures and algorithms for a coloured Petri nets simulator, pp. 57–74 (2001)Google Scholar
  25. 25.
    Jensen, K., Kristensen, L.: Coloured Petri Nets. Basic Concepts, Analysis Methods and Practical Use. Springer (1996)Google Scholar
  26. 26.
    Reisig, W.: Petri Nets. An Introduction. Springer (July 2012)Google Scholar
  27. 27.
    Takala, T.M., Rauhamaa, P., Takala, T.: Survey of 3DUI applications and development challenges, pp. 89–96 (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Francisco R. Ortega
    • 1
  • Su Liu
    • 1
  • Frank Hernandez
    • 1
  • Armando Barreto
    • 1
  • Naphtali Rishe
    • 1
  • Malek Adjouadi
    • 1
  1. 1.Florida International UniversityMiamiUSA

Personalised recommendations