Modelling direct manipulation with Referent and Statecharts

  • Hallvard Trætteberg
Part of the Eurographics book series (EUROGRAPH)


An approach to modelling mouse gestures in direct manipulation interfaces is presented. The Referent and Statechart languages are used for modelling structure and behaviour, respectively. A gesture is divided into a series of steps, driven by user action and aided by feedback, all modelled as Statechart states. The Referent describes dynamic relations between these states. The states and transitions determine the gesture syntax and the actual relations established and changed during recognition. We discuss how reasoning about these models can support the design of composite gesture recognisers and provide consistency checking and design critique.


Gesture Recognition Direct Manipulation Mouse Pointer Display Element Left Mouse Button 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    “Direct Manipulation: A Step Beyond Programming Languages”. Ben Shneiderman. IEEE Computer, August 1983.Google Scholar
  2. 2.
    “Retrospective and Challenges for Model-Based Interface Development”. Pedro Szekely. Computer-Aided Design of User Interfaces. Proceedings of CADUI’96. Edited by Jean Vanderdonckt. Presses Universitaires de Namur.Google Scholar
  3. 3.
    “The Referent Model Language”. Arne S0lvberg, Terje Brasethvik. Supplement to chapter 14 in S0lvberg, Kung “Information Systems Engineering”.Google Scholar
  4. 4.
    “Statecharts: A Visual Formalism for Complex Systems.” David Harel. Science of Computer Programming 8, 1987.Google Scholar
  5. 5.
    “A Guided Tour of the Common Lisp Interface Manager”. Rao, R., York, W. M., Doughty, D. In Lisp Pointers, 4. 1991.Google Scholar
  6. 6.
    “Comprehensive Support for Graphical, Highly-Interactive User Interfaces: The Garnet User Interface Development Environment”. Myers, B.A., Guise, D.A., Dan-nenberg, R.B., Vander Zanden, B., Kosbie, D.S., Pervin, E., Mickish, A., Marchal, P. IEEE Computer 23, 11. November 1990.CrossRefGoogle Scholar
  7. 7.
    “A compositional model for the formal specification of user interface software”. Markopoulos, P. PhD thesis at Department of Computer Science, Queen Mary and Westfield College, University of London.Google Scholar
  8. 8.
    “Introducing Objectcharts or How to Use Statecharts in Object-Oriented Design”. Derek coleman IEEE Transactions on Software Engineering, vol. 18, no. 1, January 1992.Google Scholar
  9. 9.
    UML Summary, Version 1.1 and Statechart notation, Scholar
  10. 10.
    “Readings in Human-Computer Interaction: Toward the Year 2000”. Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S. Second Edition. 1995Google Scholar
  11. 11.
    “State of the Art in User Interface Software Tools”. Brad Myers, CMU. In [10], pp 323–343.Google Scholar
  12. 12.
    “Embedding Computer-Based Critics in the Context of Design”, Fischer, G., Nakakoji, K., Ostwald, J., Stahl, G., Sumner, T. Proceedings of the Conference on Human Factors in Computing Systems, INTERCHI’93, pp. 157–164. ACM Press.Google Scholar
  13. 13.
    “A Three-State Model of Graphical Input”. Buxton, W. In Human-Computer Interaction — INTERACT’90, pp. 449–456.Google Scholar
  14. 14.
    “Modelling User Interface Software”. Part I of dissertation of Niels Vejrup Carlsen. Technical University of Denmark. 1991.Google Scholar
  15. 15.
    “Statemaster: A UIMS based on Statecharts for Prototyping and Target Implementation”. Wellner, P.D. In Proceedings of CHP89 Conference on Human Factors in Computing Systems, May 1989.Google Scholar
  16. 16.
    “Integration of User Interface and Conceptual Modelling”. Farshchian, B., Krogstie, J., Solvberg, A. In Workshop Proceedings for ERCIM Workshop “Towards User Interfaces for All: Current efforts and future trends”. 1995Google Scholar
  17. 17.
    “A Taxonomy of See-Through Tools”. Bier, E.A., Stone, M.C., Fishkin, K., Buxton, W., Baudel, T. In [10].Google Scholar
  18. 18.
    “A New Model for Handling Input”. Myers, B.A. ACM Transactions on Information Systems 8. 1990.Google Scholar

Copyright information

© Springer-Verlag Wien 1998

Authors and Affiliations

  • Hallvard Trætteberg
    • 1
  1. 1.Department of Computer and Information SciencesThe Norwegian University of Science and TechnologyTrondheimNorway

Personalised recommendations