Skip to main content
SpringerLink
Log in

Specification of Visual Languages as Means for Interaction

  • Chapter
Visual Language Theory

Abstract

Interactive and end-user computing are the present challenges of computer science. They suggest the need for providing a specification methodology driving the development of effective interactive visual systems. In this line, we discuss a definition of visual languages which binds the interactive and communicative aspects with the computational ones, thus integrating a theory of visual languages with interaction-related aspects. By adopting this novel point of view, it becomes possible to study visual sentences and visual languages with respect to the basic principle of interaction that the users cannot cause unexpected events or become disoriented by the system behaviour. A classification of visual languages based on their capability of respecting this principle is then discussed and existing visual languages are framed in the classification.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. N. Bianchi, P. Bottoni, P. Mussio, M. Protti. Cooperative visual environments for the design of effective visual systems.Journal of Visual Languages and Computing4(4):357–382, 1993.

    Article  Google Scholar 

  2. N. Bianchi, P. Mussio, M. Padula, G. Rubbia Rinaldi. Multimedia document management: an anthropocentric approach.Information Processing and Management32(3):287–304, 1996.

    Article  Google Scholar 

  3. P. Bottoni, M.F. Costabile, S. Levialdi, P. Mussio. Formalizing visual languages. InProceedings of IEEE Symposium on Visual Languages’951995, IEEE Computer Society Press, Los Alamitos, pages 334–341.

    Google Scholar 

  4. P. Bottoni, M.F. Costabile, S. Levialdi, P. Mussio. Visual conditional attributed rewriting systems in visual language specification. InProceedings of IEEE Symposium on Visual Languages’961996, IEEE Computer Society Press, Los Alamitos, pages 156–163.

    Google Scholar 

  5. P. Bottoni, M.F. Costabile, S. Levialdi, P. Mussio. Defining visual languages for interactive computing.IEEE Transactions on Systems Man and Cyberneticsto appear, November 1997.

    Google Scholar 

  6. P. Bottoni, M. Mariotto, P. Mussio, G. Biella. The design of anthropocentric cooperative visual environments. InProceedings of IEEE Symposium on Visual Languages’951995, IEEE Computer Society Press, Los Alamitos, pages 45–52.

    Google Scholar 

  7. J.C. Brancheau, C.V. Brown. The management of end-user computing: status and direction.ACM Computing Surveys25(4), 1993.

    Google Scholar 

  8. M. Burnett, A. Ambler. Interactive visual data abstraction in a declarative visual programming language.Journal of Visual Languages and Computing5(1):26–60, 1994.

    Google Scholar 

  9. M.M. Burnett, A. Goldberg, T.G. Lewis, eds.Visual Object-Oriented Programming: Concepts and EnvironmentsManning, Greenwich, 1995.

    Google Scholar 

  10. T. Catarci, S.-K. Chang, M.F. Costabile, S. Levialdi, G. Santucci. A graph-based framework for multiparadigmatic visual access to databases.IEEE Transactions on Knowledge and Data Engineering8(4):455–475, 1996.

    Article  Google Scholar 

  11. S.-K. Chang, M.F. Costabile, S. Levialdi. Reality bites—progressive querying and result visualization in logical and VR spaces. InProceedings of IEEE Symposium on Visual Languages’941994, IEEE Computer Society Press, Los Alamitos, pages 100–109.

    Google Scholar 

  12. S.-K. Chang, M.J. Tauber, B. Yu, J.S. Yu. The SIL-Icon compiler—An icon-oriented system generator.International Journal of Pattern Recognition and Artificial Intelligence2(2):241–273, 1988.

    Article  Google Scholar 

  13. S.-K. Chang, G. Tortora, B. Yu, A. Guercio. Icon purity—towards a formal definition of icon.International Journal of Pattern Recognition and Artificial Intelligence1(3&4):377–392, 1987.

    Article  Google Scholar 

  14. S.S. Chok, K. Marriott. Automatic construction of user interfaces from constraint multiset grammars. InProceedings of IEEE Symposium on Visual Languages’951995, IEEE Computer Society Press, Los Alamitos, pages 242–249.

    Google Scholar 

  15. C. Crimi, A. Guercio, G. Nota, G. Pacini, G. Tortora, M. Tucci. Relation grammars and their application to multi-dimensional languagesJournal of Visual Languages and Computing2(4):333–346, 1991.

    Article  Google Scholar 

  16. M.F. Dacey. The syntax of a triangle and some other figures.Pattern Recognition2:11–31, 1970.

    Article  Google Scholar 

  17. T. Dudley, D. Mahling. Report on e-mail panel: Is visual programming a new programming paradigm? InProceedings of IEEE Workshop on Visual Languages’911991, IEEE Computer Society Press, Los Alamitos, pages 82–88.

    Google Scholar 

  18. K.S. Fu.Syntactic Pattern Recognition and ApplicationsPrentice-Hall, Englewood Cliffs, 1982.

    MATH  Google Scholar 

  19. K.S. Fu, W.H. Tsai. Attributed grammars: a tool for combining syntactic and statistical approaches to pattern recognition.IEEE Transactions on Systems Man and Cybernetics10:873–885, 1980.

    Article  MATH  Google Scholar 

  20. D. Giammarresi, A. Restivo. Recognizable picture languages.International Journal of Pattern Recognition and Artificial Intelligence6:31–42, 1992.

    Article  Google Scholar 

  21. E.J. Golin. Parsing visual languages with picture layout grammars.Journal of Visual Languages and Computing2(4):371–394, 1991.

    Article  Google Scholar 

  22. S.J. Guastello, M. Traut, G. Korienek. Verbal versus pictorial representations of objects in human-computer interfaces.Journal of Man-Machine Studies31:99–120, 1989

    Article  Google Scholar 

  23. C.A. Gurr. On the Isomorphism, or lack of it, of representations. Inthis volume.

    Google Scholar 

  24. R. Helm, K. Marriott. A declarative specification and semantics for visual languages.Journal of Visual Languages and Computing2(4):311–332, 1991.

    Article  Google Scholar 

  25. K. Inoue, I. Takanami. A survey of two-dimensional automata theory.Information Science55:99–121, 1991.

    Article  MathSciNet  MATH  Google Scholar 

  26. J.A. Jorge, D. Vaida. Formal Visual Languages and spatial reasoning InProceedings SIC’96-International Panel Conference on Soft and Intelligent ComputingBudapest, October 1996.

    Google Scholar 

  27. K. Kahn, V.A. Saraswat. Complete visualisations of concurrent programs and their executions. InProceedings of IEEE Workshop on Visual Languages’901990, IEEE Computer Society Press, Los Alamitos, pages 7–15.

    Google Scholar 

  28. E. Kandogan, B. Shneiderman. Elastic windows: improved spatial layout and rapid multiple window operations. InProceedings of Workshop on Advanced Visual Interfaces AVI’96T. Catarci, M.F. Costa-bile, S. Levialdi, G. Santucci, eds., ACM Press, New York, 1996, pages 29–38.

    Chapter  Google Scholar 

  29. S. Levialdi, P. Mussio, M. Protti, L. Tosoni. Reflections on icons. InProceedings of IEEE Workshop on Visual Languages ‘83IEEE Computer Society Press, Los Alamitos, 1993, pages 47–53.

    Google Scholar 

  30. K. Marriott, B. Meyer. The CCMG visual language hierarchy. Inthis volume.

    Google Scholar 

  31. H.A. Maurer, G. Rozenberg, E. Welzl. Using string languages to describe picture languages.Information and Control54:155–185, 1982.

    Article  MathSciNet  MATH  Google Scholar 

  32. P. Mussio, M. Finadri, P. Gentini, F. Colombo. A bootstrap approach to visual user-interface design and development.The Visual Computer8(2):75–93, 1992.

    Article  Google Scholar 

  33. P. Mussio, M. Pietrogrande, M. Protti. Simulation of hepatological models: a study in visual interactive exploration of scientific problems.Journal of Visual Languages and Computing2(1):75–95, 1991.

    Article  Google Scholar 

  34. R. Narashiman. On the description, generation and recognition of classes of pictures. InAutomatic Interpretation and Classification of ImagesA. Grasselli ed., Academic Press, London, 1969.

    Google Scholar 

  35. A. Repenning, T. Sumner. Agentsheets: a medium for creating domain-oriented visual languages.IEEE Computer28(3):17–26, 1995.

    Article  Google Scholar 

  36. A. Rosenfeld, R. Siromoney. Pictorial languages.Languages of Design1(3):229–245, 1993.

    Google Scholar 

  37. A.C. Shaw. The formal picture description scheme as a basis for picture processing systems.Information and Control14:9–52, 1969.

    Article  MATH  Google Scholar 

  38. B. Shneiderman.Designing the User InterfaceAddison-Wesley, Reading, 1992.

    Google Scholar 

  39. L. Tondl.Problems of SemanticsReidel, Dordrecht, 1981.

    Google Scholar 

  40. K. Tsuda, A. Yoshitaka, M. Hirakawa, M. Tanaka, T. Ichikawa. IconicBrowser: an iconic retrieval system for object oriented databases.Journal of Visual Languages and Computing1(1):59–76, 1991.

    Article  Google Scholar 

  41. VL Steering Committee. Ten years of visual languages research. InProceedings of IEEE Symposium on Visual Languages’941994, IEEE Computer Society Press, Los Alamitos, pages 196–205.

    Google Scholar 

  42. D. Wang, J.R. Lee. Visual reasoning: its formal semantics and applications.Journal of Visual Languages and Computing4(4):327–357, 1993.

    Article  MathSciNet  Google Scholar 

  43. D. Wang, H. Zeevat. A syntax directed approach to picture semantics. Inthis volume.

    Google Scholar 

  44. P. Wegner. Interaction as a basis for empirical computer science.ACM Computing Surveys27(1):45–48, 1995.

    Article  Google Scholar 

  45. K. Wittenburg, L. Weitzman. Relational grammars-theory and practice in a visual language interface for process modeling. Inthis volume.

    Google Scholar 

  46. K. Wittenburg, L. Weitzman, J. Talley. Unification-based grammars and tabular parsing for graphical languages.Journal of Visual Languages and Computing2(4):347–370, 1991.

    Article  Google Scholar 

Download references

Authors
  1. Paolo Bottoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Francesca Costabile
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stefano Levialdi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Piero Mussio
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Monash University, Clayton, Victoria, 3168, Australia

    Kim Marriott

  2. Lehr und Forschungseinrichtung für Programmierung und Softwaretechnik Institut für Informatik, Ludwig Maximillians Universität, Oettingenstrasse 67, Munich, 80538, Germany

    Bernd Meyer

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer Science+Business Media New York

About this chapter

Cite this chapter

Bottoni, P., Costabile, M.F., Levialdi, S., Mussio, P. (1998). Specification of Visual Languages as Means for Interaction. In: Marriott, K., Meyer, B. (eds) Visual Language Theory. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-1676-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-1676-6_13

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-7240-3

  • Online ISBN: 978-1-4612-1676-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation