Skip to main content

Taking Advantage of Model-Driven Engineering Foundations for Mixed Interaction Design

  • Chapter
Model-Driven Development of Advanced User Interfaces

Part of the book series: Studies in Computational Intelligence ((SCI,volume 340))

Abstract

New forms of interactive systems, hereafter referred to as Mixed Interactive Systems (MIS), are based on the use of physical artefacts present in the environment. Mixing the digital and physical worlds affects the development of interactive systems, especially from the point of view of the design resources which need to express new dimensions. Consequently, there is a crucial need to clearly describe the content and utility of the recent models associated to these new interaction forms. Based on existing initiatives in the field of HCI, this chapter first highlights the interest of using a Model-Driven Engineering (MDE) approach for the design of MIS. Then, this chapter retraces the application of a MDE approach on a specific Mixed Interaction design resource. The resulted contribution is a motivated, explicit, complete and standardized definition of the ASUR model, a model for mixed interaction design. This definition constitutes a basis to promote the use of this model, to support its diffusion and to derive design tools from this model. The model-driven development of a flexible ASUR editor is finally introduced, thus facilitating the insertion of model extensions and articulations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Caudell, T., Mizell, D.: Augmented reality: an application of heads-up display technology to manual manufacturing processes. In: Proc. of the Twenty Fifth Hawaii International Conference on System Science, pp. 659–669 (1992)

    Google Scholar 

  2. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proc. of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 234–241 (1997)

    Google Scholar 

  3. Weiser, M.: The computer for the 21st century. In: Baecker, R.M., Grudin, J., Buston, W., Greenberg, S. (eds.) Human-Computer Interaction: Toward the Year 2000, 2nd edn. Morgan Kaufmann Publishers Inc., San Francisco (1995)

    Google Scholar 

  4. Shaer, O., Hornecker, E.: Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human–Computer Interaction 3(1-2), 1–137 (2009)

    Article  Google Scholar 

  5. Gibson, J.J.: The Ecological Approach to Visual Perception. Lawrence Erlbaum Associates, Mahwah (1986)

    Google Scholar 

  6. Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid Journal 1(1), 75–85 (1996)

    Google Scholar 

  7. Dubois, E., Gray, P., Nigay, L.: ASUR++: A Design Notation for Mobile Mixed Systems. Interacting with Computers 15(4), 497–520 (2003)

    Article  Google Scholar 

  8. Norman, D.A.: Cognitive engineering. In: Norman, D.A., Draper, S.W. (eds.) User centered system design. Lawrence Erlbaum Associates, Mahwah (1986)

    Google Scholar 

  9. Foley, J.D., Dam, A.V.: Fundamentals of interactive computer graphics. Addison-Wesley Longman Publishing Co., Inc., Amsterdam (1982)

    Google Scholar 

  10. Moran, T.P.: Command language grammar: a representation for the user interface of interactive computer systems. International Journal on Man-Machine Studies 15(1), 3–50 (1981)

    Article  Google Scholar 

  11. UIMS Workshop, A Metamodel for the Runtime Architecture of an Interactive System: the UIMS tool developers workshop. SIGCHI Bulletin 24(1), 32-37 (1992)

    Google Scholar 

  12. Card, S.K., Moran, T.P., Newell, A.: The Psychology of Human-Computer Interaction. Lawrence Erlbaum, Mahwah (1983)

    Google Scholar 

  13. Krasner, G.E., Pope, S.T.: A Cookbook for Using the Model-View-Controller User Interface Paradigm in Smalltalk-80. Journal of Object-Oriented Programming 1(3), 26–49 (1988)

    Google Scholar 

  14. Bastide, R., Palanque, P.: A Visual and Formal Glue between Application and Interaction. Journal of Visual Languages and Computing 10(5), 481–507 (1999)

    Article  Google Scholar 

  15. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Systems Journal 39(3-4), 915–931 (2000)

    Article  Google Scholar 

  16. Shaer, O., Leland, N., Calvillo-Gamez, E.H., et al.: The TAC Paradigm: Specifying Tangible User Interfaces. Personal Ubiquitous Computing 8(5), 359–369 (2004)

    Article  Google Scholar 

  17. Fishkin, K.P.: A Taxonomy for and Analysis of Tangible Interfaces. Personal Ubiquitous Computing 8(5), 347–358 (2004)

    Article  Google Scholar 

  18. Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Proc. of the ACM Conference on Human Factors in Computing Systems CHI 2006, pp. 437–446 (2006)

    Google Scholar 

  19. Blackstock, M., Lea, R., Krasic, C.: Toward Wide Area Interaction with Ubiquitous Computing Environments. In: Proc. of the First European Conference on Smart Sensing and Context, pp. 113–127 (2006)

    Google Scholar 

  20. Trevisan, D.G., Vanderdonckt, J., Macq, B.: Designing Interaction Space for Mixed Reality Systems. In: Proc. of the International Workshop on Mixed Reality MIXER 2004, pp. 29–37 (2004)

    Google Scholar 

  21. Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Ziegelbaum, J.: Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In: Proc. of the Twenty-Sixth Annual ACM SIGCHI Conference on Human Factors in Computing Systems CHI 2008, pp. 201–210 (2008)

    Google Scholar 

  22. Coutrix, C., Nigay, L.: Mixed reality: a model of mixed interaction. In: Proc. of the ACM working Conference on Advanced Visual Interfaces AVI 2006, pp. 43–50 (2006)

    Google Scholar 

  23. Wolfe, C., Graham, T.N., Phillips, W.G., Roy, B.: Fiia: user-centered development of adaptive groupware systems. In: Proc. of the ACM Symposium on Engineering Interactive Computing Systems, EICS 2009, pp. 275–284 (2009)

    Google Scholar 

  24. Bezivin, J.: On the unification power of models. Software and System Modeling 4(2), 171–188 (2005)

    Article  Google Scholar 

  25. Rothenberg, J.: The Nature of Modeling. In: Widman, L.E., Loparo, K.A., Nielsen, N.R. (eds.) Artificial Intelligence, Simulation and Modeling. John Wiley & Sons, Inc., Chichester (1989)

    Google Scholar 

  26. Muñoz, J., Pelechano, V.: Building a software factory for pervasive systems development. In: Pastor, Ó., Falcão e Cunha, J. (eds.) CAiSE 2005. LNCS, vol. 3520, pp. 342–356. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  27. Wittkaemper, M., Broll, W.: A Mixed Reality User Interface Description Language. In: Proc. of the International Conference on Computer Graphics and Interactive Techniques SIGGRAPH 2006 – Research poster, vol. 156 (2006)

    Google Scholar 

  28. Sandor, C., Reicher, T.: CUIML: A Language for the Generation of Multimodal Human-Computer Interfaces. In: Proc. of the European UIML Conference, vol. 124 (2001)

    Google Scholar 

  29. Ledermann, F., Schmalstieg, D.: APRIL: A high-level framework for creating Augmented Reality Presentations. In: Proc. of the IEEE International Conference on Virtual Reality, VR 2005, pp. 187–194 (2005)

    Google Scholar 

  30. Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., López-Jaquero, V.: IXML: A language supporting multi-path development of user interfaces. In: Proc. of the Joint Working Conferences EHCI-DSVIS 2004, pp. 200–220 (2004)

    Google Scholar 

  31. Dubois, E., Gray, P.: A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model. In: Gulliksen, J., Harning, M.B., van der Veer, G.C., Wesson, J. (eds.) EIS 2007. LNCS, vol. 4940, pp. 465–482. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  32. Eclipse Foundation, Eclipse Modeling Project (2006), http://www.eclipse.org/modeling (accessed September 6, 2010)

  33. Hartmann, B., Klemmer, S.R., Bernstein, M., Abdula, L., Burr, B., Robinson-Mosher, A., Gee, J.: Reflective physical prototyping through integrated design, test, and analysis. In: Proc. of the 19th Annual ACM Symposium on User Interface Software and Technology, UIST 2006, pp. 299–308 (2006)

    Google Scholar 

  34. Koleva, B., Egglestone, S.R., Schnädelbach, H., Glover, K., Greenhalgh, C., Rodden, T., Dade-Robertson, M.: Supporting the creation of hybrid museum experiences. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, pp. 1973–1982 (2009)

    Google Scholar 

  35. GuideMe, Editor of MIS specific models (2009), http://ihcs.irit.fr/guideme (accessed September 6, 2010)

  36. Gauffre, G., Charfi, S., Bortolaso, C., Bach, C., Dubois, E.: Developing Mixed Interactive Systems: A Model-Based Process for Generating and Managing Design Solutions. In: Dubois, E., Gray, P., Nigay, L. (eds.) The Engineering of Mixed Reality Systems. Springer Human Computer Interactions Series (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Gauffre, G., Dubois, E. (2011). Taking Advantage of Model-Driven Engineering Foundations for Mixed Interaction Design. In: Hussmann, H., Meixner, G., Zuehlke, D. (eds) Model-Driven Development of Advanced User Interfaces. Studies in Computational Intelligence, vol 340. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14562-9_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14562-9_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14561-2

  • Online ISBN: 978-3-642-14562-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics