Skip to main content
SpringerLink
Log in
Book cover

The Human Face of Ambient Intelligence pp 259–318Cite as

Implicit and Natural HCI in AmI: Ambient and Multimodal User Interfaces, Intelligent Agents, Intelligent Behavior, and Mental and Physical Invisibility

  • Chapter
  • First Online:

  • 1229 Accesses

Part of the book series: Atlantis Ambient and Pervasive Intelligence ((ATLANTISAPI,volume 9))

Abstract

This chapter intends to examine, discuss, and classify the different features of implicit and natural HCI pertaining to ambient and multimodal interaction and user interfaces, intelligent agents, intelligent behavior (personalization, adaptation, responsiveness, and anticipation), and mental and physical invisibility, as well as related issues, challenges, and limitations.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • ACM SIGCHI (2009) Curricula for human-computer interaction. http://old.sigchi.org/cdg/cdg2.html#2_1. Viewed 20 Dec 2009

  • Adjouadi M, Sesin A, Ayala M, Cabrerizo M (2004) Remote eye gaze tracking system as a computer interface for persons with severe motor disability. In: Proceedings of the 9th international conference on computers helping people with special needs, Paris, pp 761–766

    Google Scholar 

  • Alexander S, Sarrafzadeh A (2004) Interfaces that adapt like humans. In: Proceedings of 6th computer human interaction 6th Asia pacific conference (APCHI 2004), Rotorua, pp 641–645

    Google Scholar 

  • Argyle M, Cook M (1976) Gaze and mutual gaze. Cambridge University Press, Cambridge

    Google Scholar 

  • Balkenius C (1995) Natural intelligence in artificial creatures. PhD thesis, Department of Cognitive Studies, Lund University, Lund

    Google Scholar 

  • Balkenius C, Hulth N (1999) Attention as selection-for-action: a scheme for active perception. In: Schweitzer G, Burgard W, Nehmzow U, Vestli SJ (eds) Proceedings of EUROBOT ‘99, IEEE Press, pp 113–119

    Google Scholar 

  • Barkhuus L, Dey AK (2003) Is context-aware computing taking control away from the user? Three levels of interactivity examined. Proceedings of UbiComp. Springer, Heidelberg, pp 149–156

    Google Scholar 

  • Beslay L, Punie Y (2002) The virtual residence: identity, privacy and security. The IPTS Report 67:17–23 (Special Issue on Identity and Privacy)

    Google Scholar 

  • Bettini C, Brdiczka O, Henricksen K, Indulska J, Nicklas D, Ranganathan A, Riboni D (2010) A survey of context modelling and reasoning techniques. J Pervasive Mobile Comput 6(2):161–180 (Special Issue on Context Modelling, Reasoning and Management)

    Article  Google Scholar 

  • Bibri SE (2012) A critical reading of the scholarly and ICT industry’s construction of ambient intelligence for societal transformation of Europe. Master thesis, Malmö University

    Google Scholar 

  • Bohn J, Coroama V, Langheinrich M, Mattern F, Rohs M (2004) Living in a world of smart everyday objects—social, economic, and ethical implications. J Hum Ecol Risk Assess 10(5):763–786

    Article  Google Scholar 

  • Brown PJ, Jones GJF (2001) Context-aware retrieval: exploring a new environment for information retrieval and information altering. Pers Ubiquit Comput 5(4):253–263

    Article  Google Scholar 

  • Brown PJ, Bovey JD, Chen X (1997) Context-aware applications: from the laboratory to the marketplace. IEEE Pers Commun 4(5):58–64

    Article  Google Scholar 

  • Cassell J, Sullivan J, Prevost S, Churchill E (eds) (2000) Embodied conversational agents. MIT Press, Cambridge

    Google Scholar 

  • Chen G, Kotz D (2000) A survey of context-aware mobile computing research. Paper TR2000-381, Department of Computer Science, Darthmouth College

    Google Scholar 

  • Cheverst K, Mitchell K, Davies N (2001) Investigating context-aware information push vs. information pull to tourists. In: Proceedings of mobile HCI 01

    Google Scholar 

  • Criel J, Claeys L (2008) A transdisciplinary study design on context-aware applications and environments, a critical view on user participation within calm computing. Observatorio (OBS*) J 5:057–077

    Google Scholar 

  • Crutzen CKM (2005) Intelligent ambience between heaven and hell. Inf Commun Ethics Soc 3(4):219–232

    Article  Google Scholar 

  • de Silva GC, Lyons MJ, Tetsutani N (2004) Vision based acquisition of mouth actions for human-computer interaction. In: Proceedings of the 8th pacific rim international conference on artificial intelligence, Auckland, pp 959–960

    Google Scholar 

  • Dewey J (1916) Democracy and education. The Macmillan Company, used edition: ILT Digital Classics 1994. http://www.ilt.columbia.edu/publications/dewey.html. Viewed 25 June 2005

  • Dey AK (2001) Understanding and using context. Pers Ubiquit Comput 5(1):4–7

    Article  Google Scholar 

  • Dix A, FinlayJ, Abowd G, Beale R (1998) Human computer interaction. Prentice Hall Europe, Englewood Cliffs, NJ

    Google Scholar 

  • Dourish P (2001) Where the action is. MIT Press

    Google Scholar 

  • Dreyfus H (2001) On the internet. Routledge, London

    Google Scholar 

  • Erickson T (2002) Ask not for whom the cell phone tolls: some problems with the notion of context-aware computing. Commun ACM 45(2):102–104

    Article  Google Scholar 

  • Franklin S, Graesser A (1997) Is it an agent, or just a program?: a taxonomy for autonomous agents. In: Proceedings of the 3rd international workshop on agent theories, architectures, and languages. Springer, London

    Google Scholar 

  • Gill SK, Cormican K (2005) Support ambient intelligence solutions for small to medium size enterprises: Typologies and taxonomies for developers. In: Proceedings of the 12th international conference on concurrent enterprising, Milan, Italy, 26–28 June 2005

    Google Scholar 

  • Hayes PJ, Reddy RD (1983) Steps toward graceful interaction in spoken and written man-machine communication. Int J Man Mach Stud I(19):231–284

    Google Scholar 

  • Hix D, Hartson HR (1993) Developing user interfaces: ensuring usability through product and process. Wiley, London

    Google Scholar 

  • ISO 9241-11 (1998) Ergonomic requirements for office work with visual display terminals (VDTs), part 11: guidance on usability. International Organization for Standardization, Switzerland, Genève

    Google Scholar 

  • ISTAG 2001 (2001) Scenarios for ambient intelligence in 2010. ftp://ftp.cordis.lu/pub/ist/docs/istagscenarios2010.pdf. Viewed 22 Oct 2009

  • ISTAG 2003 (2003) Ambient intelligence: from vision to reality (For participation—in society and business). http://www.ideo.co.uk/DTI/CatalIST/istag-ist2003_draft_consolidated_report.pdf. Viewed 23 Oct 2009

  • José R, Rodrigues H, Otero N (2010) Ambient intelligence: beyond the inspiring vision. J Univ Comput Sci 16(12):1480–1499

    Google Scholar 

  • Karpinski M (2009) From speech and gestures to dialogue acts. In: Esposito A, Hussain A, Marinaro M, Martone R (eds) Multimodal signals: cognitive and algorithmic issues. Springer, Berlin, pp 164–169

    Chapter  Google Scholar 

  • Kasabov N (1998) Introduction: hybrid intelligent adaptive systems’. Int J Intell Syst 6:453–454

    Article  Google Scholar 

  • Kelley T (2002) The art of innovation: lessons in creativity from IDEO, America’s leading design firm. Harper Collins Business, London

    Google Scholar 

  • Kim S, Suh E, Yoo K (2007) A study of context inference for web-based information systems. Electron Commer Res Appl 6:146–158

    Article  Google Scholar 

  • Kumar M, Paepcke A, Winograd T (2007) EyePoint: practical pointing and selection using gaze and keyboard. In: Proceedings of the CHI: conference on human factors in computing systems, San Jose, CA, pp 421–30

    Google Scholar 

  • Lavie T, Tractinsky N (2004) Assessing dimensions of perceived visual aesthetics of web sites. Int J Hum Comput Stud 60(3):269–298

    Article  Google Scholar 

  • Lee Y, Shin C, Woo W (2009) Context-aware cognitive agent architecture for ambient user interfaces. In: Jacko JA (ed) Hum Comput Interact. Springer, Berlin, pp 456–463

    Google Scholar 

  • Lenat DB, Guha RV (1994) Enabling agents to work together. Communications of the ACM 37(7):127–142

    Google Scholar 

  • Lenat DB, Guha RV, Pittman K, PrattM D, Shepherd M (1990) Cyc: toward programs with commonsense. Commun ACM 33(8):30–49

    Article  Google Scholar 

  • Lieberman H, Selker T (2000) Out of context: computer systems that adapt to, and learn from, context. IBM Syst J 39:617–632

    Article  Google Scholar 

  • Lindblom J, Ziemke T (2002) Social situatedness: Vygotsky and beyond. In: 2nd international workshop on epigenetic robotics: modeling cognitive development in robotic systems, Edinburgh, pp 71–78

    Google Scholar 

  • Luck M, McBurney P, Priest C (2003) Agent technology: enabling next generation computing. A roadmap for agent-based computing. Agentlink EU FP5 NoE

    Google Scholar 

  • Lucky R (1999) Connections. In: Bi-monthly column in IEEE Spectrum

    Google Scholar 

  • Lueg C (2002) Operationalizing context in context-aware artifacts: benefits and pitfalls. Hum Technol Interface 5(2):1–5

    Google Scholar 

  • Luger G, Stubblefield W (2004) Artificial intelligence: structures and strategies for complex problem solving. The Benjamin/Cummings Publishing Company Inc

    Google Scholar 

  • Nielsen J (1993) Usability engineering. Academic Press, Boston

    Google Scholar 

  • Nielsen J, Budiu R (2012) Mobile usability. New Riders Press

    Google Scholar 

  • Norman DA (1988) The design of everyday things. Doubleday, New York

    Google Scholar 

  • Norman DA (1998) The invisible computer. MIT Press, Cambridge, MA

    Google Scholar 

  • Pantic M, Rothkrantz LJM (2003) Toward an affect sensitive multimodal human-computer interaction. Proc IEEE 91(9):1370–1390

    Article  Google Scholar 

  • Petersen MG (2004) Remarkable computing—the challenge of designing for the Home. In: CHI 2004, Vienna, Austria, pp 1445–1448

    Google Scholar 

  • Pfeifer R, Scheier C (1999) Understanding intelligence. MIT Press, Cambridge

    Google Scholar 

  • Picard RW (1997) Affective computing. MIT Press, Cambridge

    Book  Google Scholar 

  • Picard RW (2000) Perceptual user interfaces: affective perception. Commun ACM 43(3):50–51

    Article  Google Scholar 

  • Picard RW, Vyzas E, Healey J (2001) Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175–1191

    Article  Google Scholar 

  • Poslad S (2009) Ubiquitous computing: smart devices, environments and interaction. Wiley, London

    Google Scholar 

  • Punie Y (2003) A social and technological view of ambient intelligence in everyday life: what bends the trend? In: The European media and technology in everyday life network, 2000–2003, Institute for Prospective Technological Studies Directorate General Joint Research Center European Commission

    Google Scholar 

  • Punie Y (2005) The future of ambient intelligence in europe: the need for more everyday life. In: Media technology and everyday life in Europe: from information to communication. Roger Silverstone Edition, Ashgate, pp. 141–165

    Google Scholar 

  • Rieder B (2003) Agent technology and the delegation-paradigm in a networked society. Paper for the EMTEL conference, 23–26 April, London

    Google Scholar 

  • Rist T, Brandmeier P (2002) Customizing graphics for tiny displays of mobile devices. Pers Ubiquit Comput 6(4):260–268

    Article  Google Scholar 

  • Riva G, Loreti P, Lunghi M, Vatalaro F, Davide F (2003) Presence 2010: the emergence of ambient intelligence. In: Riva G, Davide F, Jsselsteijn WAI (eds) Being there: concepts, effects and measurement of user presence in synthetic environments. IOS Press, Amsterdam, pp 60–81

    Google Scholar 

  • Riva G, Vatalaro F, Davide F, Alcañiz M (2005) Ambient intelligence: the evolution of technology, communication and cognition towards the future of human-computer interaction. IOS Press, Amsterdam

    Google Scholar 

  • Rosen R (1985) Anticipatory systems: philosophical, mathematical and methodological foundations. Pergamon Press, Oxford

    Google Scholar 

  • Rosenfield PL (1992) The potential of transdisciplinary research for sustaining and extending linkages between the health and social science. Soc Sci Med 35(11):1343–1357

    Google Scholar 

  • Rossi D, Schwabe G, Guimares R (2001) Designing personalized web applications. In: Proceedings of the tenth international conference on World Wide Web, pp 275–284

    Google Scholar 

  • Russell S, Norvig P (1995) Artificial intelligence: a modern approach. Prentice-Hall Inc, Englewood Cliffs, NJ

    Google Scholar 

  • Russell S, Norvig P (2003) Artificial intelligence—a modern approach. Pearson Education, Upper Saddle River, New Jersey

    Google Scholar 

  • Samtani P, Valente A, Johnson WL (2008) Applying the SAIBA framework to the tactical language and culture training system. In: Parkes P, Parsons M (eds) The 7th international conference on autonomous agents and multiagent systems (AAMAS 2008). Estoril, Portugal

    Google Scholar 

  • Schilit B, Adams N, Want R (1994) Context-aware computing applications. In: Proceedings of IEEE workshop on mobile computing systems and applications, Santa Cruz, CA, pp 85–90

    Google Scholar 

  • Schmidhuber J (1991) Adaptive confidence and adaptive curiosity. Technische Universitat Munchen, Institut fur Informatik

    Google Scholar 

  • Schmidt A (2005) Interactive context-aware systems interacting with ambient intelligence. In: Riva G, Vatalaro F, Davide F, Alcañiz M (eds) Ambient intelligence: the evolution of technology, communication and cognition towards the future of human-computer interaction. IOS Press, Amsterdam, pp 159–178

    Google Scholar 

  • Schütz A, Luckmann T (1974) The structures of the life-world. Heinemann, London

    Google Scholar 

  • Sibert LE, Jacob RJK (2000) Evaluation of eye gaze interaction. In: Proceedings of the ACM conference on human factors in computing systems. The Hague, pp 281–288

    Google Scholar 

  • Smith R, Conrey FR (2007) Agent-based modeling: a new approach for theory building in social psychology. Person Soc Psychol Rev 11:87–104

    Article  Google Scholar 

  • Somervell J, Wahid S, McCrickard DS (2003) Usability heuristics for large screen information exhibits. In: Rauterberg M, Menozzi M, Wesson J (eds) INTERACT 2003, Zurich, pp 904–907

    Google Scholar 

  • Stiermerling O, Kahler H, Wulf V (1997) How to make software softer—designing tailorable applications. In: Symposium on designing interactive systems, pp 365–376

    Google Scholar 

  • Suchman L (1987) Plans and situated actions: the problem of human-machine communication. Cambridge University Press, Cambridge

    Google Scholar 

  • Suchman L (2005) Introduction to plans and situated actions II: human-machine reconfigurations, 2nd edn. Cambridge University Press, New York/Cambridge

    Google Scholar 

  • Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge, MA

    Google Scholar 

  • ter Maat M, Heylen D (2009) Using context to disambiguate communicative signals. In: Esposito A, Hussain A, Marinaro M, Martone R (eds) Multimodal signals. Springer, Berlin, pp 164–169

    Google Scholar 

  • Udsen LE, Jorgensen AH (2005) The aesthetic turn: unraveling recent aesthetic approaches to human-computer interaction. Digital Creativity 16(4):205–216

    Google Scholar 

  • Ulrich W (2008) Information, context, and critique: context awareness of the third kind. In: The 31st information systems research seminar in Scandinavia, Keynote talk presented to IRIS 31

    Google Scholar 

  • Vilhjálmsson HH (2009) Representing communicative function and behavior in multimodal communication. In: Esposito A, Hussain A, Marinaro M, Martone R (eds) Signals: cognitive and algorithmic issues. Springer, Berlin, pp 47–59

    Chapter  Google Scholar 

  • Wasserman V, Rafaeli A, Kluger AN (2000) Aesthetic symbols as emotional cues. In: Fineman S (ed) Emotion in organizations. Sage, London, pp 140–167

    Chapter  Google Scholar 

  • Weiser M (1991) The computer for the 21st century. Sci Am 265(3):94–104

    Article  Google Scholar 

  • Weiser M, Brown JS (1998) The coming age of calm technology. In: Denning PJ, Metcalfe RM (eds) Beyond calculation: the next fifty years of computing. Springer, New York, pp 75–85

    Google Scholar 

  • Wooldridge M (2002) An introduction to multiagent systems. Wiley, London

    Google Scholar 

  • Wooldridge M, Jennings NR (1995) Intelligent agents: theory and practice. Knowl Eng Rev 10(2):115–152

    Article  Google Scholar 

  • Wright D (2005) The dark side of ambient intelligence. Forsight 7(6):33–51

    Google Scholar 

  • Wright D, Gutwirth S, Friedewald M, Punie Y, Vildjiounaite E (2008) Safeguards in a world of ambient intelligence. Springer, Dordrecht

    Google Scholar 

  • York J, Pendharkar PC (2004) Human-computer interaction issues for mobile computing in a variable work context. Int J Hum Comput Stud 60:771–797

    Article  Google Scholar 

  • Zhou J, Kallio P (2005) Ambient emotion intelligence: from business awareness to emotion awareness. In: Proceeding of 17th international conference on systems research, informatics and cybernetics, Baden

    Google Scholar 

  • Zhou J, Yu C, Riekki J, Kärkkäinen E (2007) AmE framework: a model for emotion-aware ambient intelligence. University of Oulu, Department of Electrical and Information Engineering, Faculty of Humanities, Department of English VTT Technical Research Center of Finland

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Halmstad University, Halmstad, Sweden

    Simon Elias Bibri

Authors
  1. Simon Elias Bibri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simon Elias Bibri .

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Atlantis Press and the author(s)

About this chapter

Cite this chapter

Bibri, S.E. (2015). Implicit and Natural HCI in AmI: Ambient and Multimodal User Interfaces, Intelligent Agents, Intelligent Behavior, and Mental and Physical Invisibility. In: The Human Face of Ambient Intelligence. Atlantis Ambient and Pervasive Intelligence, vol 9. Atlantis Press, Paris. https://doi.org/10.2991/978-94-6239-130-7_6

Download citation

  • DOI: https://doi.org/10.2991/978-94-6239-130-7_6

  • Published:

  • Publisher Name: Atlantis Press, Paris

  • Print ISBN: 978-94-6239-129-1

  • Online ISBN: 978-94-6239-130-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation