Abstract
This study investigates how the psychological notion of affordance, known from human computer interface design, can be adopted for the analysis and design of communication of a user with a Virtual Human (VH), as a novel interface. We take as starting point the original notion of affordance, used to describe the function of objects for humans. Then, we dwell on the human-computer interaction case when the object used by the human is (a piece of software in) the computer. In the next step, we look at human-human communication and identify actual and perceived affordances of the human body and mind. Then using the generic framework of affordances, we explain certain essential phenomena of human-human multimodal communication. Finally, we show how they carry over to the case of communicating with a ’designed human’, that is an VH, whose human-like communication means may be augmented with ones reminiscent of the computer and fictive worlds. In the closing section we discuss and reformulate the method of cognitive walkthrough to make it applicable for evaluating the design of verbal and non-verbal interactive behaviour of VHs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge (2000)
Cassell, J., Bickmore, T.W., Vilhjálmsson, H.H., Yan, H.: More than just a pretty face: affordances of embodiment. In: Proc. of Intelligent User Interfaces, pp. 52–59 (2000)
Cornwell, J., O’Brien, K., Silverman, B.G., Toth, J.: Affordance theory for improving the rapid generation, composability, and reusability of synthetic agents and objects. In: Proc. of 12th Conf. on Behavior Representation in Modeling and Simulation (2003)
Dennett, D.C.: True believers: The intentional strategy and why it works. In: Heath, A.F. (ed.) Scientific Explanations: Papers based on Herbert Spencer Lectures Given in the University of Oxford, Reprinted in The Nature of Consciousness (David Rosenthal, ed.) (1981)
Dennett, D.C.: The Intentional Stance. MIT Press, Cambridge (1987)
Dix, A., Finlay, J., Abowd, G., Beale, R.: Human Computer Interaction. Prentice Hall, Englewood Cliffs (2004)
Gaver, W.: Affordances for interaction: The social is material for design. Ecological Psychology 8(2), 112–129 (1996)
Gibson, J.J.: The ecological approach to visual perception. Houghton, Mifflin, Boston (1979), http://www.alamut.com/notebooks/a/affordances.html
Personal communication at the AAMAS 2004 ws ‘Balanced Perception and Action in ECAs’ (2004)
McGrenere, J., Ho, W.: Affordance: Clarifying and Evolving a Concept. In: Proceedings of Graphics Interface, Montreal, Canada, pp. 179–186 (2000)
Murphy, R.R.: Case studies of applying Gibson’s ecological approach to mobile robots. IEEE Transactions on Systems, Man, and Cybernetics, Part A 29(1), 105–111 (1999)
Norman, D.: The psychology of everyday things, Basic Books, New York(1988), http://www.jnd.org/dn.mss/affordances_and_desi.html
Peters, C., Pelachaud, C., Bevacqua, E., Mancini, M.: Engagement Capabilities of ECAs. In: AAMAS 2005 Ws on Creating Bonds with ECAs, Utrecht (2005)
Ruttkay, Zs., Pelachaud, C. (eds.): From Brows to Trust: Evaluating Embodied Conversational Agents. Kluwer, Dordrecht (2004)
Reeves, B., Nass, C.: The Media Equation. How People Treat Computers, Television and New Media Like Real People and Places. CSLI Publication Cambridge University Press, Cambridge (1998)
Ruttkay, Zs., Ten Hagen, P.: Reactive Monologues Modeling Refinement and Variations of Interaction Protocols of ECAs. In: Proc. of AAMAS 2004, Workshop on Balanced Perception and Action in ECAs, New York (2004)
Thórisson, K.R.: Natural Turn-Taking Needs No Manual. In: Granström, B., House, D., Karlsson, I. (eds.) Multimodality in Language and Speech Systems, pp. 173–207. Kluwer Academic Publishers, Dordrecht (2002)
Whittaker, S.: Theories and Methods in Mediated Communication. In: Graesser, A., Gernsbacher, M., Goldman, S. (eds.) The Handbook of Discourse Processes, pp. 243–286. Erlbaum, NJ (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ruttkay, Z., op den Akker, R. (2008). Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction. In: Esposito, A., Bourbakis, N.G., Avouris, N., Hatzilygeroudis, I. (eds) Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction. Lecture Notes in Computer Science(), vol 5042. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70872-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-70872-8_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70871-1
Online ISBN: 978-3-540-70872-8
eBook Packages: Computer ScienceComputer Science (R0)