“Where Did I Put That?” – Effectiveness of Kinesthetic Memory in Immersive Virtual Environments

  • Achim Ebert
  • Matthias Deller
  • Daniel Steffen
  • Matthias Heintz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5616)


Kinesthetic memory is an essential factor in human interaction with the outside world. It helps adept keyboard users to type rapidly and hit the keys without having to look at them. It enables musicians to play their instruments without consciously having to think about the necessary movements. And it can help people to find things again, based on the location where they put them. The benefits of kinesthetic memory in the physical world are well known and well used for training or in physical therapy. Yet little effort has been made to examine the effects of kinesthetic memory in a virtual environment. In our paper, we present a user study designed to explore the intensity of kinesthetic memory while interacting with a large screen immersive environment. This could be used to improve the usability and effectiveness of user interfaces for such environments.


Kinesthetic memory Virtual environments Usability 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ängeslevä, J., Oakley, I., Hughes, S., O’Modhrain, S.: Body mnemonics – Portable device interaction design concept. In: UIST 2003 – Adjunct Proceedings of the 16th annual ACM Symposium on user interface software and technology, ACM, New York (2003)Google Scholar
  2. 2.
    Bakdash, J.Z., Augustyn, J.S., Proffitt, D.R.: Large displays enhance spatial knowledge of a virtual environment. In: Proceedings of the 3rd symposium on Applied perception in graphics and visualization, pp. 59–62. ACM, New York (2006)CrossRefGoogle Scholar
  3. 3.
    Balakrishnan, R., Hinckley, K.: The role of kinesthetic reference frames in two-handed input performance. In: Proceedings of the 12th annual ACM symposium on User interface software and technology, pp. 171–178. ACM, New York (1999)CrossRefGoogle Scholar
  4. 4.
    Ball, R., DellaNoce, M., Ni, T., Quek, F., North, C.: Applying embodied interaction and usability engineering to visualization on large displays. In: British HCI – Workshop on visualization and interaction, pp. 57–65 (2006)Google Scholar
  5. 5.
    Ball, R., North, C.: Visual analytics: realizing embodied interaction for visual analytics through large displays. In: Computers and graphics, vol. 31, pp. 380–400. Pergamon Press, Elmsford (2007)Google Scholar
  6. 6.
    Boeck, J.D., Cuppens, E., Weyer, T.D., Raymaekers, C., Coninx, K.: Multisensory interaction metaphors with haptics and proprioception in virtual environments. In: Proceedings of the 3rd Nordic conference on human-computer interaction, pp. 189–197. ACM, New York (2004)CrossRefGoogle Scholar
  7. 7.
    Bowman, D.A., Wingrave, C.A.: Desing and evaluation of menu systems for immersive virtual environments. In: Proceedings of the Virtual Reality 2001 Conference (VR 2001), pp. 149–156. IEEE Computer Society, Washington (2001)CrossRefGoogle Scholar
  8. 8.
    Kahol, K., Tripathi, P., Panchanathan, S.: Tactile cueing in haptic visualization. In: Proceedings of the ACM workshop on haptic visualization at ACM Comupter Human Conference, ACM, New York (2005)Google Scholar
  9. 9.
    Klemmer, S.R., Hartmann, B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of the 6th conference on Designing Interactive systems, pp. 140–149. ACM, New York (2006)CrossRefGoogle Scholar
  10. 10.
    Larssen, A.T., Robertson, T., Edwards, J.: The feel dimension of technology interaction: exploring tangibles through movement and touch. In: Proceedings of the 1st international conference on Tangible and embedded interaction, pp. 271–278. ACM, New York (2007)CrossRefGoogle Scholar
  11. 11.
    Levisohn, A.M.: The body as a medium: reassessing the role of kinesthetic awareness in interactive applications. In: Proceedings of the 15th international conference on Multimedia, pp. 485–488. ACM, New York (2007)CrossRefGoogle Scholar
  12. 12.
    Mine, M.R., Brooks, F.P., Sequin, C.H.: Moving objects in space: exploiting proprioception in virtual-environment interaction. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, pp. 19–26. ACM, New York (1997)Google Scholar
  13. 13.
    Ni, T., Bowman, D.A., Chen, J.: Increased display size and resolution improve task performance in information-rich virtual environments. In: Proceedings of Graphics Interface 2006, pp. 139–146. Canadian Information Processing Society, Toronto (2006)Google Scholar
  14. 14.
    Seitz, J.A.: The bodily basis of thought. New ideas in Psychology: An international journal of innovative theory in psychology 18, 23–40Google Scholar
  15. 15.
    Sivilotti, P.A.G., Pike, S.M.: A collection of kinesthetic learning activities for a course on distributed computing: ACM SIGACT news distributed computing column 26. In: ACM SIGACT News, pp. 56–74. ACM, New York (2007)Google Scholar
  16. 16.
    Tan, D., Pausch, R., Stefanucci, J.K., Proffitt, D.R.: Kinesthetic cues aid spatial memory. In: CHI 2002 extended abstracts on Human factors in computing systems, pp. 806–807. ACM, New York (2002)Google Scholar
  17. 17.
    Tan, D.S., Gergle, D., Scupelli, P., Pausch, R.: Physically large displays improve performance on spatial tasks. In: ACM Transactions on Computer-human interaction, vol. 13, pp. 71–99. ACM, New York (2006)Google Scholar
  18. 18.
    Tan, D.S., Stefanucci, J.K., Proffitt, D.R., Pausch, R.: The Infocockpit: providing location and place to aid human memory. In: Proceedings of the 2001 workshop on Perceptive user interfaces, pp. 1–4. ACM, New York (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Achim Ebert
    • 1
  • Matthias Deller
    • 1
  • Daniel Steffen
    • 1
  • Matthias Heintz
    • 1
  1. 1.DFKI GmbH, CC Human-Centered VisualizationKaiserslauternGermany

Personalised recommendations