Evaluating Effects of Hand Pointing by an Image-Based Avatar of a Navigation System

  • Michiko Inoue
  • Aya Shiraiwa
  • Hiroki Yoshimura
  • Masashi NishiyamaEmail author
  • Yoshio Iwai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10902)


We investigate whether the behavior of pointing at a map by an image-based avatar helps a user understand a route in an image-based avatar navigation system. We also evaluate whether this behavior is preferred by the user. Existing avatar-based methods inform the user of a route by this behavior while talking. However, the existing methods do not consider how to incorporate a map. Thus, we consider how to inform the user of a route using an image-based avatar that indicates the route by pointing at a map. In the experiments, after users interacted with the system, we conducted a route depiction test to determine whether a user was able to correctly understand the route on a map and performed a questionnaire-based subjective assessment to determine whether the user liked the image-based avatar system. The results of the experiments show that the pointing behavior significantly increased the likeability of the system but did not help the user understand the route.


Navigation system Hand pointing Image-based avatar Route depiction test Questionnaire 


  1. 1.
    Artstein, R., Traum, D., Alexander, O., Leuski, A., Jones, A., Georgila, K., Debevec, P., Swartout, W., Maio, H., Smith, S.: Time-offset interaction with a holocaust survivor. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, pp. 163–168 (2014)Google Scholar
  2. 2.
    Robinson, S., Traum, D., Ittycheriah, I., Henderer, J.: What would you ask a conversational agent? Observations of human-agent dialogues in a museum setting. In: Proceedings of the Sixth International Conference on Language Resources and Evaluation, pp. 28–30 (2008)Google Scholar
  3. 3.
    Nishiyama, M., Miyauchi, T., Yoshimura, H., Iwai, Y.: Synthesizing realistic image-based avatars by body sway analysis. In: Proceedings of the Fourth International Conference on Human Agent Interaction, pp. 155–162 (2016)Google Scholar
  4. 4.
    Jones, A., Unger, J., Nagano, K., Busch, J., Yu, X., Peng, H.I., Alexander, O., Bolas, M., Debevec, P.: An automultiscopic projector array for interactive digital humans. In: ACM SIGGRAPH 2015 Emerging TechnologiesGoogle Scholar
  5. 5.
    Miyauchi, T., Ono, A., Yoshimura, H., Nishiyama, M., Iwai, Y.: Embedding the awareness state and response state in an image-based Avatar to start natural user interaction. IEICE Trans. Inf. Syst. E100.D 12, 3045–3049 (2017)CrossRefGoogle Scholar
  6. 6.
    Darken, R.P., Peterson, B.: Spatial orientation wayfinding and representation. Design, Implementation, and Applications. Handbook of Virtual Environments. CRC Press, Boca Raton (2002)Google Scholar
  7. 7.
    Devlin, A.S., Bernstein, J.: Interactive wayfinding: use of cues by men and women. J. Environ. Psychol. 15(1), 23–38 (1995)CrossRefGoogle Scholar
  8. 8.
    Blades, M., Spencer, C.: How do people use maps to navigate through the world? Cartographica: Int. J. Geogr. Inf. Geovis. 24(3), 64–75 (1987)CrossRefGoogle Scholar
  9. 9.
    Makimura, Y., Yoshimura, H., Nishiyama, M., Iwai, Y.: Decreasing physical burden using the following effect and a superimposed navigation system. In: Virtual, Augmented and Mixed Reality, pp. 533–543 (2017)Google Scholar
  10. 10.
    Kopp, S., Tepper, P.A., Ferriman, K., Striegnitz, K., Cassell, J.: Trading spaces: how humans and humanoids use speech and gesture to give directions. In: Conversational Informatics: An Engineering Approach, pp. 1–26 (2007)Google Scholar
  11. 11.
    Bergmann, K., Kopp, S.: Gnetic - using Bayesian decision networks for iconic gesture generation. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents, pp. 76–89 (2009)CrossRefGoogle Scholar
  12. 12.
    Bergmann, K., Kopp, S.: Knowledge representation for generating locating gestures in route directions. In: Proceedings of Workshop on Spatial Language and Dialogue, pp. 1–13 (2005)Google Scholar
  13. 13.
    Taylor, H.A., Tversky, B.: The description of routes: a cognitive approach to the production of spatial discourse. Cah. Psychol. Cogn. 35, 371–391 (1996)Google Scholar
  14. 14.
    Cowan, N.: The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav. Brain Sci. 24(1), 87–114 (2001)CrossRefGoogle Scholar
  15. 15.
    Denis, M.: The description of routes: a cognitive approach to the production of spatial discourse. Cahiers Psychologie Cogn. 16(8), 409–458 (1997)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Michiko Inoue
    • 1
  • Aya Shiraiwa
    • 2
  • Hiroki Yoshimura
    • 2
  • Masashi Nishiyama
    • 2
    • 3
    Email author
  • Yoshio Iwai
    • 2
  1. 1.Graduate School of Sustainability ScienceTottori UniversityTottoriJapan
  2. 2.Graduate School of EngineeringTottori UniversityTottoriJapan
  3. 3.Cross-informatics Research CenterTottori UniversityTottoriJapan

Personalised recommendations