Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction

  • Minghao CaiEmail author
  • Soh Masuko
  • Jiro Tanaka
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10903)


In this paper, we introduce a remote co-shopping system–Shopping Together for two geographically separated people: an in-house user who remains in a house and an in-store user who goes to a shopping place. We support the two of users to achieve a real-time two-way spatial gestural interaction in the physical shopping world where the in-store user stays, with an attention awareness subsystem to enhance a common feeling. The in-house user accesses to the remote shopping venue with an immersive shopping feeling, while the in-store user experiences an augmented reality feeling. Through our system, users could accomplish a shopping task together and share a Shopping together feeling which means a sensation that they are going for purchase together in the same space.


Immersive shopping Remote communication Gestural interaction 


  1. 1.
    Kegel, I., Cesar, P., Jansen, J., Bulterman, D.C., Stevens, T., Kort, J., Färber, N.: Enabling ‘togetherness’ in high-quality domestic video. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 159–168. ACM (2012)Google Scholar
  2. 2.
    Cook, S.W., Tanenhaus, M.K.: Embodied communication: speakers gestures affect listeners actions. Cognition 113(1), 98–104 (2009)CrossRefGoogle Scholar
  3. 3.
    Sodhi, R.S., Jones, B.R., Forsyth, D., Bailey, B.P., Maciocci, G.: Bethere: 3D mobile collaboration with spatial input. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 179–188. ACM (2013)Google Scholar
  4. 4.
    Karam, H., Tanaka, J.: Finger click detection using a depth camera. Procedia Manuf. 3, 5381–5388 (2015)CrossRefGoogle Scholar
  5. 5.
    Karam, H., Tanaka, J.: Two-handed interactive menu: an application of asymmetric bimanual gestures and depth based selection techniques. In: Yamamoto, S. (ed.) HCI 2014. LNCS, vol. 8521, pp. 187–198. Springer, Cham (2014). Scholar
  6. 6.
    Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)CrossRefGoogle Scholar
  7. 7.
    Chang, C.T., Takahashi, S., Tanaka, J.: WithYou - a communication system to provide out together feeling. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 320–323. ACM (2012)Google Scholar
  8. 8.
    Cai, M., Tanaka, J.: Trip together: a remote pair sightseeing system supporting gestural communication. In: Proceedings of the 5th International Conference on Human Agent Interaction, pp. 317–324. ACM (2017)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Waseda UniversityKitakyushuJapan
  2. 2.Rakuten Institute of Technology, Rakuten, Inc.TokyoJapan

Personalised recommendations