Skip to main content

From Body Tracking Interaction in Floor Projection Displays to Elderly Cardiorespiratory Training Through Exergaming

  • Conference paper
  • First Online:
  • 397 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10057))

Abstract

The opportunity to develop new natural user interfaces has come forward due to the recent development of inexpensive full body tracking sensors, which has made this technology accessible to millions of users. In this paper, we present a comparative study between two natural user interfaces, and a cardiorespiratory training exergame developed based on the study results. The focus was on studying interfaces that could easily be used by an elderly population for interaction with floor projection displays. One interface uses both feet position to control a cursor and feet distance to trigger activation. In the alternative interface, the cursor is controlled by forearm ray casting into the projection floor and interaction is activated by hand pose. These modes of interaction were tested with 19 elderly participants in a point-and-click and a drag-and-drop task using a between-subjects experimental design. The usability, perceived workload and performance indicators were measured for each interface. Results show a clear preference towards the feet-controlled interface and a marginally better performance for this method. The results from the study served as a guide to the design of a cardiorespiratory fitness exergame for the elderly. The game “Grape Stomping” uses ground projection and mapping to display real-size winery elements. These virtual elements are used to simulate, in a playful way, the process of grape maceration through repeated stomping. A playtest session with nine elderly users was completed and its insights are presented in addition to the description of the game.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. European Commission, Economic and Financial Affairs: The 2012 Ageing Report (2012)

    Google Scholar 

  2. Fozard, J.: Vision and hearing in aging. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the Psychology of Aging, pp. 143–156. Academic Press, San Diego (1990)

    Google Scholar 

  3. World Health Organization: Global recommendations on physical activity for health (2010). http://www.who.int/dietphysicalactivity/publications/9789241599979/en/

  4. Microsoft News Center: Xbox Execs Talk Momentum and the Future of TV (2013). http://news.microsoft.com/2013/02/11/xbox-execs-talk-momentum-and-the-future-of-tv/

  5. Microsoft’s Q2: Record $24.52 billion revenue and 3.9 million Xbox One sales. http://www.theverge.com/2014/1/23/5338162/microsoft-q2-2014-financial-earnings

  6. Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)

    Google Scholar 

  7. Chen, C., Liu, K., Jafari, R., Kehtarnavaz, N.: Home-based Senior Fitness Test measurement system using collaborative inertial and depth sensors. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4135–4138 (2014)

    Google Scholar 

  8. Gonçalves, A., Gouveia, É., Cameirão, M., Bermúdez i Badia, S.: Automating senior fitness testing through gesture detection with depth sensors. In: Proceedings of the IET International Conference on Technologies for Active and Assisted Living (TechAAL 2015). Institution of Engineering and Technology, London (2015)

    Google Scholar 

  9. Da Gama, A., Chaves, T., Figueiredo, L., Teichrieb, V.: Guidance and movement correction based on therapeutics movements for motor rehabilitation support systems. In: 2012 14th Symposium on Virtual and Augmented Reality (SVR), pp. 191–200 (2012)

    Google Scholar 

  10. Spasojević, S., Santos-Victor, J., Ilić, T., Milanović, S., Potkonjak, V., Rodić, A.: A vision-based system for movement analysis in medical applications: the example of Parkinson disease. In: Nalpantidis, L., Krüger, V., Eklundh, J.-O., Gasteratos, A. (eds.) ICVS 2015. LNCS, vol. 9163, pp. 424–434. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20904-3_38

    Chapter  Google Scholar 

  11. Jones, B., et al.: RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 637–644. ACM, New York (2014)

    Google Scholar 

  12. Gonçalves, A., Cameirão, M.: Evaluating body tracking interaction in floor projection displays with an elderly population. In: Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS, Lisbon, Portugal, pp. 24–32 (2016)

    Google Scholar 

  13. Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 177–186. ACM, New York (2011)

    Google Scholar 

  14. Boulos, M.N.K., Blanchard, B.J., Walker, C., Montero, J., Tripathy, A., Gutierrez-Osuna, R.: Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation. Int. J. Health Geogr. 10, 45 (2011)

    Article  Google Scholar 

  15. Francese, R., Passero, I., Tortora, G.: Wiimote and Kinect: gestural user interfaces add a natural third dimension to HCI. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 116–123. ACM, New York (2012)

    Google Scholar 

  16. Roupé, M., Bosch-Sijtsema, P., Johansson, M.: Interactive navigation interface for Virtual Reality using the human body. Comput. Environ. Urban Syst. 43, 42–50 (2014)

    Article  Google Scholar 

  17. Tan, J.H., Chao, C., Zawaideh, M., Roberts, A.C., Kinney, T.B.: Informatics in radiology: developing a touchless user interface for intraoperative image control during interventional radiology procedures. RadioGraphics. 33, E61–E70 (2013)

    Article  Google Scholar 

  18. Bigdelou, A., Schwarz, L., Navab, N.: An adaptive solution for intra-operative gesture-based human-machine interaction. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 75–84. ACM, New York (2012)

    Google Scholar 

  19. Fikkert, W., van der Vet, P., van der Veer, G., Nijholt, A.: Gestures for large display control. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS (LNAI), vol. 5934, pp. 245–256. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12553-9_22

    Chapter  Google Scholar 

  20. Vatavu, R.-D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video, pp. 45–48. ACM, New York (2012)

    Google Scholar 

  21. Golod, I., Heidrich, F., Möllering, C., Ziefle, M.: Design principles of hand gesture interfaces for microinteractions. In: Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces, pp. 11–20. ACM, New York (2013)

    Google Scholar 

  22. Lee, S.-S., Chae, J., Kim, H., Lim, Y., Lee, K.: Towards more natural digital content manipulation via user freehand gestural interaction in a living room. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 617–626. ACM, New York (2013)

    Google Scholar 

  23. Bragdon, A., DeLine, R., Hinckley, K., Morris, M.R.: Code space: Touch + Air gesture hybrid interactions for supporting developer meetings. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 212–221. ACM, New York (2011)

    Google Scholar 

  24. Hopmann, M., Salamin, P., Chauvin, N., Vexo, F., Thalmann, D.: Natural activation for gesture recognition systems. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 173–183. ACM, New York (2011)

    Google Scholar 

  25. Krogh, P., Ludvigsen, M., Lykke-Olesen, A.: “Help Me Pull That Cursor” A collaborative interactive floor enhancing community interaction. Australas. J. Inf. Syst. 11, 75–87 (2004)

    Google Scholar 

  26. Augsten, T., et al.: Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 209–218. ACM, New York (2010)

    Google Scholar 

  27. Larsen, L.H., Schou, L., Lund, H.H., Langberg, H.: The physical effect of exergames in healthy elderly—a systematic review. GAMES Health Res. Dev. Clin. Appl. 2, 205–212 (2013)

    Article  Google Scholar 

  28. Molina, K.I., Ricci, N.A., de Moraes, S.A., Perracini, M.R.: Virtual reality using games for improving physical functioning in older adults: a systematic review. J. Neuroeng. Rehabil. 11, 156 (2014)

    Article  Google Scholar 

  29. Vanden Abeele, V.A., Van Rompaey, V.: Introducing human-centered research to game design: designing game concepts for and with senior citizens. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 1469–1474. ACM (2006)

    Google Scholar 

  30. Gerling, K., Masuch, M.: When gaming is not suitable for everyone: playtesting Wii games with frail elderly. In: 1st Workshop on Game Accessibility (2011)

    Google Scholar 

  31. Sayago, S., Rosales, A., Righi, V., Ferreira, S.M., Coleman, G.W., Blat, J.: On the conceptualization, design, and evaluation of appealing, meaningful, and playable digital games for older people. Games Cult. 11, 53–80 (2016)

    Article  Google Scholar 

  32. Folstein, M.F., Folstein, S.E., McHugh, P.R.: Mini-mental state. J. Psychiatr. Res. 12, 189–198 (1975)

    Article  Google Scholar 

  33. Roberta E. Rikli, C.J.J.: The Reliability and Validity of a 6-Minute Walk Test as a Measure of Physical Endurance in Older Adults (1998)

    Google Scholar 

  34. Brooke, J.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189, 194 (1996)

    Google Scholar 

  35. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Advances in Psychology, pp. 139–183. North-Holland, Amsterdam (1988)

    Google Scholar 

  36. Mousavi Hondori, H., Khademi, M., Dodakian, L., McKenzie, A., Lopes, C.V., Cramer, S.C.: Choice of human-computer interaction mode in stroke rehabilitation. Neurorehabil. Neural. Repair. 30, 258–265 (2015)

    Article  Google Scholar 

  37. Cunha, C.A., Cunha, R.: Culture and Customs of Portugal. ABC-CLIO (2010)

    Google Scholar 

  38. Oja, P., Tuxworth, B., et al.: Eurofit for adults: assessment of health-related fitness. Council of Europe (1995)

    Google Scholar 

  39. Rikli, R.E., Jones, C.J.: Development and validation of a functional fitness test for community-residing older adults. J. Aging Phys. Act. 7, 129–161 (1999)

    Article  Google Scholar 

  40. Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. CRC Press, Boca Raton (2005)

    Book  Google Scholar 

Download references

Acknowledgment

The authors thank Funchal’s Santo António municipal gymnasium for their cooperation, Teresa Paulino for the development of the experimental tasks, Fábio Pereira for his help during the data collection process, and Diogo Freitas and John Sousa for their contributions in the development of the first prototype of “Grape Stomping”.

This work was supported by the Fundação para a Ciência e Tecnologia through the AHA project (CMUPERI/HCI/0046/2013) and LARSyS – UID/EEA/50009/2013.

Author information

Authors and Affiliations

Authors

Contributions

Afonso Gonçalves designed and carried out the floor projection interaction study, designed the “Grape Stomping” game and wrote the paper. Filipa Nóbrega developed the game and contributed to the writing of the paper. Mónica Cameirão supervised the study, contributed to the game design and writing of the paper. John Muñoz, Élvio Gouveia and Sergi Bermudez i Badia contributed to the game design and writing of the paper.

Corresponding author

Correspondence to Afonso Gonçalves .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gonçalves, A., Nóbrega, F., Cameirão, M., Muñoz, J.E., Gouveia, É., Bermudez i Badia, S. (2019). From Body Tracking Interaction in Floor Projection Displays to Elderly Cardiorespiratory Training Through Exergaming. In: Holzinger, A., Pope, A., Plácido da Silva, H. (eds) Physiological Computing Systems. PhyCS PhyCS PhyCS 2016 2017 2018. Lecture Notes in Computer Science(), vol 10057. Springer, Cham. https://doi.org/10.1007/978-3-030-27950-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-27950-9_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-27949-3

  • Online ISBN: 978-3-030-27950-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics