Abstract
Currently, there are limited, commercially available video games for people with disabilities. Sim-Assist is a software system that aims to allow people with disabilities to interface with a three-dimensional simulation game of Air Hockey. This is accomplished through various integrated assistive technologies, such as brain-computer interfacing, voice commands, and speech-to-text capabilities. With Sim-Assist, users are able to play Air Hockey without depending on sight, and in a hands-free manner. We conducted an exploratory study to provide the foundation for integrating assistive technologies in 3D simulations, including scientific simulations and serious games. In this paper, we introduce the research and development of assistive technologies, focusing more on the BCI software component; outline our system design and implementation; provide a short walkthrough of the interface; and briefly discuss our preliminary results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Annual Disability Statistics Compendium. http://disabilitycompendium.org/
Facts and Figures on Adults with Vision Loss. http://www.afb.org/info/blindnessstatistics/adults/facts-and-figures/235
Gomez, J., Montoro, G., Haya, P.A., Alaman, X., Alves, S., Martinez, M.: Adaptive manuals as assistive technology to support and train people with acquired brain injury in their daily life activities. Personal and Ubiquitous Computing 17, 1117–1126 (2013)
Donoghue, J.P., Nurmikko, A., Black, M., Hochberg, L.R.: Assistive technology and robotic control using motor cortex ensemble-based neural interface systems in humans with tetraplegia. The Journal of Physiology 579, 603–611 (2007)
Narasimhan, P., Gandhi, R., Rossi, D.: Smartphone-based assistive technologies for the blind. In: Proceedings of the 2009 International Conference on Compilers, Architecture, and Synthesis for Embedded Systems, pp. 223–232. ACM (2009)
Edyburn, D.L.: Assistive technology and mild disabilities. Special Education Technology Practice 8, 18–28 (2006)
Bright, A.K., Coventry, L.: Assistive technology for older adults: psychological and socio-emotional design requirements. In: Proceedings of the 6th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA-2013), pp. 9–12. ACM (May 2013)
Low Vision Aids and Technology. Macular Degeneration Foundation. Accessed July 30, 2015. http://www.mdfoundation.com.au/resources/1/MDFLowVisionAids.pdf
Burgess, D.: Techniques for low cost spatial audio. In: Proceedings of the 5th annual ACM Symposium on User Interface Software and Technology (UIST 1992), pp. 53–59 (1992)
Weinberg, F., Hellstrom, S.O.: The quest for auditory direct manipulation: the sonified towers of hanoi. In: Proceedings of the 3rd International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT 2000), pp. 75–81 (2000)
Mynatt, E.D., Weber, G.: Nonvisual presentation of graphical user interfaces: contrasting two approaches. In: Proceedings of the Human Factors in Computing Systems Conference, CHI 1994, pp. 166–172. ACM Press (1994)
Petrie, H., Morley, S., Weber, G.: Tactile-based direct manipulation in GUIs for blind users. In: Conference Companion on Human Factors in Computing Systems, CHI 1995, pp. 428–429. ACM, New York (1995)
Savidis, A., Stephanidis, C., Korte, A., Crispien, K., Fellbaum, K.: A generic direct-manipulation 3D auditory environment for hierarchical navigation in non-visual interaction. In: Proceedings of Assets 1996, pp. 117–123. ACM (1996)
Pitt, I.J., Edwards, A.D.N.: Navigating the interface by sound for blind users. In: Proceedings of the HCI 1991 Conference on People and Computers VI, pp. 373–383 (1991)
Gajos, K., Wobbrock, J., Weld, D.: Automatically generating user interfaces adapted to users’ motor and vision capabilities. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, pp. 231–240. ACM (2007)
Barreto, A., Scargle, S., Adjouadi, M.: A practical EMG-based human-computer interface for users with motor disabilities. Journal of Rehabilitation Research and Development 70, 53–64 (2000)
Salem, C., Zhai, S.: An isometric tongue pointing device. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 1997), pp. 538–539 (1997)
HeadMouse Extreme. Origin Instruments. http://www.orin.com/access/headmouse/ (accessed March 23, 2015)
Emotiv. http://emotiv.com (accessed May 10, 2015)
Junker, A., Sudkamp, T., Eachus, T., Mikov, T., Wegner, J., Edmister, E., Livick. S., Heiman–Patterson, T., Goren, M.: Hands-free computer access for the severely disabled (unpublished)
Pino, A., Kalogeros, E., Salemis, E., Kouroupetroglou, G.: Brain computer interface cursor measures for motion-impaired and able-bodied users. In: Proceedings of the 10th International Conference on Human-Computer Interaction, vol. 4, pp. 1462–1466 (2003)
Dascalu, S.: Scientific collaboration in virtual environments: the western consortium for watershed analysis, visualization, and exploration project. Invited talk. In: Proc. CTS 2014, pp. 560–561 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Chan, A.T., Gamino, A., Harris, F.C., Dascalu, S. (2016). Integration of Assistive Technologies into 3D Simulations: An Exploratory Study. In: Latifi, S. (eds) Information Technology: New Generations. Advances in Intelligent Systems and Computing, vol 448. Springer, Cham. https://doi.org/10.1007/978-3-319-32467-8_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-32467-8_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-32466-1
Online ISBN: 978-3-319-32467-8
eBook Packages: EngineeringEngineering (R0)