Skip to main content

BCI-Based Navigation in Virtual and Real Environments

  • Conference paper
Advances in Computational Intelligence (IWANN 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7903))

Included in the following conference series:

Abstract

A Brain-Computer Interface (BCI) is a system that enables people to control an external device with their brain activity, without the need of any muscular activity. Researchers in the BCI field aim to develop applications to improve the quality of life of severely disabled patients, for whom a BCI can be a useful channel for interaction with their environment. Some of these systems are intended to control a mobile device (e. g. a wheelchair). Virtual Reality is a powerful tool that can provide the subjects with an opportunity to train and to test different applications in a safe environment. This technical review will focus on systems aimed at navigation, both in virtual and real environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kübler, A., Müller, K.R.: An introduction to brain-computer interfacing. In: Dornhege, G., Millán, J.D.R., Hinterberger, T., McFarland, D.J., Müller, K.R. (eds.) Toward Brain-Computer Interfacing, G, pp. 1–25. MIT Press, Cambrigde (2007)

    Google Scholar 

  2. Lopez-Gordo, M.A., Prieto, A., Pelayo, F., Morillas, C.: Use of Phase in Brain–Computer Interfaces based on Steady-State Visual Evoked Potentials. Neural Process Lett. 32(1), 1–9 (2010)

    Article  Google Scholar 

  3. Lopez-Gordo, M.A., Fernandez, E., Romero, S., Pelayo, F., Prieto, A.: An auditory brain–computer interface evoked by natural speech. J. Neural Eng. 9(3), 1–9 (2012)

    Article  Google Scholar 

  4. Kübler, A., Nijboer, F., Birbaumer, N.: Brain-computer interfaces for communication and motor control- perspectives on clinical applications. In: Dornhege, G., Millán, J.D.R., Hinterberger, T., McFarland, D.J., Müller, K.R. (eds.) Toward Brain-Computer Interfacing, pp. 373–391. MIT Press, Cambrigde (2007)

    Google Scholar 

  5. Pfurtscheller, G., Müller, G.R., Pfurtscheller, J., Gerner, H.J., Rupp, R.: ‘Thought’-control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia. Neurosci. Lett. 351(1), 33–36 (2003)

    Article  Google Scholar 

  6. Blankertz, B., Dornhege, G., Krauledat, M., et al.: The Berlin brain-computer interface presents the novel mental typewriter hex-o-spell. In: Proceedings of the 3rd International Brain-Computer Interface Workshop and Training Course, Graz, pp. 108–109 (2006)

    Google Scholar 

  7. Guger, C., Holzner, C., Grönegree, C., Edlinger, G., Slater, M.: Control of a smart home with a brain-computer interface. In: Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course, Graz, pp. 339–342 (2008)

    Google Scholar 

  8. Bensch, M., Karim, A.A., Mellinger, J., Hinterberger, T., Tangermann, M., Bogdan, M., Rosenstiel, W., Birbaumer, N.: Nessi: An EEG-controlled web browser for severely paralyzed patients. Computational Intelligence and Neuroscience (2007)

    Google Scholar 

  9. Ron-Angevin, R., Lopez, M.A., Pelayo, F.: The Training Issue in Brain-Computer Interface: A Multi-disciplinary Field. In: Cabestany, J., Sandoval, F., Prieto, A., Corchado, J.M. (eds.) IWANN 2009, Part I. LNCS, vol. 5517, pp. 666–673. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  10. Galán, F., Nuttin, M., Lew, E., Ferrez, P.W., Vanacker, G., Philips, J., Millán, J.D.R.: A brain-actuated wheelchair: Asynchronous and non-invasive brain-computer interfaces for continuous control of robots. Clinical Neurophysiology 119(9), 2159–2169 (2008)

    Article  Google Scholar 

  11. Millán, J.D.R., Renkens, F., Mouriño, J., Gerstner, W.: Noninvasive brain-actuated control of a mobile robot by human EEG. IEEE Trans. Biomed. Eng. 51(6), 1026–1033 (2004)

    Article  Google Scholar 

  12. Pineda, J.A., Silverman, D.S., Vankov, A., Hestenes, J.: Learning to control brain rhythms: Making a brain-computer interface possible. IEEE Transactions on Neural Systems and Rehabilitation Engineering 11(2), 181–184 (2003)

    Article  Google Scholar 

  13. Krepki, R., Curio, G., Blankertz, B., Müller, K.-R.: Berlin brain-computer interface-the HCI communication channel for discovery. International Journal of Human Computer Studies 65(5), 460–477 (2007)

    Article  Google Scholar 

  14. Lécuyer, A., Lotte, F., Reilly, R.B., Leeb, R., Hirose, M., Slater, M.: Brain-computer interfaces, virtual reality, and videogames. Computer 41(10), 66–72 (2008)

    Article  Google Scholar 

  15. Ron-Angevin, R., Díaz-Estrella, A.: Brain-computer interface: Changes in performance using virtual reality techniques. Neurosci. Lett. 449(2), 123–127 (2009)

    Article  Google Scholar 

  16. Scherer, R., Friedrich, E.C.V., Allison, B., Pröll, M., Chung, M., Cheung, W., Rao, R.P.N., Neuper, C.: Non-invasive brain-computer interfaces: Enhanced gaming and robotic control. In: Cabestany, J., Rojas, I., Joya, G. (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 362–369. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  17. Friedman, D., Leeb, R., Guger, C., Steed, A., Pfurtseheller, G., Slater, M.: Navigating virtual reality by thought: What is it like? Presence-Teleop. Virt. 16(1), 100–110 (2007)

    Article  Google Scholar 

  18. Leeb, R., Lee, F., Keinrath, C., Scherer, R., Bischof, H., Pfurtscheller, G.: Brain-computer communication: Motivation, aim, and impact of exploring a virtual apartment. IEEE Trans. Neural Syst. Rehabil. Eng. 15(4), 473–482 (2007)

    Article  Google Scholar 

  19. Fujisawa, J., Touyama, H., Hirose, M.: EEG-based navigation of immersing virtual environment using common spatial patterns. In: Proceedings - IEEE Virtual Reality (2008)

    Google Scholar 

  20. Ron-Angevin, R., Díaz-Estrella, A., Velasco-Álvarez, F.: A two-class brain computer interface to freely navigate through virtual worlds. Biomed. Tech. 54(3), 126–133 (2009)

    Article  Google Scholar 

  21. Bayliss, J.D.: Use of the evoked potential P3 component for control in a virtual apartment. IEEE Trans. Neural Syst. Rehabil. Eng. 11(2), 113–116 (2003)

    Article  MathSciNet  Google Scholar 

  22. Donnerer, M., Steed, A.: Using a P300 brain-computer interface in an immersive virtual environment. Presence-Teleop. Virt. 19(1), 12–24 (2010)

    Article  Google Scholar 

  23. Groenegress, C., Holzner, C., Guger, C., Slater, M.: Effects of P300-based BCI use on reported presence in a virtual environment. Presence-Teleop. Virt. 19(1), 1–11 (2010)

    Article  Google Scholar 

  24. Chung, M., Cheung, W., Scherer, R., Rao, R.P.N.: Towards hierarchical BCIs for robotic control. In: 5th International IEEE/EMBS Conference (2011)

    Google Scholar 

  25. Faller, J., Müller-Putz, G., Schmalstieg, D., Pfurtscheller, G.: An application framework for controlling an avatar in a desktop-based virtual environment via a software SSVEP brain-computer interface. Presence-Teleop. Virt. 19(1), 25–34 (2010)

    Article  Google Scholar 

  26. Leeb, R., Settgast, V., Fellner, D., Pfurtscheller, G.: Self-paced exploration of the Austrian National Library through thought, Int. J. Bioelectromagnetism 9, 237–244 (2007)

    Google Scholar 

  27. Leeb, R., Friedman, D., Müller-Putz, G.R., Scherer, R., Slater, M., Pfurtscheller, G.: Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: A case study with a tetraplegic. Computational Intelligence and Neuroscience (2007)

    Google Scholar 

  28. Suh, D., Cho, H.S., Goo, J., Park, K.S., Hahn, M.: Virtual navigation system for the disabled by motor imagery. In: Elleithy, K. (ed.) Advances in Computer, Information, and Systems Sciences, and Engineering (2006)

    Google Scholar 

  29. Tsui, C.S.L., Gan, J.Q.: Asynchronous BCI control of a robot simulator with supervised online training. In: Yin, H., Tino, P., Corchado, E., Byrne, W., Yao, X. (eds.) IDEAL 2007. LNCS, vol. 4881, pp. 125–134. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  30. Geng, T., Dyson, M., Tsui, C.S., Gan, J.Q.: A 3-class asynchronous BCI controlling a simulated mobile robot. In: Int. Conf. IEEE Eng. in Med. and Biol. Society, pp. 2524–2527 (2007)

    Google Scholar 

  31. Scherer, R., Lee, F., Schlögl, A., Leeb, R., Bischof, H., Pfurtscheller, G.: Toward self-paced brain-computer communication: Navigation through virtual worlds. IEEE Trans. Biomed. Eng. 55(2), 675–682 (2008)

    Article  Google Scholar 

  32. Lotte, F., van Langhenhove, A., Lamarche, F., Ernest, T., Renard, Y., Arnaldi, B., Lécuyer, A.: Exploring large virtual environments by thoughts using a brain-computer interface based on motor imagery and high-level commands. Presence-Teleop. Virt. 19(1), 54–70 (2010)

    Article  Google Scholar 

  33. Velasco-Álvarez, F., Ron-Angevin, R.: Asynchronous brain-computer interface to navigate in virtual environments using one motor imagery. In: Cabestany, J., Sandoval, F., Prieto, A., Corchado, J.M. (eds.) IWANN 2009, Part I. LNCS, vol. 5517, pp. 698–705. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  34. Velasco-Álvarez, F., Ron-Angevin, R., Da Silva-Sauer, L., Sancha-Ros, S.: Brain-computer interface: Comparison of two paradigms to freely navigate in a virtual environment through one mental task. In: Int. Conf. on Broadband and Biomed. Comm., IB2Com (2010)

    Google Scholar 

  35. Velasco-Álvarez, F., Ron-Angevin, R., Da Silva-Sauer, L., Sancha-Ros, S., Blanca-Mena, M.J.: Audio-cued SMR brain-computer interface to drive a virtual wheelchair. In: Cabestany, J., Rojas, I., Joya, G. (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 337–344. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  36. Escolano, C., Antelis, J.M., Minguez, J.: A telepresence mobile robot controlled with a noninvasive brain-computer interface. IEEE Trans. on Systems, Man, and Cybernetics, Part B: Cybernetics 42(3), 793–804 (2012)

    Article  Google Scholar 

  37. Chang, H., Deng, H., Lee, P., Wu, C., Shyu, K.: Real-time control of an SSVEP-actuated remote-controlled car. In: SICE Annual Conference (2010)

    Google Scholar 

  38. Bell, C.J., Shenoy, P., Chalodhorn, R., Rao, R.P.N.: Control of a humanoid robot by a noninvasive brain-computer interface in humans. J. Neural Eng. 5(2), 214–220 (2008)

    Article  Google Scholar 

  39. Wu, L., Liao, H., Hu, J., Lo, P.: Brain-controlled robot agent: An EEG-based eRobot agent. Ind. Robot. 35(6), 507–519 (2008)

    Article  Google Scholar 

  40. Chae, Y., Jeong, J., Jo, S.: Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI. IEEE Trans. on Robotics 99, 1–14 (2012)

    Google Scholar 

  41. Barbosa, A.O.G., Achanccaray, D.R., Meggiolar, M.A.: Activation of a mobile robot through a brain computer interface. In: IEEE Int. Conf. on Robotics and Automation (2010)

    Google Scholar 

  42. Velasco-Álvarez, F., Ron-Angevin, R., Da Silva-Sauer, L., Sancha-Ros, S.: Audio-Cued Motor Imagery-Based Brain-Computer Interface: Navigation Through Virtual and Real Environments. Neurocomputing (in press 2013)

    Google Scholar 

  43. Millán, J.D.R., Renkens, F., Mouriño, J., Gerstner, W.: Brain-actuated interaction. Artif. Intell. 159(1-2), 241–259 (2004)

    Article  Google Scholar 

  44. Bryan, M., Green, J., Chung, M., Chang, L., Scherert, R., Smith, J., Rao, R.P.N.: An adaptive brain-computer interface for humanoid robot control. In: 11th IEEE-RAS Int. Conf. on Humanoid Robots (2011)

    Google Scholar 

  45. Vanacker, G., Del, J., Millán, R., Lew, E., Ferrez, P.W., Moles, F.G., Philips, J., Van Brussel, H., Nuttin, M.: Context-based filtering for assisted brain-actuated wheelchair driving. Computational Intelligence and Neuroscience (2007)

    Google Scholar 

  46. Choi, K., Cichocki, A.: Control of a wheelchair by motor imagery in real time. In: Fyfe, C., Kim, D., Lee, S.-Y., Yin, H. (eds.) IDEAL 2008. LNCS, vol. 5326, pp. 330–337. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  47. Long, J., Li, Y., Wang, H., Yu, T., Pan, J., Li, F.: A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans. on Neural Systems and Rehab. Eng. 20(5), 720–729 (2012)

    Article  Google Scholar 

  48. Iturrate, I., Antelis, J.M., Kübler, A., Minguez, J.: A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation. IEEE Trans. on Robotics 25(3), 614–627 (2009)

    Article  Google Scholar 

  49. Rebsamen, B., Guan, C., Zhang, H., Wang, C., Teo, C., Ang Jr., M.H., Burdet, E.: A brain controlled wheelchair to navigate in familiar environments. IEEE Trans. Neural Syst. Rehabil. Eng. 18(6), 590–598 (2010)

    Article  Google Scholar 

  50. Muller, S.M.T., Bastos-Filho, T.F., Sarcinelli-Filho, M.: Using a SSVEP-BCI to command a robotic wheelchair. In: IEEE Int. Symp. on. Ind. Electronics (2011)

    Google Scholar 

  51. Shin, B.-G., Kim, T., Jo, S.: Non-invasive brain signal interface for a wheelchair navigation. In: Int. Conf. on Control Automation and Systems (2010)

    Google Scholar 

  52. Lopes, A.C., Pires, G., Vaz, L., Nunes, U.: Wheelchair navigation assisted by human-machine shared-control and a P300-based brain computer interface. In: Int. Conf. on Intelligent Robots and Systems (2011)

    Google Scholar 

  53. Kronegg, J., Chanel, G., Voloshynovskiy, S., Pun, T.: EEG-based synchronized brain-computer interfaces: A model for optimizing the number of mental tasks. IEEE Trans. Neural Syst. Rehabil. Eng. 15(1), 50–58 (2007)

    Article  Google Scholar 

  54. Obermaier, B., Neuper, C., Guger, C., Pfurtscheller, G.: Information transfer rate in a five-classes brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 9(3), 283–288 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Velasco-Alvarez, F., Ron-Angevin, R., Lopez-Gordo, M.A. (2013). BCI-Based Navigation in Virtual and Real Environments. In: Rojas, I., Joya, G., Cabestany, J. (eds) Advances in Computational Intelligence. IWANN 2013. Lecture Notes in Computer Science, vol 7903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38682-4_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38682-4_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38681-7

  • Online ISBN: 978-3-642-38682-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics