Skip to main content

The Use of Brain-Computer Interfacing in Ambient Intelligence

  • Conference paper

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 11))

Abstract

This paper is aimed to introduce IDIAP Brain Computer Interface (IBCI) research that successfully applied Ambience Intelligence (AmI) principles in designing intelligent brain-machine interactions. We proceed through IBCI applications describing how machines can decode and react to the human mental commands, cognitive and emotive states. We show how effective human-machine interaction for brain computer interfacing (BCI) can be achieved through, 1) asynchronous and spontaneous BCI, 2) shared control between the human and machine, 3) online learning and 4) the use of cognitive state recognition. Identifying common principles in BCI research and ambiance intelligence (AmI) research, we discuss IBCI applications. With the current studies on recognition of human cognitive states, we argue for the possibility of designing empathic environments or devices that have a better human like understanding directly from brain signals.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Buttfield, A., Ferrez, P.W., del Millán, J.R.: Towards a robust BCI: Error potentials and online learning. IEEE Trans. on Neural Systems and Rehabilitation Engineering 14(2), 164–168 (2006)

    Article  Google Scholar 

  2. Allison, B.Z., Pineda, J.A.: ERPs evoked by different matrix sizes: implications for a brain computer interface (bci) system. IEEE Trans Neural Syst. Rehabil Eng. 11(2), 110–113 (2003)

    Article  Google Scholar 

  3. Babiloni, F., Cincotti, F., Lazzarini, L., del Millán, J.R., Mouriño, J., Varsta, M., Heikkonen, J., Bianchi, L., Marciani, M.G.: Linear classification of low-resolution EEG patterns produced by imagined hand movements. IEEE Trans Rehabil Eng. 8(2), 186–188 (2000)

    Article  Google Scholar 

  4. Bayliss, J.D.: Use of the evoked potential P300 component for control in a virtual apartment. IEEE Trans Neural Syst. Rehabil Eng. 11(2), 113–116 (2003)

    Article  MathSciNet  Google Scholar 

  5. Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter, J., Taub, E., Flor, H.: A spelling device for the paralysed. Nature 398(6725), 297–298 (1999)

    Article  Google Scholar 

  6. Buttfield, A., del Millán, J.R.: Online classifier adaptation in brain-computer interfaces. IDIAP-RR 16, IDIAP (2006)

    Google Scholar 

  7. Chochon, F., Cohen, L., van de Moortele, P.F., Dehaene, S.: Differential contributions of the left and right inferior parietal lobules to number processing. J. Cogn. Neurosci. 11(6), 617–630 (1999)

    Article  Google Scholar 

  8. Dornhege, G., Blankertz, B., Curio, G., Müller, K.R.: Boosting bit rates in noninvasive eeg single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed. Eng. 51(6), 993–1002 (2004)

    Article  Google Scholar 

  9. Farwell, L.A., Donchin, E.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin Neurophysiol. 70(6), 510–523 (1988)

    Article  Google Scholar 

  10. Felton, E.A., Wilson, J.A., Williams, J.C., Garell, P.C.: Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. report of four cases. J Neurosurg. 106(3), 495–500 (2007)

    Article  Google Scholar 

  11. Ferrez, P.W., del Millán, J.R.: You are wrong!—automatic detection of interaction errors from brain waves. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence, Edinburgh, UK (August 2005)

    Google Scholar 

  12. Ferrez, P.W., del Millán, J.R.: Error-related EEG potentials in brain-computer interfaces. In: Dornhege, G., Millán, J.d.R., Hinterberger, T., McFarland, D., Müller, K.-R. (eds.) Towards Brain-Computer Interfacing, MIT Press, Cambridge (2007)

    Google Scholar 

  13. Galán, F., Ferrez, P.W., Oliva, F., Guàrdia, J., del Millán, J.R.: Feature extraction for multiclass BCI using canonical variates analysis. In: IEEE International Symposium on Intelligent Signal Processing, Alcalá de Henares (2007)

    Google Scholar 

  14. Galán, F., Nuttin, M., Lew, E., Ferrez, P.W., Vanacker, G., Philips, J., Brussel, H.V., del Millán, J.R.: An asynchronous and non-invasive brain-actuated wheelchair. In: In 13th International Symposium on Robotics Research, Hiroshima, Japan (2007)

    Google Scholar 

  15. Gao, X., Xu, D., Cheng, M., Gao, S.: A BCI-based environmental controller for the motion-disabled. IEEE Trans. Neural. Syst. Rehabil. Eng. 11(2), 137–140 (2003)

    Article  Google Scholar 

  16. Hauser, A., Sottas, P.E.,, J.: Temporal processing of brain activity foe the recognition of EEG patterns. In: Proceedings 12th Int. Conf. on Artificial Neural Networks, pp. 1125–1130 (2002)

    Google Scholar 

  17. Hinterberger, T., Neumann, N., Pham, M., Kübler, A., Grether, A., Hofmayer, N., Wilhelm, B., Flor, H., Birbaumer, N.: A multimodal brain-based feedback and communication system. Exp. Brain Res. 154(4), 521–526 (2004)

    Article  Google Scholar 

  18. Hinterberger, T., Schmidt, S., Neumann, N., Mellinger, J., Blankertz, B., Curio, G., Birbaumer, N.: Brain-computer communication and slow cortical potentials. IEEE Trans Biomed Eng. 51(6), 1011–1018 (2004)

    Article  Google Scholar 

  19. Kennedy, P.R., Bakay, R.A.: Restoration of neural output from a paralysed patient by a direct brain connection. Neuroreport 9, 1707–1711 (1998)

    Article  Google Scholar 

  20. Krepki, R., Blankert, B., Curio, G., Müller, K.R.: The Berlin brain-computer interface (BBCI) towards a new communication channel for online control in gaming applications. Multimedia Tools and Applications, 73–90 (February 2007)

    Google Scholar 

  21. Kübler, A., Müller, K.R.: An introduction to brain computer interfacing in Towards Brain-Computer Interfacing. MIT Press, Cambridge (2007)

    Google Scholar 

  22. Lebedev, M.A., Nicolelis, M.A.: Brain-machine interfaces: past, present and future. Trends Neurosci. 29, 536–546 (2006)

    Article  Google Scholar 

  23. Lotte, F., Congedo, M., Lcuyer, A., Lamarche, F., Arnaldi, B.: A review of classification algorithms for eeg-based brain-computer interfaces. J. Neural Eng. 4(2), R1–R13 (2007)

    Google Scholar 

  24. Middendorf, M., McMillan, G., Calhoun, G., Jones, K.S.: Brain-computer interfaces based on the steady-state visual-evoked response. IEEE Trans. Rehabil. Eng. 8(2), 211–214 (2000)

    Article  Google Scholar 

  25. del Millán, J.R.: Brain-computer interfaces. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, 2nd edn., The MIT Press, Cambridge (2002)

    Google Scholar 

  26. del Millán, J.R., Ferrez, P.W., Buttfield, A.: Non-invasive brain-machine interfaces. ESA report on studies on feasibility of non-invasive brain-machine interfaces (2006), www.esa.int/gsp/ACT/bio/BMI.htm

  27. del Millán, J.R., Mouriño, J.: Asynchronous BCI and local neural classifiers: An overview of the Adaptive Brain Interface project. IEEE Trans. on Neural Systems and Rehabilitation Engineering, Special Issue on Brain-Computer Interface Technology 11(2), 159–161 (2003)

    Article  Google Scholar 

  28. del Millán, J.R., Mouriño, J., Franzé, M., Cincotti, F., Varsta, M., Heikkonen, J., Babiloni, F.: A local neural classifier for the recognition of EEG patterns associated to mental tasks. IEEE Trans Neural Networks 13(3), 678–686 (2002)

    Article  Google Scholar 

  29. del Millán, J.R., Renkens, F., Mouriño, J., Gerstner, W.: Non-invasive brain-actuated control of a mobile robot by human EEG. IEEE Trans. Biomed Eng. 51(6), 1026–1033 (2004)

    Article  Google Scholar 

  30. del Millán, J.R., Renkens, F., Mourino, J., Wulfram, G.: Brain-actuated interaction. Artif. Intell. 159(1-2), 241–259 (2004)

    Article  Google Scholar 

  31. Obermaier, B., Müller, G.R., Pfurtscheller, G.: “Virtual keyboard” controlled by spontaneous EEG activity. IEEE Trans. Neural Syst. Rehabil. Eng. 11(4), 422–426 (2003)

    Article  Google Scholar 

  32. Petersen, S.E., Fox, P.T., Posner, M.I., Mintun, M., Raichle, M.E.: Positron emission tomographic studies of the cortical anatomy of single-word processing. Nature 331(6157), 585–589 (1988)

    Article  Google Scholar 

  33. Pfurtscheller, G., Neuper, C.: Motor imagery activates primary sensorimotor area in humans. Neurosci. Lett. 239(2-3), 65–68 (1997)

    Article  Google Scholar 

  34. Pfurtscheller, G., Neuper, C.: Motor imagery and direct brain-computer communication. In: IEEE, vol. 89, pp. 1123–1134 (2001)

    Google Scholar 

  35. Philips, J., del Millán, J.R., Vanacker, G., Lew, E., Galán, F.: Adaptive shared control of a brain-actuated simulated wheelchair. In: IEEE 10th International Conference on Rehabilitation Robotics (2007)

    Google Scholar 

  36. Rebsamen, B., Burdet, E., Teo, C.L., Zeng, Q., Guan, C., Ang, M., Laugier, C.: A brain control wheelchair with a P300 based bci and a path following controller. In: Proc. 1st IEEE/RAS-EMBS Int. Conf. Biomedical Robotics and Biomechatronics (2006)

    Google Scholar 

  37. Roberts, S.J., Penny, W.D.: Real-time brain-computer interfacing: a preliminary study using bayesian learning. Med. Biol. Eng. Comput. 38(1), 56–61 (2000)

    Article  Google Scholar 

  38. Rosen, R.: Anticipatory systems. Pergamon Press, Oxford (1985)

    Google Scholar 

  39. Schmidt, A.: Interactive Context-Aware Systems Interacting with Ambient Intelligence, pp. 159–178. IOS Press, Amsterdam (2006)

    Google Scholar 

  40. Sutter, E.E.: The brain response interface: communication through visually-induced electrical brain responses. J. Microcomput. Appl. 15, 31–45 (1992)

    Article  Google Scholar 

  41. Vanacker, G., del Millán, J.R., Lew, E., Ferrez, P., Galán, F., Philips, J., Brussel, H.V., Nuttin, M.: Context-based filtering for assisted brain-actuated wheelchair driving. Computational Intelligence and Neuroscience (2007)

    Google Scholar 

  42. Walter, W.G., Cooper, R., Aldridge, V.J., McCallum, W.C., Winter, A.L.: Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature 203, 380–384 (1964)

    Article  Google Scholar 

  43. Wolpaw, J.R.: Brain-computer interfaces (BCIs) for communication and control: a mini-review. Suppl. Clin. Neurophysiol. 57, 607–613 (2004)

    Article  Google Scholar 

  44. Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)

    Article  Google Scholar 

  45. Wolpaw, J.R., McFarland, D.L., Vaughan, T.M.: Brain-Computer Interface Research at the Wadsworth Center. IEEE Trans. Rehab. Eng. 8, 222–226 (2000)

    Article  Google Scholar 

  46. Yoshino, A., Inoue, M., Suzuki, A.: A topographic electrophysiologic study of mental rotation. Brain Res. Cogn. Brain Res. 9(2), 121–124 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Max Mühlhäuser Alois Ferscha Erwin Aitenbichler

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Garipelli, G., Galán, F., Chavarriaga, R., Ferrez, P.W., Lew, E., del R. Millán, J. (2008). The Use of Brain-Computer Interfacing in Ambient Intelligence. In: Mühlhäuser, M., Ferscha, A., Aitenbichler, E. (eds) Constructing Ambient Intelligence. AmI 2007. Communications in Computer and Information Science, vol 11. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85379-4_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85379-4_34

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85378-7

  • Online ISBN: 978-3-540-85379-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics