Abstract
This paper is aimed to introduce IDIAP Brain Computer Interface (IBCI) research that successfully applied Ambience Intelligence (AmI) principles in designing intelligent brain-machine interactions. We proceed through IBCI applications describing how machines can decode and react to the human mental commands, cognitive and emotive states. We show how effective human-machine interaction for brain computer interfacing (BCI) can be achieved through, 1) asynchronous and spontaneous BCI, 2) shared control between the human and machine, 3) online learning and 4) the use of cognitive state recognition. Identifying common principles in BCI research and ambiance intelligence (AmI) research, we discuss IBCI applications. With the current studies on recognition of human cognitive states, we argue for the possibility of designing empathic environments or devices that have a better human like understanding directly from brain signals.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Buttfield, A., Ferrez, P.W., del Millán, J.R.: Towards a robust BCI: Error potentials and online learning. IEEE Trans. on Neural Systems and Rehabilitation Engineering 14(2), 164–168 (2006)
Allison, B.Z., Pineda, J.A.: ERPs evoked by different matrix sizes: implications for a brain computer interface (bci) system. IEEE Trans Neural Syst. Rehabil Eng. 11(2), 110–113 (2003)
Babiloni, F., Cincotti, F., Lazzarini, L., del Millán, J.R., Mouriño, J., Varsta, M., Heikkonen, J., Bianchi, L., Marciani, M.G.: Linear classification of low-resolution EEG patterns produced by imagined hand movements. IEEE Trans Rehabil Eng. 8(2), 186–188 (2000)
Bayliss, J.D.: Use of the evoked potential P300 component for control in a virtual apartment. IEEE Trans Neural Syst. Rehabil Eng. 11(2), 113–116 (2003)
Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter, J., Taub, E., Flor, H.: A spelling device for the paralysed. Nature 398(6725), 297–298 (1999)
Buttfield, A., del Millán, J.R.: Online classifier adaptation in brain-computer interfaces. IDIAP-RR 16, IDIAP (2006)
Chochon, F., Cohen, L., van de Moortele, P.F., Dehaene, S.: Differential contributions of the left and right inferior parietal lobules to number processing. J. Cogn. Neurosci. 11(6), 617–630 (1999)
Dornhege, G., Blankertz, B., Curio, G., Müller, K.R.: Boosting bit rates in noninvasive eeg single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed. Eng. 51(6), 993–1002 (2004)
Farwell, L.A., Donchin, E.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin Neurophysiol. 70(6), 510–523 (1988)
Felton, E.A., Wilson, J.A., Williams, J.C., Garell, P.C.: Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. report of four cases. J Neurosurg. 106(3), 495–500 (2007)
Ferrez, P.W., del Millán, J.R.: You are wrong!—automatic detection of interaction errors from brain waves. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence, Edinburgh, UK (August 2005)
Ferrez, P.W., del Millán, J.R.: Error-related EEG potentials in brain-computer interfaces. In: Dornhege, G., Millán, J.d.R., Hinterberger, T., McFarland, D., Müller, K.-R. (eds.) Towards Brain-Computer Interfacing, MIT Press, Cambridge (2007)
Galán, F., Ferrez, P.W., Oliva, F., Guàrdia, J., del Millán, J.R.: Feature extraction for multiclass BCI using canonical variates analysis. In: IEEE International Symposium on Intelligent Signal Processing, Alcalá de Henares (2007)
Galán, F., Nuttin, M., Lew, E., Ferrez, P.W., Vanacker, G., Philips, J., Brussel, H.V., del Millán, J.R.: An asynchronous and non-invasive brain-actuated wheelchair. In: In 13th International Symposium on Robotics Research, Hiroshima, Japan (2007)
Gao, X., Xu, D., Cheng, M., Gao, S.: A BCI-based environmental controller for the motion-disabled. IEEE Trans. Neural. Syst. Rehabil. Eng. 11(2), 137–140 (2003)
Hauser, A., Sottas, P.E.,, J.: Temporal processing of brain activity foe the recognition of EEG patterns. In: Proceedings 12th Int. Conf. on Artificial Neural Networks, pp. 1125–1130 (2002)
Hinterberger, T., Neumann, N., Pham, M., Kübler, A., Grether, A., Hofmayer, N., Wilhelm, B., Flor, H., Birbaumer, N.: A multimodal brain-based feedback and communication system. Exp. Brain Res. 154(4), 521–526 (2004)
Hinterberger, T., Schmidt, S., Neumann, N., Mellinger, J., Blankertz, B., Curio, G., Birbaumer, N.: Brain-computer communication and slow cortical potentials. IEEE Trans Biomed Eng. 51(6), 1011–1018 (2004)
Kennedy, P.R., Bakay, R.A.: Restoration of neural output from a paralysed patient by a direct brain connection. Neuroreport 9, 1707–1711 (1998)
Krepki, R., Blankert, B., Curio, G., Müller, K.R.: The Berlin brain-computer interface (BBCI) towards a new communication channel for online control in gaming applications. Multimedia Tools and Applications, 73–90 (February 2007)
Kübler, A., Müller, K.R.: An introduction to brain computer interfacing in Towards Brain-Computer Interfacing. MIT Press, Cambridge (2007)
Lebedev, M.A., Nicolelis, M.A.: Brain-machine interfaces: past, present and future. Trends Neurosci. 29, 536–546 (2006)
Lotte, F., Congedo, M., Lcuyer, A., Lamarche, F., Arnaldi, B.: A review of classification algorithms for eeg-based brain-computer interfaces. J. Neural Eng. 4(2), R1–R13 (2007)
Middendorf, M., McMillan, G., Calhoun, G., Jones, K.S.: Brain-computer interfaces based on the steady-state visual-evoked response. IEEE Trans. Rehabil. Eng. 8(2), 211–214 (2000)
del Millán, J.R.: Brain-computer interfaces. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, 2nd edn., The MIT Press, Cambridge (2002)
del Millán, J.R., Ferrez, P.W., Buttfield, A.: Non-invasive brain-machine interfaces. ESA report on studies on feasibility of non-invasive brain-machine interfaces (2006), www.esa.int/gsp/ACT/bio/BMI.htm
del Millán, J.R., Mouriño, J.: Asynchronous BCI and local neural classifiers: An overview of the Adaptive Brain Interface project. IEEE Trans. on Neural Systems and Rehabilitation Engineering, Special Issue on Brain-Computer Interface Technology 11(2), 159–161 (2003)
del Millán, J.R., Mouriño, J., Franzé, M., Cincotti, F., Varsta, M., Heikkonen, J., Babiloni, F.: A local neural classifier for the recognition of EEG patterns associated to mental tasks. IEEE Trans Neural Networks 13(3), 678–686 (2002)
del Millán, J.R., Renkens, F., Mouriño, J., Gerstner, W.: Non-invasive brain-actuated control of a mobile robot by human EEG. IEEE Trans. Biomed Eng. 51(6), 1026–1033 (2004)
del Millán, J.R., Renkens, F., Mourino, J., Wulfram, G.: Brain-actuated interaction. Artif. Intell. 159(1-2), 241–259 (2004)
Obermaier, B., Müller, G.R., Pfurtscheller, G.: “Virtual keyboard” controlled by spontaneous EEG activity. IEEE Trans. Neural Syst. Rehabil. Eng. 11(4), 422–426 (2003)
Petersen, S.E., Fox, P.T., Posner, M.I., Mintun, M., Raichle, M.E.: Positron emission tomographic studies of the cortical anatomy of single-word processing. Nature 331(6157), 585–589 (1988)
Pfurtscheller, G., Neuper, C.: Motor imagery activates primary sensorimotor area in humans. Neurosci. Lett. 239(2-3), 65–68 (1997)
Pfurtscheller, G., Neuper, C.: Motor imagery and direct brain-computer communication. In: IEEE, vol. 89, pp. 1123–1134 (2001)
Philips, J., del Millán, J.R., Vanacker, G., Lew, E., Galán, F.: Adaptive shared control of a brain-actuated simulated wheelchair. In: IEEE 10th International Conference on Rehabilitation Robotics (2007)
Rebsamen, B., Burdet, E., Teo, C.L., Zeng, Q., Guan, C., Ang, M., Laugier, C.: A brain control wheelchair with a P300 based bci and a path following controller. In: Proc. 1st IEEE/RAS-EMBS Int. Conf. Biomedical Robotics and Biomechatronics (2006)
Roberts, S.J., Penny, W.D.: Real-time brain-computer interfacing: a preliminary study using bayesian learning. Med. Biol. Eng. Comput. 38(1), 56–61 (2000)
Rosen, R.: Anticipatory systems. Pergamon Press, Oxford (1985)
Schmidt, A.: Interactive Context-Aware Systems Interacting with Ambient Intelligence, pp. 159–178. IOS Press, Amsterdam (2006)
Sutter, E.E.: The brain response interface: communication through visually-induced electrical brain responses. J. Microcomput. Appl. 15, 31–45 (1992)
Vanacker, G., del Millán, J.R., Lew, E., Ferrez, P., Galán, F., Philips, J., Brussel, H.V., Nuttin, M.: Context-based filtering for assisted brain-actuated wheelchair driving. Computational Intelligence and Neuroscience (2007)
Walter, W.G., Cooper, R., Aldridge, V.J., McCallum, W.C., Winter, A.L.: Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature 203, 380–384 (1964)
Wolpaw, J.R.: Brain-computer interfaces (BCIs) for communication and control: a mini-review. Suppl. Clin. Neurophysiol. 57, 607–613 (2004)
Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)
Wolpaw, J.R., McFarland, D.L., Vaughan, T.M.: Brain-Computer Interface Research at the Wadsworth Center. IEEE Trans. Rehab. Eng. 8, 222–226 (2000)
Yoshino, A., Inoue, M., Suzuki, A.: A topographic electrophysiologic study of mental rotation. Brain Res. Cogn. Brain Res. 9(2), 121–124 (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Garipelli, G., Galán, F., Chavarriaga, R., Ferrez, P.W., Lew, E., del R. Millán, J. (2008). The Use of Brain-Computer Interfacing in Ambient Intelligence. In: Mühlhäuser, M., Ferscha, A., Aitenbichler, E. (eds) Constructing Ambient Intelligence. AmI 2007. Communications in Computer and Information Science, vol 11. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85379-4_34
Download citation
DOI: https://doi.org/10.1007/978-3-540-85379-4_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85378-7
Online ISBN: 978-3-540-85379-4
eBook Packages: Computer ScienceComputer Science (R0)