Skip to main content
SpringerLink
Log in

Brain Responses to Errors During 3D Motion in a Hapto-Visual VR

  • Conference paper
  • First Online:
Haptics: Perception, Devices, Control, and Applications (EuroHaptics 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9775))

Abstract

We investigated brain potentials recorded by electroencephalography (EEG) signals in response to unpredictable haptic/kinesthetic disturbances to a continuously moving object in a hapto-visual 3D virtual world that highly resembles reality. Participants moved a virtual object from an initial position to a target position in the virtual environment. A large cylinder obscured part of the motion between the origin and the target. The position of the emerging object under the cylinder is disturbed, and hence unexpected, for part of the scenarios. This disturbance is perceived as an error. We examined the EEG signals locked to the error. Our results show a consistent disturbance-locked potential with an early negative peak followed by a positive peak. Peak-to-peak amplitude increased with the disturbance magnitude. Source estimation at the time of the negative and positive peaks revealed a strong activity in the vicinity of Brodmann area (BA) 7, known to be involved in hapto-visual integration and in the neural computation of dynamic motor errors. These results demonstrate the presence of haptic-disturbance-related brain activity under conditions of continuous motion. Results further suggest a feedback signal for error detection and correction in EEG-based Brain-Computer Interfaces (BCI) in applications such as telesurgery, manipulation of remote objects and rehabilitation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kahol, K., French, J., Panchanathan, S., Davis, G., Berka, C.: Evaluating the role of visio-haptic feedback in multimodal interfaces through EEG analysis. In: Schmorrow, D., Stanney, K., Reeves., L. (eds.) Augmented Cognition: Past, Present and Future, pp. 289–296. Strategic Analysis, Inc., Arlington, VA (2006)

    Google Scholar 

  2. Murguialday, A.R., Aggarwal, V., Chatterjee, A., Cho, Y.C.Y., Rasmussen, R., O’Rourke, B., Acharya, S., Thakor, N.V.: Brain-computer interface for a prosthetic hand using local machine control and haptic feedback. In: 2007 IEEE 10th International Conference on Rehabilitation Robotics, pp. 609–613 (2007)

    Google Scholar 

  3. Gomez-Rodriguez, M., Peterst, J., Hin, J., Schölkopf, B., Gharabaghi, A., Grosse-Wentrup, M.: Closing the sensorimotor loop: haptic feedback facilitates decoding of arm movement imagery. In: Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, pp. 121–126 (2010)

    Google Scholar 

  4. Ferrez, P.W., Millán, J.D.R.: Simultaneous real-time detection of motor imagery and error-related potentials for improved BCI accuracy. In: Proceedings of 4th Brain-Computer Interface Workshop and Training Course, pp. 197–202 (2008)

    Google Scholar 

  5. Pfurtscheller, G., Muller-Putz, G.R., Scherer, R., Neuper, C.: Rehabilitation with brain-computer interface systems. Computer 41, 58–65 (2008)

    Article  Google Scholar 

  6. Milekovic, T., Ball, T., Schulze-Bonhage, A., Aertsen, A., Mehring, C.: Detection of error related neuronal responses recorded by electrocorticography in humans during continuous movements. PLoS One 8, e55235 (2013)

    Article  Google Scholar 

  7. Milekovic, T., Ball, T., Schulze-Bonhage, A., Aertsen, A., Mehring, C.: Error-related electrocorticographic activity in humans during continuous movements. J. Neural Eng. 9, 026007 (2012)

    Article  Google Scholar 

  8. Spuler, M., Niethammer, C.: Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity. Front. Hum. Neurosci. 9, 1–10 (2015)

    Google Scholar 

  9. Falkenstein, M., Hoormann, J., Christ, S., Hohnsbein, J.: ERP components on reaction errors and their functional significance: a tutorial. Biol. Psychol. 51, 87–107 (2000)

    Article  Google Scholar 

  10. Bediou, B., Koban, L., Rosset, S., Pourtois, G., Sander, D.: Delayed monitoring of accuracy errors compared to commission errors in ACC. Neuroimage 60, 1925–1936 (2012)

    Article  Google Scholar 

  11. Ferrez, P.W., Millán, J.D.R.: Error-related EEG potentials generated during simulated brain-computer interaction. IEEE Trans. Biomed. Eng. 55, 923–929 (2008)

    Article  Google Scholar 

  12. Geomagic: Geomagic® haptic devices. www.geomagic.com

  13. BioSemi. http://www.biosemi.com

  14. Reiner, M.: The role of haptics in immersive telecommunication environments. IEEE Trans. Circ. Syst. Video Technol. 14, 392–401 (2004)

    Article  Google Scholar 

  15. Zaaroor, M., Pratt, H., Starr, A.: Influence of task-related ipsilateral hand movement on motor cortex excitability. Clin. Neurophysiol. 112, 908–916 (2001)

    Article  Google Scholar 

  16. Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004)

    Article  Google Scholar 

  17. Gómez-Herrero, G.: Automatic artifact removal (AAR) toolbox v1.3 (Release 09.12.2007) for MATLAB. Technology 3, 1–23 (2007)

    Google Scholar 

  18. Pascual-Marqui, R.D.: Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. Methods Find. Exp. Clin. Pharmacol. 24(Suppl D), 5–12 (2002)

    Google Scholar 

  19. He, P., Wilson, G., Russell, C.: Removal of ocular artifacts from electro-encephalogram by adaptive filtering. Med. Biol. Eng. Comput. 42, 407–412 (2004)

    Article  Google Scholar 

  20. Correa, A.G., Laciar, E., Patiño, H.D., Valentinuzzi, M.E.: Artifact removal from EEG signals using adaptive filters in cascade. In: 16th Argentine Bioengineering Congress and the 5th Conference of Clinical Engineering. Journal of Physics: Conference Series, Bristol, U.K., pp. 012081–012090 (2007)

    Google Scholar 

  21. De Clercq, W., Vergult, A., Vanrumste, B., Van Paesschen, W., Van Huffel, S.: Canonical correlation analysis applied to remove muscle artifacts from the electroencephalogram. IEEE Trans. Biomed. Eng. 53, 2583–2587 (2006)

    Article  Google Scholar 

  22. Sörnmo, L., Laguna, P.: Bioelectrical Signal Processing in Cardiac and Neurological Applications. Elsevier Academic Press, Amsterdam (2005)

    Google Scholar 

  23. Luck, S.J.: An Introduction to the Event-Related Potential Technique. The MIT Press, Cambridge (2005)

    Google Scholar 

  24. Widmann, A., Schröger, E., Maess, B.: Digital filter design for electrophysiological data - a practical approach. J. Neurosci. Methods 250, 34–46 (2014)

    Article  Google Scholar 

  25. Allison, P.D.: Fixed Effects Regression Methods for Longitudinal Data Using SAS. SAS Institute Inc., Cary (2005)

    Google Scholar 

  26. Contreras-Vidal, J.L., Kerick, S.E.: Independent component analysis of dynamic brain responses during visuomotor adaptation. Neuroimage 21, 936–945 (2004)

    Article  Google Scholar 

  27. Desmurget, M., Epstein, C.M., Turner, R.S., Prablanc, C., Alexander, G.E., Grafton, S.T.: Role of the posterior parietal cortex in updating reaching movements to a visual target. Nat. Neurosci. 2, 563–567 (1999)

    Article  Google Scholar 

  28. Buneo, C.A., Andersen, R.A.: The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia 44, 2594–2606 (2006)

    Article  Google Scholar 

  29. Hauschild, M., Mulliken, G.H., Fineman, I., Loeb, G.E., Andersen, R.A.: Cognitive signals for brain-machine interfaces in posterior parietal cortex include continuous 3D trajectory commands. Proc. Natl. Acad. Sci. U.S.A., 17075–17080 (2012)

    Google Scholar 

  30. Fink, G.R., Marshall, J.C., Halligan, P.W., Frith, C.D., Driver, J., Frackowiak, R.S.J., Dolan, R.J.: The neural consequences of conflict between intention and the senses. Brain 122, 497–512 (1999)

    Article  Google Scholar 

  31. Sekihara, K., Sahani, M., Nagarajan, S.S.: Localization bias and spatial resolution of adaptive and non-adaptive spatial filters for MEG source reconstruction. Neuroimage 25, 1056–1067 (2005)

    Article  Google Scholar 

  32. Greenblatt, R.E., Ossadtchi, A., Pflieger, M.E.: Local linear estimators for the bioelectromagnetic inverse problem. IEEE Trans. Signal Process. 53, 3403–3412 (2005)

    Article  MathSciNet  Google Scholar 

  33. Diedrichsen, J., Hashambhoy, Y., Rane, T., Shadmehr, R.: Neural correlates of reach errors. J. Neurosci. 25, 9919–9931 (2005)

    Article  Google Scholar 

  34. Torrecillos, F., Albouy, P., Brochier, T., Malfait, N.: Does the processing of sensory and reward-prediction errors involve common neural resources? Evidence from a frontocentral negative potential modulated by movement execution errors. J. Neurosci. 34, 4845–4856 (2014)

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank the laboratory engineer Tami Gelfeld for helping in the design and implementation of the experimental set-up.

Author information

Authors and Affiliations

  1. Technion – Israel Institute of Technology, Haifa, 32000, Israel

    Boris Yazmir, Miriam Reiner, Hillel Pratt & Miriam Zacksenhouse

Authors
  1. Boris Yazmir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miriam Reiner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hillel Pratt
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Miriam Zacksenhouse
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Boris Yazmir .

Editor information

Editors and Affiliations

  1. Imperial College London, London, United Kingdom

    Fernando Bello

  2. The University of Electro-Communications, Chofu, Japan

    Hiroyuki Kajimoto

  3. University of California, Santa Barbara, Santa Barbara, Japan

    Yon Visell

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Yazmir, B., Reiner, M., Pratt, H., Zacksenhouse, M. (2016). Brain Responses to Errors During 3D Motion in a Hapto-Visual VR. In: Bello, F., Kajimoto, H., Visell, Y. (eds) Haptics: Perception, Devices, Control, and Applications. EuroHaptics 2016. Lecture Notes in Computer Science(), vol 9775. Springer, Cham. https://doi.org/10.1007/978-3-319-42324-1_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42324-1_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42323-4

  • Online ISBN: 978-3-319-42324-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation