Abstract
It is most essential to stop a vehicle in time for assuring a driver’s safety. In this study, a simulated driving environment was implemented to study the neural correlation of braking intention in diverse driving situations. We further investigated to what extent these neural correlates can be used to detect a participant’s braking intention prior to the behavioral response. A feature combination method was proposed for the enhancement of detection performance and additional classification of emergency braking triggered by stimuli and voluntary braking. It consists of event-related potential (ERP), readiness potential (RP), and event-related desynchronization (ERD) features. Fifteen participants drove a virtual vehicle and were exposed to the diversified traffic situations in the constructed simulator framework, while technical signals (i.e., gas pedal and brake pedal), electroencephalogram (EEG) and electromyogram (EMG) signals were measured. After that, the neural correlation of the measured signals was analyzed. The proposed framework shows excellent detection performance for various kinds of driver’s braking intention. Our study suggests that a driver’s braking intention is characterized by specific neural patterns of sensory perception and processing, as well as motor preparation and execution, which can be utilized by smart vehicle technology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The parts have been taken verbatim from the author’s prior publication [39] marked with bold in Introduction and Discussion Section.
References
Schmidt EA, Schrauf M, Simon M, Fritzsche M, Buchner A, Kincses WE (2009) Driver’s misjudgement of vigilance state during prolonged monotonous daytime driving. Accid Anal Prev 41(5):1087–1093
Papadelis C, Chen Z, Kourtidou-Papadeli C, Bamidis PD, Chouvarda I, Bekiaris E, Maglaveras N (2007) Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents. Clin Neurophysiol 118(9):1906–1922
Kohlmorgen J, Dornhege G, Braun M, Blankertz B, Müller KR, Curio G, Hagemann K, Bruns A, Schrauf M, Kincses W (2007) Improving human performance in a real operating environment through real-time mental workload detection. In: Toward brain-computer interfacing. MIT Press, Cambridge, MA, pp 409–422
Schmidt WE, Kincses WE, Schrauf M, Haufe S, Schubert R, Curio G (2007) Assessing driver’s vigilance state during monotonous driving. In: Proceedings of the 4th International symposium on human factors in driving assessment, training, and vehicle design, Washington, USA, pp 138–145
Hood D, Joseph D, Rakotonirainy A, Sridhara S, Fookes C (2012) Use of brain computer interface to drive: preliminary results. In: Proceedings of the 4th International conference on automotive user interfaces and interactive vehicular applications 2012, Eindhoven, Netherlands, pp 103–106
Khaliliardali Z, Chavarriaga R, Gheorghe LA, Millán JdR (2012) Detection of anticipatory brain potentials during car driving. In: Proceedings of the IEEE conference on EMBS 2012, San Diego, USA, pp 3829–3832
Luzheng B, Nini L, Xin-an F (2012) A brain-computer interface in the context of a head up display system. In: Proceedings of the ICME International conference on complex medical engineering 2012, Kobe, Japan, pp 241–244
Müller KR, Tangermann M, Dornhege G, Krauledat M, Curio G, Blankertz B (2008) Machine learning for real-time single-trial EEG-analysis: from brain-computer interfacing to mental state monitoring. J Neurosci Methods 167(1):82–90
Renold H, Chavarriaga R, Gheorghe LA, Millán JdR (2014) EEG correlates of active visual search during simulated driving: an exploratory study. In: Proceedings of the IEEE International conference on systems, man and cybernetics, San Diego, CA, USA, 5–8 Oct 2014, pp 2815–2820
Zhang H, Chavarriaga R, Gheorghe LA, Millán JdR (2013) Inferring driver’s turning direction through detection of error related brain activity. In: 35th Annual international conference of the IEEE engineering in medicine and biology society, Osaka, Japan, 3–7 July 2013, pp 2196–2199
Gheorghe LA, Chavarriaga R, Millán JdR (2013) Steering timing prediction in a driving simulator task. In: 35th Annual international conference of the IEEE engineering in medicine and biology society, Osaka, Japan, 3–7 July 2013, pp 6913–6916
Haufe S, Treder MS, Gugler MF, Sagebaum M, Curio G, Blankertz B (2011) EEG potentials predict upcoming emergency brakings during simulated driving. J Neural Eng 8(5):056001
Shibasaki H, Hallett M (2006) What is the bereitschaftspotential? Clin Neurophysiol 117(11):2341–2356
Sharbrough F, Chartrian GE, Lesser RP, Lüders H, Nuwer M, Picton TW (1991) American electroencephalographic society guidelines for standard electrode position nomenclature. J Clin Neurophysiol 8(2):200–202
Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR (2008) Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process Mag 25(1):41–56
Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874
Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36
Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Hum Genet 7(2):179–188
Duda RO, Hard PE, Stork DG (2000) Pattern classification. Wiley, New York
Lemm S, Blankertz B, Dickhaus T, Müller KR (2011) Introduction to machine learning for brain imaging. NeuroImage 56(2):387–399
Tomioka R, Müller KR (2010) A regularized discriminative framework for EEG analysis with application to brain-computer interface. NeuroImage 49(1):415–432
Friedman JH (1989) Regularized discriminant analysis. J Am Stat Assoc 84(405):165–175
Blankertz B, Lemm S, Treder M, Haufe S, Müller KR (2011) Single-trial analysis and classification of ERP components – a tutorial. NeuroImage 56(2):814–825
Ledoit O, Wolf M (2004) A well-conditioned estimator for large-dimensional covariance matrices. J Multivar Anal 88(2):365–411
Schäfer J, Strimmer K (2005) A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat Appl Genet Mol Biol 4(1):32
Gibbons JD, Chakraborti S (2011) Nonparametric statistical inference. Marcel Dekker, New York
Bonferroni CE (1936) Teoria Statistica delle Classi e Calcolo delle Probabilitá. Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commerciali di Firenze 8:3–62
Sutton S, Braren M, Zubin J, John ER (1965) Evoked-potential correlates of stimulus uncertainty. Science 150(3700):1187–1188
Kim I-H, Kim J-W, Haufe S, Lee S-W (2013) Detection of multi-class emergency situations during simulated driving from ERP. In: 2013 IEEE International winter workshop on brain-computer interface, Jeongseon, Korea, pp 49–51
Kornhuber HH, Deecke L (1965) Hirnpotentialänderungen bei Willkürbeweguugen und passive Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale. Pügers Arch 284:1–17
Penfiled W, Boldrey E (1937) Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain J Neurol 60:389–443
Libet B, Gleason CA, Wright EW, Pearl DK (1983) Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential): the unconscious initiation of a freely voluntary act. Brain J Neurol 106(3):623–642
Haggard P, Eimer M (1999) On the relation between brain potentials and the awareness of voluntary movements. Exp Brain Res 126(1):128–133
Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in non-invasive EEG single-trial classifications by feature combination and multi-class paradigms. IEEE Trans Bio-Med Eng 51(6):993–1002
Blankertz B, Dornhege G, Schäfer C, Krepki R, Kohlmorgen J, Müller KR, Kunzmann V, Losch F, Curio G (2003) Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis. IEEE Trans Neural Syst Rehabil Eng 11(2):127–131
Pfurtscheller G, Lopes da Silva FH (1999) Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol 110(11):1842–1857
Leocani L, Toro C, Zhuang P, Gerloff C, Hallett M (2001) Event-related desynchronization in reaction time paradigms: a comparison with event-related potentials and corticospinal excitability. Clin Neurophysiol 112(5):923–930
Haufe S, Kim J-W, Kim I-H, Sonnleitner A, Schrauf M, Curio G, Blankertz B (2014) Electrophysiology-based detection of emergency braking intention in real-world driving. J Neural Eng 11(5):056011
Kim I-H, Kim J-W, Haufe S, Lee S-W (2015) Detection of braking intention in diverse situations during simulated driving based on EEG feature combination. J Neural Eng 12(1):016001
Acknowledgements
This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (NRF-2015R1A2A1A05001867). The authors acknowledge the use of text from the own prior publication [39] in this article. Jeong-Woo Kim and Seong-Whan Lee thank their co-authors for allowing them to use materials from prior joint publication [39].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Kim, JW., Kim, IH., Haufe, S., Lee, SW. (2015). Brain-Computer Interface for Smart Vehicle: Detection of Braking Intention During Simulated Driving. In: Lee, SW., Bülthoff, H., Müller, KR. (eds) Recent Progress in Brain and Cognitive Engineering. Trends in Augmentation of Human Performance, vol 5. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-7239-6_2
Download citation
DOI: https://doi.org/10.1007/978-94-017-7239-6_2
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-017-7238-9
Online ISBN: 978-94-017-7239-6
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)