Skip to main content

Analysis of Effect of RSVP Speller BCI Paradigm Along with CNN to Analysis P300 Signals

  • Conference paper
  • First Online:
Augmented Cognition (HCII 2021)

Abstract

People suffering from neurological disorders, including spinal cord injury (S.C.I.), stroke, Parkinson’s disease may be severely paralyzed and incapable of performing any motor functions. However, they may still have some cognitive abilities, and that can be accessed through brain-computer interaction (BCI). Electroencephalography (E.E.G.) pattern classification is attractive for many researchers in the field of BCI. P300 may be a style of ERP signal which is employed by the BCI system. P300, well known as a prominent component of event-related potential (ERP) from E.E.G. signal. It’s also elicited in an oddball paradigm. In some cases, patients get completely locked in until losing control of their ocular movements. Researchers have shifted toward the BCI system because of these people, which will work without the eye movement. Hence the proposed approach is attempting to implement the BCI system without using oculomotor movements. The traditional methods/algorithms such as the hidden Markov model, support vector machine (SVM), and Linear discriminant analysis (LDA) may not perform well for cross-subject variations with extreme variations. Hence, in recent years, deep neural networks, particularly the conventional neural networks (CNN) widely used, have shown high performance compared to the traditional approach for various applications. CNN can extract data from raw data as well as give us unknown information about the data. Most of the research work related to P300 and various speller system involved the gaze of the subject. However, these systems are not suitable for the patient having problems in oculomotor control. The proposed convolution neural network (CNN) has been used for high-level feature extraction and improves the performance of P300 classification to predict target and non-target character. Along with CNN to analyze P300 signals, this study used gaze independent BCI speller paradigm called rapid serial visual presentation (RSVP). We have selected/formed the letters intuitively by attending target letters in the stream of visual stimuli. A vocabulary of 30 symbols was presented one by one in a pseudo-random sequence at the same display location. We applied the CNN on the RSVP Dataset which gave us an average accuracy of 97% which is better than the previously implemented on the BCI competition dataset II without channel selection before the classification, i.e. 95.5%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Acqualagna, L., Blankertz, B.: Gaze-independent BCI-spelling using rapid serial visual presentation (RSVP). Clin. Neurophysiol. 124(5), 901–908 (2013)

    Article  Google Scholar 

  2. Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2011)

    Article  Google Scholar 

  3. Tan, F.-J: Analysis of feature extraction algorithms used in brain-computer interfaces. DEStech Trans. Eng. Technol. Res. (AMEME) (2016)

    Google Scholar 

  4. Sirvent, J., Azorín, J., Iáñez, E., Úbeda, A., Fernández, E.: P300-based brain-computer interface for internet browsing. In: Demazeau, Y., et al. (eds.) Trends in Practical Applications of Agents and Multiagent Systems: 8th International Conference on Practical Applications of Agents and Multiagent Systems, pp. 615–622. Springer Berlin Heidelberg, Berlin, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12433-4_72

    Chapter  Google Scholar 

  5. Betke, M., Gips, J., Fleming, P.: The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. IEEE Trans. Neural Syst. Rehabil. Eng. 10(1), 1–10 (2002)

    Article  Google Scholar 

  6. Quitadamo, L.R., Marciani, M.G., Cardarilli, G., Bianchi, L.: Describing different brain computer interface systems through a unique model: a UML implementation. Neuroinformatics 6(2), 81–96 (2008). https://doi.org/10.1007/s12021-008-9015-0

    Article  Google Scholar 

  7. Quitadamo, L.R., Abbafati, M., Saggio, G., Marciani, M.G., Cardarilli, G.C., Bianchi, L.: A UML model for the description of different brain-computer interface systems. In: 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1363–1366. IEEE (2008)

    Google Scholar 

  8. Ma, Y., Jiang, G., Chang, T., Guo, L.: Research on feature extraction and classification of P300 EEG signals. In: 2nd International Conference on Electrical, Automation and Mechanical Engineering (E.A.M.E. 2017), pp. 26–30. Atlantis Press (2017)

    Google Scholar 

  9. Guo, S., Lin, S., Huang, Z.: Feature extraction of P300s in E.E.G. signal with discrete wavelet transform and fisher criterion. In: 8th International Conference on Biomedical Engineering and Informatics (B.M.E.I.), pp. 200–204. IEEE (2015)

    Google Scholar 

  10. Zhang, X., Yao, L., Wang, X., Monaghan, J., Mcalpine, D., Zhang, Y.: A survey on deep learning based brain computer interface: recent advances and new frontiers. arXiv preprint arXiv:1905.04149 (2019)

  11. Xiang, L., Guo, G., Jingming, Y., Sheng, V.S., Yang, P.: A convolutional neural network-based linguistic steganalysis for synonym substitution steganography. Math. Biosci. Eng. 17(2), 1041–1058 (2020)

    Article  MathSciNet  Google Scholar 

  12. Rrusienski, D., Schalk, G.: Documentation Wadsworth BCI Dataset (P300 Evoked Potentials) Data Acquired Using BCI2000’s P3 Speller Paradigm. BCI Competition III Challenge, pp. 1–8 (2004)

    Google Scholar 

  13. Gandhi, V., Prasad, G., Coyle, D., Behera, L., McGinnity, T.: EEG-based mobile robot control through an adaptive brain–robot interface. IEEE Tran. Syst. Man Cybern.: Syst. 44(9), 1278–1285 (2014)

    Article  Google Scholar 

  14. Throckmorton, C.S., Colwell, K.A., Ryan, D.B., Sellers, E.W., Collins, L.M.: Bayesian approach to dynamically controlling data collection in P300 spellers. IEEE Trans. Neural Syst. Rehabil. Eng. 21(3), 508–517 (2013)

    Article  Google Scholar 

  15. Jarchi, D., Sanei, S., Principe, J., Makkiabadi, B.: A new spatiotemporal filtering method for single-trial estimation of correlated ERP subcomponents. IEEE Trans. Biomed. Eng. 58(1), 132–143 (2011)

    Article  Google Scholar 

  16. Hoffmann, U.: Bayesian machine learning applied in a brain-computer interface for disabled users, E.P.F.L., Lausanne (2007)

    Google Scholar 

  17. Sharbrough, F., Chatrian, G.-E., Lesser, R.P., Lüders, H., Nuwer, M., Picton, T.W.: American electroencephalographic society guidelines for standard electrode position nomenclature. J. Clin. Neurophysiol. 8, 200–202 (1991)

    Article  Google Scholar 

  18. Carlos, T.S.C.L., Uma, M., Prabhu, S.: Analysis of P300 detection with different configuration electrodes based on offline dataset. J. Chem. Pharm. Sci. 9(3), 1730–1734 (2016)

    Google Scholar 

Download references

Acknowledgement

This work was supported by the National Research Council of Science & Technology (N.S.T.) grant by the Korean government (M.S.I.P.) (No. CRC-15–05-ETRI).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Murali Subramaniyam or Seung Nam Min .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Uma, M., Prabhu, S., Subramaniyam, M., Min, S.N. (2021). Analysis of Effect of RSVP Speller BCI Paradigm Along with CNN to Analysis P300 Signals. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science(), vol 12776. Springer, Cham. https://doi.org/10.1007/978-3-030-78114-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78114-9_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78113-2

  • Online ISBN: 978-3-030-78114-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics