Abstract
The paper describes the idea of touchless virtual keyboard designed for disabled people with tetraparesis. Each key can be selected by three double eye blinks registered by EMG sensor. EEG signals are used as a support that allows the user to change the input mode of single characters to the mode of predicted words selection. The keyboard was implemented and evaluated during provided experiments. Obtained result (\(WPM=1.11\)) partially confirms the calculated typing speed (\(WPM=1.23\)). It is also found that the keyboard efficiency can be improved by using a list of predicted words, even the number of those words is low and they are short (\(WPM=1.27\)). Provided discuss presents that improved keyboard used by experienced users could achieve the typing efficiency even up to \(WPM=3.15\).
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
B10NUMB3R5: Average duration of a single eye blink (2008). http://bionumbers.hms.harvard.edu/bionumber.aspx?s=y&id=100706
Cecotti, H.: A self-paced and calibration-less SSVEP-based brain-computer interface speller. IEEE Trans. Neural Syst. Rehabil. Eng. 18(2), 127–133 (2010)
Chapin, J.K., Moxon, K.A., Markowitz, R.S., Nicolelis, M.A.: Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2(7), 664–670 (1999)
Duchowski, A.T.: Eye Tracking Methodology. Theory and Practice. Springer, London (2007)
Hwang, H.J., Kim, S., Choi, S., Im, C.H.: EEG-based brain-computer interfaces: a thorough literature survey. Int. J. Hum.-Comput. Interact. 29(12), 814–826 (2013)
Kang, K., Hong, J.: A framework for computer interface using EEG and EMG. In: RACS 2015, Prague, Czech Republic, pp. 472–473 (2015)
Krapic, L., Lenac, K., Ljubic, S.: Integrating Blink Click interaction into a head tracking system: implementation and usability issues. Univ. Access Inf. Soc. 14(2), 247–264 (2015)
Królak, A., Strumiłło, P.: Eye-blink detection system for human-computer interaction. Univ. Access Inf. Soc. 11(4), 409–419 (2012)
Lin, C.T., Chen, Y.C., Huang, T.Y., Chiu, T.T., Ko, L.W., Liang, S.F., Hsieh, H.Y., Hsu, S.H., Duann, J.R.: Development of wireless brain computer interface with embedded multitask scheduling and its application on real-time driver’s drowsiness detection and warning. IEEE Trans. Biomed. Eng. 55(5), 1582–1591 (2008)
Lin, C.T., Lin, F.C., Chen, S.A., Lu, S.W., Chen, T.C., Ko, L.W.: EEG-based brain-computer interface for smart living environmental auto-adjustment. J. Med. Biol. Eng. 30(4), 237–245 (2010)
MacKenzie, I.S., Ashtiani, B.: BlinkWrite: efficient text entry using eye blinks. Univ. Access Inf. Soc. 10(1), 69–80 (2011)
MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: CHI 2003, Ft. Lauderdale, FL, USA, pp. 754–755 (2003)
Majaranta, P.: Communication and text entry by gaze. In: Majaranta, P. (ed.) Gaze Interaction and Applications of Eye Tracking: Advances in Assistive, pp. 63–77. IGI Global, Hershey (2012)
Marshall, D., Coyle, D., Wilson, S., Callaghan, M.: Games, gameplay, and BCI: the state of the art. IEEE Trans. Comput. Intell. AI Games 5(2), 82–99 (2013)
McFarland, D.J., Krusienski, D.J., Sarnacki, W.A., Wolpaw, J.R.: Emulation of computer mouse control with a noninvasive brain-computer interface. J. Neural Eng. 5(2), 101 (2008)
NeuroSky: Neurosky MindWave Mobile EEG. http://store.neurosky.com/pages/mindwave. Accessed 12 2016
Obermaier, B., Muller, G.R., Pfurtscheller, G.: “Virtual keyboard” controlled by spontaneous EEG activity. IEEE Trans. Neural Syst. Rehabil. Eng. 11(4), 422–426 (2003)
Păsărică, A., Bozomitu, R.G., Cehan, V., Rotariu, C.: Eye blinking detection to perform selection for an eye tracking system used in assistive technology. In: SIITME 2016, Oradea, Romania, pp. 213–216 (2016)
Perego, P., Turconi, A., Andreoni, G., Gagliardi, C.: Cognitive ability assessment by brain-computer interface II: application of a BCI-based assessment method for cognitive abilities. Brain-Comput. Interfaces 1(3–4), 170–180 (2014)
Scherer, R., Muller, G., Neuper, C., Graimann, B., Pfurtscheller, G.: An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate. IEEE Trans. Biomed. Eng. 51(6), 979–984 (2004)
Soukoreff, R.W., MacKenzie, I.S.: Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. In: CHI 2001, Seattle, WA, USA, pp. 319–320 (2001)
Stamps, K., Hamam, Y.: Towards inexpensive BCI control for wheelchair navigation in the enabled environment–a hardware survey. In: Brain Informatics. LNCS, vol. 6334, pp. 336–345. Springer, Heidelberg (2010)
Tan, D.S., Nijholt, A.: Brain-Computer Interfaces. Applying our Minds to Human-Computer Interaction. Springer, London (2010)
Acknowledgements
Publication financed by the Institute of Informatics at Silesian University of Technology, statutory research no. 02/020/BK-16/0077.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Dobosz, K., Stawski, K. (2018). Touchless Virtual Keyboard Controlled by Eye Blinking and EEG Signals. In: Gruca, A., Czachórski, T., Harezlak, K., Kozielski, S., Piotrowska, A. (eds) Man-Machine Interactions 5. ICMMI 2017. Advances in Intelligent Systems and Computing, vol 659. Springer, Cham. https://doi.org/10.1007/978-3-319-67792-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-67792-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67791-0
Online ISBN: 978-3-319-67792-7
eBook Packages: EngineeringEngineering (R0)