Skip to main content

Development of EOG and EMG-Based Multimodal Assistive Systems

  • Chapter
  • First Online:
Medical Imaging in Clinical Applications

Part of the book series: Studies in Computational Intelligence ((SCI,volume 651))

Abstract

This study discusses a human-computer interface (HCI)- based novel approach for designing a computer-aided control and communication system using electrooculogram (EOG) and electromyogram (EMG) signals for people with severe hindrance to motor activities and communication. The EOG and EMG signals were attributed to eye movements and voluntary eye blinks, respectively. The acquired signals were processed and classified in a MATLAB-based graphical user interface (GUI) to detect different eye movements. A couple of Hall-effect sensors were conditioned to be used concurrently with multidirectional eye movements or voluntary eye blinks to generate multipurpose serial commands to control the movement of a robotic vehicle (representative assistive aid) and communications support systems. The user details were registered and the system operability was monitored in the same GUI. Due to multitasking and ease of use of the proposed device, the quality of life of the incapacitated individuals can be improved with greater independence.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Vaish, A., Kumari, P.: A comparative study on machine learning algorithms in emotion state recognition using ECG. In: Proceedings of the Second International Conference on Soft Computing for Problem Solving (SocProS 2012), Dec 28–30, 2012, pp. 1467–1476. Springer (2014)

    Google Scholar 

  2. Choi, K., Cichocki, A.: Control of a wheelchair by motor imagery in real time. Intelligent Data Engineering and Automated Learning–IDEAL 2008, pp. 330–337. Springer (2008)

    Google Scholar 

  3. Tanaka, K., Matsunaga, K., Wang, H.O.: Electroencephalogram-based control of an electric wheelchair. IEEE Trans. Robot. 21, 762–766 (2005)

    Article  Google Scholar 

  4. Sharma, P., Vaish, A.: Information-Theoretic Measures on Intrinsic Mode Function for the Individual Identification Using EEG Sensors

    Google Scholar 

  5. Champaty, B., Jose, J., Pal, K., Thirugnanam, A.: Development of EOG based human machine interface control system for motorized wheelchair. In: 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD), pp. 1–7. IEEE (2014)

    Google Scholar 

  6. Yamagishi, K., Hori, J., Miyakawa, M.: Development of EOG-based communication system controlled by eight-directional eye movements. In: Engineering in Medicine and Biology Society, 2006. EMBS’06. 28th Annual International Conference of the IEEE, pp. 2574–2577. IEEE (2006)

    Google Scholar 

  7. Han, J.-S., Bien, Z.Z., Kim, D.-J., Lee, H.-E., Kim, J.-S.: Human-machine interface for wheelchair control with EMG and its evaluation. In: Engineering in Medicine and Biology Society, 2003. Proceedings of the 25th Annual International Conference of the IEEE, pp. 1602–1605. IEEE (2003)

    Google Scholar 

  8. Moon, I., Lee, M., Chu, J., Mun, M.: Wearable EMG-based HCI for electric-powered wheelchair users with motor disabilities. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005. ICRA 2005, pp. 2649–2654. IEEE (2005)

    Google Scholar 

  9. Dey, N., Dey, G., Chakraborty, S., Chaudhuri, S.S.: Feature analysis of blind watermarked electromyogram signal in wireless telemonitoring. Concepts and Trends in Healthcare Information Systems, pp. 205–229. Springer (2014)

    Google Scholar 

  10. Mukherjee, A., Dey, G., Dey, M., Dey, N.: Web-based intelligent EEG signal authentication and tamper detection system for secure telemonitoring. Brain-Computer Interfaces, pp. 295–312. Springer (2015)

    Google Scholar 

  11. Coco, G.L., Coco, D.L., Cicero, V., Oliveri, A., Verso, G.L., Piccoli, F., La Bella, V.: Individual and health-related quality of life assessment in amyotrophic lateral sclerosis patients and their caregivers. J. Neurol. Sci. 238, 11–17 (2005)

    Article  Google Scholar 

  12. Nathan, D.S., Vinod, A.P., Thomas, K.P.: An electrooculogram based assistive communication system with improved speed and accuracy using multi-directional eye movements. In: 2012 35th International Conference on Telecommunications and Signal Processing (TSP), pp. 554–558. IEEE (2012)

    Google Scholar 

  13. Dhillon, H.S., Singla, R., Rekhi, N.S., Jha, R.: EOG and EMG based virtual keyboard: a brain-computer interface. In: 2nd IEEE International Conference on Computer Science and Information Technology, 2009. ICCSIT 2009, pp. 259–262. IEEE (2009)

    Google Scholar 

  14. Akan, B., Argunsah, A.O.: A human-computer interface (HCI) based on electrooculogram (EOG) for handicapped. In: Signal Processing and Communications Applications, 2007. SIU 2007. IEEE 15th, pp. 1–3. IEEE (2007)

    Google Scholar 

  15. Barea, R., Boquete, L., Mazo, M., López, E.: System for assisted mobility using eye movements based on electrooculography. IEEE Trans. Neural Syst. Rehabil. Eng. 10, 209–218 (2002)

    Article  Google Scholar 

  16. Chen, Y., Newman, W.S.: A human-robot interface based on electrooculography. In: 2004 IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA’04, pp. 243–248. IEEE (2004)

    Google Scholar 

  17. Hiley, J.B., Redekopp, A.H., Fazel-Rezai, R.: A low cost human computer interface based on eye tracking. In: Engineering in Medicine and Biology Society, 2006. EMBS’06. 28th Annual International Conference of the IEEE, pp. 3226–3229. IEEE (2006)

    Google Scholar 

  18. Junichi, H., Sakano, K., Saitoh, Y.: Development of a communication support device controlled by eye movements and voluntary eye blink. IEICE Trans. Inf. Syst. 89, 1790–1797 (2006)

    Google Scholar 

  19. Kim, Y., Doh, N., Youm, Y., Chung, W.K.: Development of human-mobile communication system using electrooculogram signals. In: Proceedings. 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2001, pp. 2160–2165. IEEE (2001)

    Google Scholar 

  20. LaCourse, J.R., Hludik Jr., F.C.: An eye movement communication-control system for the disabled. IEEE Trans. Bio-med. Eng. 37, 1215–1220 (1990)

    Google Scholar 

  21. Pander, T., Przybyla, T., Czabanski, R.: An application of detection function for the eye blinking detection. In: 2008 Conference on Human System Interactions, pp. 287–291. IEEE (2008)

    Google Scholar 

  22. Tecce, J.J., Gips, J., Olivieri, C.P., Pok, L.J., Consiglio, M.R.: Eye movement control of computer functions. Int. J. Psychophysiol. 29, 319–325 (1998)

    Article  Google Scholar 

  23. Ubeda, A., Ianez, E., Azorin, J.M.: Wireless and portable EOG-based interface for assisting disabled people. IEEE/ASME Trans. Mechatron. 16, 870–873 (2011)

    Article  Google Scholar 

  24. Champaty, B., Pal, K., Dash, A.: Functional electrical stimulation using voluntary eyeblink for foot drop correction. In: 2013 Annual International Conference on Emerging Research Areas and 2013 International Conference on Microelectronics, Communications and Renewable Energy (AICERA/ICMiCR), pp. 1–4. IEEE (2013)

    Google Scholar 

  25. Iáñez, E., Úbeda, A., Azorín, J.M., Perez-Vidal, C.: Assistive robot application based on an RFID control architecture and a wireless EOG interface. Robot. Auton. Syst. 60, 1069–1077 (2012)

    Article  Google Scholar 

  26. Barea, R., Boquete, L., Mazo, M., López, E.: Guidance of a wheelchair using electrooculography. In: Proceeding of the 3rd IMACS International Multiconference on Circuits, Systems, Communications and Computers (CSCC’99). Citeseer (1999)

    Google Scholar 

  27. Dev, A.: Eye controlled wheel chair using EOG. Program. Device Circuits Syst. 4, 592–595 (2012)

    Google Scholar 

  28. Tsui, C.S.L., Jia, P., Gan, J.Q., Hu, H., Yuan, K.: EMG-based hands-free wheelchair control with EOG attention shift detection. In: IEEE International Conference on Robotics and Biomimetics, 2007. ROBIO 2007, pp. 1266–1271. IEEE (2007)

    Google Scholar 

  29. Wijesoma, W.S., Wee, K.S., Wee, O.C., Balasuriya, A.P., San, K.T., Soon, L.K.: EOG based control of mobile assistive platforms for the severely disabled. In: 2005 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 490–494. IEEE (2005)

    Google Scholar 

  30. Chambayil, B., Singla, R., Jha, R.: Virtual keyboard BCI using Eye blinks in EEG. In: WiMob, pp. 466–470 (2010)

    Google Scholar 

  31. Ding, Q., Tong, K., Li, G.: Development of an EOG (electro-oculography) based human-computer interface. In: 27th Annual International Conference of the Engineering in Medicine and Biology Society, 2005. IEEE-EMBS 2005, pp. 6829–6831. IEEE (2006)

    Google Scholar 

  32. Tamura, H., Miyashita, M., Tanno, K., Fuse, Y.: Mouse cursor control system using electrooculogram signals. In: World Automation Congress (WAC), 2010, pp. 1–6. IEEE (2010)

    Google Scholar 

  33. Lv, Z., Wu, X., Li, M., Zhang, C.: Implementation of the EOG-based human computer interface system. In: The 2nd International Conference on Bioinformatics and Biomedical Engineering, 2008. ICBBE 2008, pp. 2188–2191. IEEE (2008)

    Google Scholar 

  34. Rajan, A., Shivakeshavan, R., Ramnath, J.: Electrooculogram based instrumentation and control system (IC system) and its applications for severely paralysed patients. In: International Conference on Biomedical and Pharmaceutical Engineering, 2006. ICBPE 2006, pp. 1–4. IEEE (2006)

    Google Scholar 

  35. Zheng, X., Li, X., Liu, J., Chen, W., Hao, Y.: A portable wireless eye movement-controlled human-computer interface for the disabled. In: ICME International Conference on Complex Medical Engineering, 2009. CME, pp. 1–5. IEEE (2009)

    Google Scholar 

  36. Li, L., Wu, X.: Design and implementation of multimedia control system based on bluetooth and electrooculogram (EOG). In: 2011 5th International Conference on Bioinformatics and Biomedical Engineering, (iCBBE), pp. 1–4. IEEE (2011)

    Google Scholar 

  37. Navallas, J., Ariz, M., Villanueva, A., San Agustín, J., Cabeza, R.: Optimizing interoperability between video-oculographic and electromyographic systems. J. Rehabil. Res. Dev. 48, 253–266 (2011)

    Article  Google Scholar 

  38. Hutchinson, T.E., White Jr, K.P., Martin, W.N., Reichert, K.C., Frey, L.A.: Human-computer interaction using eye-gaze input. IEEE Trans. Syst. Man Cybern. 19, 1527–1534 (1989)

    Article  Google Scholar 

  39. Heide, W., Koenig, E., Trillenberg, P., Kömpf, D., Zee, D.: Electrooculography: technical standards and applications. Electroencephalogr. Clin. Neurophysiol. 1999, 223–240 (1999)

    Google Scholar 

  40. Kumar, U., Champaty, B., Shashikala, P., Pal, K.: Design of low-cost continuous temperature and water spillage monitoring system. In: 2013 International Conference on Information Communication and Embedded Systems (ICICES), pp. 1156–1159. IEEE (2013)

    Google Scholar 

  41. Dutta, D., Champaty, B., Banerjee, I., Pal, K., Tibarewala, D.: Development of a wireless attendant calling system for improved patient care. Advancements of Medical Electronics, pp. 185–191. Springer (2015)

    Google Scholar 

  42. Champaty, B., Dubey, P., Sahoo, S., Ray, S.S., Pal, K., Anis, A.: Development of wireless EMG control system for rehabilitation devices. In: 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD), pp. 1–4. IEEE (2014)

    Google Scholar 

  43. Lay-Ekuakille, A., Vergallo, P., Griffo, G., Conversano, F., Casciaro, S., Urooj, S., Bhateja, V., Trabacca, A.: Entropy index in quantitative EEG measurement for diagnosis accuracy. IEEE Trans. Instrum. Meas. 63, 1440–1450 (2014)

    Article  Google Scholar 

  44. Reaz, M., Hussain, M., Mohd-Yasin, F.: Techniques of EMG signal analysis: detection, processing, classification and applications. Biol. Proced. Online 8, 11–35 (2006)

    Article  Google Scholar 

  45. Malcolm, B., Michael, M., Vaegan, E., Mitchell, B., Michael, B.: ISCEV standard for clinical electro-oculography (EOG). Doc. Ophthalmol. 113, 205–212 (2006)

    Article  Google Scholar 

  46. Chang, N., Gupta, V.: PS/2 Mouse Control with EOG/EMG Signals. ECE (2004)

    Google Scholar 

  47. Banerjee, A., Datta, S., Konar, A., Tibarewala, D.: Development strategy of eye movement controlled rehabilitation aid using Electro-oculogram. Int. J. Sci. Eng. Res. 3, 1–6 (2012)

    Google Scholar 

  48. Ellis, S.R., Menges, B.M.: Judgments of the distance to nearby virtual objects: interaction of viewing conditions and accommodative demand. Presence (Cambridge, Mass.), vol. 6, pp. 452–460 (1997)

    Google Scholar 

  49. Dobrev, D., Neycheva, T., Mudrov, N.: Simple high-Q comb filter for mains interference and baseline drift suppression. Ann. J. Electron. 3, 50–52 (2009)

    Google Scholar 

  50. Pandey, V.K., Naidu, N.K.S., Pandey, P.C.: Tracking based baseline restoration for acquisition of impedance cardiogram and other biosignals. In: 27th Annual International Conference of the Engineering in Medicine and Biology Society, 2005. IEEE-EMBS 2005, pp. 3486–3489. IEEE (2006)

    Google Scholar 

  51. Bhateja, V., Verma, R., Mehrotra, R., Urooj, S.: A non-linear approach to ECG signal processing using morphological filters. Int. J. Measur. Technol. Instrum. Eng. (IJMTIE) 3, 46–59 (2013)

    Google Scholar 

  52. Kawasaki, K., Tamura, T.: Automated measurement of the electro-oculogram for clinical use. Doc. Ophthalmol. 66, 85–94 (1987)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kunal Pal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Champaty, B., Tibarewala, D.N., Mohapatra, B., Pal, K. (2016). Development of EOG and EMG-Based Multimodal Assistive Systems. In: Dey, N., Bhateja, V., Hassanien, A. (eds) Medical Imaging in Clinical Applications. Studies in Computational Intelligence, vol 651. Springer, Cham. https://doi.org/10.1007/978-3-319-33793-7_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33793-7_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33791-3

  • Online ISBN: 978-3-319-33793-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics