Assistive Technologies to Support Communication with Neuro-motor Disabled Patients

  • Cristian RotariuEmail author
  • Radu Gabriel Bozomitu
  • Hariton Costin
Part of the Intelligent Systems Reference Library book series (ISRL, volume 170)


The paper describes the evolution in design and implementation of a new complex electro-informatics assistive medical system used for the communication with neuromotor disabled patients. These patients are severe handicapped persons who cannot interfere with real world by normal ways like speech, writing or language signs. Fortunately, these persons can see or can hear and they understand the meaning of different messages. The developed medical system is made by the following main functional components: the patient equipment, server, and caretaker device, connected together by using Internet available infrastructure. The bidirectional communication is performed by using keywords technology or ideograms presented on the patient’s screen provided by an application running at the server and accessed by the patient through a web browser. Patient needs are performed by using for interfacing with a software application by using different types of sensors including switch-type sensors (tactile, pressure, strain gauge) or eye tracking devices, all of these adapted to the patient’s physical condition. The medical system has also a secondary function, the remote monitoring of few vital physiological parameters needed for patient treatment and rehabilitation, based on wireless and wearable sensor network, that share the same hardware platform. The application running on caretaker device displays the patient’s needs together with the values of the selected physiological parameters in real time. The medical devices are responsible for physiological parameters acquiring, preprocessing and forwarding into the server. The server performs the parameters processing and computing the medical condition of the patient and also has the ability of sending alerts to the caretaker when one or more parameters are outside the normal limits. The application running on server manages the system databases, the communication protocols between patient and caretaker devices, records and processes the remote monitored data values and alarms the caretaker devices in emergency situations. The prototype of the developed medical system has been successfully within Clinic of “Geriatrics and Gerontology” at “Dr. C. I. Parhon” Hospital of Iaşi, Romania. The assistive solution proposed can be used in hospitals, care and treatment centers, nursing homes and also for patients treated in outpatient settings. The system contributes to increasing the level of care and treatment for neuromotor disabled patients, lowering costs in health care system.


Medical rehabilitation Human-computer interfaces Neuro-motor disabled patients Assistive devices 


  1. 1.
    Cook, A.M., Hussey, S.M.: Assistive Technologies: Principles and Practice, Pb. Mosby-Year Book (2001). ISBN 0323006434Google Scholar
  2. 2.
    Bryant, D.P., Bryant, B.R.: Assistive Technology for People with Disabilities, Pb. Allyn & Bacon (2002) ISBN 020532715XGoogle Scholar
  3. 3.
    European Commission: A Strategy for Smart, Sustainable and Inclusive Growth. COM (2010).
  4. 4.
    Bozomitu, R.G.: New methods of detecting voluntary blinking used to communicate with disabled people. Adv. Electr. Comput. Eng. 12(4), 47–52 (2012). Scholar
  5. 5.
    Cehan, V., Cehan, A.-D., Bozomitu, R.G.: A new technology of communication with people with major neuro-locomotor disability. In: Proceedings of the 2nd Electronics System-Integration Technology Conference (ESTC-2008), Greenwich, London, UK, 1st–4th Sept 2008, pp. 791–795. IEEE Catalog Number: CFP08TEM-PRT, ISBN 978-1-4244-2813-7Google Scholar
  6. 6.
    Lupu, R.G., Ungureanu, F., Bozomitu, R.G.: Mobile embedded system for human computer communication in assistive technology. In: Proceedings of the Intelligent Computer Communication and Processing (ICCP 2012), IEEE International Conference, Sinaia, Romania, Aug 30–Sept 1 2012, pp. 209–212. ISBN 978-1-4673-2951-4Google Scholar
  7. 7.
    Bozomitu, R.G., Barabaşa, C., Cehan, V., Lupu, R.G.: The hardware component of the technology used to communicate with people with major neuro-locomotor disability using ocular electromyogram. In: Proceedings of the 17th International Symposium for Design and Technology of Electronic Packages, SIITME 2011, Timişoara, Romania, 20–23 Oct 2011, pp. 193–196. ISBN 978-1-4577-1275-3Google Scholar
  8. 8.
    Cehan, D.A., Lupu, R.G,. Cehan, V., Bozomitu, R.G.: Key-word data base used in communication system with disabled people. In: Proceedings of the 17th International Symposium for Design and Technology of Electronic Packages, SIITME 2011, Timişoara, Romania, 20–23 Oct 2011, pp. 365–368. ISBN 978-1-4577-1275-3Google Scholar
  9. 9.
    Lupu, R.G,. Bozomitu, R.G., Ungureanu, F., Cehan, V.: Eye tracking based communication system for patient with major neuro-locomotor disabilities. In: Proceedings of the 15th International Conference System Theory, Control, and Computing (ICSTCC 2011), Sinaia, Romania, 14–16 Oct 2011, pp. 318–322. ISBN 978-973-621-322-9Google Scholar
  10. 10.
    Cehan, V., Cehan, D.A., Bozomitu, R.G., Lupu, R.: A new system for communication with disabled people. In: Proceedings of the Digital Cities Symposium, ERA-6 Conference, Athens, Greece, 23–24 Sept 2011Google Scholar
  11. 11.
    Lupu, R.G., Bozomitu, R.G., Cehan, V., Cehan, D.A.: A New computer-based technology for communicating with people with major neuro-locomotor disability using ocular electromyogram. In: Proceedings of the 34th International Spring Seminar on Electronics Technology, ISSE 2011, High Tatras, Slovakia, 11–15 May 2011, pp. 442–446. ISBN 978-1-4577-2111-3Google Scholar
  12. 12.
    Bozomitu, R.G., Cehan, V., Barabaşa, C.: A new VLSI implementation of a CMOS frequency synthesizer for SRD applications. In: Proceedings of the 16th International Symposium for Design and Technology of Electronic Packages, SIITME 2010, Piteşti, Romania, 23–26 Sept 2010, pp. 181–186. ISBN 978-1-4244-8123-1Google Scholar
  13. 13.
    Cehan, V., Bozomitu, R.G., Barabaşa, C.: Interactive communication system with patients with disabilities—the software component. In: Proceedings of the 16th International Symposium for Design and Technology of Electronic Packages, SIITME 2010, 23–26 Sept 2010, Piteşti, Romania, pp. 323–326. ISBN 978-1-4244-8123-1Google Scholar
  14. 14.
    Bozomitu, R.G., Cehan, V., Barabaşa, C.: A VLSI implementation of a 3 Gb/s LVDS transceiver in CMOS technology. In: Proceedings of the 15th International Symposium for Design and Technology of Electronic Packages, SIITME 2009, Gyula, Hungary, 17–20 Sept 2009, pp. 69–74. ISBN 978-1-4244-5132-6Google Scholar
  15. 15.
    Barabaşa, C., Bozomitu, R.G., Cehan, V.: Application of short range radio devices in communication systems for patients with severe neuro-locomotor disabilities. In: Proceedings of the 15th International Symposium for Design and Technology of Electronic Packages, SIITME 2009, Gyula, Hungary, 17–20 Sept 2009, pp. 251–255. ISBN 978-1-4244-5132-6Google Scholar
  16. 16.
    Cehan, A., Radinschi, I., Cehan, V., Bozomitu, R.G.: Interactive system for assisting the educational process of students with special requirements. In: Vol. 3 of Research, Reflections and Innovations in Integrating ICT in Education, pp. 1358–1360. Zurbaran 1, 2a Planta, Oficina 1, 06002 Budajoz, Spain, BA-224-2009 (The V International Conference on Multimedia and Information & Communication Technologies in Education—m-ICTE2009, Lisbon, Portugal). ISBN of Collection: 978-84-692-1788-7, ISBN vol. 3: 978-84-692-1791-7Google Scholar
  17. 17.
    Barabaşa, C., Cehan, V., Bozomitu, R.G.: Application of short range radio devices in biological signal monitoring, in advancements of medical bioengineering and informatics. In: Proceedings of the Second Edition of the International Conference E-health and Bioengineering—EHB 2009, Constanţa, 17–18 Sept 2009, pp. 128–131. “Gr. T. Popa” University of Medicine and Pharmacy Publishing House, Iaşi, 2009ISSN 2066-7590Google Scholar
  18. 18.
    Lupu, R.G., Cehan, V., Cehan, A.: Computer-based Communication system for people with neuro-muscular disabilities. In: Proceedings of the International Carpathian Control Conference ICCC’2009, Zakopane, Poland, 24–27 May 2009, pp. 203–206. ISBN 8389772-51-5Google Scholar
  19. 19.
    Bozomitu, R.G.: Radio Transmitters and Receivers. Ed. Fundaţiei Academice AXIS, Iaşi, Romania (2010). ISBN 978-973-7742-86-5Google Scholar
  20. 20.
    Lupu, R.G.: Medical Telemonitoring and Assistive Technology. Ed. Politehnium, Iaşi, Romania (2013)Google Scholar
  21. 21.
    Cehan, V: The Basics of Radio Transmitters. Ed. MatrixRom, Bucureşti, Romania (1997). ISBN 973-9254-39-XGoogle Scholar
  22. 22.
    ASISTSYS: Integrated System of Assistance for Patients with Severe Neuromotor Affections. National Multiannual Grant, PNCDI2, Partnerships, within the Program Joint Applied Research Projects, Funded by the Romanian National Authority for Scientific Research (MEN - UEFISCDI), Contract No. 12-122/01.10.2008, 2011 (2008)Google Scholar
  23. 23.
    TELPROT: Communication system with people with major neuromotor disability. TUIASI, CEEX Contract No. 69 CEEX–II 03/28.07.2006/15213/4.08.2006, 2008 (2006)Google Scholar
  24. 24.
    Bhatnagar, S.C,. Silverman, F.: Communicating with nonverbal patients in India: inexpensive augmentative communication devices.
  25. 25.
    New Grant to Fund Research to Aid People with Communication Disabilities, Durham NC, USA, “Duke University Medical Center”.
  26. 26.
    EnableMart: Producer of communication equipment for the disabled.
  27. 27.
    Speechview: Producer of software and video systems for the disabled.
  28. 28.
    The Institute on Disabilities at Temple University of Philadelphia.
  29. 29.
    Site of the National Institute of Disability Rehabilitation Research of the US.
  30. 30.
    TELEMON: Integrated Real Time Monitoring System for Patients and Older Persons. Within the program Joint Applied Research Projects, Funded by the Romanian National Authority for Scientific Research (MEN—UEFISCDI) Contract No. 11-067/18.09.2007, 2010 (2007)Google Scholar
  31. 31.
    Castanié, F., Mailhes, C. et al.: The U-R-safe project: a multidisciplinary approach for a fully nomad care for patients. In: Invited Paper for SETIT 2003, Tunisia, 17–21 Mar 2003Google Scholar
  32. 32.
    Clifford, G.D., Azuaje, F., McSharry, P.E. (eds.): Advanced Methods and Tools for ECG Analysis. Artech House Publishing, Boston/London (2006). ISBN 1-58053-966-1Google Scholar
  33. 33.
    Kropp, A.: Wireless communication for medical applications: the HEARTS experience. J. Telecommun. Inf. Technol. (JTIT) 4, 40–41 (2005)Google Scholar
  34. 34.
    Malan, D., Thaddeus, R.F. et al.: CodeBlue: an ad hoc sensor network infrastructure for emergency medical care. In: Proceedings of the MobiSys 2004 Workshop on Applications of Mobile Embedded Systems (2004)Google Scholar
  35. 35.
    Rubel, P., Fayn, J., et al.: Toward personal eHealth in cardiology. Results from the EPI-MEDICS telemedicine project. J. Electrocardiol. 38(4), 100–106 (2005)CrossRefGoogle Scholar
  36. 36.
    Varshney, U.: Pervasive Healthcare Computing. Springer (2009). ISBN 978-1-4419-0214-6Google Scholar
  37. 37.
    Yang, X., Hui, C. (eds.): Mobile Telemedicine: A Computing and Networking Perspective. CRC Press (2008). ISBN 978-1-4200-6046-1Google Scholar
  38. 38.
    Bronzino, J.D.: Biomedical Engineering and Instrumentation. PWS Engineering, Boston, MA (1986)Google Scholar
  39. 39.
    Bronzino, J.D.: The Biomedical Engineering Handbook. CRC and IEEE, Boca Raton, FL (1995)Google Scholar
  40. 40.
    Dawant, B.M., Norris, P.R.: Knowledge-based systems for intelligent patient monitoring and the management in critical care environments. In: Bronzino, J.D. (ed.) Biomedical Engineering Handbook, 2nd edn. CRC Press LLC (2000). ISBN 0-8493-0461-XGoogle Scholar
  41. 41.
    Scherer, M.J.: Living in the State of Stuck: How Technology Impacts the Lives of People with Disabilities, 4th edn. Brookline Books, Cambridge, MA (2005)Google Scholar
  42. 42.
    Rotariu, C.: Systems for Remote Monitoring of Vital Parameters. Ed. Gr. T Popa UMF, Iaşi (2009). ISBN 978-606-544-011-1Google Scholar
  43. 43.
    Rotariu, C., Costin, H., et al.: E-health system for medical telesurveillance of chronic patients. Int. J. Comput. Commun. Control 5(5), 900–909 (2010)CrossRefGoogle Scholar
  44. 44.
    Rotariu, C., Pasarica, A.l., et al.: Telemedicine system for remote blood pressure and heart rate monitoring. In: Proceedings of the 3rd International Conference on E-Health and Bioengineering—EHB 2011, 24–26 Nov 2011, pp. 127–130Google Scholar
  45. 45.
    Rotariu, C., Manta, V.: Wireless system for remote monitoring of oxygen saturation and heart rate. In: Proceedings of the Federated Conference on Computer Science and Information Systems, FedCSIS 2012, Wrocław, Poland, 9–12 Sept 2012, pp. 215–218Google Scholar
  46. 46.
    Rotariu, C., Manta, V., Ciobotariu, R.: Integrated system based on wireless sensors network for cardiac arrhythmia monitoring. Adv. Electr. Comput. Eng. 13(1), 95–100 (2013)CrossRefGoogle Scholar
  47. 47.
    CARDIONET: Integrated system for continuous surveillance in the e-health intelligent network of patients with cardiac diseases (2009).
  48. 48.
    TELEASIS: Complex system, on NGN support—next generation networking—for home senior teleassistance (2009).
  49. 49.
    Costin, H., Rotariu, C., Dionisie, B., et al.: Telemonitoring system for complex telemedicine services. In: Proceedings of International Conference on Computers, Communications & Control, ICCCC 2006, Baile Felix Spa, Oradea, 1–3 June 2006, pp. 150–155Google Scholar
  50. 50.
    Puscoci, S., Costin, H., Rotariu, C., et al.: TELMES—regional medical telecentres. In: Proceedings of XVII International Conference on Computer and Information Science and Engineering, ENFORMATIKA 2006, Cairo, Egypt, Dec 2006, pp. 243–246. ISSN 1305-5313Google Scholar
  51. 51.
    Bozomitu, R.G., Nita, L., et al.: A new integrated system for assistance in communicating with and telemonitoring severely disabled patients. Sensors 19(9), 2026 (2019). Scholar
  52. 52.
    Hnatiuc, M., Caranica, A.: Communication between the sensor levels for monitoring subjects with disabilities. In: Proceedings of Advanced Technologies for Enhanced Quality of Life, pp. 87–91 (2009)Google Scholar
  53. 53.
    Hnatiuc, M., Belconde, A., Kratz, F.: Location of a person by means of sensors’ network. In: Proceedings of ARTIPED 2010, pp. 301–305 (2010)Google Scholar
  54. 54.
    Schmitt, K.U., Muser, H., et al.: Comparing eye movements recorded by search coil and infrared eye tracking. J. Clin. Monitor. Comput. 21, 49–53 (2007)CrossRefGoogle Scholar
  55. 55.
    Kong, Y., et al.: Low-cost infrared video-oculography for measuring rapid eye movements. In: Park J., Chen, S.C., Raymond Choo, K.K. (eds.) Advanced Multimedia and Ubiquitous Engineering. FutureTech 2017, MUE 2017. Lecture Notes in Electrical Engineering, vol. 448. Springer, Singapore. Clerk Maxwell, J.: A Treatise on Electricity and Magnetism, vol. 2., 3rd edn. Clarendon, Oxford, 1892, pp. 68–73 (2017)Google Scholar
  56. 56.
    Johns, M.W., Tucker, A., et al.: Monitoring eye and eyelid movements by infrared reflectance oculography to measure drowsiness in drivers. Somnologie Schlafforschung Schlafmedizin 11, 234–242 (2007)CrossRefGoogle Scholar
  57. 57.
    Lupu, R., Ungureanu, F.: A survey of eye tracking methods and applications. Sci. Bull. Polytech. Inst. Autom. Control Comput. Sci. Sect. 3, 71–86 (2013)Google Scholar
  58. 58.
    Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice, Chapter 5: Eye Tracking Techniques, pp. 51–59. Springer (2007)Google Scholar
  59. 59.
    Chau, M., Betke, M.: Real time eye tracking and blink detection with USB cameras. Technical Reports, No. 12, pp. 1–10. Boston University Computer Science (2005)Google Scholar
  60. 60.
    Andrienko, G., Andrienko, N., Burch, M., Weiskopf, D.: Visual analyrics methodology for eye movement studies. IEEE Trans. Visual Comput. Graph. 18(12), 2889–2898 (2012)CrossRefGoogle Scholar
  61. 61.
    Barae, R., Boquete, L., Mazo, M.: System for assisted mobility using eye movements based on electrooculography. IEEE Trans. Neural Syst. Rehabil. Eng. 10(4), 209–218 (2002)CrossRefGoogle Scholar
  62. 62.
    Arthi, S.V., Norman, R.: Interface and control of appliances by the analysis of electrooculography signals. In: Artificial Intelligence and Evolutionary Computations in Engineering Systems, pp. 1075–1084. Springer, India (2016)Google Scholar
  63. 63.
    Wu, S.L., Liao, L., et al.: Controlling a human-computer interface system with a novel classification method that uses electrooculography signals. IEEE Trans. Biomed. Eng. 60(8), 2133–2141 (2013)CrossRefGoogle Scholar
  64. 64.
    Barea, R., Boquete, L., et al.: Wheelchair guidance strategies using EOG. J. Intell. Robot. Syst. 34, 279–299 (2002)CrossRefGoogle Scholar
  65. 65.
    Dhillon, H.S., Singla R., Rekhi, N.S., Jha, R.: EOG and EMG based virtual keyboard: a brain–computer interface. In: Proceedings of 2nd IEEE International Conference on Computer Science and Information Technology, pp. 259–262 (2009)Google Scholar
  66. 66.
    Usakli, A.B., Gurkan, S.: Design of a novel efficient human–computer interface: an electrooculagram based virtual keyboard. IEEE Trans. Instrum. Measure. 59(8), 2099–2108 (2010)CrossRefGoogle Scholar
  67. 67.
    Deng, L.Y., Hsu, C.L., et al.: EOG based human-computer interface system development. Expert Syst. Appl. 37, 3337–3343 (2010)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Cristian Rotariu
    • 1
    Email author
  • Radu Gabriel Bozomitu
    • 2
  • Hariton Costin
    • 1
    • 3
  1. 1.Faculty of Medical BioengineeringGrigore T Popa University of Medicine and PharmacyIasiRomania
  2. 2.Faculty of Electronics, Telecommunications and Information TechnologyGheorghe Asachi Technical UniversityIasiRomania
  3. 3.Institute of Computer Science of Romanian Academy, Iași BranchIasiRomania

Personalised recommendations