A Smart Home Assistive Living Framework Using Fog Computing for Audio and Lighting Stimulation

  • N. K. SuryadevaraEmail author
  • Atul Negi
  • Srinivasa Raju Rudraraju
Conference paper
Part of the Learning and Analytics in Intelligent Systems book series (LAIS, volume 3)


This work proposes an innovative Ambient Assisted Living framework for mature adults suffering from dementia. A novel Fog computing based ubiquitous recognition model is used to stimulate subjects and immediately trigger an associative recall in recognizing familiar persons and everyday objects. When a known person is sensed in the house, then a relevant audio file is played on smart speakers located in the house, so as to trigger associative recall based on the principles of music therapy. Also, the lighting effects are used to assist the subjects in identifying domestic objects accurately. Person and object recognition is achieved by using the Haar Cascade Classifier. The system was successful in the identification of 82% of the familiar people or objects so that the benefits of music therapy and lighting are realized for everyday living.


Audio-lighting stimulation Smart home Associative recall Dementia Fog computing Internet of Things (IoT) 


  1. 1.
    World Alzheimer Report 2018: the state of the art of dementia research: new frontiers. Last accessed 20 Jan 2019
  2. 2.
  3. 3.
    Dzulkifli MA, Mustafar MF (2013) The influence of colour on memory Performance: a review. Malays J Med Sci 20(2):3–9Google Scholar
  4. 4.
    Wichmann FA, Sharpe LT, Gegenfurtner KR (2002) The contributions of color to recognition memory for natural scenes. J Exp Psychol: Learn, Mem, Cogn 28(3):509–520Google Scholar
  5. 5.
    Auditory Stimulation for Alzheimer’s Disease and Dementia. Last accessed 18 Nov 2018
  6. 6.
    Gayathri KS, Easwarakumar KS (2016) Intelligent decision support system for dementia care through smart home. In: 6th international conference on advances in computing & communications, Cochin, pp 947–955Google Scholar
  7. 7.
    Shi W, Cao J, Zhang Q, Li Y, Xu L (2016) Edge computing: vision and challenges. IEEE Internet Things J 3(5):637–646CrossRefGoogle Scholar
  8. 8.
    Aazam M, Zeadally S, Harrass KA (2018) Fog computing architecture, evaluation, and future research directions. IEEE Commun Mag 56(5):46–52CrossRefGoogle Scholar
  9. 9.
    Wang J, Zhang Z, Li B, Lee S, Sherratt RS (2014) An enhanced fall detection system for elderly person monitoring using consumer home networks. IEEE Trans Consum Electron 60(1):23–29CrossRefGoogle Scholar
  10. 10.
    Suryadevara NK, Mukhopadhyay SC (2012) Wireless sensor network based home monitoring system for wellness determination of elderly. IEEE Sens J 12(6):1965–1972CrossRefGoogle Scholar
  11. 11.
    Jean-Baptiste EMD, Mihailidis A (2017) Benefits of automatic human action recognition in an assistive system for people with dementia. In: IEEE Canada international humanitarian technology conference (IHTC), pp 61–65Google Scholar
  12. 12.
    Zhang S, McClean S, Scotney B, Hong X, Nugent C, Mulvenna M (2008) Decision support for alzheimers patients in smart homes. In: 21st IEEE international symposium on computer-based medical systems, pp 236–241Google Scholar
  13. 13.
    Amiribesheli M, Bouchachia A (2016) Towards dementia-friendly smart homes. In: 40th IEEE computer software and applications conference (COMPSAC), pp 638–647Google Scholar
  14. 14.
    Khan SS, Zhu T, Ye B, Mihailidis A, Iaboni A, Newman K, Wang AH, Martin LS (2017) DAAD: a framework for detecting agitation and aggression in people living with dementia using a novel multi-modal sensor network. In: IEEE international conference on data mining workshops (ICDMW), pp 703–710Google Scholar
  15. 15.
    Mulvenna M, Zheng H, Bond R, McAllister P, Wang H, Riestra R (2017) Participatory design-based requirements elicitation involving people living with dementia towards a home-based platform to monitor emotional wellbeing. In: IEEE international conference on bioinformatics and biomedicine (BIBM), pp 2026–2030Google Scholar
  16. 16.
    Schinle M, Papantonis I, Stork W (2018) Personalization of monitoring system parameters to support ambulatory care for dementia patients. In: IEEE sensors applications symposium (SAS), pp 1–6Google Scholar
  17. 17.
    Ritcher J, Findeisen M, Hirtz G (2015) Assessment and care system based on people detection for elderly suffering from dementia. In: 5th IEEE international conference on consumer electronics (ICCE), Berlin, pp 59–63Google Scholar
  18. 18.
    Kasliwal MH, Patil HY (2017) Smart location tracking system for dementia patients. In: International conference on advances in computing, communication and control (ICAC3), pp 1–6Google Scholar
  19. 19.
    Ceccacci S, Generosi A, Giraldi L, Mengoni M (2017) An user-centered approach to design smart systems for people with dementia. In: 7th IEEE international conference on consumer electronics (ICCE), Berlin, pp 273—278Google Scholar
  20. 20.
    OpenCV library. Last accessed 20 Oct 2018
  21. 21.
    openHAB. Last accessed 21 Dec 2018

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • N. K. Suryadevara
    • 1
    Email author
  • Atul Negi
    • 1
  • Srinivasa Raju Rudraraju
    • 1
    • 2
  1. 1.School of Computer and Information SciencesUniversity of HyderabadHyderabadIndia
  2. 2.Department of Computer Science and EngineeringVishnu Institute of TechnologyBhimavaramIndia

Personalised recommendations