Memory Aid Service Using Mind Sensing and Daily Retrospective by Virtual Agent

  • Haruhisa MaedaEmail author
  • Sachio Saiki
  • Masahide Nakamura
  • Kiyoshi Yasuda
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11582)


Our research group has been studying smart home services for elderly people, which detect their daily activities based on the environmental sensors in the house. However, such sensors can only obtain limited information. To execute more optimized care, we must retrieve not only external events but internal states. Furthermore, to support memory aid, it is important to be able to retrieve the recorded information at any time. In this paper, we propose a new memory aid service, which records the self-talk of elderly people and utilizes the recorded information. Specifically, we develop mind sensing, which is to externalize the inside of elderly’s heart as a sentence using a virtual agent. Then, the recorded information by mind sensing is cleansed through calibration and classification based on dialogue between an elderly person and a virtual agent. These information can be retrieved by classification or arbitrary keywords. In this way, the proposed service enable elderly to record and retrieve what they thought anytime anywhere.


Smart health-care Dialogue agent Mind sensing 



This research was partially supported by the Japan Ministry of Education, Science, Sports, and Culture [Grant-in-Aid for Scientific Research (B) (16H02908, 18H03242, 18H03342), Grant-in-Aid for Scientific Research (A) (17H00731)], and Tateishi Science and Technology Foundation (C) (No.2177004).


  1. 1.
    Di Cesare, G., Di Dio, C., Marchi, M., Rizzolatti, G.: Expressing our internal states and understanding those of others. Proc. Nat. Acad. Sci. 112(33), 10331–10335 (2015)CrossRefGoogle Scholar
  2. 2.
    Government of Japan: Annual report on the aging society, June 2018.
  3. 3.
    Government of Japan: Community-based integrated care systems, June 2018. (in japanese)
  4. 4.
    LINE Developers: Messaging api, July 2018.
  5. 5.
    Nakatani, S., Saiki, S., Nakamura, M., Yasuda, K.: Generating personalized virtual agent in speech dialogue system for people with dementia. In: Duffy, V.G. (ed.) DHM 2018. LNCS, vol. 10917, pp. 326–337. Springer, Cham (2018). Scholar
  6. 6.
    Tamamizu, K., Sakakibara, S., Saiki, S., Nakamura, M., Yasuda, K.: Machine learning approach to recognizing indoor activities based on detection of environmental change. In: 11th World Conference of Gerontechnology (ISG2018), vol. 17, p. 118s, st. Petersburg, USA, May 2018Google Scholar
  7. 7.
    Tokunaga, S., Tamamizu, K., Saiki, S., Nakamura, M., Yasuda, K.: VirtualCareGiver: personalized smart elderly care. Int. J. Softw. Innov. 5(1), 30–43 (2016). abstract-announcement/158780CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Haruhisa Maeda
    • 1
    Email author
  • Sachio Saiki
    • 1
  • Masahide Nakamura
    • 1
    • 2
  • Kiyoshi Yasuda
    • 3
  1. 1.Graduate School of System InformaticsKobe UniversityKobeJapan
  2. 2.Riken AIPChuo-kuJapan
  3. 3.Osaka Institute of TechnologyOsakaJapan

Personalised recommendations