CALONIS: An Artificial Companion Within a Smart Home for the Care of Cognitively Impaired Patients

  • Yorick Wilks
  • Jan M. JasiewiczEmail author
  • Roberta Catizone
  • Lucian Galescu
  • Kristina M. Martinez
  • Deborah Rugs
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8456)


The paper describes a prototype Embodied Conversational Agent or Companion, called CALONIS, for a brain-injured Veteran with severe cognitive impairment. The CALONIS project is a sub-project of the larger Tampa VA SmartHome implementation initiative. CALONIS is intended to provide increased engagement, diversion and assistance beyond the usual mechanisms of providing assistance through text based prompting and interactions. We hope to eventually integrate CALONIS fully into the next generation of the Tampa VA SmartHome in which the SmartHome itself becomes a fully interactive and intelligent electronic caregiver. The project began with a Wizard-of-Oz version of CALONIS but even at this early stage we appear to have achieved high levels of patient engagement as well as in relation to the caregiver. The full CALONIS prototype is based on the Senior Companion project, originally developed as part of a large-scale EU project [1].


Companion Artificial agent Carer Engagement Smart home Wizard of Oz Spoken dialogue system 



This work is supported by grants from the U.S. Department of Veterans Affairs and Ubisense PLC.

The views, opinions, and/or findings contained in this article are those of the authors and should not be construed as an official position, policy or decision of the Departments of Defense or Veterans Affairs unless so designated by other official documentation.


  1. 1.
    Wilks, Y.: Introducing artificial companions. In: Wilks, Y. (ed.) Close Engagements with Artificial Companions: Key Social, Psychological, Ethical and Design Issues. John Benjamins, Amsterdam (2010)CrossRefGoogle Scholar
  2. 2.
    Jasiewicz, J., Kearns, W., Craighead, J., Fozard, J.L., Scott, S., McCarthy, J.: Smart rehabilitation for the 21st century: the Tampa smart home for veterans with traumatic brain injury. J. Rehabil. Res. Dev. 48(8), xii–xvii (2011)CrossRefGoogle Scholar
  3. 3.
    Kearns, W., Jasiewicz, J.M., Fozard, J., Webster, P., Scott, S., Craighead, J., Bowen, M.E., McCarthy, J.: Temporo-spatial prompting for persons with cognitive impairment using a smart wrist-worn interface. J. Rehabil. Res. Dev. 50(10), vii–xiii (2013)CrossRefGoogle Scholar
  4. 4.
    Bickmore, T.W., Caruso, L., Clough-Gorr, K., Heeren, T.: ‘It’s just like you talk to a friend’ – relational agents for older adults. Interact. Comput. 17(6), 711–735 (2005)CrossRefGoogle Scholar
  5. 5.
    Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of Oz studies – why and how. In: Proceedings of the 1st International Conference on User interfaces, IUI ’93 (1993)Google Scholar
  6. 6.
    Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005)CrossRefGoogle Scholar
  7. 7.
    Marsella, S., Gratch, J., Petta, P.: Computational models of emotion. In: Scherer, K.R., Bänziger, T., Roesch, E. (eds.) A Blueprint for an Affectively Competent Agent: Cross-Fertilization Between Emotion Psychology, Affective Neuroscience, and Affective Computing. Oxford University Press, Oxford (2010)Google Scholar
  8. 8.
    Wilks, Y., Catizone, R., Worgan, S., Dingli, A., Moore, R., Field, D., Cheng, W.: A prototype for a conversational companion for reminiscing about images. Comput. Speech Lang. 25(2), 140–157 (2011)CrossRefGoogle Scholar
  9. 9.
    Wilks, Y., Ballim, A.: Liability and consent. In: Narayanan, N., Bennun, T. (eds.) Law, Computers and Artificial Intelligence. Ablex, Norwood (1990)Google Scholar
  10. 10.
    McDermott, D.: Why ethics is a high hurdle for AI. In: Proceedings of North American Conference on Computers and Philosophy (NA-CAP), Bloomington, Indiana (2008)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Yorick Wilks
    • 1
  • Jan M. Jasiewicz
    • 2
    Email author
  • Roberta Catizone
    • 1
  • Lucian Galescu
    • 1
  • Kristina M. Martinez
    • 3
  • Deborah Rugs
    • 2
  1. 1.Florida Institute for Human and Machine CognitionOcalaUSA
  2. 2.HSR&D/RR&D Center of Innovation on Disability and Rehabilitation Research (CINDRR)James A. Haley Veterans’ HospitalTampaUSA
  3. 3.Defense and Veterans Brain Injury CenterJames A. Haley Veterans’ HospitalTampaUSA

Personalised recommendations