An Ontology-Based Approach to Activity Recognition

  • Liming ChenEmail author
  • Chris D. Nugent


This chapter introduces an ontology-based knowledge-driven approach to real-time, continuous activity recognition based on multi-sensor data streams in the context of assisted living within smart homes. It first presents a generic system architecture for the proposed knowledge-driven approach and its underlying ontology-based activity recognition process. It then analyses the characteristics of smart homes and Activities of Daily Living (ADL) upon which both context and ADL ontologies are developed. Following this, the chapter describes algorithms for activity recognition based on semantic subsumption reasoning. Finally, an example case study is conducted using an implemented function-rich software system, which evaluates and demonstrates the proposed approach through extensive experiments involving a number of various ADL use scenarios.


  1. 1.
    Chen D, Yang J, Wactlar HD (2004) Towards automatic analysis of social interaction patterns in a nursing home environment from video. In: Proceedings of the 6th ACM SIGMM international workshop on multimedia information retrieval - MIR ’04Google Scholar
  2. 2.
    Hakeem A, Shah M (2004) Ontology and taxonomy collaborated framework for meeting classification. In: Proceedings - international conference on pattern recognitionGoogle Scholar
  3. 3.
    Georis B (2004) A video interpretation platform applied to bank agency monitoring. In: Intelligent distributed surveillance systems (IDSS-04)Google Scholar
  4. 4.
    Nevatia R, Hobbs J, Bolles B (2004) An ontology for video event representation. In: IEEE computer society conference on computer vision and pattern recognition workshopsGoogle Scholar
  5. 5.
    François ARJ, Nevatia R, Hobbs J, Bolles RC (2005) VERL: an ontology framework for representing and annotating video events. IEEE Multimed 12:76–86CrossRefGoogle Scholar
  6. 6.
    Akdemir U, Turaga P, Chellappa R (2008) An ontology based approach for activity recognition from video. In: Proceeding of the 16th ACM international conference on multimedia - MM ’08Google Scholar
  7. 7.
    Tapia EM, Choudhury T, Philipose M (2006) Building reliable activity models using hierarchical shrinkage and mined ontology. In: Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics)Google Scholar
  8. 8.
    Yamada N, Sakamoto K, Kunito G, Isoda Y, Yamazaki K, Tanaka S (2007) Applying ontology and probabilistic model to human activity recognition from surrounding things. IPSJ Digit CourGoogle Scholar
  9. 9.
    Latfi F, Lefebvre B, Descheneaux C (2007) Ontology-based management of the telehealth smart home, dedicated to elderly in loss of cognitive autonomy. In: CEUR workshop proceedingsGoogle Scholar
  10. 10.
    Klein M, Schmidt A, Lauer R (2007) Ontology-centred design of an ambient middleware for assisted living: the case of SOPRANO. ContextGoogle Scholar
  11. 11.
    Chen L, Nugent C, Mulvenna M, Finlay D, Hong X (2009) Semantic smart homes: towards knowledge rich assisted living environments. Stud Comput IntellGoogle Scholar
  12. 12.
    James AB (2014) Activities of daily living and instrumental activities of daily living. In: Willard and spackman’s occupational therapy, 12th edn. Wolters Kluwer Health/Lippincott Williams & Wilkins, PhiladelphiaGoogle Scholar
  13. 13.
    Chan M, Estève D, Escriba C, Campo E (2008) A review of smart homes—present state and future challenges. Comput Methods Programs Biomed 91:55–81CrossRefGoogle Scholar
  14. 14.
    Cook DJ, Hagras H, Callaghan V, Helal A (2009) Making our environments intelligent. Pervasive Mob Comput 5(5):556–557CrossRefGoogle Scholar
  15. 15.
    Helal S, Mann W, El-Zabadani H, King J, Kaddoura Y, Jansen E (2005) The gator tech smart house: a programmable pervasive space. Computer (Long Beach, California) 38:50–60CrossRefGoogle Scholar
  16. 16.
    Espinilla M, Martinez L, Medina J, Nugent C (2018) The experience of developing the UJAmI Smart Lab. IEEE AccessGoogle Scholar
  17. 17.
    Dundalk Institute of Technology: Home | NetwellCASALA.
  18. 18.
    Cook DJ, Das SK (2007) How smart are our environments? An updated look at the state of the art. Pervasive Mob Comput 3(2):53–73CrossRefGoogle Scholar
  19. 19.
    Chen L, Nugent C, Mulvenna M, Finlay D, Hong X, Poland M (2008) A logical framework for behaviour reasoning and assistance in a smart home. Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics)Google Scholar
  20. 20.
    Philipose M, Fishkin KP, Perkowitz M, Patterson DJ, Fox D, Kautz H, Hähnel D (2004) Inferring activities from interactions with objects. IEEE Pervasive Comput 4(2004):50–57CrossRefGoogle Scholar
  21. 21.
    Sánchez D, Tentori M, Favela J (2008) Activity recognition for the smart hospital. IEEE Intell Syst 23(2):50–57CrossRefGoogle Scholar
  22. 22.
    Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Ferscha A, Mattern F (eds) Pervasive computing. Springer, Berlin, pp 1–17Google Scholar
  23. 23.
    Brdiczka O, Crowley JL, Reignier P (2009) Learning situation models in a smart home. IEEE Trans Syst Man Cybern Part B CybernGoogle Scholar
  24. 24.
    Hoey J, Poupart P (2005) Solving POMDPs with continuous or large discrete observation spaces. In: IJCAI international joint conference on artificial intelligenceGoogle Scholar
  25. 25.
    Stanford University: Protégé.
  26. 26.
    Tsarkov D, Horrocks I (2006) FaCT++ description logic reasoner: system description. In: Furbach U, Shankar N (eds) Automated reasoning. Springer, Berlin, pp 292–297CrossRefGoogle Scholar
  27. 27.
    Horrocks I, Sattler U (2005) A tableaux decision procedure for SHOIQ. In: IJCAI international joint conference on artificial intelligenceGoogle Scholar
  28. 28.
    Krotzsch M, Simancik F, Horrocks I (2014) Description logics. IEEE Intell SystGoogle Scholar
  29. 29.
    Motik B, Shearer R, Horrocks I (2009) Hypertableau reasoning for description logics. J Artif Intell ResGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.School of Computer Science and InformaticsDe Montfort UniversityLeicesterUK
  2. 2.School of ComputingUlster UniversityBelfastUK

Personalised recommendations