Using Constraint Optimization for Conflict Resolution and Detail Control in Activity Recognition

  • Chrysi Filippaki
  • Grigoris Antoniou
  • Ioannis Tsamardinos
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7040)


In Ambient Assisted Living and other environments the problem is to recognize all of user activities. Due to noisy or incomplete information a naïve recognition system may report activities that are logically inconsistent with each other, e.g., the user is sleeping on the couch and at the same time is watching TV. In this work, we develop a rule-based recognition system for hierarchically-organized activities that returns only logically consistent scenarios. This is achieved by explicitly formulating conflicts as Weighted Partial MaxSAT clauses to be satisfied. The system also has the ability to adjust the desired level of detail of the scenarios returned. This is accomplished by assigning preferences to clauses of the SAT problem. The system is implemented and evaluated in a real Ambient Intelligence experimental space. It is shown to be robust to the presence of noise; the level of detail can easily be adjusted by the use of two preference parameters.


Conflict Resolution Rule-based Activity recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Artikis, A., Sergot, M., Paliouras, G.: A Logic Programming Approach to Activity Recognition. In: Proc. of ACM International Workshop on Events in Multimedia (2010)Google Scholar
  2. 2.
    Dousson, C., Maigat, P.L.: Chronicle recognition improvement using temporal focusing and hierarchisation. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 324–329 (2007)Google Scholar
  3. 3.
    Shet, V., Neumann, J., Ramesh, V., Davis, L.: Bilattice-based logical reasoning for human detection. In: Proc. of IEEE Computer Vision and Pattern Recognition, CVPR (2007)Google Scholar
  4. 4.
    Richardson, M., Domingos, P.: Markov logic networks. Machine Learning 62(1-2), 107–136 (2006)CrossRefGoogle Scholar
  5. 5.
    Tran, S.D., Davis, L.S.: Event Modeling and Recognition using Markov Logic Networks. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 610–623. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Biswas, R., Thrun, S., Fujimura, K.: Recognizing Activities with Multiple Cues. In: Elgammal, A., Rosenhahn, B., Klette, R. (eds.) Human Motion 2007. LNCS, vol. 4814, pp. 255–270. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Yamato, J., Ohya, J., Ishii, K.: Recognizing Human Action in Time-Sequential Images Using Hidden Markov Model. In: Proc. Computer Vision and Pattern Recognition, pp. 379–385 (1992)Google Scholar
  8. 8.
    Nguyen, N.T., Phung D.Q., Venkatesh, S., Bui, H.H.: Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, pp. 955–960 (2005)Google Scholar
  9. 9.
    Helaoui, R., Niepert, M., Stuckenschmidt, H.: Recognizing Interleaved and Concurrent Activities: A Statistical-Relational Approach. In: Proceedings of the 9th Annual IEEE International Conference on Pervasive Computing and Communications (2011)Google Scholar
  10. 10.
    Le Berre, D., Parrain, A.: The Sat4j library, release 2.2. Journal on Satisfiability, Boolean Modeling and Computation (JSAT) 7, 59–64 (2010)Google Scholar
  11. 11.
    Friedman-Hill, E.: Jess in Action: Rule-Based Systems in Java. Manning Publications Co. (2003)Google Scholar
  12. 12.
    Liao, H.H., Chang, J.Y., Chen, L.G.: A localized Approach to abandoned luggage detection with Foreground –Mask sampling. In: Proceedings of 5th IEEE International Conference on Advanced Video and Signal based Surveillance, Santa Fe, pp. 132–139 (2008)Google Scholar
  13. 13.
    Grammenos, D., Zabulis, X., Argyros, A.A., Stephanidis C.: FORTH-ICS internal RTD Programme ’Ambient Intelligence and Smart Environments’. In 3rd European Conference on Ambient Intelligence, Salzburg (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Chrysi Filippaki
    • 1
    • 2
  • Grigoris Antoniou
    • 1
    • 2
  • Ioannis Tsamardinos
    • 1
    • 2
  1. 1.Computer Science DepartmentUniversity of CreteGreece
  2. 2.Institute of Computer Science, Forth-ICSHeraklionGreece

Personalised recommendations